Nov 15 08:05:30 user nova-compute[95467]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=95467) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=95467) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=95467) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 15 08:05:30 user nova-compute[95467]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:05:30 user nova-compute[95467]: INFO nova.virt.driver [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 15 08:05:30 user nova-compute[95467]: INFO nova.compute.provider_config [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] Acquiring lock "singleton_lock" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] Acquired lock "singleton_lock" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] Releasing lock "singleton_lock" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] Full set of CONF: {{(pid=95467) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] ******************************************************************************** {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] Configuration options gathered from: {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] ================================================================================ {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] allow_resize_to_same_host      = True {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] arq_binding_timeout            = 300 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] backdoor_port                  = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] backdoor_socket                = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] block_device_allocate_retries  = 300 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] block_device_allocate_retries_interval = 5 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] cert                           = self.pem {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] compute_monitors               = [] {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] config_dir                     = [] {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] config_drive_format            = iso9660 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] config_source                  = [] {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] console_host                   = user {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] control_exchange               = nova {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] cpu_allocation_ratio           = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] daemon                         = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] debug                          = True {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] default_access_ip_network_name = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] default_availability_zone      = nova {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] default_ephemeral_format       = ext4 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] default_green_pool_size        = 1000 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] default_schedule_zone          = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] disk_allocation_ratio          = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] enable_new_services            = True {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] enabled_apis                   = ['osapi_compute'] {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] enabled_ssl_apis               = [] {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] flat_injected                  = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] force_config_drive             = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] force_raw_images               = True {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] graceful_shutdown_timeout      = 5 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] heal_instance_info_cache_interval = 60 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] host                           = user {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] instance_build_timeout         = 0 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] instance_delete_interval       = 300 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] instance_format                = [instance: %(uuid)s]  {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] instance_name_template         = instance-%08x {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] instance_usage_audit           = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] instance_usage_audit_period    = month {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] internal_service_availability_zone = internal {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] key                            = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] live_migration_retry_count     = 30 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] log_config_append              = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] log_dir                        = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] log_file                       = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] log_options                    = True {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] log_rotate_interval            = 1 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] log_rotate_interval_type       = days {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] log_rotation_type              = none {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] long_rpc_timeout               = 1800 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] max_concurrent_builds          = 10 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] max_concurrent_live_migrations = 1 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] max_concurrent_snapshots       = 5 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] max_local_block_devices        = 3 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] max_logfile_count              = 30 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] max_logfile_size_mb            = 200 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] maximum_instance_delete_attempts = 5 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] metadata_listen                = 0.0.0.0 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] metadata_listen_port           = 8775 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] metadata_workers               = 3 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] migrate_max_retries            = -1 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] mkisofs_cmd                    = genisoimage {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] my_ip                          = 10.0.0.210 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] network_allocate_retries       = 0 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] osapi_compute_listen_port      = 8774 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] osapi_compute_unique_server_name_scope =  {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] osapi_compute_workers          = 3 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] password_length                = 12 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] periodic_enable                = True {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] periodic_fuzzy_delay           = 60 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] pointer_model                  = ps2mouse {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] preallocate_images             = none {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] publish_errors                 = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] pybasedir                      = /opt/stack/nova {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] ram_allocation_ratio           = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] rate_limit_burst               = 0 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] rate_limit_except_level        = CRITICAL {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] rate_limit_interval            = 0 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] reboot_timeout                 = 0 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] reclaim_instance_interval      = 0 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] record                         = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] reimage_timeout_per_gb         = 60 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] report_interval                = 120 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] rescue_timeout                 = 0 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] reserved_host_cpus             = 0 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] reserved_host_disk_mb          = 0 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] reserved_host_memory_mb        = 512 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] reserved_huge_pages            = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] resize_confirm_window          = 0 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] resize_fs_using_block_device   = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] resume_guests_state_on_host_boot = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] rpc_response_timeout           = 60 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] run_external_periodic_tasks    = True {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] running_deleted_instance_action = reap {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] running_deleted_instance_poll_interval = 1800 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] running_deleted_instance_timeout = 0 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] scheduler_instance_sync_interval = 120 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] service_down_time              = 720 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] servicegroup_driver            = db {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] shelved_offload_time           = 0 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] shelved_poll_interval          = 3600 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] shutdown_timeout               = 0 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] source_is_ipv6                 = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] ssl_only                       = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] state_path                     = /opt/stack/data/nova {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] sync_power_state_interval      = 600 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] sync_power_state_pool_size     = 1000 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] syslog_log_facility            = LOG_USER {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] tempdir                        = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] timeout_nbd                    = 10 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] transport_url                  = **** {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] update_resources_interval      = 0 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] use_cow_images                 = True {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] use_eventlog                   = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] use_journal                    = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] use_json                       = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] use_rootwrap_daemon            = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] use_stderr                     = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] use_syslog                     = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vcpu_pin_set                   = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vif_plugging_is_fatal          = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vif_plugging_timeout           = 0 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] virt_mkfs                      = [] {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] volume_usage_poll_interval     = 0 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] watch_log_file                 = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] web                            = /usr/share/spice-html5 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_concurrency.disable_process_locking = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] api.auth_strategy              = keystone {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] api.compute_link_prefix        = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] api.dhcp_domain                = novalocal {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] api.enable_instance_password   = True {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] api.glance_link_prefix         = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] api.instance_list_per_project_cells = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] api.list_records_by_skipping_down_cells = True {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] api.local_metadata_per_cell    = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] api.max_limit                  = 1000 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] api.metadata_cache_expiration  = 15 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] api.neutron_default_tenant_id  = default {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] api.use_forwarded_for          = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] api.use_neutron_default_nets   = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] api.vendordata_dynamic_targets = [] {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] api.vendordata_jsonfile_path   = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] cache.backend                  = dogpile.cache.memcached {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] cache.backend_argument         = **** {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] cache.config_prefix            = cache.oslo {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] cache.dead_timeout             = 60.0 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] cache.debug_cache_backend      = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] cache.enable_retry_client      = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] cache.enable_socket_keepalive  = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] cache.enabled                  = True {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] cache.expiration_time          = 600 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] cache.hashclient_retry_attempts = 2 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] cache.memcache_dead_retry      = 300 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] cache.memcache_password        =  {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] cache.memcache_pool_maxsize    = 10 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] cache.memcache_sasl_enabled    = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] cache.memcache_username        =  {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] cache.proxies                  = [] {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] cache.retry_attempts           = 2 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] cache.retry_delay              = 0.0 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] cache.socket_keepalive_count   = 1 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] cache.socket_keepalive_idle    = 1 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] cache.socket_keepalive_interval = 1 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] cache.tls_allowed_ciphers      = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] cache.tls_cafile               = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] cache.tls_certfile             = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] cache.tls_enabled              = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] cache.tls_keyfile              = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] cinder.auth_section            = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] cinder.auth_type               = password {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] cinder.cafile                  = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] cinder.certfile                = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] cinder.collect_timing          = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] cinder.cross_az_attach         = True {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] cinder.debug                   = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] cinder.endpoint_template       = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] cinder.http_retries            = 3 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] cinder.insecure                = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] cinder.keyfile                 = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] cinder.os_region_name          = RegionOne {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] cinder.split_loggers           = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] cinder.timeout                 = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] compute.cpu_dedicated_set      = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] compute.cpu_shared_set         = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] compute.image_type_exclude_list = [] {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] compute.max_concurrent_disk_ops = 0 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] compute.max_disk_devices_to_attach = -1 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] compute.resource_provider_association_refresh = 300 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] compute.shutdown_retry_interval = 10 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] conductor.workers              = 3 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] console.allowed_origins        = [] {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] console.ssl_ciphers            = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] console.ssl_minimum_version    = default {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] consoleauth.token_ttl          = 600 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] cyborg.cafile                  = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] cyborg.certfile                = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:30 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] cyborg.collect_timing          = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] cyborg.connect_retries         = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] cyborg.connect_retry_delay     = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] cyborg.endpoint_override       = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] cyborg.insecure                = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] cyborg.keyfile                 = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] cyborg.max_version             = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] cyborg.min_version             = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] cyborg.region_name             = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] cyborg.service_name            = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] cyborg.service_type            = accelerator {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] cyborg.split_loggers           = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] cyborg.status_code_retries     = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] cyborg.status_code_retry_delay = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] cyborg.timeout                 = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] cyborg.version                 = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] database.backend               = sqlalchemy {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] database.connection            = **** {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] database.connection_debug      = 0 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] database.connection_parameters =  {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] database.connection_recycle_time = 3600 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] database.connection_trace      = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] database.db_inc_retry_interval = True {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] database.db_max_retries        = 20 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] database.db_max_retry_interval = 10 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] database.db_retry_interval     = 1 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] database.max_overflow          = 50 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] database.max_pool_size         = 5 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] database.max_retries           = 10 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] database.mysql_wsrep_sync_wait = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] database.pool_timeout          = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] database.retry_interval        = 10 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] database.slave_connection      = **** {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] database.sqlite_synchronous    = True {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] api_database.backend           = sqlalchemy {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] api_database.connection        = **** {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] api_database.connection_debug  = 0 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] api_database.connection_parameters =  {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] api_database.connection_recycle_time = 3600 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] api_database.connection_trace  = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] api_database.db_inc_retry_interval = True {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] api_database.db_max_retries    = 20 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] api_database.db_max_retry_interval = 10 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] api_database.db_retry_interval = 1 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] api_database.max_overflow      = 50 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] api_database.max_pool_size     = 5 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] api_database.max_retries       = 10 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] api_database.pool_timeout      = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] api_database.retry_interval    = 10 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] api_database.slave_connection  = **** {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] api_database.sqlite_synchronous = True {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] devices.enabled_mdev_types     = [] {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] ephemeral_storage_encryption.enabled = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] glance.api_servers             = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] glance.cafile                  = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] glance.certfile                = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] glance.collect_timing          = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] glance.connect_retries         = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] glance.connect_retry_delay     = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] glance.debug                   = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] glance.default_trusted_certificate_ids = [] {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] glance.enable_certificate_validation = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] glance.enable_rbd_download     = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] glance.endpoint_override       = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] glance.insecure                = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] glance.keyfile                 = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] glance.max_version             = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] glance.min_version             = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] glance.num_retries             = 3 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] glance.rbd_ceph_conf           =  {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] glance.rbd_connect_timeout     = 5 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] glance.rbd_pool                =  {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] glance.rbd_user                =  {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] glance.region_name             = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] glance.service_name            = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] glance.service_type            = image {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] glance.split_loggers           = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] glance.status_code_retries     = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] glance.status_code_retry_delay = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] glance.timeout                 = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] glance.verify_glance_signatures = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] glance.version                 = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] guestfs.debug                  = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] hyperv.config_drive_cdrom      = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] hyperv.config_drive_inject_password = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] hyperv.enable_instance_metrics_collection = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] hyperv.enable_remotefx         = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] hyperv.instances_path_share    =  {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] hyperv.iscsi_initiator_list    = [] {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] hyperv.limit_cpu_features      = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] hyperv.power_state_check_timeframe = 60 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] hyperv.use_multipath_io        = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] hyperv.volume_attach_retry_count = 10 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] hyperv.vswitch_name            = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] mks.enabled                    = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] image_cache.manager_interval   = 2400 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] image_cache.precache_concurrency = 1 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] image_cache.remove_unused_base_images = True {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] image_cache.subdirectory_name  = _base {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] ironic.api_max_retries         = 60 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] ironic.api_retry_interval      = 2 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] ironic.auth_section            = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] ironic.auth_type               = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] ironic.cafile                  = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] ironic.certfile                = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] ironic.collect_timing          = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] ironic.conductor_group         = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] ironic.connect_retries         = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] ironic.connect_retry_delay     = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] ironic.endpoint_override       = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] ironic.insecure                = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] ironic.keyfile                 = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] ironic.max_version             = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] ironic.min_version             = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] ironic.peer_list               = [] {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] ironic.region_name             = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] ironic.serial_console_state_timeout = 10 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] ironic.service_name            = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] ironic.service_type            = baremetal {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] ironic.split_loggers           = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] ironic.status_code_retries     = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] ironic.status_code_retry_delay = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] ironic.timeout                 = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] ironic.version                 = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] key_manager.fixed_key          = **** {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] barbican.barbican_api_version  = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] barbican.barbican_endpoint     = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] barbican.barbican_endpoint_type = public {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] barbican.barbican_region_name  = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] barbican.cafile                = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] barbican.certfile              = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] barbican.collect_timing        = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] barbican.insecure              = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] barbican.keyfile               = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] barbican.number_of_retries     = 60 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] barbican.retry_delay           = 1 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] barbican.send_service_user_token = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] barbican.split_loggers         = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] barbican.timeout               = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] barbican.verify_ssl            = True {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] barbican.verify_ssl_path       = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] barbican_service_user.auth_section = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] barbican_service_user.auth_type = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] barbican_service_user.cafile   = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] barbican_service_user.certfile = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] barbican_service_user.collect_timing = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] barbican_service_user.insecure = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] barbican_service_user.keyfile  = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] barbican_service_user.split_loggers = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] barbican_service_user.timeout  = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vault.approle_role_id          = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vault.approle_secret_id        = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vault.cafile                   = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vault.certfile                 = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vault.collect_timing           = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vault.insecure                 = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vault.keyfile                  = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vault.kv_mountpoint            = secret {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vault.kv_path                  = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vault.kv_version               = 2 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vault.namespace                = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vault.root_token_id            = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vault.split_loggers            = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vault.ssl_ca_crt_file          = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vault.timeout                  = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vault.use_ssl                  = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] keystone.auth_section          = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] keystone.auth_type             = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] keystone.cafile                = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] keystone.certfile              = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] keystone.collect_timing        = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] keystone.connect_retries       = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] keystone.connect_retry_delay   = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] keystone.endpoint_override     = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] keystone.insecure              = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] keystone.keyfile               = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] keystone.max_version           = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] keystone.min_version           = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] keystone.region_name           = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] keystone.service_name          = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] keystone.service_type          = identity {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] keystone.split_loggers         = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] keystone.status_code_retries   = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] keystone.status_code_retry_delay = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] keystone.timeout               = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] keystone.version               = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.connection_uri         =  {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.cpu_mode               = custom {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: WARNING oslo_config.cfg [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.cpu_power_governor_high = performance {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.cpu_power_governor_low = powersave {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.cpu_power_management   = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.device_detach_attempts = 8 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.device_detach_timeout  = 20 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.disk_cachemodes        = [] {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.disk_prefix            = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.enabled_perf_events    = [] {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.file_backed_memory     = 0 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.gid_maps               = [] {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.hw_disk_discard        = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.hw_machine_type        = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.images_rbd_glance_store_name =  {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.images_rbd_pool        = rbd {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.images_type            = default {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.images_volume_group    = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.inject_key             = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.inject_partition       = -2 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.inject_password        = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.iscsi_iface            = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.iser_use_multipath     = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.live_migration_bandwidth = 0 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.live_migration_downtime = 500 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.live_migration_inbound_addr = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.live_migration_permit_post_copy = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.live_migration_scheme  = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.live_migration_timeout_action = abort {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.live_migration_tunnelled = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: WARNING oslo_config.cfg [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 15 08:05:31 user nova-compute[95467]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 15 08:05:31 user nova-compute[95467]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 15 08:05:31 user nova-compute[95467]: and ``live_migration_inbound_addr`` respectively.
Nov 15 08:05:31 user nova-compute[95467]: ).  Its value may be silently ignored in the future.
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.live_migration_with_native_tls = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.max_queues             = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.nfs_mount_options      = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.num_memory_encrypted_guests = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.num_pcie_ports         = 0 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.pmem_namespaces        = [] {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.quobyte_client_cfg     = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.rbd_secret_uuid        = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.rbd_user               = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.remote_filesystem_transport = ssh {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.rescue_image_id        = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.rescue_kernel_id       = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.rescue_ramdisk_id      = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.rx_queue_size          = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.smbfs_mount_options    =  {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.snapshot_compression   = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.snapshot_image_format  = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.sparse_logical_volumes = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.swtpm_enabled          = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.swtpm_group            = tss {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.swtpm_user             = tss {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.sysinfo_serial         = unique {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.tb_cache_size          = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.tx_queue_size          = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.uid_maps               = [] {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.use_virtio_for_bridges = True {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.virt_type              = kvm {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.volume_clear           = zero {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.volume_clear_size      = 0 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.volume_use_multipath   = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.vzstorage_cache_path   = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.vzstorage_mount_user   = stack {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] neutron.auth_section           = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] neutron.auth_type              = password {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] neutron.cafile                 = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] neutron.certfile               = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] neutron.collect_timing         = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] neutron.connect_retries        = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] neutron.connect_retry_delay    = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] neutron.default_floating_pool  = public {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] neutron.endpoint_override      = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] neutron.extension_sync_interval = 600 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] neutron.http_retries           = 3 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] neutron.insecure               = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] neutron.keyfile                = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] neutron.max_version            = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] neutron.min_version            = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] neutron.ovs_bridge             = br-int {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] neutron.physnets               = [] {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] neutron.region_name            = RegionOne {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] neutron.service_metadata_proxy = True {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] neutron.service_name           = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] neutron.service_type           = network {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] neutron.split_loggers          = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] neutron.status_code_retries    = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] neutron.status_code_retry_delay = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] neutron.timeout                = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] neutron.version                = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] notifications.bdms_in_notifications = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] notifications.default_level    = INFO {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] notifications.notification_format = unversioned {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] notifications.notify_on_state_change = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] pci.alias                      = [] {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] pci.device_spec                = [] {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] pci.report_in_placement        = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] placement.auth_section         = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] placement.auth_type            = password {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] placement.cafile               = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] placement.certfile             = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] placement.collect_timing       = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] placement.connect_retries      = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] placement.connect_retry_delay  = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] placement.default_domain_id    = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] placement.default_domain_name  = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] placement.domain_id            = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] placement.domain_name          = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] placement.endpoint_override    = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] placement.insecure             = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] placement.keyfile              = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] placement.max_version          = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] placement.min_version          = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] placement.password             = **** {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] placement.project_domain_id    = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] placement.project_domain_name  = Default {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] placement.project_id           = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] placement.project_name         = service {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] placement.region_name          = RegionOne {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] placement.service_name         = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] placement.service_type         = placement {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] placement.split_loggers        = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] placement.status_code_retries  = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] placement.status_code_retry_delay = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] placement.system_scope         = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] placement.timeout              = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] placement.trust_id             = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] placement.user_domain_id       = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] placement.user_domain_name     = Default {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] placement.user_id              = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] placement.username             = placement {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] placement.version              = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] quota.cores                    = 20 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] quota.count_usage_from_placement = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] quota.injected_file_content_bytes = 10240 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] quota.injected_file_path_length = 255 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] quota.injected_files           = 5 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] quota.instances                = 10 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] quota.key_pairs                = 100 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] quota.metadata_items           = 128 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] quota.ram                      = 51200 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] quota.recheck_quota            = True {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] quota.server_group_members     = 10 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] quota.server_groups            = 10 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] rdp.enabled                    = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] scheduler.image_metadata_prefilter = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] scheduler.max_attempts         = 3 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] scheduler.max_placement_results = 1000 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] scheduler.query_placement_for_image_type_support = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] scheduler.workers              = 3 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] filter_scheduler.host_subset_size = 1 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] filter_scheduler.isolated_hosts = [] {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] filter_scheduler.isolated_images = [] {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] filter_scheduler.pci_in_placement = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] filter_scheduler.track_instance_changes = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] metrics.required               = True {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] metrics.weight_multiplier      = 1.0 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] metrics.weight_setting         = [] {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] serial_console.enabled         = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] serial_console.port_range      = 10000:20000 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] serial_console.serialproxy_port = 6083 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] service_user.auth_section      = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] service_user.auth_type         = password {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] service_user.cafile            = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] service_user.certfile          = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] service_user.collect_timing    = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] service_user.insecure          = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] service_user.keyfile           = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] service_user.send_service_user_token = True {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] service_user.split_loggers     = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] service_user.timeout           = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] spice.agent_enabled            = True {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] spice.enabled                  = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] spice.html5proxy_port          = 6082 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] spice.image_compression        = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] spice.jpeg_compression         = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] spice.playback_compression     = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] spice.server_listen            = 127.0.0.1 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] spice.streaming_mode           = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] spice.zlib_compression         = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] upgrade_levels.baseapi         = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] upgrade_levels.cert            = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] upgrade_levels.compute         = auto {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] upgrade_levels.conductor       = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] upgrade_levels.scheduler       = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vendordata_dynamic_auth.auth_section = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vendordata_dynamic_auth.auth_type = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vendordata_dynamic_auth.cafile = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vendordata_dynamic_auth.certfile = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vendordata_dynamic_auth.insecure = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vendordata_dynamic_auth.keyfile = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vendordata_dynamic_auth.timeout = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vmware.api_retry_count         = 10 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vmware.ca_file                 = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vmware.cache_prefix            = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vmware.cluster_name            = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vmware.connection_pool_size    = 10 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vmware.console_delay_seconds   = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vmware.datastore_regex         = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vmware.host_ip                 = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vmware.host_password           = **** {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vmware.host_port               = 443 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vmware.host_username           = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vmware.insecure                = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vmware.integration_bridge      = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vmware.maximum_objects         = 100 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vmware.pbm_default_policy      = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vmware.pbm_enabled             = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vmware.pbm_wsdl_location       = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vmware.serial_port_proxy_uri   = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vmware.serial_port_service_uri = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vmware.task_poll_interval      = 0.5 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vmware.use_linked_clone        = True {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vmware.vnc_keymap              = en-us {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vmware.vnc_port                = 5900 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vmware.vnc_port_total          = 10000 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vnc.auth_schemes               = ['none'] {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vnc.enabled                    = True {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vnc.novncproxy_port            = 6080 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vnc.server_listen              = 0.0.0.0 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vnc.vencrypt_ca_certs          = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vnc.vencrypt_client_cert       = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vnc.vencrypt_client_key        = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] workarounds.disable_rootwrap   = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] workarounds.enable_numa_live_migration = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] workarounds.libvirt_disable_apic = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] wsgi.client_socket_timeout     = 900 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] wsgi.default_pool_size         = 1000 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] wsgi.keep_alive                = True {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] wsgi.max_header_line           = 16384 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] wsgi.ssl_ca_file               = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] wsgi.ssl_cert_file             = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] wsgi.ssl_key_file              = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] wsgi.tcp_keepidle              = 600 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] zvm.ca_file                    = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] zvm.cloud_connector_url        = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] zvm.reachable_timeout          = 300 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_policy.enforce_new_defaults = True {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_policy.enforce_scope      = True {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_policy.policy_default_rule = default {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_policy.policy_file        = policy.yaml {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] profiler.connection_string     = messaging:// {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] profiler.enabled               = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] profiler.es_doc_type           = notification {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] profiler.es_scroll_size        = 10000 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] profiler.es_scroll_time        = 2m {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] profiler.filter_error_trace    = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] profiler.hmac_keys             = **** {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] profiler.sentinel_service_name = mymaster {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] profiler.socket_timeout        = 0.1 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] profiler.trace_requests        = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] profiler.trace_sqlalchemy      = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] profiler_jaeger.process_tags   = {} {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] profiler_jaeger.service_name_prefix = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] profiler_otlp.service_name_prefix = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] remote_debug.host              = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] remote_debug.port              = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_messaging_rabbit.ssl      = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_messaging_notifications.retry = -1 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_messaging_notifications.transport_url = **** {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_limit.auth_section        = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_limit.auth_type           = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_limit.cafile              = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_limit.certfile            = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_limit.collect_timing      = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_limit.connect_retries     = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_limit.connect_retry_delay = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_limit.endpoint_id         = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_limit.endpoint_override   = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_limit.insecure            = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_limit.keyfile             = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_limit.max_version         = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_limit.min_version         = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_limit.region_name         = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_limit.service_name        = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_limit.service_type        = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_limit.split_loggers       = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_limit.status_code_retries = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_limit.status_code_retry_delay = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_limit.timeout             = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_limit.valid_interfaces    = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_limit.version             = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_reports.file_event_handler = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] oslo_reports.log_dir           = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vif_plug_ovs_privileged.group  = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] vif_plug_ovs_privileged.user   = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] os_vif_linux_bridge.flat_interface = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] os_vif_ovs.isolate_vif         = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] os_vif_ovs.per_port_bridge     = False {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] os_brick.lock_path             = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] privsep_osbrick.capabilities   = [21] {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] privsep_osbrick.group          = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] privsep_osbrick.helper_command = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] privsep_osbrick.user           = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] nova_sys_admin.group           = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] nova_sys_admin.helper_command  = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] nova_sys_admin.user            = None {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG oslo_service.service [None req-624b0b64-420d-4961-b420-2f2a0218cd63 None None] ******************************************************************************** {{(pid=95467) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 15 08:05:31 user nova-compute[95467]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 15 08:05:31 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Connecting to libvirt: qemu:///system {{(pid=95467) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7efeda107550> {{(pid=95467) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 15 08:05:31 user nova-compute[95467]: libvirt:  error : internal error: could not initialize domain event timer
Nov 15 08:05:31 user nova-compute[95467]: WARNING nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 15 08:05:31 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7efeda107550> {{(pid=95467) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Starting native event thread {{(pid=95467) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Starting green dispatch thread {{(pid=95467) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 15 08:05:31 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Starting connection event dispatch thread {{(pid=95467) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 15 08:05:31 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Connection event '1' reason 'None'
Nov 15 08:05:31 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 15 08:05:31 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.mount [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Initialising _HostMountState generation 0 {{(pid=95467) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 15 08:05:38 user nova-compute[95467]: INFO nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Libvirt host capabilities <capabilities>
Nov 15 08:05:38 user nova-compute[95467]:   <host>
Nov 15 08:05:38 user nova-compute[95467]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 15 08:05:38 user nova-compute[95467]:     <cpu>
Nov 15 08:05:38 user nova-compute[95467]:       <arch>x86_64</arch>
Nov 15 08:05:38 user nova-compute[95467]:       <model>IvyBridge-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <vendor>Intel</vendor>
Nov 15 08:05:38 user nova-compute[95467]:       <microcode version='1070'/>
Nov 15 08:05:38 user nova-compute[95467]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 15 08:05:38 user nova-compute[95467]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature name='ss'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature name='vmx'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature name='pcid'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature name='osxsave'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature name='hypervisor'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature name='arat'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature name='tsc_adjust'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature name='md-clear'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature name='stibp'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature name='arch-capabilities'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature name='ssbd'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature name='invtsc'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature name='rsba'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature name='skip-l1dfl-vmentry'/>
Nov 15 08:05:38 user nova-compute[95467]:       <pages unit='KiB' size='4'/>
Nov 15 08:05:38 user nova-compute[95467]:       <pages unit='KiB' size='2048'/>
Nov 15 08:05:38 user nova-compute[95467]:     </cpu>
Nov 15 08:05:38 user nova-compute[95467]:     <power_management>
Nov 15 08:05:38 user nova-compute[95467]:       <suspend_mem/>
Nov 15 08:05:38 user nova-compute[95467]:       <suspend_disk/>
Nov 15 08:05:38 user nova-compute[95467]:       <suspend_hybrid/>
Nov 15 08:05:38 user nova-compute[95467]:     </power_management>
Nov 15 08:05:38 user nova-compute[95467]:     <iommu support='no'/>
Nov 15 08:05:38 user nova-compute[95467]:     <migration_features>
Nov 15 08:05:38 user nova-compute[95467]:       <live/>
Nov 15 08:05:38 user nova-compute[95467]:       <uri_transports>
Nov 15 08:05:38 user nova-compute[95467]:         <uri_transport>tcp</uri_transport>
Nov 15 08:05:38 user nova-compute[95467]:         <uri_transport>rdma</uri_transport>
Nov 15 08:05:38 user nova-compute[95467]:       </uri_transports>
Nov 15 08:05:38 user nova-compute[95467]:     </migration_features>
Nov 15 08:05:38 user nova-compute[95467]:     <topology>
Nov 15 08:05:38 user nova-compute[95467]:       <cells num='2'>
Nov 15 08:05:38 user nova-compute[95467]:         <cell id='0'>
Nov 15 08:05:38 user nova-compute[95467]:           <memory unit='KiB'>8189224</memory>
Nov 15 08:05:38 user nova-compute[95467]:           <pages unit='KiB' size='4'>2047306</pages>
Nov 15 08:05:38 user nova-compute[95467]:           <pages unit='KiB' size='2048'>0</pages>
Nov 15 08:05:38 user nova-compute[95467]:           <distances>
Nov 15 08:05:38 user nova-compute[95467]:             <sibling id='0' value='10'/>
Nov 15 08:05:38 user nova-compute[95467]:             <sibling id='1' value='20'/>
Nov 15 08:05:38 user nova-compute[95467]:           </distances>
Nov 15 08:05:38 user nova-compute[95467]:           <cpus num='6'>
Nov 15 08:05:38 user nova-compute[95467]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 15 08:05:38 user nova-compute[95467]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 15 08:05:38 user nova-compute[95467]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 15 08:05:38 user nova-compute[95467]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 15 08:05:38 user nova-compute[95467]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 15 08:05:38 user nova-compute[95467]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 15 08:05:38 user nova-compute[95467]:           </cpus>
Nov 15 08:05:38 user nova-compute[95467]:         </cell>
Nov 15 08:05:38 user nova-compute[95467]:         <cell id='1'>
Nov 15 08:05:38 user nova-compute[95467]:           <memory unit='KiB'>8206460</memory>
Nov 15 08:05:38 user nova-compute[95467]:           <pages unit='KiB' size='4'>2051615</pages>
Nov 15 08:05:38 user nova-compute[95467]:           <pages unit='KiB' size='2048'>0</pages>
Nov 15 08:05:38 user nova-compute[95467]:           <distances>
Nov 15 08:05:38 user nova-compute[95467]:             <sibling id='0' value='20'/>
Nov 15 08:05:38 user nova-compute[95467]:             <sibling id='1' value='10'/>
Nov 15 08:05:38 user nova-compute[95467]:           </distances>
Nov 15 08:05:38 user nova-compute[95467]:           <cpus num='6'>
Nov 15 08:05:38 user nova-compute[95467]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 15 08:05:38 user nova-compute[95467]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 15 08:05:38 user nova-compute[95467]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 15 08:05:38 user nova-compute[95467]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 15 08:05:38 user nova-compute[95467]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 15 08:05:38 user nova-compute[95467]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 15 08:05:38 user nova-compute[95467]:           </cpus>
Nov 15 08:05:38 user nova-compute[95467]:         </cell>
Nov 15 08:05:38 user nova-compute[95467]:       </cells>
Nov 15 08:05:38 user nova-compute[95467]:     </topology>
Nov 15 08:05:38 user nova-compute[95467]:     <cache>
Nov 15 08:05:38 user nova-compute[95467]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 15 08:05:38 user nova-compute[95467]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 15 08:05:38 user nova-compute[95467]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 15 08:05:38 user nova-compute[95467]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 15 08:05:38 user nova-compute[95467]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 15 08:05:38 user nova-compute[95467]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 15 08:05:38 user nova-compute[95467]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 15 08:05:38 user nova-compute[95467]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 15 08:05:38 user nova-compute[95467]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 15 08:05:38 user nova-compute[95467]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 15 08:05:38 user nova-compute[95467]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 15 08:05:38 user nova-compute[95467]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 15 08:05:38 user nova-compute[95467]:     </cache>
Nov 15 08:05:38 user nova-compute[95467]:     <secmodel>
Nov 15 08:05:38 user nova-compute[95467]:       <model>apparmor</model>
Nov 15 08:05:38 user nova-compute[95467]:       <doi>0</doi>
Nov 15 08:05:38 user nova-compute[95467]:     </secmodel>
Nov 15 08:05:38 user nova-compute[95467]:     <secmodel>
Nov 15 08:05:38 user nova-compute[95467]:       <model>dac</model>
Nov 15 08:05:38 user nova-compute[95467]:       <doi>0</doi>
Nov 15 08:05:38 user nova-compute[95467]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 15 08:05:38 user nova-compute[95467]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 15 08:05:38 user nova-compute[95467]:     </secmodel>
Nov 15 08:05:38 user nova-compute[95467]:   </host>
Nov 15 08:05:38 user nova-compute[95467]:   <guest>
Nov 15 08:05:38 user nova-compute[95467]:     <os_type>hvm</os_type>
Nov 15 08:05:38 user nova-compute[95467]:     <arch name='alpha'>
Nov 15 08:05:38 user nova-compute[95467]:       <wordsize>64</wordsize>
Nov 15 08:05:38 user nova-compute[95467]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='4'>clipper</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <domain type='qemu'/>
Nov 15 08:05:38 user nova-compute[95467]:     </arch>
Nov 15 08:05:38 user nova-compute[95467]:     <features>
Nov 15 08:05:38 user nova-compute[95467]:       <cpuselection/>
Nov 15 08:05:38 user nova-compute[95467]:       <deviceboot/>
Nov 15 08:05:38 user nova-compute[95467]:       <disksnapshot default='on' toggle='no'/>
Nov 15 08:05:38 user nova-compute[95467]:     </features>
Nov 15 08:05:38 user nova-compute[95467]:   </guest>
Nov 15 08:05:38 user nova-compute[95467]:   <guest>
Nov 15 08:05:38 user nova-compute[95467]:     <os_type>hvm</os_type>
Nov 15 08:05:38 user nova-compute[95467]:     <arch name='armv6l'>
Nov 15 08:05:38 user nova-compute[95467]:       <wordsize>32</wordsize>
Nov 15 08:05:38 user nova-compute[95467]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>integratorcp</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>borzoi</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>spitz</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2'>nuri</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2'>musca-b1</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>versatileab</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>kzm</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2'>musca-a</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2'>smdkc210</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>sx1</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>z2</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>tosa</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='4'>sabrelite</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>realview-eb</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>n810</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>n800</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>versatilepb</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>terrier</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>mainstone</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='4'>midway</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>musicpal</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>microbit</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>cubieboard</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>verdex</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>netduino2</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='4'>raspi2b</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>cheetah</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='4'>highbank</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>akita</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>connex</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>collie</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>raspi0</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <domain type='qemu'/>
Nov 15 08:05:38 user nova-compute[95467]:     </arch>
Nov 15 08:05:38 user nova-compute[95467]:     <features>
Nov 15 08:05:38 user nova-compute[95467]:       <cpuselection/>
Nov 15 08:05:38 user nova-compute[95467]:       <deviceboot/>
Nov 15 08:05:38 user nova-compute[95467]:       <disksnapshot default='on' toggle='no'/>
Nov 15 08:05:38 user nova-compute[95467]:     </features>
Nov 15 08:05:38 user nova-compute[95467]:   </guest>
Nov 15 08:05:38 user nova-compute[95467]:   <guest>
Nov 15 08:05:38 user nova-compute[95467]:     <os_type>hvm</os_type>
Nov 15 08:05:38 user nova-compute[95467]:     <arch name='armv7l'>
Nov 15 08:05:38 user nova-compute[95467]:       <wordsize>32</wordsize>
Nov 15 08:05:38 user nova-compute[95467]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>integratorcp</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>borzoi</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>spitz</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2'>nuri</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2'>musca-b1</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>versatileab</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>kzm</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2'>musca-a</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2'>smdkc210</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>sx1</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>z2</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>tosa</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='4'>sabrelite</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>realview-eb</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>n810</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>n800</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>versatilepb</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>terrier</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>mainstone</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='4'>midway</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>musicpal</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>microbit</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>cubieboard</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>verdex</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>netduino2</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='4'>raspi2b</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>cheetah</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='4'>highbank</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>akita</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>connex</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>collie</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>raspi0</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <domain type='qemu'/>
Nov 15 08:05:38 user nova-compute[95467]:     </arch>
Nov 15 08:05:38 user nova-compute[95467]:     <features>
Nov 15 08:05:38 user nova-compute[95467]:       <cpuselection/>
Nov 15 08:05:38 user nova-compute[95467]:       <deviceboot/>
Nov 15 08:05:38 user nova-compute[95467]:       <disksnapshot default='on' toggle='no'/>
Nov 15 08:05:38 user nova-compute[95467]:     </features>
Nov 15 08:05:38 user nova-compute[95467]:   </guest>
Nov 15 08:05:38 user nova-compute[95467]:   <guest>
Nov 15 08:05:38 user nova-compute[95467]:     <os_type>hvm</os_type>
Nov 15 08:05:38 user nova-compute[95467]:     <arch name='aarch64'>
Nov 15 08:05:38 user nova-compute[95467]:       <wordsize>64</wordsize>
Nov 15 08:05:38 user nova-compute[95467]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>integratorcp</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>borzoi</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>spitz</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2'>nuri</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2'>musca-b1</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>versatileab</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>kzm</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2'>musca-a</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2'>smdkc210</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>sx1</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>z2</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>tosa</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='4'>sabrelite</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>realview-eb</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>n810</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>n800</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>versatilepb</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>terrier</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>mainstone</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='4'>midway</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>musicpal</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>microbit</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>cubieboard</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>verdex</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>netduino2</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='4'>raspi3b</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='4'>raspi2b</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>cheetah</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='4'>highbank</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>akita</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>connex</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>collie</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>raspi0</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <domain type='qemu'/>
Nov 15 08:05:38 user nova-compute[95467]:     </arch>
Nov 15 08:05:38 user nova-compute[95467]:     <features>
Nov 15 08:05:38 user nova-compute[95467]:       <acpi default='on' toggle='yes'/>
Nov 15 08:05:38 user nova-compute[95467]:       <cpuselection/>
Nov 15 08:05:38 user nova-compute[95467]:       <deviceboot/>
Nov 15 08:05:38 user nova-compute[95467]:       <disksnapshot default='on' toggle='no'/>
Nov 15 08:05:38 user nova-compute[95467]:     </features>
Nov 15 08:05:38 user nova-compute[95467]:   </guest>
Nov 15 08:05:38 user nova-compute[95467]:   <guest>
Nov 15 08:05:38 user nova-compute[95467]:     <os_type>hvm</os_type>
Nov 15 08:05:38 user nova-compute[95467]:     <arch name='cris'>
Nov 15 08:05:38 user nova-compute[95467]:       <wordsize>32</wordsize>
Nov 15 08:05:38 user nova-compute[95467]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <domain type='qemu'/>
Nov 15 08:05:38 user nova-compute[95467]:     </arch>
Nov 15 08:05:38 user nova-compute[95467]:     <features>
Nov 15 08:05:38 user nova-compute[95467]:       <cpuselection/>
Nov 15 08:05:38 user nova-compute[95467]:       <deviceboot/>
Nov 15 08:05:38 user nova-compute[95467]:       <disksnapshot default='on' toggle='no'/>
Nov 15 08:05:38 user nova-compute[95467]:     </features>
Nov 15 08:05:38 user nova-compute[95467]:   </guest>
Nov 15 08:05:38 user nova-compute[95467]:   <guest>
Nov 15 08:05:38 user nova-compute[95467]:     <os_type>hvm</os_type>
Nov 15 08:05:38 user nova-compute[95467]:     <arch name='i686'>
Nov 15 08:05:38 user nova-compute[95467]:       <wordsize>32</wordsize>
Nov 15 08:05:38 user nova-compute[95467]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>x-remote</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>isapc</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>microvm</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <domain type='qemu'/>
Nov 15 08:05:38 user nova-compute[95467]:       <domain type='kvm'/>
Nov 15 08:05:38 user nova-compute[95467]:     </arch>
Nov 15 08:05:38 user nova-compute[95467]:     <features>
Nov 15 08:05:38 user nova-compute[95467]:       <pae/>
Nov 15 08:05:38 user nova-compute[95467]:       <nonpae/>
Nov 15 08:05:38 user nova-compute[95467]:       <acpi default='on' toggle='yes'/>
Nov 15 08:05:38 user nova-compute[95467]:       <apic default='on' toggle='no'/>
Nov 15 08:05:38 user nova-compute[95467]:       <cpuselection/>
Nov 15 08:05:38 user nova-compute[95467]:       <deviceboot/>
Nov 15 08:05:38 user nova-compute[95467]:       <disksnapshot default='on' toggle='no'/>
Nov 15 08:05:38 user nova-compute[95467]:     </features>
Nov 15 08:05:38 user nova-compute[95467]:   </guest>
Nov 15 08:05:38 user nova-compute[95467]:   <guest>
Nov 15 08:05:38 user nova-compute[95467]:     <os_type>hvm</os_type>
Nov 15 08:05:38 user nova-compute[95467]:     <arch name='m68k'>
Nov 15 08:05:38 user nova-compute[95467]:       <wordsize>32</wordsize>
Nov 15 08:05:38 user nova-compute[95467]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>an5206</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>q800</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>next-cube</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <domain type='qemu'/>
Nov 15 08:05:38 user nova-compute[95467]:     </arch>
Nov 15 08:05:38 user nova-compute[95467]:     <features>
Nov 15 08:05:38 user nova-compute[95467]:       <cpuselection/>
Nov 15 08:05:38 user nova-compute[95467]:       <deviceboot/>
Nov 15 08:05:38 user nova-compute[95467]:       <disksnapshot default='on' toggle='no'/>
Nov 15 08:05:38 user nova-compute[95467]:     </features>
Nov 15 08:05:38 user nova-compute[95467]:   </guest>
Nov 15 08:05:38 user nova-compute[95467]:   <guest>
Nov 15 08:05:38 user nova-compute[95467]:     <os_type>hvm</os_type>
Nov 15 08:05:38 user nova-compute[95467]:     <arch name='microblaze'>
Nov 15 08:05:38 user nova-compute[95467]:       <wordsize>32</wordsize>
Nov 15 08:05:38 user nova-compute[95467]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <domain type='qemu'/>
Nov 15 08:05:38 user nova-compute[95467]:     </arch>
Nov 15 08:05:38 user nova-compute[95467]:     <features>
Nov 15 08:05:38 user nova-compute[95467]:       <cpuselection/>
Nov 15 08:05:38 user nova-compute[95467]:       <deviceboot/>
Nov 15 08:05:38 user nova-compute[95467]:       <disksnapshot default='on' toggle='no'/>
Nov 15 08:05:38 user nova-compute[95467]:     </features>
Nov 15 08:05:38 user nova-compute[95467]:   </guest>
Nov 15 08:05:38 user nova-compute[95467]:   <guest>
Nov 15 08:05:38 user nova-compute[95467]:     <os_type>hvm</os_type>
Nov 15 08:05:38 user nova-compute[95467]:     <arch name='microblazeel'>
Nov 15 08:05:38 user nova-compute[95467]:       <wordsize>32</wordsize>
Nov 15 08:05:38 user nova-compute[95467]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <domain type='qemu'/>
Nov 15 08:05:38 user nova-compute[95467]:     </arch>
Nov 15 08:05:38 user nova-compute[95467]:     <features>
Nov 15 08:05:38 user nova-compute[95467]:       <cpuselection/>
Nov 15 08:05:38 user nova-compute[95467]:       <deviceboot/>
Nov 15 08:05:38 user nova-compute[95467]:       <disksnapshot default='on' toggle='no'/>
Nov 15 08:05:38 user nova-compute[95467]:     </features>
Nov 15 08:05:38 user nova-compute[95467]:   </guest>
Nov 15 08:05:38 user nova-compute[95467]:   <guest>
Nov 15 08:05:38 user nova-compute[95467]:     <os_type>hvm</os_type>
Nov 15 08:05:38 user nova-compute[95467]:     <arch name='mips'>
Nov 15 08:05:38 user nova-compute[95467]:       <wordsize>32</wordsize>
Nov 15 08:05:38 user nova-compute[95467]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='16'>malta</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>mipssim</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <domain type='qemu'/>
Nov 15 08:05:38 user nova-compute[95467]:     </arch>
Nov 15 08:05:38 user nova-compute[95467]:     <features>
Nov 15 08:05:38 user nova-compute[95467]:       <cpuselection/>
Nov 15 08:05:38 user nova-compute[95467]:       <deviceboot/>
Nov 15 08:05:38 user nova-compute[95467]:       <disksnapshot default='on' toggle='no'/>
Nov 15 08:05:38 user nova-compute[95467]:     </features>
Nov 15 08:05:38 user nova-compute[95467]:   </guest>
Nov 15 08:05:38 user nova-compute[95467]:   <guest>
Nov 15 08:05:38 user nova-compute[95467]:     <os_type>hvm</os_type>
Nov 15 08:05:38 user nova-compute[95467]:     <arch name='mipsel'>
Nov 15 08:05:38 user nova-compute[95467]:       <wordsize>32</wordsize>
Nov 15 08:05:38 user nova-compute[95467]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='16'>malta</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>mipssim</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <domain type='qemu'/>
Nov 15 08:05:38 user nova-compute[95467]:     </arch>
Nov 15 08:05:38 user nova-compute[95467]:     <features>
Nov 15 08:05:38 user nova-compute[95467]:       <cpuselection/>
Nov 15 08:05:38 user nova-compute[95467]:       <deviceboot/>
Nov 15 08:05:38 user nova-compute[95467]:       <disksnapshot default='on' toggle='no'/>
Nov 15 08:05:38 user nova-compute[95467]:     </features>
Nov 15 08:05:38 user nova-compute[95467]:   </guest>
Nov 15 08:05:38 user nova-compute[95467]:   <guest>
Nov 15 08:05:38 user nova-compute[95467]:     <os_type>hvm</os_type>
Nov 15 08:05:38 user nova-compute[95467]:     <arch name='mips64'>
Nov 15 08:05:38 user nova-compute[95467]:       <wordsize>64</wordsize>
Nov 15 08:05:38 user nova-compute[95467]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='16'>malta</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>mipssim</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>pica61</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>magnum</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <domain type='qemu'/>
Nov 15 08:05:38 user nova-compute[95467]:     </arch>
Nov 15 08:05:38 user nova-compute[95467]:     <features>
Nov 15 08:05:38 user nova-compute[95467]:       <cpuselection/>
Nov 15 08:05:38 user nova-compute[95467]:       <deviceboot/>
Nov 15 08:05:38 user nova-compute[95467]:       <disksnapshot default='on' toggle='no'/>
Nov 15 08:05:38 user nova-compute[95467]:     </features>
Nov 15 08:05:38 user nova-compute[95467]:   </guest>
Nov 15 08:05:38 user nova-compute[95467]:   <guest>
Nov 15 08:05:38 user nova-compute[95467]:     <os_type>hvm</os_type>
Nov 15 08:05:38 user nova-compute[95467]:     <arch name='mips64el'>
Nov 15 08:05:38 user nova-compute[95467]:       <wordsize>64</wordsize>
Nov 15 08:05:38 user nova-compute[95467]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='16'>malta</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>mipssim</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>pica61</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>magnum</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='16'>boston</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <domain type='qemu'/>
Nov 15 08:05:38 user nova-compute[95467]:     </arch>
Nov 15 08:05:38 user nova-compute[95467]:     <features>
Nov 15 08:05:38 user nova-compute[95467]:       <cpuselection/>
Nov 15 08:05:38 user nova-compute[95467]:       <deviceboot/>
Nov 15 08:05:38 user nova-compute[95467]:       <disksnapshot default='on' toggle='no'/>
Nov 15 08:05:38 user nova-compute[95467]:     </features>
Nov 15 08:05:38 user nova-compute[95467]:   </guest>
Nov 15 08:05:38 user nova-compute[95467]:   <guest>
Nov 15 08:05:38 user nova-compute[95467]:     <os_type>hvm</os_type>
Nov 15 08:05:38 user nova-compute[95467]:     <arch name='ppc'>
Nov 15 08:05:38 user nova-compute[95467]:       <wordsize>32</wordsize>
Nov 15 08:05:38 user nova-compute[95467]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>g3beige</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>mac99</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='32'>ppce500</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>pegasos2</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>sam460ex</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>bamboo</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>40p</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>ref405ep</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>taihu</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <domain type='qemu'/>
Nov 15 08:05:38 user nova-compute[95467]:     </arch>
Nov 15 08:05:38 user nova-compute[95467]:     <features>
Nov 15 08:05:38 user nova-compute[95467]:       <cpuselection/>
Nov 15 08:05:38 user nova-compute[95467]:       <deviceboot/>
Nov 15 08:05:38 user nova-compute[95467]:       <disksnapshot default='on' toggle='no'/>
Nov 15 08:05:38 user nova-compute[95467]:     </features>
Nov 15 08:05:38 user nova-compute[95467]:   </guest>
Nov 15 08:05:38 user nova-compute[95467]:   <guest>
Nov 15 08:05:38 user nova-compute[95467]:     <os_type>hvm</os_type>
Nov 15 08:05:38 user nova-compute[95467]:     <arch name='ppc64'>
Nov 15 08:05:38 user nova-compute[95467]:       <wordsize>64</wordsize>
Nov 15 08:05:38 user nova-compute[95467]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2048'>powernv9</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>taihu</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2048'>powernv10</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='32'>ppce500</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>40p</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>pegasos2</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>bamboo</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>g3beige</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>mac99</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>sam460ex</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>ref405ep</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2048'>powernv8</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <domain type='qemu'/>
Nov 15 08:05:38 user nova-compute[95467]:     </arch>
Nov 15 08:05:38 user nova-compute[95467]:     <features>
Nov 15 08:05:38 user nova-compute[95467]:       <cpuselection/>
Nov 15 08:05:38 user nova-compute[95467]:       <deviceboot/>
Nov 15 08:05:38 user nova-compute[95467]:       <disksnapshot default='on' toggle='no'/>
Nov 15 08:05:38 user nova-compute[95467]:     </features>
Nov 15 08:05:38 user nova-compute[95467]:   </guest>
Nov 15 08:05:38 user nova-compute[95467]:   <guest>
Nov 15 08:05:38 user nova-compute[95467]:     <os_type>hvm</os_type>
Nov 15 08:05:38 user nova-compute[95467]:     <arch name='ppc64le'>
Nov 15 08:05:38 user nova-compute[95467]:       <wordsize>64</wordsize>
Nov 15 08:05:38 user nova-compute[95467]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2048'>powernv9</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>taihu</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2048'>powernv10</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='32'>ppce500</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>40p</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>pegasos2</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>bamboo</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>g3beige</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>mac99</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>sam460ex</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>ref405ep</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2048'>powernv8</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <domain type='qemu'/>
Nov 15 08:05:38 user nova-compute[95467]:     </arch>
Nov 15 08:05:38 user nova-compute[95467]:     <features>
Nov 15 08:05:38 user nova-compute[95467]:       <cpuselection/>
Nov 15 08:05:38 user nova-compute[95467]:       <deviceboot/>
Nov 15 08:05:38 user nova-compute[95467]:       <disksnapshot default='on' toggle='no'/>
Nov 15 08:05:38 user nova-compute[95467]:     </features>
Nov 15 08:05:38 user nova-compute[95467]:   </guest>
Nov 15 08:05:38 user nova-compute[95467]:   <guest>
Nov 15 08:05:38 user nova-compute[95467]:     <os_type>hvm</os_type>
Nov 15 08:05:38 user nova-compute[95467]:     <arch name='riscv32'>
Nov 15 08:05:38 user nova-compute[95467]:       <wordsize>32</wordsize>
Nov 15 08:05:38 user nova-compute[95467]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='8'>spike</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>opentitan</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='5'>sifive_u</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>sifive_e</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='8'>virt</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <domain type='qemu'/>
Nov 15 08:05:38 user nova-compute[95467]:     </arch>
Nov 15 08:05:38 user nova-compute[95467]:     <features>
Nov 15 08:05:38 user nova-compute[95467]:       <cpuselection/>
Nov 15 08:05:38 user nova-compute[95467]:       <deviceboot/>
Nov 15 08:05:38 user nova-compute[95467]:       <disksnapshot default='on' toggle='no'/>
Nov 15 08:05:38 user nova-compute[95467]:     </features>
Nov 15 08:05:38 user nova-compute[95467]:   </guest>
Nov 15 08:05:38 user nova-compute[95467]:   <guest>
Nov 15 08:05:38 user nova-compute[95467]:     <os_type>hvm</os_type>
Nov 15 08:05:38 user nova-compute[95467]:     <arch name='riscv64'>
Nov 15 08:05:38 user nova-compute[95467]:       <wordsize>64</wordsize>
Nov 15 08:05:38 user nova-compute[95467]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='8'>spike</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='5'>sifive_u</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>shakti_c</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>sifive_e</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='8'>virt</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <domain type='qemu'/>
Nov 15 08:05:38 user nova-compute[95467]:     </arch>
Nov 15 08:05:38 user nova-compute[95467]:     <features>
Nov 15 08:05:38 user nova-compute[95467]:       <cpuselection/>
Nov 15 08:05:38 user nova-compute[95467]:       <deviceboot/>
Nov 15 08:05:38 user nova-compute[95467]:       <disksnapshot default='on' toggle='no'/>
Nov 15 08:05:38 user nova-compute[95467]:     </features>
Nov 15 08:05:38 user nova-compute[95467]:   </guest>
Nov 15 08:05:38 user nova-compute[95467]:   <guest>
Nov 15 08:05:38 user nova-compute[95467]:     <os_type>hvm</os_type>
Nov 15 08:05:38 user nova-compute[95467]:     <arch name='s390x'>
Nov 15 08:05:38 user nova-compute[95467]:       <wordsize>64</wordsize>
Nov 15 08:05:38 user nova-compute[95467]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <domain type='qemu'/>
Nov 15 08:05:38 user nova-compute[95467]:     </arch>
Nov 15 08:05:38 user nova-compute[95467]:     <features>
Nov 15 08:05:38 user nova-compute[95467]:       <cpuselection/>
Nov 15 08:05:38 user nova-compute[95467]:       <deviceboot/>
Nov 15 08:05:38 user nova-compute[95467]:       <disksnapshot default='on' toggle='no'/>
Nov 15 08:05:38 user nova-compute[95467]:     </features>
Nov 15 08:05:38 user nova-compute[95467]:   </guest>
Nov 15 08:05:38 user nova-compute[95467]:   <guest>
Nov 15 08:05:38 user nova-compute[95467]:     <os_type>hvm</os_type>
Nov 15 08:05:38 user nova-compute[95467]:     <arch name='sh4'>
Nov 15 08:05:38 user nova-compute[95467]:       <wordsize>32</wordsize>
Nov 15 08:05:38 user nova-compute[95467]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>shix</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>r2d</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <domain type='qemu'/>
Nov 15 08:05:38 user nova-compute[95467]:     </arch>
Nov 15 08:05:38 user nova-compute[95467]:     <features>
Nov 15 08:05:38 user nova-compute[95467]:       <cpuselection/>
Nov 15 08:05:38 user nova-compute[95467]:       <deviceboot/>
Nov 15 08:05:38 user nova-compute[95467]:       <disksnapshot default='on' toggle='no'/>
Nov 15 08:05:38 user nova-compute[95467]:     </features>
Nov 15 08:05:38 user nova-compute[95467]:   </guest>
Nov 15 08:05:38 user nova-compute[95467]:   <guest>
Nov 15 08:05:38 user nova-compute[95467]:     <os_type>hvm</os_type>
Nov 15 08:05:38 user nova-compute[95467]:     <arch name='sh4eb'>
Nov 15 08:05:38 user nova-compute[95467]:       <wordsize>64</wordsize>
Nov 15 08:05:38 user nova-compute[95467]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>shix</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>r2d</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <domain type='qemu'/>
Nov 15 08:05:38 user nova-compute[95467]:     </arch>
Nov 15 08:05:38 user nova-compute[95467]:     <features>
Nov 15 08:05:38 user nova-compute[95467]:       <cpuselection/>
Nov 15 08:05:38 user nova-compute[95467]:       <deviceboot/>
Nov 15 08:05:38 user nova-compute[95467]:       <disksnapshot default='on' toggle='no'/>
Nov 15 08:05:38 user nova-compute[95467]:     </features>
Nov 15 08:05:38 user nova-compute[95467]:   </guest>
Nov 15 08:05:38 user nova-compute[95467]:   <guest>
Nov 15 08:05:38 user nova-compute[95467]:     <os_type>hvm</os_type>
Nov 15 08:05:38 user nova-compute[95467]:     <arch name='sparc'>
Nov 15 08:05:38 user nova-compute[95467]:       <wordsize>32</wordsize>
Nov 15 08:05:38 user nova-compute[95467]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>SS-5</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='4'>SS-20</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>LX</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>SS-4</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='4'>SS-10</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>Voyager</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <domain type='qemu'/>
Nov 15 08:05:38 user nova-compute[95467]:     </arch>
Nov 15 08:05:38 user nova-compute[95467]:     <features>
Nov 15 08:05:38 user nova-compute[95467]:       <cpuselection/>
Nov 15 08:05:38 user nova-compute[95467]:       <deviceboot/>
Nov 15 08:05:38 user nova-compute[95467]:       <disksnapshot default='on' toggle='no'/>
Nov 15 08:05:38 user nova-compute[95467]:     </features>
Nov 15 08:05:38 user nova-compute[95467]:   </guest>
Nov 15 08:05:38 user nova-compute[95467]:   <guest>
Nov 15 08:05:38 user nova-compute[95467]:     <os_type>hvm</os_type>
Nov 15 08:05:38 user nova-compute[95467]:     <arch name='sparc64'>
Nov 15 08:05:38 user nova-compute[95467]:       <wordsize>64</wordsize>
Nov 15 08:05:38 user nova-compute[95467]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>sun4u</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>niagara</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>sun4v</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <domain type='qemu'/>
Nov 15 08:05:38 user nova-compute[95467]:     </arch>
Nov 15 08:05:38 user nova-compute[95467]:     <features>
Nov 15 08:05:38 user nova-compute[95467]:       <cpuselection/>
Nov 15 08:05:38 user nova-compute[95467]:       <deviceboot/>
Nov 15 08:05:38 user nova-compute[95467]:       <disksnapshot default='on' toggle='no'/>
Nov 15 08:05:38 user nova-compute[95467]:     </features>
Nov 15 08:05:38 user nova-compute[95467]:   </guest>
Nov 15 08:05:38 user nova-compute[95467]:   <guest>
Nov 15 08:05:38 user nova-compute[95467]:     <os_type>hvm</os_type>
Nov 15 08:05:38 user nova-compute[95467]:     <arch name='x86_64'>
Nov 15 08:05:38 user nova-compute[95467]:       <wordsize>64</wordsize>
Nov 15 08:05:38 user nova-compute[95467]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>x-remote</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='1'>isapc</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>microvm</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <domain type='qemu'/>
Nov 15 08:05:38 user nova-compute[95467]:       <domain type='kvm'/>
Nov 15 08:05:38 user nova-compute[95467]:     </arch>
Nov 15 08:05:38 user nova-compute[95467]:     <features>
Nov 15 08:05:38 user nova-compute[95467]:       <acpi default='on' toggle='yes'/>
Nov 15 08:05:38 user nova-compute[95467]:       <apic default='on' toggle='no'/>
Nov 15 08:05:38 user nova-compute[95467]:       <cpuselection/>
Nov 15 08:05:38 user nova-compute[95467]:       <deviceboot/>
Nov 15 08:05:38 user nova-compute[95467]:       <disksnapshot default='on' toggle='no'/>
Nov 15 08:05:38 user nova-compute[95467]:     </features>
Nov 15 08:05:38 user nova-compute[95467]:   </guest>
Nov 15 08:05:38 user nova-compute[95467]:   <guest>
Nov 15 08:05:38 user nova-compute[95467]:     <os_type>hvm</os_type>
Nov 15 08:05:38 user nova-compute[95467]:     <arch name='xtensa'>
Nov 15 08:05:38 user nova-compute[95467]:       <wordsize>32</wordsize>
Nov 15 08:05:38 user nova-compute[95467]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='4'>sim</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='32'>kc705</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='32'>ml605</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='32'>virt</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='32'>lx200</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='32'>lx60</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <domain type='qemu'/>
Nov 15 08:05:38 user nova-compute[95467]:     </arch>
Nov 15 08:05:38 user nova-compute[95467]:     <features>
Nov 15 08:05:38 user nova-compute[95467]:       <cpuselection/>
Nov 15 08:05:38 user nova-compute[95467]:       <deviceboot/>
Nov 15 08:05:38 user nova-compute[95467]:       <disksnapshot default='on' toggle='no'/>
Nov 15 08:05:38 user nova-compute[95467]:     </features>
Nov 15 08:05:38 user nova-compute[95467]:   </guest>
Nov 15 08:05:38 user nova-compute[95467]:   <guest>
Nov 15 08:05:38 user nova-compute[95467]:     <os_type>hvm</os_type>
Nov 15 08:05:38 user nova-compute[95467]:     <arch name='xtensaeb'>
Nov 15 08:05:38 user nova-compute[95467]:       <wordsize>32</wordsize>
Nov 15 08:05:38 user nova-compute[95467]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='4'>sim</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='32'>kc705</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='32'>ml605</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='32'>virt</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='32'>lx200</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='32'>lx60</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 15 08:05:38 user nova-compute[95467]:       <domain type='qemu'/>
Nov 15 08:05:38 user nova-compute[95467]:     </arch>
Nov 15 08:05:38 user nova-compute[95467]:     <features>
Nov 15 08:05:38 user nova-compute[95467]:       <cpuselection/>
Nov 15 08:05:38 user nova-compute[95467]:       <deviceboot/>
Nov 15 08:05:38 user nova-compute[95467]:       <disksnapshot default='on' toggle='no'/>
Nov 15 08:05:38 user nova-compute[95467]:     </features>
Nov 15 08:05:38 user nova-compute[95467]:   </guest>
Nov 15 08:05:38 user nova-compute[95467]: </capabilities>
Nov 15 08:05:38 user nova-compute[95467]: 
Nov 15 08:05:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=95467) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 08:05:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=95467) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 08:05:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=95467) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 08:05:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=95467) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 08:05:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=95467) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 08:05:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=95467) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 08:05:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=95467) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 08:05:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=95467) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 08:05:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=95467) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 08:05:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Getting domain capabilities for cris via machine types: {None} {{(pid=95467) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 08:05:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=95467) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 08:05:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'pc', 'q35', 'ubuntu'} {{(pid=95467) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 08:05:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 15 08:05:38 user nova-compute[95467]: <domainCapabilities>
Nov 15 08:05:38 user nova-compute[95467]:   <path>/usr/bin/qemu-system-i386</path>
Nov 15 08:05:38 user nova-compute[95467]:   <domain>kvm</domain>
Nov 15 08:05:38 user nova-compute[95467]:   <machine>pc-q35-jammy</machine>
Nov 15 08:05:38 user nova-compute[95467]:   <arch>i686</arch>
Nov 15 08:05:38 user nova-compute[95467]:   <vcpu max='288'/>
Nov 15 08:05:38 user nova-compute[95467]:   <iothreads supported='yes'/>
Nov 15 08:05:38 user nova-compute[95467]:   <os supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:     <enum name='firmware'/>
Nov 15 08:05:38 user nova-compute[95467]:     <loader supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 15 08:05:38 user nova-compute[95467]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 15 08:05:38 user nova-compute[95467]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 15 08:05:38 user nova-compute[95467]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 15 08:05:38 user nova-compute[95467]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='type'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>rom</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>pflash</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='readonly'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>yes</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>no</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='secure'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>no</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </loader>
Nov 15 08:05:38 user nova-compute[95467]:   </os>
Nov 15 08:05:38 user nova-compute[95467]:   <cpu>
Nov 15 08:05:38 user nova-compute[95467]:     <mode name='host-passthrough' supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='hostPassthroughMigratable'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>off</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </mode>
Nov 15 08:05:38 user nova-compute[95467]:     <mode name='maximum' supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='maximumMigratable'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>on</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>off</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </mode>
Nov 15 08:05:38 user nova-compute[95467]:     <mode name='host-model' supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <vendor>Intel</vendor>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='ss'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='vmx'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='pcid'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='hypervisor'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='arat'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='umip'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='md-clear'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='stibp'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='ssbd'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='ibpb'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='ibrs'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='amd-stibp'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='disable' name='erms'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='disable' name='lm'/>
Nov 15 08:05:38 user nova-compute[95467]:     </mode>
Nov 15 08:05:38 user nova-compute[95467]:     <mode name='custom' supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>qemu64</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>qemu32</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>phenom</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>pentium3</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>pentium2</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>pentium</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>n270</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>kvm64</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>kvm32</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>coreduo</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>core2duo</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>athlon</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Westmere-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Westmere</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Snowridge</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Skylake-Server</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Skylake-Client</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>SandyBridge</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Penryn</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Opteron_G5</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Opteron_G4</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Opteron_G3</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Opteron_G2</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Opteron_G1</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Nehalem-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Nehalem</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>IvyBridge</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Icelake-Server</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Haswell</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>EPYC-Rome</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>EPYC-Milan</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>EPYC</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Dhyana</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Cooperlake</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Conroe</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Broadwell</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>486</model>
Nov 15 08:05:38 user nova-compute[95467]:     </mode>
Nov 15 08:05:38 user nova-compute[95467]:   </cpu>
Nov 15 08:05:38 user nova-compute[95467]:   <memoryBacking supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:     <enum name='sourceType'>
Nov 15 08:05:38 user nova-compute[95467]:       <value>file</value>
Nov 15 08:05:38 user nova-compute[95467]:       <value>anonymous</value>
Nov 15 08:05:38 user nova-compute[95467]:       <value>memfd</value>
Nov 15 08:05:38 user nova-compute[95467]:     </enum>
Nov 15 08:05:38 user nova-compute[95467]:   </memoryBacking>
Nov 15 08:05:38 user nova-compute[95467]:   <devices>
Nov 15 08:05:38 user nova-compute[95467]:     <disk supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='diskDevice'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>disk</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>cdrom</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>floppy</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>lun</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='bus'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>fdc</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>scsi</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtio</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>usb</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>sata</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='model'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtio</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtio-transitional</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtio-non-transitional</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </disk>
Nov 15 08:05:38 user nova-compute[95467]:     <graphics supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='type'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>sdl</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>vnc</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>spice</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>egl-headless</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </graphics>
Nov 15 08:05:38 user nova-compute[95467]:     <video supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='modelType'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>vga</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>cirrus</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>vmvga</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>qxl</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtio</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>none</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>bochs</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>ramfb</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </video>
Nov 15 08:05:38 user nova-compute[95467]:     <hostdev supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='mode'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>subsystem</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='startupPolicy'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>default</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>mandatory</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>requisite</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>optional</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='subsysType'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>usb</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>pci</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>scsi</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='capsType'/>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='pciBackend'/>
Nov 15 08:05:38 user nova-compute[95467]:     </hostdev>
Nov 15 08:05:38 user nova-compute[95467]:     <rng supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='model'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtio</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtio-transitional</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtio-non-transitional</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='backendModel'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>random</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>egd</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>builtin</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </rng>
Nov 15 08:05:38 user nova-compute[95467]:     <filesystem supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='driverType'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>path</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>handle</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtiofs</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </filesystem>
Nov 15 08:05:38 user nova-compute[95467]:     <tpm supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='model'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>tpm-tis</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>tpm-crb</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='backendModel'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>passthrough</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>emulator</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </tpm>
Nov 15 08:05:38 user nova-compute[95467]:   </devices>
Nov 15 08:05:38 user nova-compute[95467]:   <features>
Nov 15 08:05:38 user nova-compute[95467]:     <gic supported='no'/>
Nov 15 08:05:38 user nova-compute[95467]:     <vmcoreinfo supported='yes'/>
Nov 15 08:05:38 user nova-compute[95467]:     <genid supported='yes'/>
Nov 15 08:05:38 user nova-compute[95467]:     <backingStoreInput supported='yes'/>
Nov 15 08:05:38 user nova-compute[95467]:     <backup supported='yes'/>
Nov 15 08:05:38 user nova-compute[95467]:     <sev supported='no'/>
Nov 15 08:05:38 user nova-compute[95467]:   </features>
Nov 15 08:05:38 user nova-compute[95467]: </domainCapabilities>
Nov 15 08:05:38 user nova-compute[95467]:  {{(pid=95467) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 08:05:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 15 08:05:38 user nova-compute[95467]: <domainCapabilities>
Nov 15 08:05:38 user nova-compute[95467]:   <path>/usr/bin/qemu-system-i386</path>
Nov 15 08:05:38 user nova-compute[95467]:   <domain>kvm</domain>
Nov 15 08:05:38 user nova-compute[95467]:   <machine>pc-i440fx-6.2</machine>
Nov 15 08:05:38 user nova-compute[95467]:   <arch>i686</arch>
Nov 15 08:05:38 user nova-compute[95467]:   <vcpu max='255'/>
Nov 15 08:05:38 user nova-compute[95467]:   <iothreads supported='yes'/>
Nov 15 08:05:38 user nova-compute[95467]:   <os supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:     <enum name='firmware'/>
Nov 15 08:05:38 user nova-compute[95467]:     <loader supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 15 08:05:38 user nova-compute[95467]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 15 08:05:38 user nova-compute[95467]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 15 08:05:38 user nova-compute[95467]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 15 08:05:38 user nova-compute[95467]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='type'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>rom</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>pflash</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='readonly'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>yes</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>no</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='secure'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>no</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </loader>
Nov 15 08:05:38 user nova-compute[95467]:   </os>
Nov 15 08:05:38 user nova-compute[95467]:   <cpu>
Nov 15 08:05:38 user nova-compute[95467]:     <mode name='host-passthrough' supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='hostPassthroughMigratable'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>off</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </mode>
Nov 15 08:05:38 user nova-compute[95467]:     <mode name='maximum' supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='maximumMigratable'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>on</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>off</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </mode>
Nov 15 08:05:38 user nova-compute[95467]:     <mode name='host-model' supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <vendor>Intel</vendor>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='ss'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='vmx'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='pcid'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='hypervisor'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='arat'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='umip'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='md-clear'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='stibp'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='ssbd'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='ibpb'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='ibrs'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='amd-stibp'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='disable' name='erms'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='disable' name='lm'/>
Nov 15 08:05:38 user nova-compute[95467]:     </mode>
Nov 15 08:05:38 user nova-compute[95467]:     <mode name='custom' supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>qemu64</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>qemu32</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>phenom</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>pentium3</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>pentium2</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>pentium</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>n270</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>kvm64</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>kvm32</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>coreduo</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>core2duo</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>athlon</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Westmere-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Westmere</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Snowridge</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Skylake-Server</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Skylake-Client</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>SandyBridge</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Penryn</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Opteron_G5</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Opteron_G4</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Opteron_G3</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Opteron_G2</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Opteron_G1</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Nehalem-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Nehalem</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>IvyBridge</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Icelake-Server</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Haswell</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>EPYC-Rome</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>EPYC-Milan</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>EPYC</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Dhyana</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Cooperlake</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Conroe</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Broadwell</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>486</model>
Nov 15 08:05:38 user nova-compute[95467]:     </mode>
Nov 15 08:05:38 user nova-compute[95467]:   </cpu>
Nov 15 08:05:38 user nova-compute[95467]:   <memoryBacking supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:     <enum name='sourceType'>
Nov 15 08:05:38 user nova-compute[95467]:       <value>file</value>
Nov 15 08:05:38 user nova-compute[95467]:       <value>anonymous</value>
Nov 15 08:05:38 user nova-compute[95467]:       <value>memfd</value>
Nov 15 08:05:38 user nova-compute[95467]:     </enum>
Nov 15 08:05:38 user nova-compute[95467]:   </memoryBacking>
Nov 15 08:05:38 user nova-compute[95467]:   <devices>
Nov 15 08:05:38 user nova-compute[95467]:     <disk supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='diskDevice'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>disk</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>cdrom</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>floppy</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>lun</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='bus'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>ide</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>fdc</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>scsi</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtio</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>usb</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>sata</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='model'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtio</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtio-transitional</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtio-non-transitional</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </disk>
Nov 15 08:05:38 user nova-compute[95467]:     <graphics supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='type'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>sdl</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>vnc</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>spice</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>egl-headless</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </graphics>
Nov 15 08:05:38 user nova-compute[95467]:     <video supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='modelType'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>vga</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>cirrus</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>vmvga</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>qxl</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtio</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>none</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>bochs</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>ramfb</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </video>
Nov 15 08:05:38 user nova-compute[95467]:     <hostdev supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='mode'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>subsystem</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='startupPolicy'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>default</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>mandatory</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>requisite</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>optional</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='subsysType'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>usb</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>pci</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>scsi</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='capsType'/>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='pciBackend'/>
Nov 15 08:05:38 user nova-compute[95467]:     </hostdev>
Nov 15 08:05:38 user nova-compute[95467]:     <rng supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='model'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtio</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtio-transitional</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtio-non-transitional</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='backendModel'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>random</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>egd</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>builtin</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </rng>
Nov 15 08:05:38 user nova-compute[95467]:     <filesystem supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='driverType'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>path</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>handle</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtiofs</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </filesystem>
Nov 15 08:05:38 user nova-compute[95467]:     <tpm supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='model'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>tpm-tis</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>tpm-crb</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='backendModel'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>passthrough</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>emulator</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </tpm>
Nov 15 08:05:38 user nova-compute[95467]:   </devices>
Nov 15 08:05:38 user nova-compute[95467]:   <features>
Nov 15 08:05:38 user nova-compute[95467]:     <gic supported='no'/>
Nov 15 08:05:38 user nova-compute[95467]:     <vmcoreinfo supported='yes'/>
Nov 15 08:05:38 user nova-compute[95467]:     <genid supported='yes'/>
Nov 15 08:05:38 user nova-compute[95467]:     <backingStoreInput supported='yes'/>
Nov 15 08:05:38 user nova-compute[95467]:     <backup supported='yes'/>
Nov 15 08:05:38 user nova-compute[95467]:     <sev supported='no'/>
Nov 15 08:05:38 user nova-compute[95467]:   </features>
Nov 15 08:05:38 user nova-compute[95467]: </domainCapabilities>
Nov 15 08:05:38 user nova-compute[95467]:  {{(pid=95467) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 08:05:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 15 08:05:38 user nova-compute[95467]: <domainCapabilities>
Nov 15 08:05:38 user nova-compute[95467]:   <path>/usr/bin/qemu-system-i386</path>
Nov 15 08:05:38 user nova-compute[95467]:   <domain>kvm</domain>
Nov 15 08:05:38 user nova-compute[95467]:   <machine>pc-q35-6.2</machine>
Nov 15 08:05:38 user nova-compute[95467]:   <arch>i686</arch>
Nov 15 08:05:38 user nova-compute[95467]:   <vcpu max='288'/>
Nov 15 08:05:38 user nova-compute[95467]:   <iothreads supported='yes'/>
Nov 15 08:05:38 user nova-compute[95467]:   <os supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:     <enum name='firmware'/>
Nov 15 08:05:38 user nova-compute[95467]:     <loader supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 15 08:05:38 user nova-compute[95467]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 15 08:05:38 user nova-compute[95467]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 15 08:05:38 user nova-compute[95467]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 15 08:05:38 user nova-compute[95467]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='type'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>rom</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>pflash</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='readonly'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>yes</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>no</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='secure'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>no</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </loader>
Nov 15 08:05:38 user nova-compute[95467]:   </os>
Nov 15 08:05:38 user nova-compute[95467]:   <cpu>
Nov 15 08:05:38 user nova-compute[95467]:     <mode name='host-passthrough' supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='hostPassthroughMigratable'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>off</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </mode>
Nov 15 08:05:38 user nova-compute[95467]:     <mode name='maximum' supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='maximumMigratable'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>on</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>off</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </mode>
Nov 15 08:05:38 user nova-compute[95467]:     <mode name='host-model' supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <vendor>Intel</vendor>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='ss'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='vmx'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='pcid'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='hypervisor'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='arat'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='umip'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='md-clear'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='stibp'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='ssbd'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='ibpb'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='ibrs'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='amd-stibp'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='disable' name='erms'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='disable' name='lm'/>
Nov 15 08:05:38 user nova-compute[95467]:     </mode>
Nov 15 08:05:38 user nova-compute[95467]:     <mode name='custom' supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>qemu64</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>qemu32</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>phenom</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>pentium3</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>pentium2</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>pentium</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>n270</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>kvm64</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>kvm32</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>coreduo</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>core2duo</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>athlon</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Westmere-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Westmere</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Snowridge</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Skylake-Server</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Skylake-Client</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>SandyBridge</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Penryn</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Opteron_G5</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Opteron_G4</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Opteron_G3</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Opteron_G2</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Opteron_G1</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Nehalem-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Nehalem</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>IvyBridge</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Icelake-Server</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Haswell</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>EPYC-Rome</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>EPYC-Milan</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>EPYC</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Dhyana</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Cooperlake</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Conroe</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Broadwell</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>486</model>
Nov 15 08:05:38 user nova-compute[95467]:     </mode>
Nov 15 08:05:38 user nova-compute[95467]:   </cpu>
Nov 15 08:05:38 user nova-compute[95467]:   <memoryBacking supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:     <enum name='sourceType'>
Nov 15 08:05:38 user nova-compute[95467]:       <value>file</value>
Nov 15 08:05:38 user nova-compute[95467]:       <value>anonymous</value>
Nov 15 08:05:38 user nova-compute[95467]:       <value>memfd</value>
Nov 15 08:05:38 user nova-compute[95467]:     </enum>
Nov 15 08:05:38 user nova-compute[95467]:   </memoryBacking>
Nov 15 08:05:38 user nova-compute[95467]:   <devices>
Nov 15 08:05:38 user nova-compute[95467]:     <disk supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='diskDevice'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>disk</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>cdrom</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>floppy</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>lun</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='bus'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>fdc</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>scsi</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtio</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>usb</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>sata</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='model'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtio</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtio-transitional</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtio-non-transitional</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </disk>
Nov 15 08:05:38 user nova-compute[95467]:     <graphics supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='type'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>sdl</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>vnc</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>spice</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>egl-headless</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </graphics>
Nov 15 08:05:38 user nova-compute[95467]:     <video supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='modelType'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>vga</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>cirrus</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>vmvga</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>qxl</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtio</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>none</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>bochs</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>ramfb</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </video>
Nov 15 08:05:38 user nova-compute[95467]:     <hostdev supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='mode'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>subsystem</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='startupPolicy'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>default</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>mandatory</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>requisite</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>optional</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='subsysType'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>usb</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>pci</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>scsi</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='capsType'/>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='pciBackend'/>
Nov 15 08:05:38 user nova-compute[95467]:     </hostdev>
Nov 15 08:05:38 user nova-compute[95467]:     <rng supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='model'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtio</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtio-transitional</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtio-non-transitional</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='backendModel'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>random</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>egd</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>builtin</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </rng>
Nov 15 08:05:38 user nova-compute[95467]:     <filesystem supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='driverType'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>path</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>handle</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtiofs</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </filesystem>
Nov 15 08:05:38 user nova-compute[95467]:     <tpm supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='model'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>tpm-tis</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>tpm-crb</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='backendModel'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>passthrough</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>emulator</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </tpm>
Nov 15 08:05:38 user nova-compute[95467]:   </devices>
Nov 15 08:05:38 user nova-compute[95467]:   <features>
Nov 15 08:05:38 user nova-compute[95467]:     <gic supported='no'/>
Nov 15 08:05:38 user nova-compute[95467]:     <vmcoreinfo supported='yes'/>
Nov 15 08:05:38 user nova-compute[95467]:     <genid supported='yes'/>
Nov 15 08:05:38 user nova-compute[95467]:     <backingStoreInput supported='yes'/>
Nov 15 08:05:38 user nova-compute[95467]:     <backup supported='yes'/>
Nov 15 08:05:38 user nova-compute[95467]:     <sev supported='no'/>
Nov 15 08:05:38 user nova-compute[95467]:   </features>
Nov 15 08:05:38 user nova-compute[95467]: </domainCapabilities>
Nov 15 08:05:38 user nova-compute[95467]:  {{(pid=95467) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 08:05:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 15 08:05:38 user nova-compute[95467]: <domainCapabilities>
Nov 15 08:05:38 user nova-compute[95467]:   <path>/usr/bin/qemu-system-i386</path>
Nov 15 08:05:38 user nova-compute[95467]:   <domain>kvm</domain>
Nov 15 08:05:38 user nova-compute[95467]:   <machine>pc-i440fx-jammy</machine>
Nov 15 08:05:38 user nova-compute[95467]:   <arch>i686</arch>
Nov 15 08:05:38 user nova-compute[95467]:   <vcpu max='255'/>
Nov 15 08:05:38 user nova-compute[95467]:   <iothreads supported='yes'/>
Nov 15 08:05:38 user nova-compute[95467]:   <os supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:     <enum name='firmware'/>
Nov 15 08:05:38 user nova-compute[95467]:     <loader supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 15 08:05:38 user nova-compute[95467]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 15 08:05:38 user nova-compute[95467]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 15 08:05:38 user nova-compute[95467]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 15 08:05:38 user nova-compute[95467]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='type'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>rom</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>pflash</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='readonly'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>yes</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>no</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='secure'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>no</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </loader>
Nov 15 08:05:38 user nova-compute[95467]:   </os>
Nov 15 08:05:38 user nova-compute[95467]:   <cpu>
Nov 15 08:05:38 user nova-compute[95467]:     <mode name='host-passthrough' supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='hostPassthroughMigratable'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>off</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </mode>
Nov 15 08:05:38 user nova-compute[95467]:     <mode name='maximum' supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='maximumMigratable'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>on</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>off</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </mode>
Nov 15 08:05:38 user nova-compute[95467]:     <mode name='host-model' supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <vendor>Intel</vendor>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='ss'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='vmx'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='pcid'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='hypervisor'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='arat'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='umip'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='md-clear'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='stibp'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='ssbd'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='ibpb'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='ibrs'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='amd-stibp'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='disable' name='erms'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='disable' name='lm'/>
Nov 15 08:05:38 user nova-compute[95467]:     </mode>
Nov 15 08:05:38 user nova-compute[95467]:     <mode name='custom' supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>qemu64</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>qemu32</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>phenom</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>pentium3</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>pentium2</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>pentium</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>n270</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>kvm64</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>kvm32</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>coreduo</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>core2duo</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>athlon</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Westmere-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Westmere</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Snowridge</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Skylake-Server</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Skylake-Client</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>SandyBridge</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Penryn</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Opteron_G5</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Opteron_G4</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Opteron_G3</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Opteron_G2</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Opteron_G1</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Nehalem-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Nehalem</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>IvyBridge</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Icelake-Server</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Haswell</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>EPYC-Rome</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>EPYC-Milan</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>EPYC</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Dhyana</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Cooperlake</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Conroe</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Broadwell</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>486</model>
Nov 15 08:05:38 user nova-compute[95467]:     </mode>
Nov 15 08:05:38 user nova-compute[95467]:   </cpu>
Nov 15 08:05:38 user nova-compute[95467]:   <memoryBacking supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:     <enum name='sourceType'>
Nov 15 08:05:38 user nova-compute[95467]:       <value>file</value>
Nov 15 08:05:38 user nova-compute[95467]:       <value>anonymous</value>
Nov 15 08:05:38 user nova-compute[95467]:       <value>memfd</value>
Nov 15 08:05:38 user nova-compute[95467]:     </enum>
Nov 15 08:05:38 user nova-compute[95467]:   </memoryBacking>
Nov 15 08:05:38 user nova-compute[95467]:   <devices>
Nov 15 08:05:38 user nova-compute[95467]:     <disk supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='diskDevice'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>disk</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>cdrom</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>floppy</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>lun</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='bus'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>ide</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>fdc</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>scsi</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtio</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>usb</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>sata</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='model'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtio</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtio-transitional</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtio-non-transitional</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </disk>
Nov 15 08:05:38 user nova-compute[95467]:     <graphics supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='type'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>sdl</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>vnc</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>spice</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>egl-headless</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </graphics>
Nov 15 08:05:38 user nova-compute[95467]:     <video supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='modelType'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>vga</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>cirrus</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>vmvga</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>qxl</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtio</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>none</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>bochs</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>ramfb</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </video>
Nov 15 08:05:38 user nova-compute[95467]:     <hostdev supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='mode'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>subsystem</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='startupPolicy'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>default</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>mandatory</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>requisite</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>optional</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='subsysType'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>usb</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>pci</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>scsi</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='capsType'/>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='pciBackend'/>
Nov 15 08:05:38 user nova-compute[95467]:     </hostdev>
Nov 15 08:05:38 user nova-compute[95467]:     <rng supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='model'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtio</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtio-transitional</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtio-non-transitional</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='backendModel'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>random</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>egd</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>builtin</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </rng>
Nov 15 08:05:38 user nova-compute[95467]:     <filesystem supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='driverType'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>path</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>handle</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtiofs</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </filesystem>
Nov 15 08:05:38 user nova-compute[95467]:     <tpm supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='model'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>tpm-tis</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>tpm-crb</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='backendModel'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>passthrough</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>emulator</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </tpm>
Nov 15 08:05:38 user nova-compute[95467]:   </devices>
Nov 15 08:05:38 user nova-compute[95467]:   <features>
Nov 15 08:05:38 user nova-compute[95467]:     <gic supported='no'/>
Nov 15 08:05:38 user nova-compute[95467]:     <vmcoreinfo supported='yes'/>
Nov 15 08:05:38 user nova-compute[95467]:     <genid supported='yes'/>
Nov 15 08:05:38 user nova-compute[95467]:     <backingStoreInput supported='yes'/>
Nov 15 08:05:38 user nova-compute[95467]:     <backup supported='yes'/>
Nov 15 08:05:38 user nova-compute[95467]:     <sev supported='no'/>
Nov 15 08:05:38 user nova-compute[95467]:   </features>
Nov 15 08:05:38 user nova-compute[95467]: </domainCapabilities>
Nov 15 08:05:38 user nova-compute[95467]:  {{(pid=95467) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 08:05:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=95467) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 08:05:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=95467) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 08:05:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=95467) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 08:05:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=95467) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 08:05:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=95467) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 08:05:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=95467) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 08:05:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=95467) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 08:05:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Getting domain capabilities for mips via machine types: {None} {{(pid=95467) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 08:05:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=95467) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 08:05:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=95467) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 08:05:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=95467) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 08:05:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=95467) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 08:05:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=95467) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 08:05:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=95467) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 08:05:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=95467) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 08:05:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=95467) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 08:05:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=95467) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 08:05:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=95467) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 08:05:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=95467) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 08:05:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=95467) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 08:05:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=95467) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 08:05:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=95467) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 08:05:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=95467) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 08:05:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=95467) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 08:05:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=95467) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 08:05:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=95467) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 08:05:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=95467) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 08:05:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=95467) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 08:05:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=95467) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 08:05:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=95467) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 08:05:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=95467) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 08:05:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=95467) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 08:05:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=95467) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 08:05:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=95467) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 08:05:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=95467) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 08:05:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=95467) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 08:05:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=95467) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 08:05:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=95467) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 08:05:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'pc', 'q35', 'ubuntu'} {{(pid=95467) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 08:05:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 15 08:05:38 user nova-compute[95467]: <domainCapabilities>
Nov 15 08:05:38 user nova-compute[95467]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 15 08:05:38 user nova-compute[95467]:   <domain>kvm</domain>
Nov 15 08:05:38 user nova-compute[95467]:   <machine>pc-q35-jammy</machine>
Nov 15 08:05:38 user nova-compute[95467]:   <arch>x86_64</arch>
Nov 15 08:05:38 user nova-compute[95467]:   <vcpu max='288'/>
Nov 15 08:05:38 user nova-compute[95467]:   <iothreads supported='yes'/>
Nov 15 08:05:38 user nova-compute[95467]:   <os supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:     <enum name='firmware'>
Nov 15 08:05:38 user nova-compute[95467]:       <value>efi</value>
Nov 15 08:05:38 user nova-compute[95467]:     </enum>
Nov 15 08:05:38 user nova-compute[95467]:     <loader supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 15 08:05:38 user nova-compute[95467]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 15 08:05:38 user nova-compute[95467]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='type'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>rom</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>pflash</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='readonly'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>yes</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>no</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='secure'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>yes</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>no</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </loader>
Nov 15 08:05:38 user nova-compute[95467]:   </os>
Nov 15 08:05:38 user nova-compute[95467]:   <cpu>
Nov 15 08:05:38 user nova-compute[95467]:     <mode name='host-passthrough' supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='hostPassthroughMigratable'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>on</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>off</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </mode>
Nov 15 08:05:38 user nova-compute[95467]:     <mode name='maximum' supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='maximumMigratable'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>on</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>off</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </mode>
Nov 15 08:05:38 user nova-compute[95467]:     <mode name='host-model' supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <vendor>Intel</vendor>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='ss'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='vmx'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='pcid'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='hypervisor'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='arat'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='umip'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='md-clear'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='stibp'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='ssbd'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='invtsc'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='ibpb'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='ibrs'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='amd-stibp'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='rsba'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='pschange-mc-no'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='disable' name='erms'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 08:05:38 user nova-compute[95467]:     </mode>
Nov 15 08:05:38 user nova-compute[95467]:     <mode name='custom' supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>qemu64</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>qemu32</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>phenom</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>pentium3</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>pentium2</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>pentium</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>n270</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>kvm64</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>kvm32</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>coreduo</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>core2duo</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>athlon</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>Westmere-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>Westmere</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Snowridge</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Skylake-Server</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Skylake-Client</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>SandyBridge</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>Penryn</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Opteron_G5</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Opteron_G4</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Opteron_G3</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Opteron_G2</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>Opteron_G1</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>Nehalem</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>IvyBridge</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Icelake-Server</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Haswell</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>EPYC-Rome</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>EPYC-Milan</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>EPYC</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Dhyana</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Cooperlake</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>Conroe</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Broadwell</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>486</model>
Nov 15 08:05:38 user nova-compute[95467]:     </mode>
Nov 15 08:05:38 user nova-compute[95467]:   </cpu>
Nov 15 08:05:38 user nova-compute[95467]:   <memoryBacking supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:     <enum name='sourceType'>
Nov 15 08:05:38 user nova-compute[95467]:       <value>file</value>
Nov 15 08:05:38 user nova-compute[95467]:       <value>anonymous</value>
Nov 15 08:05:38 user nova-compute[95467]:       <value>memfd</value>
Nov 15 08:05:38 user nova-compute[95467]:     </enum>
Nov 15 08:05:38 user nova-compute[95467]:   </memoryBacking>
Nov 15 08:05:38 user nova-compute[95467]:   <devices>
Nov 15 08:05:38 user nova-compute[95467]:     <disk supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='diskDevice'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>disk</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>cdrom</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>floppy</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>lun</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='bus'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>fdc</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>scsi</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtio</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>usb</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>sata</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='model'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtio</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtio-transitional</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtio-non-transitional</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </disk>
Nov 15 08:05:38 user nova-compute[95467]:     <graphics supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='type'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>sdl</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>vnc</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>spice</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>egl-headless</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </graphics>
Nov 15 08:05:38 user nova-compute[95467]:     <video supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='modelType'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>vga</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>cirrus</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>vmvga</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>qxl</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtio</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>none</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>bochs</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>ramfb</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </video>
Nov 15 08:05:38 user nova-compute[95467]:     <hostdev supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='mode'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>subsystem</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='startupPolicy'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>default</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>mandatory</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>requisite</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>optional</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='subsysType'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>usb</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>pci</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>scsi</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='capsType'/>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='pciBackend'/>
Nov 15 08:05:38 user nova-compute[95467]:     </hostdev>
Nov 15 08:05:38 user nova-compute[95467]:     <rng supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='model'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtio</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtio-transitional</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtio-non-transitional</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='backendModel'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>random</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>egd</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>builtin</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </rng>
Nov 15 08:05:38 user nova-compute[95467]:     <filesystem supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='driverType'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>path</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>handle</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtiofs</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </filesystem>
Nov 15 08:05:38 user nova-compute[95467]:     <tpm supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='model'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>tpm-tis</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>tpm-crb</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='backendModel'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>passthrough</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>emulator</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </tpm>
Nov 15 08:05:38 user nova-compute[95467]:   </devices>
Nov 15 08:05:38 user nova-compute[95467]:   <features>
Nov 15 08:05:38 user nova-compute[95467]:     <gic supported='no'/>
Nov 15 08:05:38 user nova-compute[95467]:     <vmcoreinfo supported='yes'/>
Nov 15 08:05:38 user nova-compute[95467]:     <genid supported='yes'/>
Nov 15 08:05:38 user nova-compute[95467]:     <backingStoreInput supported='yes'/>
Nov 15 08:05:38 user nova-compute[95467]:     <backup supported='yes'/>
Nov 15 08:05:38 user nova-compute[95467]:     <sev supported='no'/>
Nov 15 08:05:38 user nova-compute[95467]:   </features>
Nov 15 08:05:38 user nova-compute[95467]: </domainCapabilities>
Nov 15 08:05:38 user nova-compute[95467]:  {{(pid=95467) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 08:05:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 15 08:05:38 user nova-compute[95467]: <domainCapabilities>
Nov 15 08:05:38 user nova-compute[95467]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 15 08:05:38 user nova-compute[95467]:   <domain>kvm</domain>
Nov 15 08:05:38 user nova-compute[95467]:   <machine>pc-i440fx-6.2</machine>
Nov 15 08:05:38 user nova-compute[95467]:   <arch>x86_64</arch>
Nov 15 08:05:38 user nova-compute[95467]:   <vcpu max='255'/>
Nov 15 08:05:38 user nova-compute[95467]:   <iothreads supported='yes'/>
Nov 15 08:05:38 user nova-compute[95467]:   <os supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:     <enum name='firmware'>
Nov 15 08:05:38 user nova-compute[95467]:       <value>efi</value>
Nov 15 08:05:38 user nova-compute[95467]:     </enum>
Nov 15 08:05:38 user nova-compute[95467]:     <loader supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='type'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>rom</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>pflash</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='readonly'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>yes</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>no</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='secure'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>no</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </loader>
Nov 15 08:05:38 user nova-compute[95467]:   </os>
Nov 15 08:05:38 user nova-compute[95467]:   <cpu>
Nov 15 08:05:38 user nova-compute[95467]:     <mode name='host-passthrough' supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='hostPassthroughMigratable'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>on</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>off</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </mode>
Nov 15 08:05:38 user nova-compute[95467]:     <mode name='maximum' supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='maximumMigratable'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>on</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>off</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </mode>
Nov 15 08:05:38 user nova-compute[95467]:     <mode name='host-model' supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <vendor>Intel</vendor>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='ss'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='vmx'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='pcid'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='hypervisor'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='arat'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='umip'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='md-clear'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='stibp'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='ssbd'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='invtsc'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='ibpb'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='ibrs'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='amd-stibp'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='rsba'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='pschange-mc-no'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='disable' name='erms'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 08:05:38 user nova-compute[95467]:     </mode>
Nov 15 08:05:38 user nova-compute[95467]:     <mode name='custom' supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>qemu64</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>qemu32</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>phenom</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>pentium3</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>pentium2</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>pentium</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>n270</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>kvm64</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>kvm32</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>coreduo</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>core2duo</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>athlon</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>Westmere-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>Westmere</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Snowridge</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Skylake-Server</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Skylake-Client</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>SandyBridge</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>Penryn</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Opteron_G5</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Opteron_G4</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Opteron_G3</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Opteron_G2</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>Opteron_G1</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>Nehalem</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>IvyBridge</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Icelake-Server</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Haswell</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>EPYC-Rome</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>EPYC-Milan</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>EPYC</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Dhyana</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Cooperlake</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>Conroe</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Broadwell</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>486</model>
Nov 15 08:05:38 user nova-compute[95467]:     </mode>
Nov 15 08:05:38 user nova-compute[95467]:   </cpu>
Nov 15 08:05:38 user nova-compute[95467]:   <memoryBacking supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:     <enum name='sourceType'>
Nov 15 08:05:38 user nova-compute[95467]:       <value>file</value>
Nov 15 08:05:38 user nova-compute[95467]:       <value>anonymous</value>
Nov 15 08:05:38 user nova-compute[95467]:       <value>memfd</value>
Nov 15 08:05:38 user nova-compute[95467]:     </enum>
Nov 15 08:05:38 user nova-compute[95467]:   </memoryBacking>
Nov 15 08:05:38 user nova-compute[95467]:   <devices>
Nov 15 08:05:38 user nova-compute[95467]:     <disk supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='diskDevice'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>disk</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>cdrom</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>floppy</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>lun</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='bus'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>ide</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>fdc</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>scsi</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtio</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>usb</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>sata</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='model'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtio</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtio-transitional</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtio-non-transitional</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </disk>
Nov 15 08:05:38 user nova-compute[95467]:     <graphics supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='type'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>sdl</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>vnc</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>spice</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>egl-headless</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </graphics>
Nov 15 08:05:38 user nova-compute[95467]:     <video supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='modelType'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>vga</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>cirrus</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>vmvga</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>qxl</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtio</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>none</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>bochs</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>ramfb</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </video>
Nov 15 08:05:38 user nova-compute[95467]:     <hostdev supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='mode'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>subsystem</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='startupPolicy'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>default</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>mandatory</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>requisite</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>optional</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='subsysType'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>usb</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>pci</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>scsi</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='capsType'/>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='pciBackend'/>
Nov 15 08:05:38 user nova-compute[95467]:     </hostdev>
Nov 15 08:05:38 user nova-compute[95467]:     <rng supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='model'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtio</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtio-transitional</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtio-non-transitional</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='backendModel'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>random</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>egd</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>builtin</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </rng>
Nov 15 08:05:38 user nova-compute[95467]:     <filesystem supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='driverType'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>path</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>handle</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtiofs</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </filesystem>
Nov 15 08:05:38 user nova-compute[95467]:     <tpm supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='model'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>tpm-tis</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>tpm-crb</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='backendModel'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>passthrough</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>emulator</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </tpm>
Nov 15 08:05:38 user nova-compute[95467]:   </devices>
Nov 15 08:05:38 user nova-compute[95467]:   <features>
Nov 15 08:05:38 user nova-compute[95467]:     <gic supported='no'/>
Nov 15 08:05:38 user nova-compute[95467]:     <vmcoreinfo supported='yes'/>
Nov 15 08:05:38 user nova-compute[95467]:     <genid supported='yes'/>
Nov 15 08:05:38 user nova-compute[95467]:     <backingStoreInput supported='yes'/>
Nov 15 08:05:38 user nova-compute[95467]:     <backup supported='yes'/>
Nov 15 08:05:38 user nova-compute[95467]:     <sev supported='no'/>
Nov 15 08:05:38 user nova-compute[95467]:   </features>
Nov 15 08:05:38 user nova-compute[95467]: </domainCapabilities>
Nov 15 08:05:38 user nova-compute[95467]:  {{(pid=95467) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 08:05:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 15 08:05:38 user nova-compute[95467]: <domainCapabilities>
Nov 15 08:05:38 user nova-compute[95467]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 15 08:05:38 user nova-compute[95467]:   <domain>kvm</domain>
Nov 15 08:05:38 user nova-compute[95467]:   <machine>pc-q35-6.2</machine>
Nov 15 08:05:38 user nova-compute[95467]:   <arch>x86_64</arch>
Nov 15 08:05:38 user nova-compute[95467]:   <vcpu max='288'/>
Nov 15 08:05:38 user nova-compute[95467]:   <iothreads supported='yes'/>
Nov 15 08:05:38 user nova-compute[95467]:   <os supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:     <enum name='firmware'>
Nov 15 08:05:38 user nova-compute[95467]:       <value>efi</value>
Nov 15 08:05:38 user nova-compute[95467]:     </enum>
Nov 15 08:05:38 user nova-compute[95467]:     <loader supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 15 08:05:38 user nova-compute[95467]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 15 08:05:38 user nova-compute[95467]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='type'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>rom</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>pflash</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='readonly'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>yes</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>no</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='secure'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>yes</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>no</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </loader>
Nov 15 08:05:38 user nova-compute[95467]:   </os>
Nov 15 08:05:38 user nova-compute[95467]:   <cpu>
Nov 15 08:05:38 user nova-compute[95467]:     <mode name='host-passthrough' supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='hostPassthroughMigratable'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>on</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>off</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </mode>
Nov 15 08:05:38 user nova-compute[95467]:     <mode name='maximum' supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='maximumMigratable'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>on</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>off</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </mode>
Nov 15 08:05:38 user nova-compute[95467]:     <mode name='host-model' supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <vendor>Intel</vendor>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='ss'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='vmx'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='pcid'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='hypervisor'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='arat'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='umip'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='md-clear'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='stibp'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='ssbd'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='invtsc'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='ibpb'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='ibrs'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='amd-stibp'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='rsba'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='pschange-mc-no'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='disable' name='erms'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 08:05:38 user nova-compute[95467]:     </mode>
Nov 15 08:05:38 user nova-compute[95467]:     <mode name='custom' supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>qemu64</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>qemu32</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>phenom</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>pentium3</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>pentium2</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>pentium</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>n270</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>kvm64</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>kvm32</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>coreduo</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>core2duo</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>athlon</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>Westmere-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>Westmere</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Snowridge</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Skylake-Server</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Skylake-Client</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>SandyBridge</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>Penryn</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Opteron_G5</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Opteron_G4</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Opteron_G3</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Opteron_G2</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>Opteron_G1</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>Nehalem</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>IvyBridge</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Icelake-Server</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Haswell</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>EPYC-Rome</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>EPYC-Milan</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>EPYC</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Dhyana</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Cooperlake</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>Conroe</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Broadwell</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>486</model>
Nov 15 08:05:38 user nova-compute[95467]:     </mode>
Nov 15 08:05:38 user nova-compute[95467]:   </cpu>
Nov 15 08:05:38 user nova-compute[95467]:   <memoryBacking supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:     <enum name='sourceType'>
Nov 15 08:05:38 user nova-compute[95467]:       <value>file</value>
Nov 15 08:05:38 user nova-compute[95467]:       <value>anonymous</value>
Nov 15 08:05:38 user nova-compute[95467]:       <value>memfd</value>
Nov 15 08:05:38 user nova-compute[95467]:     </enum>
Nov 15 08:05:38 user nova-compute[95467]:   </memoryBacking>
Nov 15 08:05:38 user nova-compute[95467]:   <devices>
Nov 15 08:05:38 user nova-compute[95467]:     <disk supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='diskDevice'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>disk</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>cdrom</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>floppy</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>lun</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='bus'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>fdc</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>scsi</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtio</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>usb</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>sata</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='model'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtio</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtio-transitional</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtio-non-transitional</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </disk>
Nov 15 08:05:38 user nova-compute[95467]:     <graphics supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='type'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>sdl</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>vnc</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>spice</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>egl-headless</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </graphics>
Nov 15 08:05:38 user nova-compute[95467]:     <video supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='modelType'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>vga</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>cirrus</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>vmvga</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>qxl</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtio</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>none</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>bochs</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>ramfb</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </video>
Nov 15 08:05:38 user nova-compute[95467]:     <hostdev supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='mode'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>subsystem</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='startupPolicy'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>default</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>mandatory</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>requisite</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>optional</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='subsysType'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>usb</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>pci</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>scsi</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='capsType'/>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='pciBackend'/>
Nov 15 08:05:38 user nova-compute[95467]:     </hostdev>
Nov 15 08:05:38 user nova-compute[95467]:     <rng supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='model'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtio</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtio-transitional</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtio-non-transitional</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='backendModel'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>random</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>egd</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>builtin</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </rng>
Nov 15 08:05:38 user nova-compute[95467]:     <filesystem supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='driverType'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>path</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>handle</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtiofs</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </filesystem>
Nov 15 08:05:38 user nova-compute[95467]:     <tpm supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='model'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>tpm-tis</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>tpm-crb</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='backendModel'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>passthrough</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>emulator</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </tpm>
Nov 15 08:05:38 user nova-compute[95467]:   </devices>
Nov 15 08:05:38 user nova-compute[95467]:   <features>
Nov 15 08:05:38 user nova-compute[95467]:     <gic supported='no'/>
Nov 15 08:05:38 user nova-compute[95467]:     <vmcoreinfo supported='yes'/>
Nov 15 08:05:38 user nova-compute[95467]:     <genid supported='yes'/>
Nov 15 08:05:38 user nova-compute[95467]:     <backingStoreInput supported='yes'/>
Nov 15 08:05:38 user nova-compute[95467]:     <backup supported='yes'/>
Nov 15 08:05:38 user nova-compute[95467]:     <sev supported='no'/>
Nov 15 08:05:38 user nova-compute[95467]:   </features>
Nov 15 08:05:38 user nova-compute[95467]: </domainCapabilities>
Nov 15 08:05:38 user nova-compute[95467]:  {{(pid=95467) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 08:05:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 15 08:05:38 user nova-compute[95467]: <domainCapabilities>
Nov 15 08:05:38 user nova-compute[95467]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 15 08:05:38 user nova-compute[95467]:   <domain>kvm</domain>
Nov 15 08:05:38 user nova-compute[95467]:   <machine>pc-i440fx-jammy</machine>
Nov 15 08:05:38 user nova-compute[95467]:   <arch>x86_64</arch>
Nov 15 08:05:38 user nova-compute[95467]:   <vcpu max='255'/>
Nov 15 08:05:38 user nova-compute[95467]:   <iothreads supported='yes'/>
Nov 15 08:05:38 user nova-compute[95467]:   <os supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:     <enum name='firmware'>
Nov 15 08:05:38 user nova-compute[95467]:       <value>efi</value>
Nov 15 08:05:38 user nova-compute[95467]:     </enum>
Nov 15 08:05:38 user nova-compute[95467]:     <loader supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='type'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>rom</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>pflash</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='readonly'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>yes</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>no</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='secure'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>no</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </loader>
Nov 15 08:05:38 user nova-compute[95467]:   </os>
Nov 15 08:05:38 user nova-compute[95467]:   <cpu>
Nov 15 08:05:38 user nova-compute[95467]:     <mode name='host-passthrough' supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='hostPassthroughMigratable'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>on</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>off</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </mode>
Nov 15 08:05:38 user nova-compute[95467]:     <mode name='maximum' supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='maximumMigratable'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>on</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>off</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </mode>
Nov 15 08:05:38 user nova-compute[95467]:     <mode name='host-model' supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <vendor>Intel</vendor>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='ss'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='vmx'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='pcid'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='hypervisor'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='arat'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='umip'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='md-clear'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='stibp'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='ssbd'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='invtsc'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='ibpb'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='ibrs'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='amd-stibp'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='rsba'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='require' name='pschange-mc-no'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='disable' name='erms'/>
Nov 15 08:05:38 user nova-compute[95467]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 08:05:38 user nova-compute[95467]:     </mode>
Nov 15 08:05:38 user nova-compute[95467]:     <mode name='custom' supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>qemu64</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>qemu32</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>phenom</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>pentium3</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>pentium2</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>pentium</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>n270</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>kvm64</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>kvm32</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>coreduo</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>core2duo</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>athlon</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>Westmere-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>Westmere</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Snowridge</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Skylake-Server</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Skylake-Client</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>SandyBridge</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>Penryn</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Opteron_G5</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Opteron_G4</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Opteron_G3</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Opteron_G2</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>Opteron_G1</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>Nehalem</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>IvyBridge</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Icelake-Server</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Haswell</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>EPYC-Rome</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>EPYC-Milan</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>EPYC</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Dhyana</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Cooperlake</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>Conroe</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='no'>Broadwell</model>
Nov 15 08:05:38 user nova-compute[95467]:       <model usable='yes'>486</model>
Nov 15 08:05:38 user nova-compute[95467]:     </mode>
Nov 15 08:05:38 user nova-compute[95467]:   </cpu>
Nov 15 08:05:38 user nova-compute[95467]:   <memoryBacking supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:     <enum name='sourceType'>
Nov 15 08:05:38 user nova-compute[95467]:       <value>file</value>
Nov 15 08:05:38 user nova-compute[95467]:       <value>anonymous</value>
Nov 15 08:05:38 user nova-compute[95467]:       <value>memfd</value>
Nov 15 08:05:38 user nova-compute[95467]:     </enum>
Nov 15 08:05:38 user nova-compute[95467]:   </memoryBacking>
Nov 15 08:05:38 user nova-compute[95467]:   <devices>
Nov 15 08:05:38 user nova-compute[95467]:     <disk supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='diskDevice'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>disk</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>cdrom</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>floppy</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>lun</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='bus'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>ide</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>fdc</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>scsi</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtio</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>usb</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>sata</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='model'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtio</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtio-transitional</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtio-non-transitional</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </disk>
Nov 15 08:05:38 user nova-compute[95467]:     <graphics supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='type'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>sdl</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>vnc</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>spice</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>egl-headless</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </graphics>
Nov 15 08:05:38 user nova-compute[95467]:     <video supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='modelType'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>vga</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>cirrus</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>vmvga</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>qxl</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtio</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>none</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>bochs</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>ramfb</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </video>
Nov 15 08:05:38 user nova-compute[95467]:     <hostdev supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='mode'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>subsystem</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='startupPolicy'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>default</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>mandatory</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>requisite</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>optional</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='subsysType'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>usb</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>pci</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>scsi</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='capsType'/>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='pciBackend'/>
Nov 15 08:05:38 user nova-compute[95467]:     </hostdev>
Nov 15 08:05:38 user nova-compute[95467]:     <rng supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='model'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtio</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtio-transitional</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtio-non-transitional</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='backendModel'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>random</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>egd</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>builtin</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </rng>
Nov 15 08:05:38 user nova-compute[95467]:     <filesystem supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='driverType'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>path</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>handle</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>virtiofs</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </filesystem>
Nov 15 08:05:38 user nova-compute[95467]:     <tpm supported='yes'>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='model'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>tpm-tis</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>tpm-crb</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:       <enum name='backendModel'>
Nov 15 08:05:38 user nova-compute[95467]:         <value>passthrough</value>
Nov 15 08:05:38 user nova-compute[95467]:         <value>emulator</value>
Nov 15 08:05:38 user nova-compute[95467]:       </enum>
Nov 15 08:05:38 user nova-compute[95467]:     </tpm>
Nov 15 08:05:38 user nova-compute[95467]:   </devices>
Nov 15 08:05:38 user nova-compute[95467]:   <features>
Nov 15 08:05:38 user nova-compute[95467]:     <gic supported='no'/>
Nov 15 08:05:38 user nova-compute[95467]:     <vmcoreinfo supported='yes'/>
Nov 15 08:05:38 user nova-compute[95467]:     <genid supported='yes'/>
Nov 15 08:05:38 user nova-compute[95467]:     <backingStoreInput supported='yes'/>
Nov 15 08:05:38 user nova-compute[95467]:     <backup supported='yes'/>
Nov 15 08:05:38 user nova-compute[95467]:     <sev supported='no'/>
Nov 15 08:05:38 user nova-compute[95467]:   </features>
Nov 15 08:05:38 user nova-compute[95467]: </domainCapabilities>
Nov 15 08:05:38 user nova-compute[95467]:  {{(pid=95467) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 08:05:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=95467) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 08:05:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=95467) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 08:05:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=95467) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 08:05:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=95467) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 08:05:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Checking secure boot support for host arch (x86_64) {{(pid=95467) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 15 08:05:38 user nova-compute[95467]: INFO nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Secure Boot support detected
Nov 15 08:05:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] cpu compare xml: <cpu match="exact">
Nov 15 08:05:38 user nova-compute[95467]:   <model>Nehalem</model>
Nov 15 08:05:38 user nova-compute[95467]: </cpu>
Nov 15 08:05:38 user nova-compute[95467]:  {{(pid=95467) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 15 08:05:38 user nova-compute[95467]: INFO nova.virt.node [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Generated node identity f56c3524-ed11-494e-82e4-b1a23920d1ae
Nov 15 08:05:38 user nova-compute[95467]: INFO nova.virt.node [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Wrote node identity f56c3524-ed11-494e-82e4-b1a23920d1ae to /opt/stack/data/nova/compute_id
Nov 15 08:05:38 user nova-compute[95467]: WARNING nova.compute.manager [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Compute nodes ['f56c3524-ed11-494e-82e4-b1a23920d1ae'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 15 08:05:38 user nova-compute[95467]: INFO nova.compute.manager [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 15 08:05:39 user nova-compute[95467]: WARNING nova.compute.manager [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 15 08:05:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:05:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:05:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:05:39 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Auditing locally available compute resources for user (node: user) {{(pid=95467) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 08:05:39 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:05:39 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:05:39 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Hypervisor/Node resource view: name=user free_ram=11000MB free_disk=26.195301055908203GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=95467) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 08:05:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:05:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:05:39 user nova-compute[95467]: WARNING nova.compute.resource_tracker [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] No compute node record for user:f56c3524-ed11-494e-82e4-b1a23920d1ae: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host f56c3524-ed11-494e-82e4-b1a23920d1ae could not be found.
Nov 15 08:05:39 user nova-compute[95467]: INFO nova.compute.resource_tracker [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Compute node record created for user:user with uuid: f56c3524-ed11-494e-82e4-b1a23920d1ae
Nov 15 08:05:39 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 08:05:39 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 08:05:39 user nova-compute[95467]: INFO nova.scheduler.client.report [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] [req-bdca4213-642a-4f7d-b868-696f35910c16] Created resource provider record via placement API for resource provider with UUID f56c3524-ed11-494e-82e4-b1a23920d1ae and name user.
Nov 15 08:05:39 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=95467) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 15 08:05:39 user nova-compute[95467]: INFO nova.virt.libvirt.host [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] kernel doesn't support AMD SEV
Nov 15 08:05:39 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Updating inventory in ProviderTree for provider f56c3524-ed11-494e-82e4-b1a23920d1ae with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 08:05:39 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:05:39 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Libvirt baseline CPU <cpu>
Nov 15 08:05:39 user nova-compute[95467]:   <arch>x86_64</arch>
Nov 15 08:05:39 user nova-compute[95467]:   <model>Nehalem</model>
Nov 15 08:05:39 user nova-compute[95467]:   <vendor>Intel</vendor>
Nov 15 08:05:39 user nova-compute[95467]:   <topology sockets="6" cores="1" threads="1"/>
Nov 15 08:05:39 user nova-compute[95467]: </cpu>
Nov 15 08:05:39 user nova-compute[95467]:  {{(pid=95467) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 15 08:05:39 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Updated inventory for provider f56c3524-ed11-494e-82e4-b1a23920d1ae with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 15 08:05:39 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Updating resource provider f56c3524-ed11-494e-82e4-b1a23920d1ae generation from 0 to 1 during operation: update_inventory {{(pid=95467) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 15 08:05:39 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Updating inventory in ProviderTree for provider f56c3524-ed11-494e-82e4-b1a23920d1ae with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 08:05:39 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Updating resource provider f56c3524-ed11-494e-82e4-b1a23920d1ae generation from 1 to 2 during operation: update_traits {{(pid=95467) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 15 08:05:39 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Compute_service record updated for user:user {{(pid=95467) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 08:05:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.633s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:05:39 user nova-compute[95467]: DEBUG nova.service [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Creating RPC server for service compute {{(pid=95467) start /opt/stack/nova/nova/service.py:182}}
Nov 15 08:05:39 user nova-compute[95467]: DEBUG nova.service [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] Join ServiceGroup membership for this service compute {{(pid=95467) start /opt/stack/nova/nova/service.py:199}}
Nov 15 08:05:39 user nova-compute[95467]: DEBUG nova.servicegroup.drivers.db [None req-a08e10f4-88e1-4430-97a1-c374ecfa146e None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=95467) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 15 08:06:14 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._sync_power_states {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:06:15 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:06:30 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:06:30 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:06:30 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Starting heal instance info cache {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 08:06:30 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Rebuilding the list of instances to heal {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 08:06:30 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Didn't find any instances for network info cache update. {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 08:06:30 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:06:30 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:06:30 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:06:30 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:06:30 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:06:30 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:06:30 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=95467) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 08:06:30 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager.update_available_resource {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:06:30 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:06:30 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:06:30 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:06:30 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Auditing locally available compute resources for user (node: user) {{(pid=95467) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 08:06:30 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:06:30 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:06:30 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Hypervisor/Node resource view: name=user free_ram=10455MB free_disk=26.106979370117188GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=95467) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 08:06:30 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:06:30 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:06:31 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 08:06:31 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 08:06:31 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:06:31 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:06:31 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Compute_service record updated for user:user {{(pid=95467) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 08:06:31 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.133s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:07:31 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:07:31 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:07:31 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:07:31 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:07:31 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:07:31 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:07:31 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=95467) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 08:07:31 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager.update_available_resource {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:07:31 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:07:31 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:07:31 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:07:31 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Auditing locally available compute resources for user (node: user) {{(pid=95467) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 08:07:31 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:07:31 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:07:31 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Hypervisor/Node resource view: name=user free_ram=10377MB free_disk=26.17135238647461GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=95467) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 08:07:31 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:07:31 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:07:32 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 08:07:32 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 08:07:32 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:07:32 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:07:32 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Compute_service record updated for user:user {{(pid=95467) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 08:07:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.134s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:07:33 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:07:33 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:07:33 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Starting heal instance info cache {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 08:07:33 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Rebuilding the list of instances to heal {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 08:07:33 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Didn't find any instances for network info cache update. {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 08:07:33 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:08:31 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:08:32 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:08:32 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:08:32 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=95467) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 08:08:32 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager.update_available_resource {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:08:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:08:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:08:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:08:32 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Auditing locally available compute resources for user (node: user) {{(pid=95467) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 08:08:32 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:08:32 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:08:32 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Hypervisor/Node resource view: name=user free_ram=10350MB free_disk=25.92605972290039GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=95467) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 08:08:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:08:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:08:32 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 08:08:32 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 08:08:33 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:08:33 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:08:33 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Compute_service record updated for user:user {{(pid=95467) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 08:08:33 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.148s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:08:34 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:08:34 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:08:34 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:08:34 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:08:34 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Starting heal instance info cache {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 08:08:34 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Rebuilding the list of instances to heal {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 08:08:34 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Didn't find any instances for network info cache update. {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 08:08:34 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:09:32 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:09:32 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=95467) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 08:09:33 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:09:33 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:09:33 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:09:34 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:09:34 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager.update_available_resource {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:09:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:09:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:09:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:09:34 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Auditing locally available compute resources for user (node: user) {{(pid=95467) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 08:09:34 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:09:34 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:09:34 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Hypervisor/Node resource view: name=user free_ram=9713MB free_disk=25.945335388183594GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=95467) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 08:09:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:09:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:09:35 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 08:09:35 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 08:09:35 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:09:35 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:09:35 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Compute_service record updated for user:user {{(pid=95467) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 08:09:35 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.163s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:09:36 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:09:36 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:09:36 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Starting heal instance info cache {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 08:09:36 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Rebuilding the list of instances to heal {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 08:09:36 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Didn't find any instances for network info cache update. {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 08:09:36 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:09:36 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:09:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Acquiring lock "ee2aa477-6786-483a-b088-d8ec204fe6aa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:09:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Lock "ee2aa477-6786-483a-b088-d8ec204fe6aa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:09:44 user nova-compute[95467]: DEBUG nova.compute.manager [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: ee2aa477-6786-483a-b088-d8ec204fe6aa] Starting instance... {{(pid=95467) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 08:09:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:09:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:09:44 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=95467) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 08:09:44 user nova-compute[95467]: INFO nova.compute.claims [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: ee2aa477-6786-483a-b088-d8ec204fe6aa] Claim successful on node user
Nov 15 08:09:44 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:09:45 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:09:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.427s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:09:45 user nova-compute[95467]: DEBUG nova.compute.manager [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: ee2aa477-6786-483a-b088-d8ec204fe6aa] Start building networks asynchronously for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 08:09:45 user nova-compute[95467]: DEBUG nova.compute.manager [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: ee2aa477-6786-483a-b088-d8ec204fe6aa] Allocating IP information in the background. {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 08:09:45 user nova-compute[95467]: DEBUG nova.network.neutron [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: ee2aa477-6786-483a-b088-d8ec204fe6aa] allocate_for_instance() {{(pid=95467) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 08:09:45 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: ee2aa477-6786-483a-b088-d8ec204fe6aa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 08:09:45 user nova-compute[95467]: DEBUG nova.compute.manager [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: ee2aa477-6786-483a-b088-d8ec204fe6aa] Start building block device mappings for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 08:09:45 user nova-compute[95467]: DEBUG nova.compute.manager [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: ee2aa477-6786-483a-b088-d8ec204fe6aa] Start spawning the instance on the hypervisor. {{(pid=95467) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 08:09:45 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: ee2aa477-6786-483a-b088-d8ec204fe6aa] Creating instance directory {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 08:09:45 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: ee2aa477-6786-483a-b088-d8ec204fe6aa] Creating image(s)
Nov 15 08:09:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Acquiring lock "/opt/stack/data/nova/instances/ee2aa477-6786-483a-b088-d8ec204fe6aa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:09:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Lock "/opt/stack/data/nova/instances/ee2aa477-6786-483a-b088-d8ec204fe6aa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:09:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Lock "/opt/stack/data/nova/instances/ee2aa477-6786-483a-b088-d8ec204fe6aa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:09:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Acquiring lock "a3fcf60225fcefd310404971cd18ab9851c548dc" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:09:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:09:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc.part --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:09:46 user nova-compute[95467]: DEBUG nova.policy [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1b2841a0788845f79ea0fccef74eda25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1312e86f799549eb8adb4c846576262c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95467) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 08:09:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc.part --force-share --output=json" returned: 0 in 0.172s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:09:46 user nova-compute[95467]: DEBUG nova.virt.images [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] ed9c48aa-ce73-4b3b-9db1-235898be671b was qcow2, converting to raw {{(pid=95467) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 08:09:46 user nova-compute[95467]: DEBUG nova.privsep.utils [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=95467) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 08:09:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc.part /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc.converted {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:09:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc.part /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc.converted" returned: 0 in 0.373s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:09:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc.converted --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:09:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc.converted --force-share --output=json" returned: 0 in 0.157s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:09:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.507s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:09:46 user nova-compute[95467]: INFO oslo.privsep.daemon [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmputz8ukt4/privsep.sock']
Nov 15 08:09:46 user sudo[104734]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmputz8ukt4/privsep.sock
Nov 15 08:09:46 user sudo[104734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 15 08:09:48 user nova-compute[95467]: DEBUG nova.network.neutron [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: ee2aa477-6786-483a-b088-d8ec204fe6aa] Successfully created port: 5e362799-1ab1-48d5-9ef2-1a90ce83cd80 {{(pid=95467) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 08:09:48 user sudo[104734]: pam_unix(sudo:session): session closed for user root
Nov 15 08:09:48 user nova-compute[95467]: INFO oslo.privsep.daemon [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Spawned new privsep daemon via rootwrap
Nov 15 08:09:48 user nova-compute[95467]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 15 08:09:48 user nova-compute[95467]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 15 08:09:48 user nova-compute[95467]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 15 08:09:48 user nova-compute[95467]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 104746
Nov 15 08:09:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Acquiring lock "b9210bbe-e728-4724-924b-1963226c092d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:09:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Lock "b9210bbe-e728-4724-924b-1963226c092d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:09:48 user nova-compute[95467]: DEBUG nova.compute.manager [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] [instance: b9210bbe-e728-4724-924b-1963226c092d] Starting instance... {{(pid=95467) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 08:09:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:09:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:09:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:09:48 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=95467) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 08:09:48 user nova-compute[95467]: INFO nova.compute.claims [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] [instance: b9210bbe-e728-4724-924b-1963226c092d] Claim successful on node user
Nov 15 08:09:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.151s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:09:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Acquiring lock "a3fcf60225fcefd310404971cd18ab9851c548dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:09:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:09:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:09:48 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:09:48 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:09:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.193s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:09:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/ee2aa477-6786-483a-b088-d8ec204fe6aa/disk 1073741824 {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:09:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/ee2aa477-6786-483a-b088-d8ec204fe6aa/disk 1073741824" returned: 0 in 0.118s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:09:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.314s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:09:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:09:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.404s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:09:48 user nova-compute[95467]: DEBUG nova.compute.manager [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] [instance: b9210bbe-e728-4724-924b-1963226c092d] Start building networks asynchronously for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 08:09:49 user nova-compute[95467]: DEBUG nova.compute.manager [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] [instance: b9210bbe-e728-4724-924b-1963226c092d] Allocating IP information in the background. {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 08:09:49 user nova-compute[95467]: DEBUG nova.network.neutron [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] [instance: b9210bbe-e728-4724-924b-1963226c092d] allocate_for_instance() {{(pid=95467) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 08:09:49 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] [instance: b9210bbe-e728-4724-924b-1963226c092d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 08:09:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.188s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:09:49 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ee2aa477-6786-483a-b088-d8ec204fe6aa/disk. size=1073741824 {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 08:09:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2aa477-6786-483a-b088-d8ec204fe6aa/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:09:49 user nova-compute[95467]: DEBUG nova.compute.manager [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] [instance: b9210bbe-e728-4724-924b-1963226c092d] Start building block device mappings for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 08:09:49 user nova-compute[95467]: DEBUG nova.compute.manager [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] [instance: b9210bbe-e728-4724-924b-1963226c092d] Start spawning the instance on the hypervisor. {{(pid=95467) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 08:09:49 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] [instance: b9210bbe-e728-4724-924b-1963226c092d] Creating instance directory {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 08:09:49 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] [instance: b9210bbe-e728-4724-924b-1963226c092d] Creating image(s)
Nov 15 08:09:49 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Acquiring lock "/opt/stack/data/nova/instances/b9210bbe-e728-4724-924b-1963226c092d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:09:49 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Lock "/opt/stack/data/nova/instances/b9210bbe-e728-4724-924b-1963226c092d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:09:49 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Lock "/opt/stack/data/nova/instances/b9210bbe-e728-4724-924b-1963226c092d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:09:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2aa477-6786-483a-b088-d8ec204fe6aa/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:09:49 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Cannot resize image /opt/stack/data/nova/instances/ee2aa477-6786-483a-b088-d8ec204fe6aa/disk to a smaller size. {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 08:09:49 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: ee2aa477-6786-483a-b088-d8ec204fe6aa] Created local disks {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 08:09:49 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: ee2aa477-6786-483a-b088-d8ec204fe6aa] Ensure instance console log exists: /opt/stack/data/nova/instances/ee2aa477-6786-483a-b088-d8ec204fe6aa/console.log {{(pid=95467) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 08:09:49 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:09:49 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:09:49 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:09:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:09:49 user nova-compute[95467]: DEBUG nova.policy [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd669a1577f0446dd8ceea49ed89b0bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0f20d51854422c86b85377dd75f96d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95467) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 08:09:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.166s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:09:49 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Acquiring lock "a3fcf60225fcefd310404971cd18ab9851c548dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:09:49 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:09:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:09:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.176s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:09:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/b9210bbe-e728-4724-924b-1963226c092d/disk 1073741824 {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:09:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/b9210bbe-e728-4724-924b-1963226c092d/disk 1073741824" returned: 0 in 0.041s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:09:49 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.221s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:09:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:09:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.178s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:09:49 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b9210bbe-e728-4724-924b-1963226c092d/disk. size=1073741824 {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 08:09:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9210bbe-e728-4724-924b-1963226c092d/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:09:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9210bbe-e728-4724-924b-1963226c092d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:09:50 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Cannot resize image /opt/stack/data/nova/instances/b9210bbe-e728-4724-924b-1963226c092d/disk to a smaller size. {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 08:09:50 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] [instance: b9210bbe-e728-4724-924b-1963226c092d] Created local disks {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 08:09:50 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] [instance: b9210bbe-e728-4724-924b-1963226c092d] Ensure instance console log exists: /opt/stack/data/nova/instances/b9210bbe-e728-4724-924b-1963226c092d/console.log {{(pid=95467) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 08:09:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:09:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:09:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:09:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Acquiring lock "5748cf5d-9c57-4477-8952-ec39d0d18f55" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:09:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "5748cf5d-9c57-4477-8952-ec39d0d18f55" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:09:50 user nova-compute[95467]: DEBUG nova.compute.manager [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] Starting instance... {{(pid=95467) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 08:09:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:09:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:09:50 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=95467) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 08:09:50 user nova-compute[95467]: INFO nova.compute.claims [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] Claim successful on node user
Nov 15 08:09:50 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:09:50 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:09:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.279s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:09:50 user nova-compute[95467]: DEBUG nova.compute.manager [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] Start building networks asynchronously for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 08:09:51 user nova-compute[95467]: DEBUG nova.compute.manager [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] Allocating IP information in the background. {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 08:09:51 user nova-compute[95467]: DEBUG nova.network.neutron [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] allocate_for_instance() {{(pid=95467) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 08:09:51 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 08:09:51 user nova-compute[95467]: DEBUG nova.compute.manager [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] Start building block device mappings for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 08:09:51 user nova-compute[95467]: DEBUG nova.compute.manager [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] Start spawning the instance on the hypervisor. {{(pid=95467) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 08:09:51 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] Creating instance directory {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 08:09:51 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] Creating image(s)
Nov 15 08:09:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Acquiring lock "/opt/stack/data/nova/instances/5748cf5d-9c57-4477-8952-ec39d0d18f55/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:09:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "/opt/stack/data/nova/instances/5748cf5d-9c57-4477-8952-ec39d0d18f55/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:09:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "/opt/stack/data/nova/instances/5748cf5d-9c57-4477-8952-ec39d0d18f55/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:09:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:09:51 user nova-compute[95467]: DEBUG nova.policy [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'acce273b07b64e44af6e062175afa92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e2fec6a90a41a5a586c6da227caacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95467) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 08:09:51 user nova-compute[95467]: DEBUG nova.network.neutron [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] [instance: b9210bbe-e728-4724-924b-1963226c092d] Successfully created port: 9599d4c0-f08b-4498-9c9a-119d83caa185 {{(pid=95467) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 08:09:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.188s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:09:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Acquiring lock "a3fcf60225fcefd310404971cd18ab9851c548dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:09:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:09:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:09:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.170s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:09:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/5748cf5d-9c57-4477-8952-ec39d0d18f55/disk 1073741824 {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:09:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/5748cf5d-9c57-4477-8952-ec39d0d18f55/disk 1073741824" returned: 0 in 0.047s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:09:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:09:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:09:51 user nova-compute[95467]: DEBUG nova.network.neutron [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: ee2aa477-6786-483a-b088-d8ec204fe6aa] Successfully updated port: 5e362799-1ab1-48d5-9ef2-1a90ce83cd80 {{(pid=95467) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 08:09:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Acquiring lock "refresh_cache-ee2aa477-6786-483a-b088-d8ec204fe6aa" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:09:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Acquired lock "refresh_cache-ee2aa477-6786-483a-b088-d8ec204fe6aa" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:09:51 user nova-compute[95467]: DEBUG nova.network.neutron [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: ee2aa477-6786-483a-b088-d8ec204fe6aa] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:09:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.164s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:09:51 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5748cf5d-9c57-4477-8952-ec39d0d18f55/disk. size=1073741824 {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 08:09:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5748cf5d-9c57-4477-8952-ec39d0d18f55/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:09:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Acquiring lock "73fe8852-c47a-47ab-a56f-6864c8ed5479" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:09:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "73fe8852-c47a-47ab-a56f-6864c8ed5479" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:09:51 user nova-compute[95467]: DEBUG nova.compute.manager [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] Starting instance... {{(pid=95467) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 08:09:51 user nova-compute[95467]: DEBUG nova.network.neutron [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: ee2aa477-6786-483a-b088-d8ec204fe6aa] Instance cache missing network info. {{(pid=95467) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 08:09:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5748cf5d-9c57-4477-8952-ec39d0d18f55/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:09:51 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Cannot resize image /opt/stack/data/nova/instances/5748cf5d-9c57-4477-8952-ec39d0d18f55/disk to a smaller size. {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 08:09:51 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] Created local disks {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 08:09:51 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] Ensure instance console log exists: /opt/stack/data/nova/instances/5748cf5d-9c57-4477-8952-ec39d0d18f55/console.log {{(pid=95467) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 08:09:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:09:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:09:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:09:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:09:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:09:52 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=95467) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 08:09:52 user nova-compute[95467]: INFO nova.compute.claims [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] Claim successful on node user
Nov 15 08:09:52 user nova-compute[95467]: DEBUG nova.compute.manager [req-4415e678-197f-4835-8cab-f1a37c04571e req-e29f3892-121d-4a7c-99ad-07ffc6f96eb5 service nova] [instance: ee2aa477-6786-483a-b088-d8ec204fe6aa] Received event network-changed-5e362799-1ab1-48d5-9ef2-1a90ce83cd80 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:09:52 user nova-compute[95467]: DEBUG nova.compute.manager [req-4415e678-197f-4835-8cab-f1a37c04571e req-e29f3892-121d-4a7c-99ad-07ffc6f96eb5 service nova] [instance: ee2aa477-6786-483a-b088-d8ec204fe6aa] Refreshing instance network info cache due to event network-changed-5e362799-1ab1-48d5-9ef2-1a90ce83cd80. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:09:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-4415e678-197f-4835-8cab-f1a37c04571e req-e29f3892-121d-4a7c-99ad-07ffc6f96eb5 service nova] Acquiring lock "refresh_cache-ee2aa477-6786-483a-b088-d8ec204fe6aa" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:09:52 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:09:52 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:09:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.348s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:09:52 user nova-compute[95467]: DEBUG nova.compute.manager [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] Start building networks asynchronously for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 08:09:52 user nova-compute[95467]: DEBUG nova.compute.manager [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] Allocating IP information in the background. {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 08:09:52 user nova-compute[95467]: DEBUG nova.network.neutron [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] allocate_for_instance() {{(pid=95467) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 08:09:52 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 08:09:52 user nova-compute[95467]: DEBUG nova.compute.manager [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] Start building block device mappings for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 08:09:52 user nova-compute[95467]: DEBUG nova.compute.manager [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] Start spawning the instance on the hypervisor. {{(pid=95467) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 08:09:52 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] Creating instance directory {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 08:09:52 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] Creating image(s)
Nov 15 08:09:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Acquiring lock "/opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:09:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "/opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:09:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "/opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:09:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.226s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Acquiring lock "a3fcf60225fcefd310404971cd18ab9851c548dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG nova.network.neutron [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: ee2aa477-6786-483a-b088-d8ec204fe6aa] Updating instance_info_cache with network_info: [{"id": "5e362799-1ab1-48d5-9ef2-1a90ce83cd80", "address": "fa:16:3e:2e:62:d2", "network": {"id": "9fc550b3-b517-4f14-93cd-f1c2866d1b29", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1976605572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1312e86f799549eb8adb4c846576262c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e362799-1a", "ovs_interfaceid": "5e362799-1ab1-48d5-9ef2-1a90ce83cd80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG nova.network.neutron [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] [instance: b9210bbe-e728-4724-924b-1963226c092d] Successfully updated port: 9599d4c0-f08b-4498-9c9a-119d83caa185 {{(pid=95467) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG nova.policy [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2d9b34339b404facac21f500f40b1686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a1aa4f562c64545a94157d4aaf8d14e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95467) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Acquiring lock "refresh_cache-b9210bbe-e728-4724-924b-1963226c092d" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Acquired lock "refresh_cache-b9210bbe-e728-4724-924b-1963226c092d" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG nova.network.neutron [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] [instance: b9210bbe-e728-4724-924b-1963226c092d] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Releasing lock "refresh_cache-ee2aa477-6786-483a-b088-d8ec204fe6aa" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG nova.compute.manager [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: ee2aa477-6786-483a-b088-d8ec204fe6aa] Instance network_info: |[{"id": "5e362799-1ab1-48d5-9ef2-1a90ce83cd80", "address": "fa:16:3e:2e:62:d2", "network": {"id": "9fc550b3-b517-4f14-93cd-f1c2866d1b29", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1976605572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1312e86f799549eb8adb4c846576262c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e362799-1a", "ovs_interfaceid": "5e362799-1ab1-48d5-9ef2-1a90ce83cd80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-4415e678-197f-4835-8cab-f1a37c04571e req-e29f3892-121d-4a7c-99ad-07ffc6f96eb5 service nova] Acquired lock "refresh_cache-ee2aa477-6786-483a-b088-d8ec204fe6aa" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG nova.network.neutron [req-4415e678-197f-4835-8cab-f1a37c04571e req-e29f3892-121d-4a7c-99ad-07ffc6f96eb5 service nova] [instance: ee2aa477-6786-483a-b088-d8ec204fe6aa] Refreshing network info cache for port 5e362799-1ab1-48d5-9ef2-1a90ce83cd80 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: ee2aa477-6786-483a-b088-d8ec204fe6aa] Start _get_guest_xml network_info=[{"id": "5e362799-1ab1-48d5-9ef2-1a90ce83cd80", "address": "fa:16:3e:2e:62:d2", "network": {"id": "9fc550b3-b517-4f14-93cd-f1c2866d1b29", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1976605572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1312e86f799549eb8adb4c846576262c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e362799-1a", "ovs_interfaceid": "5e362799-1ab1-48d5-9ef2-1a90ce83cd80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'ed9c48aa-ce73-4b3b-9db1-235898be671b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:09:53 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:09:53 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:09:53 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG nova.privsep.utils [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=95467) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:09:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-631948657',display_name='tempest-ServersNegativeTestJSON-server-631948657',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-631948657',id=1,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1312e86f799549eb8adb4c846576262c',ramdisk_id='',reservation_id='r-6au0mqkc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-146474397',owner_user_name='tempest-ServersNegativeTestJSON-146474397-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:09:45Z,user_data=None,user_id='1b2841a0788845f79ea0fccef74eda25',uuid=ee2aa477-6786-483a-b088-d8ec204fe6aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e362799-1ab1-48d5-9ef2-1a90ce83cd80", "address": "fa:16:3e:2e:62:d2", "network": {"id": "9fc550b3-b517-4f14-93cd-f1c2866d1b29", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1976605572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1312e86f799549eb8adb4c846576262c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e362799-1a", "ovs_interfaceid": "5e362799-1ab1-48d5-9ef2-1a90ce83cd80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Converting VIF {"id": "5e362799-1ab1-48d5-9ef2-1a90ce83cd80", "address": "fa:16:3e:2e:62:d2", "network": {"id": "9fc550b3-b517-4f14-93cd-f1c2866d1b29", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1976605572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1312e86f799549eb8adb4c846576262c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e362799-1a", "ovs_interfaceid": "5e362799-1ab1-48d5-9ef2-1a90ce83cd80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:62:d2,bridge_name='br-int',has_traffic_filtering=True,id=5e362799-1ab1-48d5-9ef2-1a90ce83cd80,network=Network(9fc550b3-b517-4f14-93cd-f1c2866d1b29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e362799-1a') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG nova.objects.instance [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Lazy-loading 'pci_devices' on Instance uuid ee2aa477-6786-483a-b088-d8ec204fe6aa {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.176s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk 1073741824 {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: ee2aa477-6786-483a-b088-d8ec204fe6aa] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:09:53 user nova-compute[95467]:   <uuid>ee2aa477-6786-483a-b088-d8ec204fe6aa</uuid>
Nov 15 08:09:53 user nova-compute[95467]:   <name>instance-00000001</name>
Nov 15 08:09:53 user nova-compute[95467]:   <memory>524288</memory>
Nov 15 08:09:53 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:09:53 user nova-compute[95467]:   <metadata>
Nov 15 08:09:53 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:09:53 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:09:53 user nova-compute[95467]:       <nova:name>tempest-ServersNegativeTestJSON-server-631948657</nova:name>
Nov 15 08:09:53 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:09:53</nova:creationTime>
Nov 15 08:09:53 user nova-compute[95467]:       <nova:flavor name="m1.tiny">
Nov 15 08:09:53 user nova-compute[95467]:         <nova:memory>512</nova:memory>
Nov 15 08:09:53 user nova-compute[95467]:         <nova:disk>1</nova:disk>
Nov 15 08:09:53 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:09:53 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:09:53 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:09:53 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:09:53 user nova-compute[95467]:       <nova:owner>
Nov 15 08:09:53 user nova-compute[95467]:         <nova:user uuid="1b2841a0788845f79ea0fccef74eda25">tempest-ServersNegativeTestJSON-146474397-project-member</nova:user>
Nov 15 08:09:53 user nova-compute[95467]:         <nova:project uuid="1312e86f799549eb8adb4c846576262c">tempest-ServersNegativeTestJSON-146474397</nova:project>
Nov 15 08:09:53 user nova-compute[95467]:       </nova:owner>
Nov 15 08:09:53 user nova-compute[95467]:       <nova:root type="image" uuid="ed9c48aa-ce73-4b3b-9db1-235898be671b"/>
Nov 15 08:09:53 user nova-compute[95467]:       <nova:ports>
Nov 15 08:09:53 user nova-compute[95467]:         <nova:port uuid="5e362799-1ab1-48d5-9ef2-1a90ce83cd80">
Nov 15 08:09:53 user nova-compute[95467]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 08:09:53 user nova-compute[95467]:         </nova:port>
Nov 15 08:09:53 user nova-compute[95467]:       </nova:ports>
Nov 15 08:09:53 user nova-compute[95467]:     </nova:instance>
Nov 15 08:09:53 user nova-compute[95467]:   </metadata>
Nov 15 08:09:53 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:09:53 user nova-compute[95467]:     <system>
Nov 15 08:09:53 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:09:53 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:09:53 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:09:53 user nova-compute[95467]:       <entry name="serial">ee2aa477-6786-483a-b088-d8ec204fe6aa</entry>
Nov 15 08:09:53 user nova-compute[95467]:       <entry name="uuid">ee2aa477-6786-483a-b088-d8ec204fe6aa</entry>
Nov 15 08:09:53 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:09:53 user nova-compute[95467]:     </system>
Nov 15 08:09:53 user nova-compute[95467]:   </sysinfo>
Nov 15 08:09:53 user nova-compute[95467]:   <os>
Nov 15 08:09:53 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:09:53 user nova-compute[95467]:     <boot dev="hd"/>
Nov 15 08:09:53 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:09:53 user nova-compute[95467]:   </os>
Nov 15 08:09:53 user nova-compute[95467]:   <features>
Nov 15 08:09:53 user nova-compute[95467]:     <acpi/>
Nov 15 08:09:53 user nova-compute[95467]:     <apic/>
Nov 15 08:09:53 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:09:53 user nova-compute[95467]:   </features>
Nov 15 08:09:53 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:09:53 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:09:53 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:09:53 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:09:53 user nova-compute[95467]:   </clock>
Nov 15 08:09:53 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:09:53 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:09:53 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:09:53 user nova-compute[95467]:   </cpu>
Nov 15 08:09:53 user nova-compute[95467]:   <devices>
Nov 15 08:09:53 user nova-compute[95467]:     <disk type="file" device="disk">
Nov 15 08:09:53 user nova-compute[95467]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 08:09:53 user nova-compute[95467]:       <source file="/opt/stack/data/nova/instances/ee2aa477-6786-483a-b088-d8ec204fe6aa/disk"/>
Nov 15 08:09:53 user nova-compute[95467]:       <target dev="vda" bus="virtio"/>
Nov 15 08:09:53 user nova-compute[95467]:     </disk>
Nov 15 08:09:53 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:09:53 user nova-compute[95467]:       <mac address="fa:16:3e:2e:62:d2"/>
Nov 15 08:09:53 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:09:53 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:09:53 user nova-compute[95467]:       <target dev="tap5e362799-1a"/>
Nov 15 08:09:53 user nova-compute[95467]:     </interface>
Nov 15 08:09:53 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:09:53 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/ee2aa477-6786-483a-b088-d8ec204fe6aa/console.log" append="off"/>
Nov 15 08:09:53 user nova-compute[95467]:     </serial>
Nov 15 08:09:53 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:09:53 user nova-compute[95467]:     <video>
Nov 15 08:09:53 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:09:53 user nova-compute[95467]:     </video>
Nov 15 08:09:53 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:09:53 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:09:53 user nova-compute[95467]:     </rng>
Nov 15 08:09:53 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:09:53 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:09:53 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:09:53 user nova-compute[95467]:     </memballoon>
Nov 15 08:09:53 user nova-compute[95467]:   </devices>
Nov 15 08:09:53 user nova-compute[95467]: </domain>
Nov 15 08:09:53 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:09:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-631948657',display_name='tempest-ServersNegativeTestJSON-server-631948657',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-631948657',id=1,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1312e86f799549eb8adb4c846576262c',ramdisk_id='',reservation_id='r-6au0mqkc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-146474397',owner_user_name='tempest-ServersNegativeTestJSON-146474397-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:09:45Z,user_data=None,user_id='1b2841a0788845f79ea0fccef74eda25',uuid=ee2aa477-6786-483a-b088-d8ec204fe6aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e362799-1ab1-48d5-9ef2-1a90ce83cd80", "address": "fa:16:3e:2e:62:d2", "network": {"id": "9fc550b3-b517-4f14-93cd-f1c2866d1b29", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1976605572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1312e86f799549eb8adb4c846576262c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e362799-1a", "ovs_interfaceid": "5e362799-1ab1-48d5-9ef2-1a90ce83cd80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Converting VIF {"id": "5e362799-1ab1-48d5-9ef2-1a90ce83cd80", "address": "fa:16:3e:2e:62:d2", "network": {"id": "9fc550b3-b517-4f14-93cd-f1c2866d1b29", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1976605572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1312e86f799549eb8adb4c846576262c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e362799-1a", "ovs_interfaceid": "5e362799-1ab1-48d5-9ef2-1a90ce83cd80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:62:d2,bridge_name='br-int',has_traffic_filtering=True,id=5e362799-1ab1-48d5-9ef2-1a90ce83cd80,network=Network(9fc550b3-b517-4f14-93cd-f1c2866d1b29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e362799-1a') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG os_vif [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:62:d2,bridge_name='br-int',has_traffic_filtering=True,id=5e362799-1ab1-48d5-9ef2-1a90ce83cd80,network=Network(9fc550b3-b517-4f14-93cd-f1c2866d1b29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e362799-1a') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG nova.network.neutron [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] [instance: b9210bbe-e728-4724-924b-1963226c092d] Instance cache missing network info. {{(pid=95467) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Created schema index Interface.name {{(pid=95467) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Created schema index Port.name {{(pid=95467) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Created schema index Bridge.name {{(pid=95467) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk 1073741824" returned: 0 in 0.178s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.359s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [POLLOUT] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG nova.compute.manager [req-5a52681f-e3dd-46bb-bfd1-87f3ae11848b req-2d5cb150-af3c-4516-b67d-2c8a00f16874 service nova] [instance: b9210bbe-e728-4724-924b-1963226c092d] Received event network-changed-9599d4c0-f08b-4498-9c9a-119d83caa185 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG nova.compute.manager [req-5a52681f-e3dd-46bb-bfd1-87f3ae11848b req-2d5cb150-af3c-4516-b67d-2c8a00f16874 service nova] [instance: b9210bbe-e728-4724-924b-1963226c092d] Refreshing instance network info cache due to event network-changed-9599d4c0-f08b-4498-9c9a-119d83caa185. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-5a52681f-e3dd-46bb-bfd1-87f3ae11848b req-2d5cb150-af3c-4516-b67d-2c8a00f16874 service nova] Acquiring lock "refresh_cache-b9210bbe-e728-4724-924b-1963226c092d" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a520018b-ef10-505a-924f-d40a4fd1c871', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:09:53 user nova-compute[95467]: INFO oslo.privsep.daemon [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpymn0o3zc/privsep.sock']
Nov 15 08:09:53 user sudo[104829]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpymn0o3zc/privsep.sock
Nov 15 08:09:53 user sudo[104829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 15 08:09:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.179s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Checking if we can resize image /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk. size=1073741824 {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Cannot resize image /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk to a smaller size. {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] Created local disks {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] Ensure instance console log exists: /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/console.log {{(pid=95467) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:09:53 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:09:54 user nova-compute[95467]: DEBUG nova.network.neutron [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] [instance: b9210bbe-e728-4724-924b-1963226c092d] Updating instance_info_cache with network_info: [{"id": "9599d4c0-f08b-4498-9c9a-119d83caa185", "address": "fa:16:3e:35:33:4d", "network": {"id": "0a2ee949-f9ab-4b7b-a4da-f9f9cc4da5c5", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1737037548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb0f20d51854422c86b85377dd75f96d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9599d4c0-f0", "ovs_interfaceid": "9599d4c0-f08b-4498-9c9a-119d83caa185", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:09:54 user nova-compute[95467]: DEBUG nova.network.neutron [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] Successfully created port: 015c421f-8bfc-4576-a9cc-bf990e3803ab {{(pid=95467) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 08:09:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Releasing lock "refresh_cache-b9210bbe-e728-4724-924b-1963226c092d" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:09:54 user nova-compute[95467]: DEBUG nova.compute.manager [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] [instance: b9210bbe-e728-4724-924b-1963226c092d] Instance network_info: |[{"id": "9599d4c0-f08b-4498-9c9a-119d83caa185", "address": "fa:16:3e:35:33:4d", "network": {"id": "0a2ee949-f9ab-4b7b-a4da-f9f9cc4da5c5", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1737037548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb0f20d51854422c86b85377dd75f96d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9599d4c0-f0", "ovs_interfaceid": "9599d4c0-f08b-4498-9c9a-119d83caa185", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 08:09:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-5a52681f-e3dd-46bb-bfd1-87f3ae11848b req-2d5cb150-af3c-4516-b67d-2c8a00f16874 service nova] Acquired lock "refresh_cache-b9210bbe-e728-4724-924b-1963226c092d" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:09:54 user nova-compute[95467]: DEBUG nova.network.neutron [req-5a52681f-e3dd-46bb-bfd1-87f3ae11848b req-2d5cb150-af3c-4516-b67d-2c8a00f16874 service nova] [instance: b9210bbe-e728-4724-924b-1963226c092d] Refreshing network info cache for port 9599d4c0-f08b-4498-9c9a-119d83caa185 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:09:54 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] [instance: b9210bbe-e728-4724-924b-1963226c092d] Start _get_guest_xml network_info=[{"id": "9599d4c0-f08b-4498-9c9a-119d83caa185", "address": "fa:16:3e:35:33:4d", "network": {"id": "0a2ee949-f9ab-4b7b-a4da-f9f9cc4da5c5", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1737037548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb0f20d51854422c86b85377dd75f96d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9599d4c0-f0", "ovs_interfaceid": "9599d4c0-f08b-4498-9c9a-119d83caa185", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'ed9c48aa-ce73-4b3b-9db1-235898be671b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:09:54 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:09:54 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:09:54 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:09:54 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:09:54 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:09:54 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:09:54 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:09:54 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:09:54 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:09:54 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:09:54 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:09:54 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:09:54 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:09:54 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:09:54 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:09:54 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:09:54 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:09:54 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:09:54 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:09:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-626150831',display_name='tempest-DeleteServersTestJSON-server-626150831',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-626150831',id=2,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb0f20d51854422c86b85377dd75f96d',ramdisk_id='',reservation_id='r-c5o0lhis',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-962386278',owner_user_name='tempest-DeleteServersTestJSON-962386278-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:09:49Z,user_data=None,user_id='d669a1577f0446dd8ceea49ed89b0bf1',uuid=b9210bbe-e728-4724-924b-1963226c092d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9599d4c0-f08b-4498-9c9a-119d83caa185", "address": "fa:16:3e:35:33:4d", "network": {"id": "0a2ee949-f9ab-4b7b-a4da-f9f9cc4da5c5", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1737037548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb0f20d51854422c86b85377dd75f96d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9599d4c0-f0", "ovs_interfaceid": "9599d4c0-f08b-4498-9c9a-119d83caa185", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:09:54 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Converting VIF {"id": "9599d4c0-f08b-4498-9c9a-119d83caa185", "address": "fa:16:3e:35:33:4d", "network": {"id": "0a2ee949-f9ab-4b7b-a4da-f9f9cc4da5c5", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1737037548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb0f20d51854422c86b85377dd75f96d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9599d4c0-f0", "ovs_interfaceid": "9599d4c0-f08b-4498-9c9a-119d83caa185", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:09:54 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:33:4d,bridge_name='br-int',has_traffic_filtering=True,id=9599d4c0-f08b-4498-9c9a-119d83caa185,network=Network(0a2ee949-f9ab-4b7b-a4da-f9f9cc4da5c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9599d4c0-f0') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:09:54 user nova-compute[95467]: DEBUG nova.objects.instance [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Lazy-loading 'pci_devices' on Instance uuid b9210bbe-e728-4724-924b-1963226c092d {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:09:54 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] [instance: b9210bbe-e728-4724-924b-1963226c092d] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:09:54 user nova-compute[95467]:   <uuid>b9210bbe-e728-4724-924b-1963226c092d</uuid>
Nov 15 08:09:54 user nova-compute[95467]:   <name>instance-00000002</name>
Nov 15 08:09:54 user nova-compute[95467]:   <memory>524288</memory>
Nov 15 08:09:54 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:09:54 user nova-compute[95467]:   <metadata>
Nov 15 08:09:54 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:09:54 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:09:54 user nova-compute[95467]:       <nova:name>tempest-DeleteServersTestJSON-server-626150831</nova:name>
Nov 15 08:09:54 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:09:54</nova:creationTime>
Nov 15 08:09:54 user nova-compute[95467]:       <nova:flavor name="m1.tiny">
Nov 15 08:09:54 user nova-compute[95467]:         <nova:memory>512</nova:memory>
Nov 15 08:09:54 user nova-compute[95467]:         <nova:disk>1</nova:disk>
Nov 15 08:09:54 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:09:54 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:09:54 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:09:54 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:09:54 user nova-compute[95467]:       <nova:owner>
Nov 15 08:09:54 user nova-compute[95467]:         <nova:user uuid="d669a1577f0446dd8ceea49ed89b0bf1">tempest-DeleteServersTestJSON-962386278-project-member</nova:user>
Nov 15 08:09:54 user nova-compute[95467]:         <nova:project uuid="bb0f20d51854422c86b85377dd75f96d">tempest-DeleteServersTestJSON-962386278</nova:project>
Nov 15 08:09:54 user nova-compute[95467]:       </nova:owner>
Nov 15 08:09:54 user nova-compute[95467]:       <nova:root type="image" uuid="ed9c48aa-ce73-4b3b-9db1-235898be671b"/>
Nov 15 08:09:54 user nova-compute[95467]:       <nova:ports>
Nov 15 08:09:54 user nova-compute[95467]:         <nova:port uuid="9599d4c0-f08b-4498-9c9a-119d83caa185">
Nov 15 08:09:54 user nova-compute[95467]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 15 08:09:54 user nova-compute[95467]:         </nova:port>
Nov 15 08:09:54 user nova-compute[95467]:       </nova:ports>
Nov 15 08:09:54 user nova-compute[95467]:     </nova:instance>
Nov 15 08:09:54 user nova-compute[95467]:   </metadata>
Nov 15 08:09:54 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:09:54 user nova-compute[95467]:     <system>
Nov 15 08:09:54 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:09:54 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:09:54 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:09:54 user nova-compute[95467]:       <entry name="serial">b9210bbe-e728-4724-924b-1963226c092d</entry>
Nov 15 08:09:54 user nova-compute[95467]:       <entry name="uuid">b9210bbe-e728-4724-924b-1963226c092d</entry>
Nov 15 08:09:54 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:09:54 user nova-compute[95467]:     </system>
Nov 15 08:09:54 user nova-compute[95467]:   </sysinfo>
Nov 15 08:09:54 user nova-compute[95467]:   <os>
Nov 15 08:09:54 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:09:54 user nova-compute[95467]:     <boot dev="hd"/>
Nov 15 08:09:54 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:09:54 user nova-compute[95467]:   </os>
Nov 15 08:09:54 user nova-compute[95467]:   <features>
Nov 15 08:09:54 user nova-compute[95467]:     <acpi/>
Nov 15 08:09:54 user nova-compute[95467]:     <apic/>
Nov 15 08:09:54 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:09:54 user nova-compute[95467]:   </features>
Nov 15 08:09:54 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:09:54 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:09:54 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:09:54 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:09:54 user nova-compute[95467]:   </clock>
Nov 15 08:09:54 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:09:54 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:09:54 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:09:54 user nova-compute[95467]:   </cpu>
Nov 15 08:09:54 user nova-compute[95467]:   <devices>
Nov 15 08:09:54 user nova-compute[95467]:     <disk type="file" device="disk">
Nov 15 08:09:54 user nova-compute[95467]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 08:09:54 user nova-compute[95467]:       <source file="/opt/stack/data/nova/instances/b9210bbe-e728-4724-924b-1963226c092d/disk"/>
Nov 15 08:09:54 user nova-compute[95467]:       <target dev="vda" bus="virtio"/>
Nov 15 08:09:54 user nova-compute[95467]:     </disk>
Nov 15 08:09:54 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:09:54 user nova-compute[95467]:       <mac address="fa:16:3e:35:33:4d"/>
Nov 15 08:09:54 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:09:54 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:09:54 user nova-compute[95467]:       <target dev="tap9599d4c0-f0"/>
Nov 15 08:09:54 user nova-compute[95467]:     </interface>
Nov 15 08:09:54 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:09:54 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/b9210bbe-e728-4724-924b-1963226c092d/console.log" append="off"/>
Nov 15 08:09:54 user nova-compute[95467]:     </serial>
Nov 15 08:09:54 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:09:54 user nova-compute[95467]:     <video>
Nov 15 08:09:54 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:09:54 user nova-compute[95467]:     </video>
Nov 15 08:09:54 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:09:54 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:09:54 user nova-compute[95467]:     </rng>
Nov 15 08:09:54 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:09:54 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:09:54 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:09:54 user nova-compute[95467]:     </memballoon>
Nov 15 08:09:54 user nova-compute[95467]:   </devices>
Nov 15 08:09:54 user nova-compute[95467]: </domain>
Nov 15 08:09:54 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:09:54 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:09:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-626150831',display_name='tempest-DeleteServersTestJSON-server-626150831',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-626150831',id=2,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb0f20d51854422c86b85377dd75f96d',ramdisk_id='',reservation_id='r-c5o0lhis',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-962386278',owner_user_name='tempest-DeleteServersTestJSON-962386278-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:09:49Z,user_data=None,user_id='d669a1577f0446dd8ceea49ed89b0bf1',uuid=b9210bbe-e728-4724-924b-1963226c092d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9599d4c0-f08b-4498-9c9a-119d83caa185", "address": "fa:16:3e:35:33:4d", "network": {"id": "0a2ee949-f9ab-4b7b-a4da-f9f9cc4da5c5", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1737037548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb0f20d51854422c86b85377dd75f96d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9599d4c0-f0", "ovs_interfaceid": "9599d4c0-f08b-4498-9c9a-119d83caa185", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:09:54 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Converting VIF {"id": "9599d4c0-f08b-4498-9c9a-119d83caa185", "address": "fa:16:3e:35:33:4d", "network": {"id": "0a2ee949-f9ab-4b7b-a4da-f9f9cc4da5c5", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1737037548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb0f20d51854422c86b85377dd75f96d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9599d4c0-f0", "ovs_interfaceid": "9599d4c0-f08b-4498-9c9a-119d83caa185", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:09:54 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:33:4d,bridge_name='br-int',has_traffic_filtering=True,id=9599d4c0-f08b-4498-9c9a-119d83caa185,network=Network(0a2ee949-f9ab-4b7b-a4da-f9f9cc4da5c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9599d4c0-f0') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:09:54 user nova-compute[95467]: DEBUG os_vif [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:33:4d,bridge_name='br-int',has_traffic_filtering=True,id=9599d4c0-f08b-4498-9c9a-119d83caa185,network=Network(0a2ee949-f9ab-4b7b-a4da-f9f9cc4da5c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9599d4c0-f0') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:09:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:09:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:09:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:09:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:09:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3f91a1e1-b1d2-5dbe-ab41-f0ddd296b638', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:09:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:09:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:09:55 user sudo[104829]: pam_unix(sudo:session): session closed for user root
Nov 15 08:09:55 user nova-compute[95467]: INFO oslo.privsep.daemon [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Spawned new privsep daemon via rootwrap
Nov 15 08:09:55 user nova-compute[95467]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 15 08:09:55 user nova-compute[95467]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 15 08:09:55 user nova-compute[95467]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 15 08:09:55 user nova-compute[95467]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 104847
Nov 15 08:09:55 user nova-compute[95467]: WARNING oslo_privsep.priv_context [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] privsep daemon already running
Nov 15 08:09:55 user nova-compute[95467]: DEBUG nova.network.neutron [req-4415e678-197f-4835-8cab-f1a37c04571e req-e29f3892-121d-4a7c-99ad-07ffc6f96eb5 service nova] [instance: ee2aa477-6786-483a-b088-d8ec204fe6aa] Updated VIF entry in instance network info cache for port 5e362799-1ab1-48d5-9ef2-1a90ce83cd80. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:09:55 user nova-compute[95467]: DEBUG nova.network.neutron [req-4415e678-197f-4835-8cab-f1a37c04571e req-e29f3892-121d-4a7c-99ad-07ffc6f96eb5 service nova] [instance: ee2aa477-6786-483a-b088-d8ec204fe6aa] Updating instance_info_cache with network_info: [{"id": "5e362799-1ab1-48d5-9ef2-1a90ce83cd80", "address": "fa:16:3e:2e:62:d2", "network": {"id": "9fc550b3-b517-4f14-93cd-f1c2866d1b29", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1976605572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1312e86f799549eb8adb4c846576262c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e362799-1a", "ovs_interfaceid": "5e362799-1ab1-48d5-9ef2-1a90ce83cd80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:09:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-4415e678-197f-4835-8cab-f1a37c04571e req-e29f3892-121d-4a7c-99ad-07ffc6f96eb5 service nova] Releasing lock "refresh_cache-ee2aa477-6786-483a-b088-d8ec204fe6aa" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:09:55 user nova-compute[95467]: DEBUG nova.network.neutron [req-5a52681f-e3dd-46bb-bfd1-87f3ae11848b req-2d5cb150-af3c-4516-b67d-2c8a00f16874 service nova] [instance: b9210bbe-e728-4724-924b-1963226c092d] Updated VIF entry in instance network info cache for port 9599d4c0-f08b-4498-9c9a-119d83caa185. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:09:55 user nova-compute[95467]: DEBUG nova.network.neutron [req-5a52681f-e3dd-46bb-bfd1-87f3ae11848b req-2d5cb150-af3c-4516-b67d-2c8a00f16874 service nova] [instance: b9210bbe-e728-4724-924b-1963226c092d] Updating instance_info_cache with network_info: [{"id": "9599d4c0-f08b-4498-9c9a-119d83caa185", "address": "fa:16:3e:35:33:4d", "network": {"id": "0a2ee949-f9ab-4b7b-a4da-f9f9cc4da5c5", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1737037548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb0f20d51854422c86b85377dd75f96d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9599d4c0-f0", "ovs_interfaceid": "9599d4c0-f08b-4498-9c9a-119d83caa185", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:09:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-5a52681f-e3dd-46bb-bfd1-87f3ae11848b req-2d5cb150-af3c-4516-b67d-2c8a00f16874 service nova] Releasing lock "refresh_cache-b9210bbe-e728-4724-924b-1963226c092d" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:09:55 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:09:55 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9599d4c0-f0, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:09:55 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9599d4c0-f0, col_values=(('qos', UUID('1cad1968-7419-436d-957b-ca250a25075c')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:09:55 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9599d4c0-f0, col_values=(('external_ids', {'iface-id': '9599d4c0-f08b-4498-9c9a-119d83caa185', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:33:4d', 'vm-uuid': 'b9210bbe-e728-4724-924b-1963226c092d'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:09:55 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:09:55 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:09:55 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:09:55 user nova-compute[95467]: INFO os_vif [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:33:4d,bridge_name='br-int',has_traffic_filtering=True,id=9599d4c0-f08b-4498-9c9a-119d83caa185,network=Network(0a2ee949-f9ab-4b7b-a4da-f9f9cc4da5c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9599d4c0-f0')
Nov 15 08:09:55 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:09:55 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5e362799-1a, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:09:55 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5e362799-1a, col_values=(('qos', UUID('611c0d1b-99bc-4175-9a56-c22503c88b08')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:09:55 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5e362799-1a, col_values=(('external_ids', {'iface-id': '5e362799-1ab1-48d5-9ef2-1a90ce83cd80', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:62:d2', 'vm-uuid': 'ee2aa477-6786-483a-b088-d8ec204fe6aa'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:09:55 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:09:55 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:09:55 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:09:55 user nova-compute[95467]: INFO os_vif [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:62:d2,bridge_name='br-int',has_traffic_filtering=True,id=5e362799-1ab1-48d5-9ef2-1a90ce83cd80,network=Network(9fc550b3-b517-4f14-93cd-f1c2866d1b29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e362799-1a')
Nov 15 08:09:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Acquiring lock "36dccf43-d4a3-47aa-bd73-de9646e1020c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:09:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "36dccf43-d4a3-47aa-bd73-de9646e1020c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:09:55 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:09:55 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] No VIF found with MAC fa:16:3e:35:33:4d, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:09:55 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:09:55 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] No VIF found with MAC fa:16:3e:2e:62:d2, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:09:55 user nova-compute[95467]: DEBUG nova.compute.manager [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Starting instance... {{(pid=95467) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 08:09:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:09:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:09:55 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=95467) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 08:09:55 user nova-compute[95467]: INFO nova.compute.claims [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Claim successful on node user
Nov 15 08:09:55 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:09:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:09:56 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:09:56 user nova-compute[95467]: DEBUG nova.network.neutron [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] Successfully created port: d7e5ca44-eee3-4452-9649-5fcbfe5ed5ad {{(pid=95467) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 08:09:56 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:09:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.424s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:09:56 user nova-compute[95467]: DEBUG nova.compute.manager [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Start building networks asynchronously for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 08:09:56 user nova-compute[95467]: DEBUG nova.compute.manager [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Allocating IP information in the background. {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 08:09:56 user nova-compute[95467]: DEBUG nova.network.neutron [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] allocate_for_instance() {{(pid=95467) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 08:09:56 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 08:09:56 user nova-compute[95467]: DEBUG nova.compute.manager [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Start building block device mappings for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 08:09:56 user nova-compute[95467]: DEBUG nova.compute.manager [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Start spawning the instance on the hypervisor. {{(pid=95467) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 08:09:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Creating instance directory {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 08:09:56 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Creating image(s)
Nov 15 08:09:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Acquiring lock "/opt/stack/data/nova/instances/36dccf43-d4a3-47aa-bd73-de9646e1020c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:09:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "/opt/stack/data/nova/instances/36dccf43-d4a3-47aa-bd73-de9646e1020c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:09:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "/opt/stack/data/nova/instances/36dccf43-d4a3-47aa-bd73-de9646e1020c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:09:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:09:56 user nova-compute[95467]: DEBUG nova.policy [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b03564d022e84f5cb133b9771e76bae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b04c448c61451d8d46ebc7a61a5e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95467) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 08:09:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:09:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:09:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.170s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:09:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Acquiring lock "a3fcf60225fcefd310404971cd18ab9851c548dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:09:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:09:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:09:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.187s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:09:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/36dccf43-d4a3-47aa-bd73-de9646e1020c/disk 1073741824 {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:09:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/36dccf43-d4a3-47aa-bd73-de9646e1020c/disk 1073741824" returned: 0 in 0.057s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:09:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:09:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:09:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.170s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:09:57 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Checking if we can resize image /opt/stack/data/nova/instances/36dccf43-d4a3-47aa-bd73-de9646e1020c/disk. size=1073741824 {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 08:09:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36dccf43-d4a3-47aa-bd73-de9646e1020c/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:09:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36dccf43-d4a3-47aa-bd73-de9646e1020c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:09:57 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Cannot resize image /opt/stack/data/nova/instances/36dccf43-d4a3-47aa-bd73-de9646e1020c/disk to a smaller size. {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 08:09:57 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Created local disks {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 08:09:57 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Ensure instance console log exists: /opt/stack/data/nova/instances/36dccf43-d4a3-47aa-bd73-de9646e1020c/console.log {{(pid=95467) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 08:09:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:09:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:09:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:09:57 user nova-compute[95467]: DEBUG nova.network.neutron [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] Successfully updated port: 015c421f-8bfc-4576-a9cc-bf990e3803ab {{(pid=95467) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 08:09:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Acquiring lock "refresh_cache-5748cf5d-9c57-4477-8952-ec39d0d18f55" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:09:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Acquired lock "refresh_cache-5748cf5d-9c57-4477-8952-ec39d0d18f55" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:09:57 user nova-compute[95467]: DEBUG nova.network.neutron [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:09:57 user nova-compute[95467]: DEBUG nova.compute.manager [req-03017a42-ff66-4053-a766-f10e6ad4108d req-da870cda-ed00-4de3-b1ca-d32598b8be7e service nova] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] Received event network-changed-015c421f-8bfc-4576-a9cc-bf990e3803ab {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:09:57 user nova-compute[95467]: DEBUG nova.compute.manager [req-03017a42-ff66-4053-a766-f10e6ad4108d req-da870cda-ed00-4de3-b1ca-d32598b8be7e service nova] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] Refreshing instance network info cache due to event network-changed-015c421f-8bfc-4576-a9cc-bf990e3803ab. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:09:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-03017a42-ff66-4053-a766-f10e6ad4108d req-da870cda-ed00-4de3-b1ca-d32598b8be7e service nova] Acquiring lock "refresh_cache-5748cf5d-9c57-4477-8952-ec39d0d18f55" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:09:57 user nova-compute[95467]: DEBUG nova.network.neutron [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] Instance cache missing network info. {{(pid=95467) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 08:09:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:09:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:09:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:09:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:09:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:09:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:09:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:09:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:09:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:09:58 user nova-compute[95467]: DEBUG nova.network.neutron [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] Updating instance_info_cache with network_info: [{"id": "015c421f-8bfc-4576-a9cc-bf990e3803ab", "address": "fa:16:3e:e1:8a:d4", "network": {"id": "27fd2b0f-65bd-4ae4-b5c8-dfca91668078", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1310727750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50e2fec6a90a41a5a586c6da227caacc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap015c421f-8b", "ovs_interfaceid": "015c421f-8bfc-4576-a9cc-bf990e3803ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:09:58 user nova-compute[95467]: DEBUG nova.network.neutron [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] Successfully updated port: d7e5ca44-eee3-4452-9649-5fcbfe5ed5ad {{(pid=95467) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 08:09:58 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Releasing lock "refresh_cache-5748cf5d-9c57-4477-8952-ec39d0d18f55" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:09:58 user nova-compute[95467]: DEBUG nova.compute.manager [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] Instance network_info: |[{"id": "015c421f-8bfc-4576-a9cc-bf990e3803ab", "address": "fa:16:3e:e1:8a:d4", "network": {"id": "27fd2b0f-65bd-4ae4-b5c8-dfca91668078", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1310727750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50e2fec6a90a41a5a586c6da227caacc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap015c421f-8b", "ovs_interfaceid": "015c421f-8bfc-4576-a9cc-bf990e3803ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 08:09:58 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-03017a42-ff66-4053-a766-f10e6ad4108d req-da870cda-ed00-4de3-b1ca-d32598b8be7e service nova] Acquired lock "refresh_cache-5748cf5d-9c57-4477-8952-ec39d0d18f55" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:09:58 user nova-compute[95467]: DEBUG nova.network.neutron [req-03017a42-ff66-4053-a766-f10e6ad4108d req-da870cda-ed00-4de3-b1ca-d32598b8be7e service nova] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] Refreshing network info cache for port 015c421f-8bfc-4576-a9cc-bf990e3803ab {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:09:58 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] Start _get_guest_xml network_info=[{"id": "015c421f-8bfc-4576-a9cc-bf990e3803ab", "address": "fa:16:3e:e1:8a:d4", "network": {"id": "27fd2b0f-65bd-4ae4-b5c8-dfca91668078", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1310727750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50e2fec6a90a41a5a586c6da227caacc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap015c421f-8b", "ovs_interfaceid": "015c421f-8bfc-4576-a9cc-bf990e3803ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'ed9c48aa-ce73-4b3b-9db1-235898be671b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:09:58 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Acquiring lock "refresh_cache-73fe8852-c47a-47ab-a56f-6864c8ed5479" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:09:58 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Acquired lock "refresh_cache-73fe8852-c47a-47ab-a56f-6864c8ed5479" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:09:58 user nova-compute[95467]: DEBUG nova.network.neutron [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:09:58 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:09:58 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:09:58 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:09:58 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:09:58 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:09:58 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:09:58 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:09:58 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:09:58 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:09:58 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:09:58 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:09:58 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:09:58 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:09:58 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:09:58 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:09:58 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:09:58 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:09:58 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:09:58 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:09:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1047071283',display_name='tempest-AttachVolumeNegativeTest-server-1047071283',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1047071283',id=3,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ0p3cr8xQKIlacwsP0Le9zxhWI+xEV5ZTCaTEBT5gz12us8WDTJMZgWcSe6Fyc/NmqFm9TsRD+uPTN2bXx7sKzNBKUvOWTry7Vty4Aom2efjxdGJU2arOxdLNCSuJmytA==',key_name='tempest-keypair-1462846547',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50e2fec6a90a41a5a586c6da227caacc',ramdisk_id='',reservation_id='r-dqbpyq5n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1750086293',owner_user_name='tempest-AttachVolumeNegativeTest-1750086293-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:09:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='acce273b07b64e44af6e062175afa92d',uuid=5748cf5d-9c57-4477-8952-ec39d0d18f55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "015c421f-8bfc-4576-a9cc-bf990e3803ab", "address": "fa:16:3e:e1:8a:d4", "network": {"id": "27fd2b0f-65bd-4ae4-b5c8-dfca91668078", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1310727750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50e2fec6a90a41a5a586c6da227caacc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap015c421f-8b", "ovs_interfaceid": "015c421f-8bfc-4576-a9cc-bf990e3803ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:09:58 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Converting VIF {"id": "015c421f-8bfc-4576-a9cc-bf990e3803ab", "address": "fa:16:3e:e1:8a:d4", "network": {"id": "27fd2b0f-65bd-4ae4-b5c8-dfca91668078", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1310727750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50e2fec6a90a41a5a586c6da227caacc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap015c421f-8b", "ovs_interfaceid": "015c421f-8bfc-4576-a9cc-bf990e3803ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:09:58 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:8a:d4,bridge_name='br-int',has_traffic_filtering=True,id=015c421f-8bfc-4576-a9cc-bf990e3803ab,network=Network(27fd2b0f-65bd-4ae4-b5c8-dfca91668078),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap015c421f-8b') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:09:58 user nova-compute[95467]: DEBUG nova.objects.instance [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lazy-loading 'pci_devices' on Instance uuid 5748cf5d-9c57-4477-8952-ec39d0d18f55 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:09:58 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:09:58 user nova-compute[95467]:   <uuid>5748cf5d-9c57-4477-8952-ec39d0d18f55</uuid>
Nov 15 08:09:58 user nova-compute[95467]:   <name>instance-00000003</name>
Nov 15 08:09:58 user nova-compute[95467]:   <memory>524288</memory>
Nov 15 08:09:58 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:09:58 user nova-compute[95467]:   <metadata>
Nov 15 08:09:58 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:09:58 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:09:58 user nova-compute[95467]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1047071283</nova:name>
Nov 15 08:09:58 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:09:58</nova:creationTime>
Nov 15 08:09:58 user nova-compute[95467]:       <nova:flavor name="m1.tiny">
Nov 15 08:09:58 user nova-compute[95467]:         <nova:memory>512</nova:memory>
Nov 15 08:09:58 user nova-compute[95467]:         <nova:disk>1</nova:disk>
Nov 15 08:09:58 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:09:58 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:09:58 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:09:58 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:09:58 user nova-compute[95467]:       <nova:owner>
Nov 15 08:09:58 user nova-compute[95467]:         <nova:user uuid="acce273b07b64e44af6e062175afa92d">tempest-AttachVolumeNegativeTest-1750086293-project-member</nova:user>
Nov 15 08:09:58 user nova-compute[95467]:         <nova:project uuid="50e2fec6a90a41a5a586c6da227caacc">tempest-AttachVolumeNegativeTest-1750086293</nova:project>
Nov 15 08:09:58 user nova-compute[95467]:       </nova:owner>
Nov 15 08:09:58 user nova-compute[95467]:       <nova:root type="image" uuid="ed9c48aa-ce73-4b3b-9db1-235898be671b"/>
Nov 15 08:09:58 user nova-compute[95467]:       <nova:ports>
Nov 15 08:09:58 user nova-compute[95467]:         <nova:port uuid="015c421f-8bfc-4576-a9cc-bf990e3803ab">
Nov 15 08:09:58 user nova-compute[95467]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 08:09:58 user nova-compute[95467]:         </nova:port>
Nov 15 08:09:58 user nova-compute[95467]:       </nova:ports>
Nov 15 08:09:58 user nova-compute[95467]:     </nova:instance>
Nov 15 08:09:58 user nova-compute[95467]:   </metadata>
Nov 15 08:09:58 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:09:58 user nova-compute[95467]:     <system>
Nov 15 08:09:58 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:09:58 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:09:58 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:09:58 user nova-compute[95467]:       <entry name="serial">5748cf5d-9c57-4477-8952-ec39d0d18f55</entry>
Nov 15 08:09:58 user nova-compute[95467]:       <entry name="uuid">5748cf5d-9c57-4477-8952-ec39d0d18f55</entry>
Nov 15 08:09:58 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:09:58 user nova-compute[95467]:     </system>
Nov 15 08:09:58 user nova-compute[95467]:   </sysinfo>
Nov 15 08:09:58 user nova-compute[95467]:   <os>
Nov 15 08:09:58 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:09:58 user nova-compute[95467]:     <boot dev="hd"/>
Nov 15 08:09:58 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:09:58 user nova-compute[95467]:   </os>
Nov 15 08:09:58 user nova-compute[95467]:   <features>
Nov 15 08:09:58 user nova-compute[95467]:     <acpi/>
Nov 15 08:09:58 user nova-compute[95467]:     <apic/>
Nov 15 08:09:58 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:09:58 user nova-compute[95467]:   </features>
Nov 15 08:09:58 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:09:58 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:09:58 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:09:58 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:09:58 user nova-compute[95467]:   </clock>
Nov 15 08:09:58 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:09:58 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:09:58 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:09:58 user nova-compute[95467]:   </cpu>
Nov 15 08:09:58 user nova-compute[95467]:   <devices>
Nov 15 08:09:58 user nova-compute[95467]:     <disk type="file" device="disk">
Nov 15 08:09:58 user nova-compute[95467]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 08:09:58 user nova-compute[95467]:       <source file="/opt/stack/data/nova/instances/5748cf5d-9c57-4477-8952-ec39d0d18f55/disk"/>
Nov 15 08:09:58 user nova-compute[95467]:       <target dev="vda" bus="virtio"/>
Nov 15 08:09:58 user nova-compute[95467]:     </disk>
Nov 15 08:09:58 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:09:58 user nova-compute[95467]:       <mac address="fa:16:3e:e1:8a:d4"/>
Nov 15 08:09:58 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:09:58 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:09:58 user nova-compute[95467]:       <target dev="tap015c421f-8b"/>
Nov 15 08:09:58 user nova-compute[95467]:     </interface>
Nov 15 08:09:58 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:09:58 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/5748cf5d-9c57-4477-8952-ec39d0d18f55/console.log" append="off"/>
Nov 15 08:09:58 user nova-compute[95467]:     </serial>
Nov 15 08:09:58 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:09:58 user nova-compute[95467]:     <video>
Nov 15 08:09:58 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:09:58 user nova-compute[95467]:     </video>
Nov 15 08:09:58 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:09:58 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:09:58 user nova-compute[95467]:     </rng>
Nov 15 08:09:58 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:09:58 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:09:58 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:09:58 user nova-compute[95467]:     </memballoon>
Nov 15 08:09:58 user nova-compute[95467]:   </devices>
Nov 15 08:09:58 user nova-compute[95467]: </domain>
Nov 15 08:09:58 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:09:58 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:09:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1047071283',display_name='tempest-AttachVolumeNegativeTest-server-1047071283',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1047071283',id=3,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ0p3cr8xQKIlacwsP0Le9zxhWI+xEV5ZTCaTEBT5gz12us8WDTJMZgWcSe6Fyc/NmqFm9TsRD+uPTN2bXx7sKzNBKUvOWTry7Vty4Aom2efjxdGJU2arOxdLNCSuJmytA==',key_name='tempest-keypair-1462846547',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50e2fec6a90a41a5a586c6da227caacc',ramdisk_id='',reservation_id='r-dqbpyq5n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1750086293',owner_user_name='tempest-AttachVolumeNegativeTest-1750086293-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:09:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='acce273b07b64e44af6e062175afa92d',uuid=5748cf5d-9c57-4477-8952-ec39d0d18f55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "015c421f-8bfc-4576-a9cc-bf990e3803ab", "address": "fa:16:3e:e1:8a:d4", "network": {"id": "27fd2b0f-65bd-4ae4-b5c8-dfca91668078", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1310727750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50e2fec6a90a41a5a586c6da227caacc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap015c421f-8b", "ovs_interfaceid": "015c421f-8bfc-4576-a9cc-bf990e3803ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:09:58 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Converting VIF {"id": "015c421f-8bfc-4576-a9cc-bf990e3803ab", "address": "fa:16:3e:e1:8a:d4", "network": {"id": "27fd2b0f-65bd-4ae4-b5c8-dfca91668078", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1310727750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50e2fec6a90a41a5a586c6da227caacc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap015c421f-8b", "ovs_interfaceid": "015c421f-8bfc-4576-a9cc-bf990e3803ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:09:58 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:8a:d4,bridge_name='br-int',has_traffic_filtering=True,id=015c421f-8bfc-4576-a9cc-bf990e3803ab,network=Network(27fd2b0f-65bd-4ae4-b5c8-dfca91668078),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap015c421f-8b') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:09:58 user nova-compute[95467]: DEBUG os_vif [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:8a:d4,bridge_name='br-int',has_traffic_filtering=True,id=015c421f-8bfc-4576-a9cc-bf990e3803ab,network=Network(27fd2b0f-65bd-4ae4-b5c8-dfca91668078),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap015c421f-8b') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:09:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:09:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:09:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:09:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:09:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fb37a44b-6e13-5fe9-b6f6-f2585f61e5d5', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:09:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:09:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:09:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:09:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap015c421f-8b, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:09:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap015c421f-8b, col_values=(('qos', UUID('cd976560-c81b-4099-9ffd-61651cb61d3b')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:09:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap015c421f-8b, col_values=(('external_ids', {'iface-id': '015c421f-8bfc-4576-a9cc-bf990e3803ab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:8a:d4', 'vm-uuid': '5748cf5d-9c57-4477-8952-ec39d0d18f55'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:09:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:09:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:09:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:09:58 user nova-compute[95467]: INFO os_vif [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:8a:d4,bridge_name='br-int',has_traffic_filtering=True,id=015c421f-8bfc-4576-a9cc-bf990e3803ab,network=Network(27fd2b0f-65bd-4ae4-b5c8-dfca91668078),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap015c421f-8b')
Nov 15 08:09:58 user nova-compute[95467]: DEBUG nova.network.neutron [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] Instance cache missing network info. {{(pid=95467) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 08:09:58 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:09:58 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] No VIF found with MAC fa:16:3e:e1:8a:d4, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:09:59 user nova-compute[95467]: DEBUG nova.network.neutron [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Successfully created port: 5b51bd20-90a5-4fb1-816c-3d8e8824cb41 {{(pid=95467) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 08:09:59 user nova-compute[95467]: DEBUG nova.network.neutron [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] Updating instance_info_cache with network_info: [{"id": "d7e5ca44-eee3-4452-9649-5fcbfe5ed5ad", "address": "fa:16:3e:e5:16:8b", "network": {"id": "d8a362dc-0dc8-49dd-b2da-0e0749d5edca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-256373617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a1aa4f562c64545a94157d4aaf8d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7e5ca44-ee", "ovs_interfaceid": "d7e5ca44-eee3-4452-9649-5fcbfe5ed5ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:09:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:09:59 user nova-compute[95467]: DEBUG nova.network.neutron [req-03017a42-ff66-4053-a766-f10e6ad4108d req-da870cda-ed00-4de3-b1ca-d32598b8be7e service nova] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] Updated VIF entry in instance network info cache for port 015c421f-8bfc-4576-a9cc-bf990e3803ab. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:09:59 user nova-compute[95467]: DEBUG nova.network.neutron [req-03017a42-ff66-4053-a766-f10e6ad4108d req-da870cda-ed00-4de3-b1ca-d32598b8be7e service nova] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] Updating instance_info_cache with network_info: [{"id": "015c421f-8bfc-4576-a9cc-bf990e3803ab", "address": "fa:16:3e:e1:8a:d4", "network": {"id": "27fd2b0f-65bd-4ae4-b5c8-dfca91668078", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1310727750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50e2fec6a90a41a5a586c6da227caacc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap015c421f-8b", "ovs_interfaceid": "015c421f-8bfc-4576-a9cc-bf990e3803ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:09:59 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-03017a42-ff66-4053-a766-f10e6ad4108d req-da870cda-ed00-4de3-b1ca-d32598b8be7e service nova] Releasing lock "refresh_cache-5748cf5d-9c57-4477-8952-ec39d0d18f55" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:09:59 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Releasing lock "refresh_cache-73fe8852-c47a-47ab-a56f-6864c8ed5479" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:09:59 user nova-compute[95467]: DEBUG nova.compute.manager [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] Instance network_info: |[{"id": "d7e5ca44-eee3-4452-9649-5fcbfe5ed5ad", "address": "fa:16:3e:e5:16:8b", "network": {"id": "d8a362dc-0dc8-49dd-b2da-0e0749d5edca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-256373617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a1aa4f562c64545a94157d4aaf8d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7e5ca44-ee", "ovs_interfaceid": "d7e5ca44-eee3-4452-9649-5fcbfe5ed5ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 08:09:59 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] Start _get_guest_xml network_info=[{"id": "d7e5ca44-eee3-4452-9649-5fcbfe5ed5ad", "address": "fa:16:3e:e5:16:8b", "network": {"id": "d8a362dc-0dc8-49dd-b2da-0e0749d5edca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-256373617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a1aa4f562c64545a94157d4aaf8d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7e5ca44-ee", "ovs_interfaceid": "d7e5ca44-eee3-4452-9649-5fcbfe5ed5ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'ed9c48aa-ce73-4b3b-9db1-235898be671b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:09:59 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:09:59 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:09:59 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:09:59 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:09:59 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:09:59 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:09:59 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:09:59 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:09:59 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:09:59 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:09:59 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:09:59 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:09:59 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:09:59 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:09:59 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:09:59 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:09:59 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:09:59 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:09:59 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:09:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-655759995',display_name='tempest-ServerActionsTestOtherA-server-655759995',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-655759995',id=4,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYstiTKN6pNWftTYd849nYQtMIuEgDEUeKiw28UGbiftMSf1b7pXDFCSUnmvZj4PjTG3wPVLUk+MQqv7tZDYQ9Hh/tLAdBctcsd51z7x2h0dxB9v2l2G0kVC6Lobby9rA==',key_name='tempest-keypair-124047716',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0a1aa4f562c64545a94157d4aaf8d14e',ramdisk_id='',reservation_id='r-32hgmua9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-937420730',owner_user_name='tempest-ServerActionsTestOtherA-937420730-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:09:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d9b34339b404facac21f500f40b1686',uuid=73fe8852-c47a-47ab-a56f-6864c8ed5479,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d7e5ca44-eee3-4452-9649-5fcbfe5ed5ad", "address": "fa:16:3e:e5:16:8b", "network": {"id": "d8a362dc-0dc8-49dd-b2da-0e0749d5edca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-256373617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a1aa4f562c64545a94157d4aaf8d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7e5ca44-ee", "ovs_interfaceid": "d7e5ca44-eee3-4452-9649-5fcbfe5ed5ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:09:59 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Converting VIF {"id": "d7e5ca44-eee3-4452-9649-5fcbfe5ed5ad", "address": "fa:16:3e:e5:16:8b", "network": {"id": "d8a362dc-0dc8-49dd-b2da-0e0749d5edca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-256373617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a1aa4f562c64545a94157d4aaf8d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7e5ca44-ee", "ovs_interfaceid": "d7e5ca44-eee3-4452-9649-5fcbfe5ed5ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:09:59 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:16:8b,bridge_name='br-int',has_traffic_filtering=True,id=d7e5ca44-eee3-4452-9649-5fcbfe5ed5ad,network=Network(d8a362dc-0dc8-49dd-b2da-0e0749d5edca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7e5ca44-ee') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:09:59 user nova-compute[95467]: DEBUG nova.objects.instance [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lazy-loading 'pci_devices' on Instance uuid 73fe8852-c47a-47ab-a56f-6864c8ed5479 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:09:59 user nova-compute[95467]: DEBUG nova.compute.manager [req-d3447f3c-d8fc-4901-8012-396ee9850183 req-787808d3-e528-45c5-a782-d879fddae020 service nova] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] Received event network-changed-d7e5ca44-eee3-4452-9649-5fcbfe5ed5ad {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:09:59 user nova-compute[95467]: DEBUG nova.compute.manager [req-d3447f3c-d8fc-4901-8012-396ee9850183 req-787808d3-e528-45c5-a782-d879fddae020 service nova] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] Refreshing instance network info cache due to event network-changed-d7e5ca44-eee3-4452-9649-5fcbfe5ed5ad. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:09:59 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-d3447f3c-d8fc-4901-8012-396ee9850183 req-787808d3-e528-45c5-a782-d879fddae020 service nova] Acquiring lock "refresh_cache-73fe8852-c47a-47ab-a56f-6864c8ed5479" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:09:59 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-d3447f3c-d8fc-4901-8012-396ee9850183 req-787808d3-e528-45c5-a782-d879fddae020 service nova] Acquired lock "refresh_cache-73fe8852-c47a-47ab-a56f-6864c8ed5479" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:09:59 user nova-compute[95467]: DEBUG nova.network.neutron [req-d3447f3c-d8fc-4901-8012-396ee9850183 req-787808d3-e528-45c5-a782-d879fddae020 service nova] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] Refreshing network info cache for port d7e5ca44-eee3-4452-9649-5fcbfe5ed5ad {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:09:59 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:09:59 user nova-compute[95467]:   <uuid>73fe8852-c47a-47ab-a56f-6864c8ed5479</uuid>
Nov 15 08:09:59 user nova-compute[95467]:   <name>instance-00000004</name>
Nov 15 08:09:59 user nova-compute[95467]:   <memory>524288</memory>
Nov 15 08:09:59 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:09:59 user nova-compute[95467]:   <metadata>
Nov 15 08:09:59 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:09:59 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:09:59 user nova-compute[95467]:       <nova:name>tempest-ServerActionsTestOtherA-server-655759995</nova:name>
Nov 15 08:09:59 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:09:59</nova:creationTime>
Nov 15 08:09:59 user nova-compute[95467]:       <nova:flavor name="m1.tiny">
Nov 15 08:09:59 user nova-compute[95467]:         <nova:memory>512</nova:memory>
Nov 15 08:09:59 user nova-compute[95467]:         <nova:disk>1</nova:disk>
Nov 15 08:09:59 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:09:59 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:09:59 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:09:59 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:09:59 user nova-compute[95467]:       <nova:owner>
Nov 15 08:09:59 user nova-compute[95467]:         <nova:user uuid="2d9b34339b404facac21f500f40b1686">tempest-ServerActionsTestOtherA-937420730-project-member</nova:user>
Nov 15 08:09:59 user nova-compute[95467]:         <nova:project uuid="0a1aa4f562c64545a94157d4aaf8d14e">tempest-ServerActionsTestOtherA-937420730</nova:project>
Nov 15 08:09:59 user nova-compute[95467]:       </nova:owner>
Nov 15 08:09:59 user nova-compute[95467]:       <nova:root type="image" uuid="ed9c48aa-ce73-4b3b-9db1-235898be671b"/>
Nov 15 08:09:59 user nova-compute[95467]:       <nova:ports>
Nov 15 08:09:59 user nova-compute[95467]:         <nova:port uuid="d7e5ca44-eee3-4452-9649-5fcbfe5ed5ad">
Nov 15 08:09:59 user nova-compute[95467]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 08:09:59 user nova-compute[95467]:         </nova:port>
Nov 15 08:09:59 user nova-compute[95467]:       </nova:ports>
Nov 15 08:09:59 user nova-compute[95467]:     </nova:instance>
Nov 15 08:09:59 user nova-compute[95467]:   </metadata>
Nov 15 08:09:59 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:09:59 user nova-compute[95467]:     <system>
Nov 15 08:09:59 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:09:59 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:09:59 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:09:59 user nova-compute[95467]:       <entry name="serial">73fe8852-c47a-47ab-a56f-6864c8ed5479</entry>
Nov 15 08:09:59 user nova-compute[95467]:       <entry name="uuid">73fe8852-c47a-47ab-a56f-6864c8ed5479</entry>
Nov 15 08:09:59 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:09:59 user nova-compute[95467]:     </system>
Nov 15 08:09:59 user nova-compute[95467]:   </sysinfo>
Nov 15 08:09:59 user nova-compute[95467]:   <os>
Nov 15 08:09:59 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:09:59 user nova-compute[95467]:     <boot dev="hd"/>
Nov 15 08:09:59 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:09:59 user nova-compute[95467]:   </os>
Nov 15 08:09:59 user nova-compute[95467]:   <features>
Nov 15 08:09:59 user nova-compute[95467]:     <acpi/>
Nov 15 08:09:59 user nova-compute[95467]:     <apic/>
Nov 15 08:09:59 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:09:59 user nova-compute[95467]:   </features>
Nov 15 08:09:59 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:09:59 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:09:59 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:09:59 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:09:59 user nova-compute[95467]:   </clock>
Nov 15 08:09:59 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:09:59 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:09:59 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:09:59 user nova-compute[95467]:   </cpu>
Nov 15 08:09:59 user nova-compute[95467]:   <devices>
Nov 15 08:09:59 user nova-compute[95467]:     <disk type="file" device="disk">
Nov 15 08:09:59 user nova-compute[95467]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 08:09:59 user nova-compute[95467]:       <source file="/opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk"/>
Nov 15 08:09:59 user nova-compute[95467]:       <target dev="vda" bus="virtio"/>
Nov 15 08:09:59 user nova-compute[95467]:     </disk>
Nov 15 08:09:59 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:09:59 user nova-compute[95467]:       <mac address="fa:16:3e:e5:16:8b"/>
Nov 15 08:09:59 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:09:59 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:09:59 user nova-compute[95467]:       <target dev="tapd7e5ca44-ee"/>
Nov 15 08:09:59 user nova-compute[95467]:     </interface>
Nov 15 08:09:59 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:09:59 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/console.log" append="off"/>
Nov 15 08:09:59 user nova-compute[95467]:     </serial>
Nov 15 08:09:59 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:09:59 user nova-compute[95467]:     <video>
Nov 15 08:09:59 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:09:59 user nova-compute[95467]:     </video>
Nov 15 08:09:59 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:09:59 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:09:59 user nova-compute[95467]:     </rng>
Nov 15 08:09:59 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:09:59 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:09:59 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:09:59 user nova-compute[95467]:     </memballoon>
Nov 15 08:09:59 user nova-compute[95467]:   </devices>
Nov 15 08:09:59 user nova-compute[95467]: </domain>
Nov 15 08:09:59 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:09:59 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:09:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-655759995',display_name='tempest-ServerActionsTestOtherA-server-655759995',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-655759995',id=4,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYstiTKN6pNWftTYd849nYQtMIuEgDEUeKiw28UGbiftMSf1b7pXDFCSUnmvZj4PjTG3wPVLUk+MQqv7tZDYQ9Hh/tLAdBctcsd51z7x2h0dxB9v2l2G0kVC6Lobby9rA==',key_name='tempest-keypair-124047716',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0a1aa4f562c64545a94157d4aaf8d14e',ramdisk_id='',reservation_id='r-32hgmua9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-937420730',owner_user_name='tempest-ServerActionsTestOtherA-937420730-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:09:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d9b34339b404facac21f500f40b1686',uuid=73fe8852-c47a-47ab-a56f-6864c8ed5479,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d7e5ca44-eee3-4452-9649-5fcbfe5ed5ad", "address": "fa:16:3e:e5:16:8b", "network": {"id": "d8a362dc-0dc8-49dd-b2da-0e0749d5edca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-256373617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a1aa4f562c64545a94157d4aaf8d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7e5ca44-ee", "ovs_interfaceid": "d7e5ca44-eee3-4452-9649-5fcbfe5ed5ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:09:59 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Converting VIF {"id": "d7e5ca44-eee3-4452-9649-5fcbfe5ed5ad", "address": "fa:16:3e:e5:16:8b", "network": {"id": "d8a362dc-0dc8-49dd-b2da-0e0749d5edca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-256373617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a1aa4f562c64545a94157d4aaf8d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7e5ca44-ee", "ovs_interfaceid": "d7e5ca44-eee3-4452-9649-5fcbfe5ed5ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:09:59 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:16:8b,bridge_name='br-int',has_traffic_filtering=True,id=d7e5ca44-eee3-4452-9649-5fcbfe5ed5ad,network=Network(d8a362dc-0dc8-49dd-b2da-0e0749d5edca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7e5ca44-ee') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:09:59 user nova-compute[95467]: DEBUG os_vif [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:16:8b,bridge_name='br-int',has_traffic_filtering=True,id=d7e5ca44-eee3-4452-9649-5fcbfe5ed5ad,network=Network(d8a362dc-0dc8-49dd-b2da-0e0749d5edca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7e5ca44-ee') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:09:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:09:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:09:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:09:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:09:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd97f70ad-3ead-52d6-b4c7-4ba839ab5003', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:09:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:09:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:09:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:09:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:09:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd7e5ca44-ee, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:09:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd7e5ca44-ee, col_values=(('qos', UUID('3acf65a2-73a8-461c-b2ef-11ef086c838c')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:09:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd7e5ca44-ee, col_values=(('external_ids', {'iface-id': 'd7e5ca44-eee3-4452-9649-5fcbfe5ed5ad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:16:8b', 'vm-uuid': '73fe8852-c47a-47ab-a56f-6864c8ed5479'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:09:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:10:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:00 user nova-compute[95467]: INFO os_vif [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:16:8b,bridge_name='br-int',has_traffic_filtering=True,id=d7e5ca44-eee3-4452-9649-5fcbfe5ed5ad,network=Network(d8a362dc-0dc8-49dd-b2da-0e0749d5edca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7e5ca44-ee')
Nov 15 08:10:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:00 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:10:00 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] No VIF found with MAC fa:16:3e:e5:16:8b, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:10:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:01 user nova-compute[95467]: DEBUG nova.network.neutron [req-d3447f3c-d8fc-4901-8012-396ee9850183 req-787808d3-e528-45c5-a782-d879fddae020 service nova] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] Updated VIF entry in instance network info cache for port d7e5ca44-eee3-4452-9649-5fcbfe5ed5ad. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:10:01 user nova-compute[95467]: DEBUG nova.network.neutron [req-d3447f3c-d8fc-4901-8012-396ee9850183 req-787808d3-e528-45c5-a782-d879fddae020 service nova] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] Updating instance_info_cache with network_info: [{"id": "d7e5ca44-eee3-4452-9649-5fcbfe5ed5ad", "address": "fa:16:3e:e5:16:8b", "network": {"id": "d8a362dc-0dc8-49dd-b2da-0e0749d5edca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-256373617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a1aa4f562c64545a94157d4aaf8d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7e5ca44-ee", "ovs_interfaceid": "d7e5ca44-eee3-4452-9649-5fcbfe5ed5ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:10:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-d3447f3c-d8fc-4901-8012-396ee9850183 req-787808d3-e528-45c5-a782-d879fddae020 service nova] Releasing lock "refresh_cache-73fe8852-c47a-47ab-a56f-6864c8ed5479" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:10:01 user nova-compute[95467]: DEBUG nova.network.neutron [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Successfully updated port: 5b51bd20-90a5-4fb1-816c-3d8e8824cb41 {{(pid=95467) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 08:10:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Acquiring lock "refresh_cache-36dccf43-d4a3-47aa-bd73-de9646e1020c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:10:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Acquired lock "refresh_cache-36dccf43-d4a3-47aa-bd73-de9646e1020c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:10:01 user nova-compute[95467]: DEBUG nova.network.neutron [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:10:01 user nova-compute[95467]: DEBUG nova.compute.manager [req-2e74fc12-b4b7-4977-b934-8086a4e82003 req-319d86d9-7078-4bd4-8b4f-d6ce060a579a service nova] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Received event network-changed-5b51bd20-90a5-4fb1-816c-3d8e8824cb41 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:10:01 user nova-compute[95467]: DEBUG nova.compute.manager [req-2e74fc12-b4b7-4977-b934-8086a4e82003 req-319d86d9-7078-4bd4-8b4f-d6ce060a579a service nova] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Refreshing instance network info cache due to event network-changed-5b51bd20-90a5-4fb1-816c-3d8e8824cb41. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:10:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-2e74fc12-b4b7-4977-b934-8086a4e82003 req-319d86d9-7078-4bd4-8b4f-d6ce060a579a service nova] Acquiring lock "refresh_cache-36dccf43-d4a3-47aa-bd73-de9646e1020c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:10:01 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:01 user nova-compute[95467]: DEBUG nova.network.neutron [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Instance cache missing network info. {{(pid=95467) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 08:10:01 user nova-compute[95467]: DEBUG nova.compute.manager [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] [instance: b9210bbe-e728-4724-924b-1963226c092d] Instance event wait completed in 0 seconds for  {{(pid=95467) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 08:10:01 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] [instance: b9210bbe-e728-4724-924b-1963226c092d] Guest created on hypervisor {{(pid=95467) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 08:10:01 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: b9210bbe-e728-4724-924b-1963226c092d] Instance spawned successfully.
Nov 15 08:10:01 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] [instance: b9210bbe-e728-4724-924b-1963226c092d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 08:10:01 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] [instance: b9210bbe-e728-4724-924b-1963226c092d] Found default for hw_cdrom_bus of ide {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:10:01 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] [instance: b9210bbe-e728-4724-924b-1963226c092d] Found default for hw_disk_bus of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:10:01 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] [instance: b9210bbe-e728-4724-924b-1963226c092d] Found default for hw_input_bus of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:10:01 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] [instance: b9210bbe-e728-4724-924b-1963226c092d] Found default for hw_pointer_model of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:10:01 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] [instance: b9210bbe-e728-4724-924b-1963226c092d] Found default for hw_video_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:10:01 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] [instance: b9210bbe-e728-4724-924b-1963226c092d] Found default for hw_vif_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:10:02 user nova-compute[95467]: INFO nova.compute.manager [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] [instance: b9210bbe-e728-4724-924b-1963226c092d] Took 12.82 seconds to spawn the instance on the hypervisor.
Nov 15 08:10:02 user nova-compute[95467]: DEBUG nova.compute.manager [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] [instance: b9210bbe-e728-4724-924b-1963226c092d] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:10:02 user nova-compute[95467]: INFO nova.compute.manager [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] [instance: b9210bbe-e728-4724-924b-1963226c092d] Took 13.73 seconds to build instance.
Nov 15 08:10:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-26372782-6283-4108-8064-13a2c4610763 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Lock "b9210bbe-e728-4724-924b-1963226c092d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.867s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:10:02 user nova-compute[95467]: DEBUG nova.network.neutron [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Updating instance_info_cache with network_info: [{"id": "5b51bd20-90a5-4fb1-816c-3d8e8824cb41", "address": "fa:16:3e:79:70:b1", "network": {"id": "f7871b75-73b3-4f0a-8e6c-814bc61ebd6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-945672014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b04c448c61451d8d46ebc7a61a5e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b51bd20-90", "ovs_interfaceid": "5b51bd20-90a5-4fb1-816c-3d8e8824cb41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:10:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Releasing lock "refresh_cache-36dccf43-d4a3-47aa-bd73-de9646e1020c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:10:02 user nova-compute[95467]: DEBUG nova.compute.manager [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Instance network_info: |[{"id": "5b51bd20-90a5-4fb1-816c-3d8e8824cb41", "address": "fa:16:3e:79:70:b1", "network": {"id": "f7871b75-73b3-4f0a-8e6c-814bc61ebd6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-945672014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b04c448c61451d8d46ebc7a61a5e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b51bd20-90", "ovs_interfaceid": "5b51bd20-90a5-4fb1-816c-3d8e8824cb41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 08:10:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-2e74fc12-b4b7-4977-b934-8086a4e82003 req-319d86d9-7078-4bd4-8b4f-d6ce060a579a service nova] Acquired lock "refresh_cache-36dccf43-d4a3-47aa-bd73-de9646e1020c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:10:02 user nova-compute[95467]: DEBUG nova.network.neutron [req-2e74fc12-b4b7-4977-b934-8086a4e82003 req-319d86d9-7078-4bd4-8b4f-d6ce060a579a service nova] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Refreshing network info cache for port 5b51bd20-90a5-4fb1-816c-3d8e8824cb41 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:10:02 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Start _get_guest_xml network_info=[{"id": "5b51bd20-90a5-4fb1-816c-3d8e8824cb41", "address": "fa:16:3e:79:70:b1", "network": {"id": "f7871b75-73b3-4f0a-8e6c-814bc61ebd6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-945672014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b04c448c61451d8d46ebc7a61a5e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b51bd20-90", "ovs_interfaceid": "5b51bd20-90a5-4fb1-816c-3d8e8824cb41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'ed9c48aa-ce73-4b3b-9db1-235898be671b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:10:02 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:10:02 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:10:02 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:10:02 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:10:02 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:10:02 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:10:02 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:10:02 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:10:02 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:10:02 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:10:02 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:10:02 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:10:02 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:10:02 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:10:02 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:10:02 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:10:02 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:10:02 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:10:02 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:09:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1540652883',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1540652883',id=5,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPMudjIgLQ94PJgpuT923qN+L46wuVWcOs/AgJykHjR77r/+WQhcSpcm7aHqbK6GHFvMQ7s34dtAlIeCULffYjuYC9U228iElL9IbpM1YAAXm8GMSQ4zQ7BkpCVv6WHbg==',key_name='tempest-keypair-1788942377',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94b04c448c61451d8d46ebc7a61a5e6e',ramdisk_id='',reservation_id='r-0d1eau01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1251988905',owner_user_name='tempest-AttachVolumeShelveTestJSON-1251988905-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:09:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b03564d022e84f5cb133b9771e76bae8',uuid=36dccf43-d4a3-47aa-bd73-de9646e1020c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b51bd20-90a5-4fb1-816c-3d8e8824cb41", "address": "fa:16:3e:79:70:b1", "network": {"id": "f7871b75-73b3-4f0a-8e6c-814bc61ebd6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-945672014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b04c448c61451d8d46ebc7a61a5e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b51bd20-90", "ovs_interfaceid": "5b51bd20-90a5-4fb1-816c-3d8e8824cb41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:10:02 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Converting VIF {"id": "5b51bd20-90a5-4fb1-816c-3d8e8824cb41", "address": "fa:16:3e:79:70:b1", "network": {"id": "f7871b75-73b3-4f0a-8e6c-814bc61ebd6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-945672014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b04c448c61451d8d46ebc7a61a5e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b51bd20-90", "ovs_interfaceid": "5b51bd20-90a5-4fb1-816c-3d8e8824cb41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:10:02 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:70:b1,bridge_name='br-int',has_traffic_filtering=True,id=5b51bd20-90a5-4fb1-816c-3d8e8824cb41,network=Network(f7871b75-73b3-4f0a-8e6c-814bc61ebd6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b51bd20-90') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:10:02 user nova-compute[95467]: DEBUG nova.objects.instance [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lazy-loading 'pci_devices' on Instance uuid 36dccf43-d4a3-47aa-bd73-de9646e1020c {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:10:02 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:10:02 user nova-compute[95467]:   <uuid>36dccf43-d4a3-47aa-bd73-de9646e1020c</uuid>
Nov 15 08:10:02 user nova-compute[95467]:   <name>instance-00000005</name>
Nov 15 08:10:02 user nova-compute[95467]:   <memory>524288</memory>
Nov 15 08:10:02 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:10:02 user nova-compute[95467]:   <metadata>
Nov 15 08:10:02 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:10:02 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:10:02 user nova-compute[95467]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1540652883</nova:name>
Nov 15 08:10:02 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:10:02</nova:creationTime>
Nov 15 08:10:02 user nova-compute[95467]:       <nova:flavor name="m1.tiny">
Nov 15 08:10:02 user nova-compute[95467]:         <nova:memory>512</nova:memory>
Nov 15 08:10:02 user nova-compute[95467]:         <nova:disk>1</nova:disk>
Nov 15 08:10:02 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:10:02 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:10:02 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:10:02 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:10:02 user nova-compute[95467]:       <nova:owner>
Nov 15 08:10:02 user nova-compute[95467]:         <nova:user uuid="b03564d022e84f5cb133b9771e76bae8">tempest-AttachVolumeShelveTestJSON-1251988905-project-member</nova:user>
Nov 15 08:10:02 user nova-compute[95467]:         <nova:project uuid="94b04c448c61451d8d46ebc7a61a5e6e">tempest-AttachVolumeShelveTestJSON-1251988905</nova:project>
Nov 15 08:10:02 user nova-compute[95467]:       </nova:owner>
Nov 15 08:10:02 user nova-compute[95467]:       <nova:root type="image" uuid="ed9c48aa-ce73-4b3b-9db1-235898be671b"/>
Nov 15 08:10:02 user nova-compute[95467]:       <nova:ports>
Nov 15 08:10:02 user nova-compute[95467]:         <nova:port uuid="5b51bd20-90a5-4fb1-816c-3d8e8824cb41">
Nov 15 08:10:02 user nova-compute[95467]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 08:10:02 user nova-compute[95467]:         </nova:port>
Nov 15 08:10:02 user nova-compute[95467]:       </nova:ports>
Nov 15 08:10:02 user nova-compute[95467]:     </nova:instance>
Nov 15 08:10:02 user nova-compute[95467]:   </metadata>
Nov 15 08:10:02 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:10:02 user nova-compute[95467]:     <system>
Nov 15 08:10:02 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:10:02 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:10:02 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:10:02 user nova-compute[95467]:       <entry name="serial">36dccf43-d4a3-47aa-bd73-de9646e1020c</entry>
Nov 15 08:10:02 user nova-compute[95467]:       <entry name="uuid">36dccf43-d4a3-47aa-bd73-de9646e1020c</entry>
Nov 15 08:10:02 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:10:02 user nova-compute[95467]:     </system>
Nov 15 08:10:02 user nova-compute[95467]:   </sysinfo>
Nov 15 08:10:02 user nova-compute[95467]:   <os>
Nov 15 08:10:02 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:10:02 user nova-compute[95467]:     <boot dev="hd"/>
Nov 15 08:10:02 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:10:02 user nova-compute[95467]:   </os>
Nov 15 08:10:02 user nova-compute[95467]:   <features>
Nov 15 08:10:02 user nova-compute[95467]:     <acpi/>
Nov 15 08:10:02 user nova-compute[95467]:     <apic/>
Nov 15 08:10:02 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:10:02 user nova-compute[95467]:   </features>
Nov 15 08:10:02 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:10:02 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:10:02 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:10:02 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:10:02 user nova-compute[95467]:   </clock>
Nov 15 08:10:02 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:10:02 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:10:02 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:10:02 user nova-compute[95467]:   </cpu>
Nov 15 08:10:02 user nova-compute[95467]:   <devices>
Nov 15 08:10:02 user nova-compute[95467]:     <disk type="file" device="disk">
Nov 15 08:10:02 user nova-compute[95467]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 08:10:02 user nova-compute[95467]:       <source file="/opt/stack/data/nova/instances/36dccf43-d4a3-47aa-bd73-de9646e1020c/disk"/>
Nov 15 08:10:02 user nova-compute[95467]:       <target dev="vda" bus="virtio"/>
Nov 15 08:10:02 user nova-compute[95467]:     </disk>
Nov 15 08:10:02 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:10:02 user nova-compute[95467]:       <mac address="fa:16:3e:79:70:b1"/>
Nov 15 08:10:02 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:10:02 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:10:02 user nova-compute[95467]:       <target dev="tap5b51bd20-90"/>
Nov 15 08:10:02 user nova-compute[95467]:     </interface>
Nov 15 08:10:02 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:10:02 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/36dccf43-d4a3-47aa-bd73-de9646e1020c/console.log" append="off"/>
Nov 15 08:10:02 user nova-compute[95467]:     </serial>
Nov 15 08:10:02 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:10:02 user nova-compute[95467]:     <video>
Nov 15 08:10:02 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:10:02 user nova-compute[95467]:     </video>
Nov 15 08:10:02 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:10:02 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:10:02 user nova-compute[95467]:     </rng>
Nov 15 08:10:02 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:10:02 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:10:02 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:10:02 user nova-compute[95467]:     </memballoon>
Nov 15 08:10:02 user nova-compute[95467]:   </devices>
Nov 15 08:10:02 user nova-compute[95467]: </domain>
Nov 15 08:10:02 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:10:02 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:09:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1540652883',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1540652883',id=5,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPMudjIgLQ94PJgpuT923qN+L46wuVWcOs/AgJykHjR77r/+WQhcSpcm7aHqbK6GHFvMQ7s34dtAlIeCULffYjuYC9U228iElL9IbpM1YAAXm8GMSQ4zQ7BkpCVv6WHbg==',key_name='tempest-keypair-1788942377',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94b04c448c61451d8d46ebc7a61a5e6e',ramdisk_id='',reservation_id='r-0d1eau01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1251988905',owner_user_name='tempest-AttachVolumeShelveTestJSON-1251988905-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:09:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b03564d022e84f5cb133b9771e76bae8',uuid=36dccf43-d4a3-47aa-bd73-de9646e1020c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b51bd20-90a5-4fb1-816c-3d8e8824cb41", "address": "fa:16:3e:79:70:b1", "network": {"id": "f7871b75-73b3-4f0a-8e6c-814bc61ebd6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-945672014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b04c448c61451d8d46ebc7a61a5e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b51bd20-90", "ovs_interfaceid": "5b51bd20-90a5-4fb1-816c-3d8e8824cb41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:10:02 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Converting VIF {"id": "5b51bd20-90a5-4fb1-816c-3d8e8824cb41", "address": "fa:16:3e:79:70:b1", "network": {"id": "f7871b75-73b3-4f0a-8e6c-814bc61ebd6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-945672014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b04c448c61451d8d46ebc7a61a5e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b51bd20-90", "ovs_interfaceid": "5b51bd20-90a5-4fb1-816c-3d8e8824cb41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:10:02 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:70:b1,bridge_name='br-int',has_traffic_filtering=True,id=5b51bd20-90a5-4fb1-816c-3d8e8824cb41,network=Network(f7871b75-73b3-4f0a-8e6c-814bc61ebd6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b51bd20-90') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:10:02 user nova-compute[95467]: DEBUG os_vif [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:70:b1,bridge_name='br-int',has_traffic_filtering=True,id=5b51bd20-90a5-4fb1-816c-3d8e8824cb41,network=Network(f7871b75-73b3-4f0a-8e6c-814bc61ebd6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b51bd20-90') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:10:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:10:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7e62ca1b-d74e-5c0b-949c-e8a0ece1b8a6', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:10:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b51bd20-90, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5b51bd20-90, col_values=(('qos', UUID('15ee3c0b-6aa1-47a5-8594-7a8928f937a1')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5b51bd20-90, col_values=(('external_ids', {'iface-id': '5b51bd20-90a5-4fb1-816c-3d8e8824cb41', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:70:b1', 'vm-uuid': '36dccf43-d4a3-47aa-bd73-de9646e1020c'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:10:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:02 user nova-compute[95467]: INFO os_vif [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:70:b1,bridge_name='br-int',has_traffic_filtering=True,id=5b51bd20-90a5-4fb1-816c-3d8e8824cb41,network=Network(f7871b75-73b3-4f0a-8e6c-814bc61ebd6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b51bd20-90')
Nov 15 08:10:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:03 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:10:03 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] No VIF found with MAC fa:16:3e:79:70:b1, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:10:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:03 user nova-compute[95467]: DEBUG nova.network.neutron [req-2e74fc12-b4b7-4977-b934-8086a4e82003 req-319d86d9-7078-4bd4-8b4f-d6ce060a579a service nova] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Updated VIF entry in instance network info cache for port 5b51bd20-90a5-4fb1-816c-3d8e8824cb41. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:10:03 user nova-compute[95467]: DEBUG nova.network.neutron [req-2e74fc12-b4b7-4977-b934-8086a4e82003 req-319d86d9-7078-4bd4-8b4f-d6ce060a579a service nova] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Updating instance_info_cache with network_info: [{"id": "5b51bd20-90a5-4fb1-816c-3d8e8824cb41", "address": "fa:16:3e:79:70:b1", "network": {"id": "f7871b75-73b3-4f0a-8e6c-814bc61ebd6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-945672014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b04c448c61451d8d46ebc7a61a5e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b51bd20-90", "ovs_interfaceid": "5b51bd20-90a5-4fb1-816c-3d8e8824cb41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:10:03 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-2e74fc12-b4b7-4977-b934-8086a4e82003 req-319d86d9-7078-4bd4-8b4f-d6ce060a579a service nova] Releasing lock "refresh_cache-36dccf43-d4a3-47aa-bd73-de9646e1020c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:10:04 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:04 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:04 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:04 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:04 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:04 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:04 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:04 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:04 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:04 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:05 user nova-compute[95467]: DEBUG nova.compute.manager [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: ee2aa477-6786-483a-b088-d8ec204fe6aa] Instance event wait completed in 0 seconds for  {{(pid=95467) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 08:10:05 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: ee2aa477-6786-483a-b088-d8ec204fe6aa] Guest created on hypervisor {{(pid=95467) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 08:10:05 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: ee2aa477-6786-483a-b088-d8ec204fe6aa] Instance spawned successfully.
Nov 15 08:10:05 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: ee2aa477-6786-483a-b088-d8ec204fe6aa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 08:10:05 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: ee2aa477-6786-483a-b088-d8ec204fe6aa] Found default for hw_cdrom_bus of ide {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:10:05 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: ee2aa477-6786-483a-b088-d8ec204fe6aa] Found default for hw_disk_bus of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:10:05 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: ee2aa477-6786-483a-b088-d8ec204fe6aa] Found default for hw_input_bus of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:10:05 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: ee2aa477-6786-483a-b088-d8ec204fe6aa] Found default for hw_pointer_model of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:10:05 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: ee2aa477-6786-483a-b088-d8ec204fe6aa] Found default for hw_video_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:10:05 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: ee2aa477-6786-483a-b088-d8ec204fe6aa] Found default for hw_vif_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:10:05 user nova-compute[95467]: INFO nova.compute.manager [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: ee2aa477-6786-483a-b088-d8ec204fe6aa] Took 20.10 seconds to spawn the instance on the hypervisor.
Nov 15 08:10:05 user nova-compute[95467]: DEBUG nova.compute.manager [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: ee2aa477-6786-483a-b088-d8ec204fe6aa] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:10:05 user nova-compute[95467]: INFO nova.compute.manager [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: ee2aa477-6786-483a-b088-d8ec204fe6aa] Took 21.11 seconds to build instance.
Nov 15 08:10:05 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-9cfb1c3f-5eb9-46ce-a800-a2be41ff2ee9 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Lock "ee2aa477-6786-483a-b088-d8ec204fe6aa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.567s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:10:06 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Acquiring lock "68264a44-5adf-4873-b380-26bcafe2ba04" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:10:06 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Lock "68264a44-5adf-4873-b380-26bcafe2ba04" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:10:06 user nova-compute[95467]: DEBUG nova.compute.manager [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] Instance event wait completed in 0 seconds for  {{(pid=95467) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 08:10:06 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] Guest created on hypervisor {{(pid=95467) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 08:10:06 user nova-compute[95467]: DEBUG nova.compute.manager [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Starting instance... {{(pid=95467) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 08:10:06 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] Instance spawned successfully.
Nov 15 08:10:06 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 08:10:06 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] Found default for hw_cdrom_bus of ide {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:10:06 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] Found default for hw_disk_bus of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:10:06 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] Found default for hw_input_bus of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:10:06 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] Found default for hw_pointer_model of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:10:06 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] Found default for hw_video_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:10:06 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] Found default for hw_vif_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:10:06 user nova-compute[95467]: INFO nova.compute.manager [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] Took 15.23 seconds to spawn the instance on the hypervisor.
Nov 15 08:10:06 user nova-compute[95467]: DEBUG nova.compute.manager [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:10:06 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:10:06 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:10:06 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:06 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=95467) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 08:10:06 user nova-compute[95467]: INFO nova.compute.claims [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Claim successful on node user
Nov 15 08:10:06 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:06 user nova-compute[95467]: INFO nova.compute.manager [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] Took 15.95 seconds to build instance.
Nov 15 08:10:06 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:06 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-72b96579-ffad-414a-b9a7-deae49f59fc9 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "5748cf5d-9c57-4477-8952-ec39d0d18f55" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.210s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:10:07 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:10:07 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:10:07 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.698s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:10:07 user nova-compute[95467]: DEBUG nova.compute.manager [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Start building networks asynchronously for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 08:10:07 user nova-compute[95467]: DEBUG nova.compute.manager [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Allocating IP information in the background. {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 08:10:07 user nova-compute[95467]: DEBUG nova.network.neutron [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] allocate_for_instance() {{(pid=95467) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 08:10:07 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 08:10:07 user nova-compute[95467]: DEBUG nova.compute.manager [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] Instance event wait completed in 0 seconds for  {{(pid=95467) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 08:10:07 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] Guest created on hypervisor {{(pid=95467) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 08:10:07 user nova-compute[95467]: DEBUG nova.compute.manager [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Start building block device mappings for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 08:10:07 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] Instance spawned successfully.
Nov 15 08:10:07 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 08:10:07 user nova-compute[95467]: DEBUG nova.policy [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '331b706f494247759f827dbb1efcb663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f1d989dd2242bfad9c3a5d7380c887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95467) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 08:10:07 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] Found default for hw_cdrom_bus of ide {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:10:07 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] Found default for hw_disk_bus of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:10:07 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] Found default for hw_input_bus of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:10:07 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] Found default for hw_pointer_model of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:10:07 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] Found default for hw_video_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:10:07 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] Found default for hw_vif_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:10:07 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:07 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:07 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:07 user nova-compute[95467]: INFO nova.compute.manager [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] Took 14.80 seconds to spawn the instance on the hypervisor.
Nov 15 08:10:07 user nova-compute[95467]: DEBUG nova.compute.manager [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:10:07 user nova-compute[95467]: DEBUG nova.compute.manager [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Start spawning the instance on the hypervisor. {{(pid=95467) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 08:10:07 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Creating instance directory {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 08:10:07 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Creating image(s)
Nov 15 08:10:07 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Acquiring lock "/opt/stack/data/nova/instances/68264a44-5adf-4873-b380-26bcafe2ba04/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:10:07 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Lock "/opt/stack/data/nova/instances/68264a44-5adf-4873-b380-26bcafe2ba04/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:10:07 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Lock "/opt/stack/data/nova/instances/68264a44-5adf-4873-b380-26bcafe2ba04/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:10:07 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:07 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:07 user nova-compute[95467]: DEBUG nova.compute.manager [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Instance event wait completed in 0 seconds for  {{(pid=95467) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 08:10:07 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Guest created on hypervisor {{(pid=95467) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 08:10:07 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.280s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:07 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Acquiring lock "a3fcf60225fcefd310404971cd18ab9851c548dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:10:07 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.005s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:10:07 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:08 user nova-compute[95467]: INFO nova.compute.manager [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] Took 16.08 seconds to build instance.
Nov 15 08:10:08 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Instance spawned successfully.
Nov 15 08:10:08 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 08:10:08 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8800f30c-2189-4640-9344-3ae37ba5009b tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "73fe8852-c47a-47ab-a56f-6864c8ed5479" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.207s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:10:08 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Found default for hw_cdrom_bus of ide {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:10:08 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Found default for hw_disk_bus of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:10:08 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Found default for hw_input_bus of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:10:08 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Found default for hw_pointer_model of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:10:08 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Found default for hw_video_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:10:08 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Found default for hw_vif_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:10:08 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.318s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:08 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/68264a44-5adf-4873-b380-26bcafe2ba04/disk 1073741824 {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:08 user nova-compute[95467]: INFO nova.compute.manager [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Took 11.88 seconds to spawn the instance on the hypervisor.
Nov 15 08:10:08 user nova-compute[95467]: DEBUG nova.compute.manager [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:10:08 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/68264a44-5adf-4873-b380-26bcafe2ba04/disk 1073741824" returned: 0 in 0.070s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:08 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.392s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:10:08 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:08 user nova-compute[95467]: INFO nova.compute.manager [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Took 12.82 seconds to build instance.
Nov 15 08:10:08 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.239s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:08 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Checking if we can resize image /opt/stack/data/nova/instances/68264a44-5adf-4873-b380-26bcafe2ba04/disk. size=1073741824 {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 08:10:08 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68264a44-5adf-4873-b380-26bcafe2ba04/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:08 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a1366344-8cd0-4df8-bf58-b94c190472bf tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "36dccf43-d4a3-47aa-bd73-de9646e1020c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.006s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:10:08 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:08 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:08 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68264a44-5adf-4873-b380-26bcafe2ba04/disk --force-share --output=json" returned: 0 in 0.382s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:09 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Cannot resize image /opt/stack/data/nova/instances/68264a44-5adf-4873-b380-26bcafe2ba04/disk to a smaller size. {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 08:10:09 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Created local disks {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 08:10:09 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Ensure instance console log exists: /opt/stack/data/nova/instances/68264a44-5adf-4873-b380-26bcafe2ba04/console.log {{(pid=95467) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 08:10:09 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:10:09 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:10:09 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:10:09 user nova-compute[95467]: DEBUG nova.network.neutron [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Successfully created port: 10ed2f01-5666-4615-be28-c574ff652c1d {{(pid=95467) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 08:10:09 user nova-compute[95467]: DEBUG nova.compute.manager [req-0ff00efd-1277-441c-89be-437e7ea98db0 req-4b1dcbe8-aa03-4eba-90ca-fc5594e3d7fd service nova] [instance: ee2aa477-6786-483a-b088-d8ec204fe6aa] Received event network-vif-plugged-5e362799-1ab1-48d5-9ef2-1a90ce83cd80 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:10:09 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-0ff00efd-1277-441c-89be-437e7ea98db0 req-4b1dcbe8-aa03-4eba-90ca-fc5594e3d7fd service nova] Acquiring lock "ee2aa477-6786-483a-b088-d8ec204fe6aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:10:09 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-0ff00efd-1277-441c-89be-437e7ea98db0 req-4b1dcbe8-aa03-4eba-90ca-fc5594e3d7fd service nova] Lock "ee2aa477-6786-483a-b088-d8ec204fe6aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:10:09 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-0ff00efd-1277-441c-89be-437e7ea98db0 req-4b1dcbe8-aa03-4eba-90ca-fc5594e3d7fd service nova] Lock "ee2aa477-6786-483a-b088-d8ec204fe6aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:10:09 user nova-compute[95467]: DEBUG nova.compute.manager [req-0ff00efd-1277-441c-89be-437e7ea98db0 req-4b1dcbe8-aa03-4eba-90ca-fc5594e3d7fd service nova] [instance: ee2aa477-6786-483a-b088-d8ec204fe6aa] No waiting events found dispatching network-vif-plugged-5e362799-1ab1-48d5-9ef2-1a90ce83cd80 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:10:09 user nova-compute[95467]: WARNING nova.compute.manager [req-0ff00efd-1277-441c-89be-437e7ea98db0 req-4b1dcbe8-aa03-4eba-90ca-fc5594e3d7fd service nova] [instance: ee2aa477-6786-483a-b088-d8ec204fe6aa] Received unexpected event network-vif-plugged-5e362799-1ab1-48d5-9ef2-1a90ce83cd80 for instance with vm_state active and task_state None.
Nov 15 08:10:09 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:09 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:10 user nova-compute[95467]: DEBUG nova.network.neutron [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Successfully updated port: 10ed2f01-5666-4615-be28-c574ff652c1d {{(pid=95467) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 08:10:10 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Acquiring lock "refresh_cache-68264a44-5adf-4873-b380-26bcafe2ba04" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:10:10 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Acquired lock "refresh_cache-68264a44-5adf-4873-b380-26bcafe2ba04" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:10:10 user nova-compute[95467]: DEBUG nova.network.neutron [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:10:10 user nova-compute[95467]: DEBUG nova.compute.manager [req-bc813090-90a4-4c4c-af1c-8331716c0d55 req-899bcc8c-85c4-4dd9-bb62-b824418580e8 service nova] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Received event network-changed-10ed2f01-5666-4615-be28-c574ff652c1d {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:10:10 user nova-compute[95467]: DEBUG nova.compute.manager [req-bc813090-90a4-4c4c-af1c-8331716c0d55 req-899bcc8c-85c4-4dd9-bb62-b824418580e8 service nova] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Refreshing instance network info cache due to event network-changed-10ed2f01-5666-4615-be28-c574ff652c1d. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:10:10 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-bc813090-90a4-4c4c-af1c-8331716c0d55 req-899bcc8c-85c4-4dd9-bb62-b824418580e8 service nova] Acquiring lock "refresh_cache-68264a44-5adf-4873-b380-26bcafe2ba04" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:10:10 user nova-compute[95467]: DEBUG nova.network.neutron [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Instance cache missing network info. {{(pid=95467) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 08:10:11 user nova-compute[95467]: DEBUG nova.compute.manager [req-61b6e028-1089-4502-97ce-4c46db340da5 req-03ed3e14-450b-4517-83cb-1bd6f7636575 service nova] [instance: ee2aa477-6786-483a-b088-d8ec204fe6aa] Received event network-vif-plugged-5e362799-1ab1-48d5-9ef2-1a90ce83cd80 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:10:11 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-61b6e028-1089-4502-97ce-4c46db340da5 req-03ed3e14-450b-4517-83cb-1bd6f7636575 service nova] Acquiring lock "ee2aa477-6786-483a-b088-d8ec204fe6aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:10:11 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-61b6e028-1089-4502-97ce-4c46db340da5 req-03ed3e14-450b-4517-83cb-1bd6f7636575 service nova] Lock "ee2aa477-6786-483a-b088-d8ec204fe6aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:10:11 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-61b6e028-1089-4502-97ce-4c46db340da5 req-03ed3e14-450b-4517-83cb-1bd6f7636575 service nova] Lock "ee2aa477-6786-483a-b088-d8ec204fe6aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:10:11 user nova-compute[95467]: DEBUG nova.compute.manager [req-61b6e028-1089-4502-97ce-4c46db340da5 req-03ed3e14-450b-4517-83cb-1bd6f7636575 service nova] [instance: ee2aa477-6786-483a-b088-d8ec204fe6aa] No waiting events found dispatching network-vif-plugged-5e362799-1ab1-48d5-9ef2-1a90ce83cd80 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:10:11 user nova-compute[95467]: WARNING nova.compute.manager [req-61b6e028-1089-4502-97ce-4c46db340da5 req-03ed3e14-450b-4517-83cb-1bd6f7636575 service nova] [instance: ee2aa477-6786-483a-b088-d8ec204fe6aa] Received unexpected event network-vif-plugged-5e362799-1ab1-48d5-9ef2-1a90ce83cd80 for instance with vm_state active and task_state None.
Nov 15 08:10:11 user nova-compute[95467]: DEBUG nova.network.neutron [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Updating instance_info_cache with network_info: [{"id": "10ed2f01-5666-4615-be28-c574ff652c1d", "address": "fa:16:3e:82:8d:0f", "network": {"id": "4e5f387a-ee4d-4e5b-bbb3-0d3af738de45", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-839692973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6f1d989dd2242bfad9c3a5d7380c887", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10ed2f01-56", "ovs_interfaceid": "10ed2f01-5666-4615-be28-c574ff652c1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:10:11 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Releasing lock "refresh_cache-68264a44-5adf-4873-b380-26bcafe2ba04" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:10:11 user nova-compute[95467]: DEBUG nova.compute.manager [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Instance network_info: |[{"id": "10ed2f01-5666-4615-be28-c574ff652c1d", "address": "fa:16:3e:82:8d:0f", "network": {"id": "4e5f387a-ee4d-4e5b-bbb3-0d3af738de45", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-839692973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6f1d989dd2242bfad9c3a5d7380c887", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10ed2f01-56", "ovs_interfaceid": "10ed2f01-5666-4615-be28-c574ff652c1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 08:10:11 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-bc813090-90a4-4c4c-af1c-8331716c0d55 req-899bcc8c-85c4-4dd9-bb62-b824418580e8 service nova] Acquired lock "refresh_cache-68264a44-5adf-4873-b380-26bcafe2ba04" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:10:11 user nova-compute[95467]: DEBUG nova.network.neutron [req-bc813090-90a4-4c4c-af1c-8331716c0d55 req-899bcc8c-85c4-4dd9-bb62-b824418580e8 service nova] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Refreshing network info cache for port 10ed2f01-5666-4615-be28-c574ff652c1d {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:10:11 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Start _get_guest_xml network_info=[{"id": "10ed2f01-5666-4615-be28-c574ff652c1d", "address": "fa:16:3e:82:8d:0f", "network": {"id": "4e5f387a-ee4d-4e5b-bbb3-0d3af738de45", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-839692973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6f1d989dd2242bfad9c3a5d7380c887", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10ed2f01-56", "ovs_interfaceid": "10ed2f01-5666-4615-be28-c574ff652c1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'ed9c48aa-ce73-4b3b-9db1-235898be671b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:10:11 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:10:11 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:10:11 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:10:11 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:10:11 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:10:11 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:10:11 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:10:11 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:10:11 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:10:11 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:10:11 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:10:11 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:10:11 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:10:11 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:10:11 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:10:11 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:10:11 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:10:11 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:10:11 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:10:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-786424798',display_name='tempest-VolumesAdminNegativeTest-server-786424798',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-786424798',id=6,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVFQLpomGOlTe7RQfiaXsxb49npzMYEHUdYLYmq6p1hZqbGb3qfTM22mebsuEDCAbks47UXSp1jmcKxYvQgLP0bqoh37F7q5rCzdt2jYQ94J5zx8A7As4d9iaN26WPb0A==',key_name='tempest-keypair-1487563835',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6f1d989dd2242bfad9c3a5d7380c887',ramdisk_id='',reservation_id='r-uc06nhha',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1724237472',owner_user_name='tempest-VolumesAdminNegativeTest-1724237472-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:10:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='331b706f494247759f827dbb1efcb663',uuid=68264a44-5adf-4873-b380-26bcafe2ba04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10ed2f01-5666-4615-be28-c574ff652c1d", "address": "fa:16:3e:82:8d:0f", "network": {"id": "4e5f387a-ee4d-4e5b-bbb3-0d3af738de45", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-839692973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6f1d989dd2242bfad9c3a5d7380c887", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10ed2f01-56", "ovs_interfaceid": "10ed2f01-5666-4615-be28-c574ff652c1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:10:11 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Converting VIF {"id": "10ed2f01-5666-4615-be28-c574ff652c1d", "address": "fa:16:3e:82:8d:0f", "network": {"id": "4e5f387a-ee4d-4e5b-bbb3-0d3af738de45", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-839692973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6f1d989dd2242bfad9c3a5d7380c887", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10ed2f01-56", "ovs_interfaceid": "10ed2f01-5666-4615-be28-c574ff652c1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:10:11 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:8d:0f,bridge_name='br-int',has_traffic_filtering=True,id=10ed2f01-5666-4615-be28-c574ff652c1d,network=Network(4e5f387a-ee4d-4e5b-bbb3-0d3af738de45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10ed2f01-56') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:10:11 user nova-compute[95467]: DEBUG nova.objects.instance [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Lazy-loading 'pci_devices' on Instance uuid 68264a44-5adf-4873-b380-26bcafe2ba04 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:10:11 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:10:11 user nova-compute[95467]:   <uuid>68264a44-5adf-4873-b380-26bcafe2ba04</uuid>
Nov 15 08:10:11 user nova-compute[95467]:   <name>instance-00000006</name>
Nov 15 08:10:11 user nova-compute[95467]:   <memory>524288</memory>
Nov 15 08:10:11 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:10:11 user nova-compute[95467]:   <metadata>
Nov 15 08:10:11 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:10:11 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:10:11 user nova-compute[95467]:       <nova:name>tempest-VolumesAdminNegativeTest-server-786424798</nova:name>
Nov 15 08:10:11 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:10:11</nova:creationTime>
Nov 15 08:10:11 user nova-compute[95467]:       <nova:flavor name="m1.tiny">
Nov 15 08:10:11 user nova-compute[95467]:         <nova:memory>512</nova:memory>
Nov 15 08:10:11 user nova-compute[95467]:         <nova:disk>1</nova:disk>
Nov 15 08:10:11 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:10:11 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:10:11 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:10:11 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:10:11 user nova-compute[95467]:       <nova:owner>
Nov 15 08:10:11 user nova-compute[95467]:         <nova:user uuid="331b706f494247759f827dbb1efcb663">tempest-VolumesAdminNegativeTest-1724237472-project-member</nova:user>
Nov 15 08:10:11 user nova-compute[95467]:         <nova:project uuid="d6f1d989dd2242bfad9c3a5d7380c887">tempest-VolumesAdminNegativeTest-1724237472</nova:project>
Nov 15 08:10:11 user nova-compute[95467]:       </nova:owner>
Nov 15 08:10:11 user nova-compute[95467]:       <nova:root type="image" uuid="ed9c48aa-ce73-4b3b-9db1-235898be671b"/>
Nov 15 08:10:11 user nova-compute[95467]:       <nova:ports>
Nov 15 08:10:11 user nova-compute[95467]:         <nova:port uuid="10ed2f01-5666-4615-be28-c574ff652c1d">
Nov 15 08:10:11 user nova-compute[95467]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 08:10:11 user nova-compute[95467]:         </nova:port>
Nov 15 08:10:11 user nova-compute[95467]:       </nova:ports>
Nov 15 08:10:11 user nova-compute[95467]:     </nova:instance>
Nov 15 08:10:11 user nova-compute[95467]:   </metadata>
Nov 15 08:10:11 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:10:11 user nova-compute[95467]:     <system>
Nov 15 08:10:11 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:10:11 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:10:11 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:10:11 user nova-compute[95467]:       <entry name="serial">68264a44-5adf-4873-b380-26bcafe2ba04</entry>
Nov 15 08:10:11 user nova-compute[95467]:       <entry name="uuid">68264a44-5adf-4873-b380-26bcafe2ba04</entry>
Nov 15 08:10:11 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:10:11 user nova-compute[95467]:     </system>
Nov 15 08:10:11 user nova-compute[95467]:   </sysinfo>
Nov 15 08:10:11 user nova-compute[95467]:   <os>
Nov 15 08:10:11 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:10:11 user nova-compute[95467]:     <boot dev="hd"/>
Nov 15 08:10:11 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:10:11 user nova-compute[95467]:   </os>
Nov 15 08:10:11 user nova-compute[95467]:   <features>
Nov 15 08:10:11 user nova-compute[95467]:     <acpi/>
Nov 15 08:10:11 user nova-compute[95467]:     <apic/>
Nov 15 08:10:11 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:10:11 user nova-compute[95467]:   </features>
Nov 15 08:10:11 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:10:11 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:10:11 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:10:11 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:10:11 user nova-compute[95467]:   </clock>
Nov 15 08:10:11 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:10:11 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:10:11 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:10:11 user nova-compute[95467]:   </cpu>
Nov 15 08:10:11 user nova-compute[95467]:   <devices>
Nov 15 08:10:11 user nova-compute[95467]:     <disk type="file" device="disk">
Nov 15 08:10:11 user nova-compute[95467]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 08:10:11 user nova-compute[95467]:       <source file="/opt/stack/data/nova/instances/68264a44-5adf-4873-b380-26bcafe2ba04/disk"/>
Nov 15 08:10:11 user nova-compute[95467]:       <target dev="vda" bus="virtio"/>
Nov 15 08:10:11 user nova-compute[95467]:     </disk>
Nov 15 08:10:11 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:10:11 user nova-compute[95467]:       <mac address="fa:16:3e:82:8d:0f"/>
Nov 15 08:10:11 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:10:11 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:10:11 user nova-compute[95467]:       <target dev="tap10ed2f01-56"/>
Nov 15 08:10:11 user nova-compute[95467]:     </interface>
Nov 15 08:10:11 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:10:11 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/68264a44-5adf-4873-b380-26bcafe2ba04/console.log" append="off"/>
Nov 15 08:10:11 user nova-compute[95467]:     </serial>
Nov 15 08:10:11 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:10:11 user nova-compute[95467]:     <video>
Nov 15 08:10:11 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:10:11 user nova-compute[95467]:     </video>
Nov 15 08:10:11 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:10:11 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:10:11 user nova-compute[95467]:     </rng>
Nov 15 08:10:11 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:10:11 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:10:11 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:10:11 user nova-compute[95467]:     </memballoon>
Nov 15 08:10:11 user nova-compute[95467]:   </devices>
Nov 15 08:10:11 user nova-compute[95467]: </domain>
Nov 15 08:10:11 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:10:11 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:10:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-786424798',display_name='tempest-VolumesAdminNegativeTest-server-786424798',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-786424798',id=6,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVFQLpomGOlTe7RQfiaXsxb49npzMYEHUdYLYmq6p1hZqbGb3qfTM22mebsuEDCAbks47UXSp1jmcKxYvQgLP0bqoh37F7q5rCzdt2jYQ94J5zx8A7As4d9iaN26WPb0A==',key_name='tempest-keypair-1487563835',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6f1d989dd2242bfad9c3a5d7380c887',ramdisk_id='',reservation_id='r-uc06nhha',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1724237472',owner_user_name='tempest-VolumesAdminNegativeTest-1724237472-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:10:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='331b706f494247759f827dbb1efcb663',uuid=68264a44-5adf-4873-b380-26bcafe2ba04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10ed2f01-5666-4615-be28-c574ff652c1d", "address": "fa:16:3e:82:8d:0f", "network": {"id": "4e5f387a-ee4d-4e5b-bbb3-0d3af738de45", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-839692973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6f1d989dd2242bfad9c3a5d7380c887", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10ed2f01-56", "ovs_interfaceid": "10ed2f01-5666-4615-be28-c574ff652c1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:10:11 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Converting VIF {"id": "10ed2f01-5666-4615-be28-c574ff652c1d", "address": "fa:16:3e:82:8d:0f", "network": {"id": "4e5f387a-ee4d-4e5b-bbb3-0d3af738de45", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-839692973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6f1d989dd2242bfad9c3a5d7380c887", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10ed2f01-56", "ovs_interfaceid": "10ed2f01-5666-4615-be28-c574ff652c1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:10:11 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:8d:0f,bridge_name='br-int',has_traffic_filtering=True,id=10ed2f01-5666-4615-be28-c574ff652c1d,network=Network(4e5f387a-ee4d-4e5b-bbb3-0d3af738de45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10ed2f01-56') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:10:11 user nova-compute[95467]: DEBUG os_vif [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:8d:0f,bridge_name='br-int',has_traffic_filtering=True,id=10ed2f01-5666-4615-be28-c574ff652c1d,network=Network(4e5f387a-ee4d-4e5b-bbb3-0d3af738de45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10ed2f01-56') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:10:11 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:11 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:11 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:10:11 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:11 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b9856777-980f-529b-b1a2-428c9876c833', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:11 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:11 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Acquiring lock "7e53d93e-1222-4b1a-9745-d512da0f7925" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:10:11 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Lock "7e53d93e-1222-4b1a-9745-d512da0f7925" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:10:11 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:10:11 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:11 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap10ed2f01-56, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:11 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap10ed2f01-56, col_values=(('qos', UUID('bd7dcec0-9daf-4aad-b211-5a4897ac7b38')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:11 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap10ed2f01-56, col_values=(('external_ids', {'iface-id': '10ed2f01-5666-4615-be28-c574ff652c1d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:8d:0f', 'vm-uuid': '68264a44-5adf-4873-b380-26bcafe2ba04'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:11 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:11 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:10:11 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Starting instance... {{(pid=95467) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 08:10:11 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:11 user nova-compute[95467]: INFO os_vif [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:8d:0f,bridge_name='br-int',has_traffic_filtering=True,id=10ed2f01-5666-4615-be28-c574ff652c1d,network=Network(4e5f387a-ee4d-4e5b-bbb3-0d3af738de45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10ed2f01-56')
Nov 15 08:10:11 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:10:11 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] No VIF found with MAC fa:16:3e:82:8d:0f, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:10:11 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:10:11 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:10:11 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=95467) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 08:10:11 user nova-compute[95467]: INFO nova.compute.claims [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Claim successful on node user
Nov 15 08:10:12 user nova-compute[95467]: DEBUG nova.network.neutron [req-bc813090-90a4-4c4c-af1c-8331716c0d55 req-899bcc8c-85c4-4dd9-bb62-b824418580e8 service nova] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Updated VIF entry in instance network info cache for port 10ed2f01-5666-4615-be28-c574ff652c1d. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:10:12 user nova-compute[95467]: DEBUG nova.network.neutron [req-bc813090-90a4-4c4c-af1c-8331716c0d55 req-899bcc8c-85c4-4dd9-bb62-b824418580e8 service nova] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Updating instance_info_cache with network_info: [{"id": "10ed2f01-5666-4615-be28-c574ff652c1d", "address": "fa:16:3e:82:8d:0f", "network": {"id": "4e5f387a-ee4d-4e5b-bbb3-0d3af738de45", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-839692973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6f1d989dd2242bfad9c3a5d7380c887", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10ed2f01-56", "ovs_interfaceid": "10ed2f01-5666-4615-be28-c574ff652c1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:10:12 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-bc813090-90a4-4c4c-af1c-8331716c0d55 req-899bcc8c-85c4-4dd9-bb62-b824418580e8 service nova] Releasing lock "refresh_cache-68264a44-5adf-4873-b380-26bcafe2ba04" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:10:12 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:10:12 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:10:12 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.699s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:10:12 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Start building networks asynchronously for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 08:10:12 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Allocating IP information in the background. {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 08:10:12 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] allocate_for_instance() {{(pid=95467) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 08:10:12 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 08:10:12 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Start building block device mappings for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 08:10:12 user nova-compute[95467]: INFO nova.virt.block_device [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Booting with volume 01b18fa8-0d71-4fef-b5f2-44b7afba773f at /dev/vda
Nov 15 08:10:12 user nova-compute[95467]: DEBUG nova.policy [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '54bfe816a1bf4ee485e055604f0b7609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b11067a2d84bba8e6929713034b422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95467) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 08:10:13 user nova-compute[95467]: DEBUG os_brick.utils [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:10:13 user nova-compute[95467]: INFO oslo.privsep.daemon [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp8h4clhky/privsep.sock']
Nov 15 08:10:13 user sudo[105520]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp8h4clhky/privsep.sock
Nov 15 08:10:13 user sudo[105520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 15 08:10:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Acquiring lock "1edf7591-3991-4df9-98c9-ebc4ca9e5a4a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:10:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Lock "1edf7591-3991-4df9-98c9-ebc4ca9e5a4a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:10:13 user nova-compute[95467]: DEBUG nova.compute.manager [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Starting instance... {{(pid=95467) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 08:10:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:10:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:10:13 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=95467) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 08:10:13 user nova-compute[95467]: INFO nova.compute.claims [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Claim successful on node user
Nov 15 08:10:14 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Successfully created port: 1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2 {{(pid=95467) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 08:10:14 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:10:14 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:10:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:14 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.976s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:10:14 user nova-compute[95467]: DEBUG nova.compute.manager [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Start building networks asynchronously for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 08:10:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:14 user nova-compute[95467]: DEBUG nova.compute.manager [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Allocating IP information in the background. {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 08:10:14 user nova-compute[95467]: DEBUG nova.network.neutron [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] allocate_for_instance() {{(pid=95467) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 08:10:14 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 08:10:14 user nova-compute[95467]: DEBUG nova.compute.manager [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Start building block device mappings for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 08:10:15 user nova-compute[95467]: DEBUG nova.compute.manager [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Start spawning the instance on the hypervisor. {{(pid=95467) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 08:10:15 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Creating instance directory {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 08:10:15 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Creating image(s)
Nov 15 08:10:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Acquiring lock "/opt/stack/data/nova/instances/1edf7591-3991-4df9-98c9-ebc4ca9e5a4a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:10:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Lock "/opt/stack/data/nova/instances/1edf7591-3991-4df9-98c9-ebc4ca9e5a4a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:10:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Lock "/opt/stack/data/nova/instances/1edf7591-3991-4df9-98c9-ebc4ca9e5a4a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:10:15 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:15 user nova-compute[95467]: DEBUG nova.policy [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ad3d95ab283840bebdb388b34d039c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f70df4261044d978ed77e71a44d51c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95467) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 08:10:15 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.266s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Acquiring lock "a3fcf60225fcefd310404971cd18ab9851c548dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:10:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:10:15 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:15 user sudo[105520]: pam_unix(sudo:session): session closed for user root
Nov 15 08:10:15 user nova-compute[95467]: INFO oslo.privsep.daemon [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Spawned new privsep daemon via rootwrap
Nov 15 08:10:15 user nova-compute[95467]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 15 08:10:15 user nova-compute[95467]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 15 08:10:15 user nova-compute[95467]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 15 08:10:15 user nova-compute[95467]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 105611
Nov 15 08:10:15 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ad4789-9d88-43fd-a0b4-547bcb45ce46]: (2,) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:10:15 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.221s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:15 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/1edf7591-3991-4df9-98c9-ebc4ca9e5a4a/disk 1073741824 {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:15 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/1edf7591-3991-4df9-98c9-ebc4ca9e5a4a/disk 1073741824" returned: 0 in 0.083s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.312s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:10:15 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:15 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Successfully updated port: 1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2 {{(pid=95467) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 08:10:15 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:15 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:15 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca50fe2-cb46-4ddc-882b-f76762288781]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:882ae90641f\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:10:15 user nova-compute[95467]: WARNING os_brick.initiator.connectors.nvmeof [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 15 08:10:15 user nova-compute[95467]: DEBUG nova.compute.manager [req-874217b9-dc89-4418-8529-7d57c5787c55 req-12eb8da1-1ccd-4bdf-be3a-d57fd89cad1e service nova] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Received event network-changed-1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:10:15 user nova-compute[95467]: DEBUG nova.compute.manager [req-874217b9-dc89-4418-8529-7d57c5787c55 req-12eb8da1-1ccd-4bdf-be3a-d57fd89cad1e service nova] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Refreshing instance network info cache due to event network-changed-1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:10:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-874217b9-dc89-4418-8529-7d57c5787c55 req-12eb8da1-1ccd-4bdf-be3a-d57fd89cad1e service nova] Acquiring lock "refresh_cache-7e53d93e-1222-4b1a-9745-d512da0f7925" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:10:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-874217b9-dc89-4418-8529-7d57c5787c55 req-12eb8da1-1ccd-4bdf-be3a-d57fd89cad1e service nova] Acquired lock "refresh_cache-7e53d93e-1222-4b1a-9745-d512da0f7925" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:10:15 user nova-compute[95467]: DEBUG nova.network.neutron [req-874217b9-dc89-4418-8529-7d57c5787c55 req-12eb8da1-1ccd-4bdf-be3a-d57fd89cad1e service nova] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Refreshing network info cache for port 1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:10:15 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Acquiring lock "refresh_cache-7e53d93e-1222-4b1a-9745-d512da0f7925" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:10:15 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.037s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:15 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[46874f1d-6339-43f8-894a-09c484f3f90b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:10:15 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:16 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.294s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:16 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1edf7591-3991-4df9-98c9-ebc4ca9e5a4a/disk. size=1073741824 {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 08:10:16 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1edf7591-3991-4df9-98c9-ebc4ca9e5a4a/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:16 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.050s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:16 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[be59867b-6a25-4178-ac56-480cf2f0652c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:10:16 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[417add2a-3845-4298-af5e-b0f0de50bf5b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:10:16 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Running cmd (subprocess): nvme version {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:16 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] 'nvme version' failed. Not Retrying. {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:10:16 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] nvme not present on system {{(pid=95467) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 08:10:16 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:16 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:10:16 user nova-compute[95467]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 08:10:16 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c31e340-42fd-4e7e-8104-60533e243065]: (4, '') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:10:16 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=95467) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 08:10:16 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 08:10:16 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] LIGHTOS: no hostnqn found. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 08:10:16 user nova-compute[95467]: DEBUG os_brick.utils [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] <== get_connector_properties: return (3068ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:882ae90641f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:10:16 user nova-compute[95467]: DEBUG nova.virt.block_device [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Updating existing volume attachment record: 8b18566e-4f7e-40d4-8b28-96c352ca1d28 {{(pid=95467) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 08:10:16 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1edf7591-3991-4df9-98c9-ebc4ca9e5a4a/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:16 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Cannot resize image /opt/stack/data/nova/instances/1edf7591-3991-4df9-98c9-ebc4ca9e5a4a/disk to a smaller size. {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 08:10:16 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Created local disks {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 08:10:16 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Ensure instance console log exists: /opt/stack/data/nova/instances/1edf7591-3991-4df9-98c9-ebc4ca9e5a4a/console.log {{(pid=95467) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 08:10:16 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:10:16 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:10:16 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:10:16 user nova-compute[95467]: DEBUG nova.network.neutron [req-874217b9-dc89-4418-8529-7d57c5787c55 req-12eb8da1-1ccd-4bdf-be3a-d57fd89cad1e service nova] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Instance cache missing network info. {{(pid=95467) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 08:10:16 user nova-compute[95467]: DEBUG nova.compute.manager [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Instance event wait completed in 0 seconds for  {{(pid=95467) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 08:10:16 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Guest created on hypervisor {{(pid=95467) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 08:10:16 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Instance spawned successfully.
Nov 15 08:10:16 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 08:10:16 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:16 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:16 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Found default for hw_cdrom_bus of ide {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:10:16 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Found default for hw_disk_bus of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:10:16 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Found default for hw_input_bus of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:10:16 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Found default for hw_pointer_model of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:10:16 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Found default for hw_video_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:10:16 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Found default for hw_vif_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:10:17 user nova-compute[95467]: INFO nova.compute.manager [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Took 9.33 seconds to spawn the instance on the hypervisor.
Nov 15 08:10:17 user nova-compute[95467]: DEBUG nova.compute.manager [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:10:17 user nova-compute[95467]: INFO nova.compute.manager [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Took 10.74 seconds to build instance.
Nov 15 08:10:17 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f7041400-6867-4913-b389-2b3eeda6b919 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Lock "68264a44-5adf-4873-b380-26bcafe2ba04" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.965s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:10:17 user nova-compute[95467]: DEBUG nova.network.neutron [req-874217b9-dc89-4418-8529-7d57c5787c55 req-12eb8da1-1ccd-4bdf-be3a-d57fd89cad1e service nova] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:10:17 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-874217b9-dc89-4418-8529-7d57c5787c55 req-12eb8da1-1ccd-4bdf-be3a-d57fd89cad1e service nova] Releasing lock "refresh_cache-7e53d93e-1222-4b1a-9745-d512da0f7925" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:10:17 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Acquired lock "refresh_cache-7e53d93e-1222-4b1a-9745-d512da0f7925" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:10:17 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:10:17 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Instance cache missing network info. {{(pid=95467) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 08:10:17 user nova-compute[95467]: DEBUG nova.network.neutron [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Successfully created port: 193139f8-f050-4caf-89d7-106a3a504625 {{(pid=95467) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 08:10:18 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Updating instance_info_cache with network_info: [{"id": "1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2", "address": "fa:16:3e:b1:d4:80", "network": {"id": "d8daee94-e2d9-42cf-9675-8c06e7292d36", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-765825262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81b11067a2d84bba8e6929713034b422", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d8e0cf8-c3", "ovs_interfaceid": "1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:10:18 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Releasing lock "refresh_cache-7e53d93e-1222-4b1a-9745-d512da0f7925" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:10:18 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Instance network_info: |[{"id": "1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2", "address": "fa:16:3e:b1:d4:80", "network": {"id": "d8daee94-e2d9-42cf-9675-8c06e7292d36", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-765825262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81b11067a2d84bba8e6929713034b422", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d8e0cf8-c3", "ovs_interfaceid": "1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 08:10:18 user nova-compute[95467]: DEBUG nova.network.neutron [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Successfully updated port: 193139f8-f050-4caf-89d7-106a3a504625 {{(pid=95467) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 08:10:18 user nova-compute[95467]: DEBUG nova.compute.manager [req-ed379146-7457-4f64-9536-d75fa4c73c90 req-151ab266-80d9-414b-862c-1f7439925402 service nova] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Received event network-changed-193139f8-f050-4caf-89d7-106a3a504625 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:10:18 user nova-compute[95467]: DEBUG nova.compute.manager [req-ed379146-7457-4f64-9536-d75fa4c73c90 req-151ab266-80d9-414b-862c-1f7439925402 service nova] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Refreshing instance network info cache due to event network-changed-193139f8-f050-4caf-89d7-106a3a504625. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:10:18 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ed379146-7457-4f64-9536-d75fa4c73c90 req-151ab266-80d9-414b-862c-1f7439925402 service nova] Acquiring lock "refresh_cache-1edf7591-3991-4df9-98c9-ebc4ca9e5a4a" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:10:18 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ed379146-7457-4f64-9536-d75fa4c73c90 req-151ab266-80d9-414b-862c-1f7439925402 service nova] Acquired lock "refresh_cache-1edf7591-3991-4df9-98c9-ebc4ca9e5a4a" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:10:18 user nova-compute[95467]: DEBUG nova.network.neutron [req-ed379146-7457-4f64-9536-d75fa4c73c90 req-151ab266-80d9-414b-862c-1f7439925402 service nova] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Refreshing network info cache for port 193139f8-f050-4caf-89d7-106a3a504625 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:10:18 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Acquiring lock "refresh_cache-1edf7591-3991-4df9-98c9-ebc4ca9e5a4a" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:10:19 user nova-compute[95467]: DEBUG nova.network.neutron [req-ed379146-7457-4f64-9536-d75fa4c73c90 req-151ab266-80d9-414b-862c-1f7439925402 service nova] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Instance cache missing network info. {{(pid=95467) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 08:10:19 user nova-compute[95467]: DEBUG nova.network.neutron [req-ed379146-7457-4f64-9536-d75fa4c73c90 req-151ab266-80d9-414b-862c-1f7439925402 service nova] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:10:19 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ed379146-7457-4f64-9536-d75fa4c73c90 req-151ab266-80d9-414b-862c-1f7439925402 service nova] Releasing lock "refresh_cache-1edf7591-3991-4df9-98c9-ebc4ca9e5a4a" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:10:19 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Acquired lock "refresh_cache-1edf7591-3991-4df9-98c9-ebc4ca9e5a4a" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:10:19 user nova-compute[95467]: DEBUG nova.network.neutron [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:10:19 user nova-compute[95467]: DEBUG nova.network.neutron [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Instance cache missing network info. {{(pid=95467) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 08:10:20 user nova-compute[95467]: DEBUG nova.network.neutron [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Updating instance_info_cache with network_info: [{"id": "193139f8-f050-4caf-89d7-106a3a504625", "address": "fa:16:3e:ff:f2:53", "network": {"id": "f0b11bd0-0901-4ad2-982b-eda46e03fa1c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1915160333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f70df4261044d978ed77e71a44d51c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap193139f8-f0", "ovs_interfaceid": "193139f8-f050-4caf-89d7-106a3a504625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:10:20 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Releasing lock "refresh_cache-1edf7591-3991-4df9-98c9-ebc4ca9e5a4a" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:10:20 user nova-compute[95467]: DEBUG nova.compute.manager [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Instance network_info: |[{"id": "193139f8-f050-4caf-89d7-106a3a504625", "address": "fa:16:3e:ff:f2:53", "network": {"id": "f0b11bd0-0901-4ad2-982b-eda46e03fa1c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1915160333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f70df4261044d978ed77e71a44d51c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap193139f8-f0", "ovs_interfaceid": "193139f8-f050-4caf-89d7-106a3a504625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 08:10:20 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Start _get_guest_xml network_info=[{"id": "193139f8-f050-4caf-89d7-106a3a504625", "address": "fa:16:3e:ff:f2:53", "network": {"id": "f0b11bd0-0901-4ad2-982b-eda46e03fa1c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1915160333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f70df4261044d978ed77e71a44d51c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap193139f8-f0", "ovs_interfaceid": "193139f8-f050-4caf-89d7-106a3a504625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'ed9c48aa-ce73-4b3b-9db1-235898be671b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:10:20 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:10:20 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:10:20 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:10:20 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:10:20 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:10:20 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:10:20 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:10:20 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:10:20 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:10:20 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:10:20 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:10:20 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:10:20 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:10:20 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:10:20 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:10:20 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:10:20 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:10:20 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:10:20 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:10:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1870022804',display_name='tempest-TestVolumeSwap-server-1870022804',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1870022804',id=8,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGwq1WBdUFZ1Z3ja7L/L4p6PACTYXD5PCPUPwRd3lrb9GL1RliBoFLJu6tB1C0dYROS9DCw1p9N09wCw7neE0hJs1hvrRMkMivRvvefdvnZjgHfG6FuuJIwTc2fFKMIg/Q==',key_name='tempest-keypair-1249332897',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f70df4261044d978ed77e71a44d51c4',ramdisk_id='',reservation_id='r-3raibaz5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1759371360',owner_user_name='tempest-TestVolumeSwap-1759371360-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:10:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad3d95ab283840bebdb388b34d039c6d',uuid=1edf7591-3991-4df9-98c9-ebc4ca9e5a4a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "193139f8-f050-4caf-89d7-106a3a504625", "address": "fa:16:3e:ff:f2:53", "network": {"id": "f0b11bd0-0901-4ad2-982b-eda46e03fa1c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1915160333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f70df4261044d978ed77e71a44d51c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap193139f8-f0", "ovs_interfaceid": "193139f8-f050-4caf-89d7-106a3a504625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:10:20 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Converting VIF {"id": "193139f8-f050-4caf-89d7-106a3a504625", "address": "fa:16:3e:ff:f2:53", "network": {"id": "f0b11bd0-0901-4ad2-982b-eda46e03fa1c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1915160333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f70df4261044d978ed77e71a44d51c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap193139f8-f0", "ovs_interfaceid": "193139f8-f050-4caf-89d7-106a3a504625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:10:20 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:f2:53,bridge_name='br-int',has_traffic_filtering=True,id=193139f8-f050-4caf-89d7-106a3a504625,network=Network(f0b11bd0-0901-4ad2-982b-eda46e03fa1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap193139f8-f0') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:10:20 user nova-compute[95467]: DEBUG nova.objects.instance [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Lazy-loading 'pci_devices' on Instance uuid 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:10:20 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:10:20 user nova-compute[95467]:   <uuid>1edf7591-3991-4df9-98c9-ebc4ca9e5a4a</uuid>
Nov 15 08:10:20 user nova-compute[95467]:   <name>instance-00000008</name>
Nov 15 08:10:20 user nova-compute[95467]:   <memory>524288</memory>
Nov 15 08:10:20 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:10:20 user nova-compute[95467]:   <metadata>
Nov 15 08:10:20 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:10:20 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:10:20 user nova-compute[95467]:       <nova:name>tempest-TestVolumeSwap-server-1870022804</nova:name>
Nov 15 08:10:20 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:10:20</nova:creationTime>
Nov 15 08:10:20 user nova-compute[95467]:       <nova:flavor name="m1.tiny">
Nov 15 08:10:20 user nova-compute[95467]:         <nova:memory>512</nova:memory>
Nov 15 08:10:20 user nova-compute[95467]:         <nova:disk>1</nova:disk>
Nov 15 08:10:20 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:10:20 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:10:20 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:10:20 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:10:20 user nova-compute[95467]:       <nova:owner>
Nov 15 08:10:20 user nova-compute[95467]:         <nova:user uuid="ad3d95ab283840bebdb388b34d039c6d">tempest-TestVolumeSwap-1759371360-project-member</nova:user>
Nov 15 08:10:20 user nova-compute[95467]:         <nova:project uuid="6f70df4261044d978ed77e71a44d51c4">tempest-TestVolumeSwap-1759371360</nova:project>
Nov 15 08:10:20 user nova-compute[95467]:       </nova:owner>
Nov 15 08:10:20 user nova-compute[95467]:       <nova:root type="image" uuid="ed9c48aa-ce73-4b3b-9db1-235898be671b"/>
Nov 15 08:10:20 user nova-compute[95467]:       <nova:ports>
Nov 15 08:10:20 user nova-compute[95467]:         <nova:port uuid="193139f8-f050-4caf-89d7-106a3a504625">
Nov 15 08:10:20 user nova-compute[95467]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 08:10:20 user nova-compute[95467]:         </nova:port>
Nov 15 08:10:20 user nova-compute[95467]:       </nova:ports>
Nov 15 08:10:20 user nova-compute[95467]:     </nova:instance>
Nov 15 08:10:20 user nova-compute[95467]:   </metadata>
Nov 15 08:10:20 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:10:20 user nova-compute[95467]:     <system>
Nov 15 08:10:20 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:10:20 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:10:20 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:10:20 user nova-compute[95467]:       <entry name="serial">1edf7591-3991-4df9-98c9-ebc4ca9e5a4a</entry>
Nov 15 08:10:20 user nova-compute[95467]:       <entry name="uuid">1edf7591-3991-4df9-98c9-ebc4ca9e5a4a</entry>
Nov 15 08:10:20 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:10:20 user nova-compute[95467]:     </system>
Nov 15 08:10:20 user nova-compute[95467]:   </sysinfo>
Nov 15 08:10:20 user nova-compute[95467]:   <os>
Nov 15 08:10:20 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:10:20 user nova-compute[95467]:     <boot dev="hd"/>
Nov 15 08:10:20 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:10:20 user nova-compute[95467]:   </os>
Nov 15 08:10:20 user nova-compute[95467]:   <features>
Nov 15 08:10:20 user nova-compute[95467]:     <acpi/>
Nov 15 08:10:20 user nova-compute[95467]:     <apic/>
Nov 15 08:10:20 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:10:20 user nova-compute[95467]:   </features>
Nov 15 08:10:20 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:10:20 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:10:20 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:10:20 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:10:20 user nova-compute[95467]:   </clock>
Nov 15 08:10:20 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:10:20 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:10:20 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:10:20 user nova-compute[95467]:   </cpu>
Nov 15 08:10:20 user nova-compute[95467]:   <devices>
Nov 15 08:10:20 user nova-compute[95467]:     <disk type="file" device="disk">
Nov 15 08:10:20 user nova-compute[95467]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 08:10:20 user nova-compute[95467]:       <source file="/opt/stack/data/nova/instances/1edf7591-3991-4df9-98c9-ebc4ca9e5a4a/disk"/>
Nov 15 08:10:20 user nova-compute[95467]:       <target dev="vda" bus="virtio"/>
Nov 15 08:10:20 user nova-compute[95467]:     </disk>
Nov 15 08:10:20 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:10:20 user nova-compute[95467]:       <mac address="fa:16:3e:ff:f2:53"/>
Nov 15 08:10:20 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:10:20 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:10:20 user nova-compute[95467]:       <target dev="tap193139f8-f0"/>
Nov 15 08:10:20 user nova-compute[95467]:     </interface>
Nov 15 08:10:20 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:10:20 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/1edf7591-3991-4df9-98c9-ebc4ca9e5a4a/console.log" append="off"/>
Nov 15 08:10:20 user nova-compute[95467]:     </serial>
Nov 15 08:10:20 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:10:20 user nova-compute[95467]:     <video>
Nov 15 08:10:20 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:10:20 user nova-compute[95467]:     </video>
Nov 15 08:10:20 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:10:20 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:10:20 user nova-compute[95467]:     </rng>
Nov 15 08:10:20 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:10:20 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:10:20 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:10:20 user nova-compute[95467]:     </memballoon>
Nov 15 08:10:20 user nova-compute[95467]:   </devices>
Nov 15 08:10:20 user nova-compute[95467]: </domain>
Nov 15 08:10:20 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:10:20 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:10:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1870022804',display_name='tempest-TestVolumeSwap-server-1870022804',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1870022804',id=8,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGwq1WBdUFZ1Z3ja7L/L4p6PACTYXD5PCPUPwRd3lrb9GL1RliBoFLJu6tB1C0dYROS9DCw1p9N09wCw7neE0hJs1hvrRMkMivRvvefdvnZjgHfG6FuuJIwTc2fFKMIg/Q==',key_name='tempest-keypair-1249332897',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f70df4261044d978ed77e71a44d51c4',ramdisk_id='',reservation_id='r-3raibaz5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1759371360',owner_user_name='tempest-TestVolumeSwap-1759371360-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:10:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad3d95ab283840bebdb388b34d039c6d',uuid=1edf7591-3991-4df9-98c9-ebc4ca9e5a4a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "193139f8-f050-4caf-89d7-106a3a504625", "address": "fa:16:3e:ff:f2:53", "network": {"id": "f0b11bd0-0901-4ad2-982b-eda46e03fa1c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1915160333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f70df4261044d978ed77e71a44d51c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap193139f8-f0", "ovs_interfaceid": "193139f8-f050-4caf-89d7-106a3a504625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:10:20 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Converting VIF {"id": "193139f8-f050-4caf-89d7-106a3a504625", "address": "fa:16:3e:ff:f2:53", "network": {"id": "f0b11bd0-0901-4ad2-982b-eda46e03fa1c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1915160333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f70df4261044d978ed77e71a44d51c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap193139f8-f0", "ovs_interfaceid": "193139f8-f050-4caf-89d7-106a3a504625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:10:20 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:f2:53,bridge_name='br-int',has_traffic_filtering=True,id=193139f8-f050-4caf-89d7-106a3a504625,network=Network(f0b11bd0-0901-4ad2-982b-eda46e03fa1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap193139f8-f0') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:10:20 user nova-compute[95467]: DEBUG os_vif [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:f2:53,bridge_name='br-int',has_traffic_filtering=True,id=193139f8-f050-4caf-89d7-106a3a504625,network=Network(f0b11bd0-0901-4ad2-982b-eda46e03fa1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap193139f8-f0') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:10:20 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:20 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:20 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:10:20 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:20 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '34ae4b36-effe-503f-aa00-ae07fb7a5021', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:20 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:20 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:20 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:20 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap193139f8-f0, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:20 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap193139f8-f0, col_values=(('qos', UUID('8e17af2a-c6b6-4196-8565-4ca348e2b781')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:20 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap193139f8-f0, col_values=(('external_ids', {'iface-id': '193139f8-f050-4caf-89d7-106a3a504625', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:f2:53', 'vm-uuid': '1edf7591-3991-4df9-98c9-ebc4ca9e5a4a'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:20 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:20 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:10:20 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:20 user nova-compute[95467]: INFO os_vif [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:f2:53,bridge_name='br-int',has_traffic_filtering=True,id=193139f8-f050-4caf-89d7-106a3a504625,network=Network(f0b11bd0-0901-4ad2-982b-eda46e03fa1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap193139f8-f0')
Nov 15 08:10:20 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Acquiring lock "0917b083-2bbf-4baf-a0b8-d59ba3e2256b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:10:20 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Lock "0917b083-2bbf-4baf-a0b8-d59ba3e2256b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:10:20 user nova-compute[95467]: DEBUG nova.compute.manager [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Starting instance... {{(pid=95467) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 08:10:20 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:10:20 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] No VIF found with MAC fa:16:3e:ff:f2:53, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:10:20 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:10:20 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:10:20 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=95467) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 08:10:20 user nova-compute[95467]: INFO nova.compute.claims [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Claim successful on node user
Nov 15 08:10:21 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:10:21 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:10:21 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:21 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.739s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:10:21 user nova-compute[95467]: DEBUG nova.compute.manager [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Start building networks asynchronously for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 08:10:21 user nova-compute[95467]: DEBUG nova.compute.manager [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Allocating IP information in the background. {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 08:10:21 user nova-compute[95467]: DEBUG nova.network.neutron [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] allocate_for_instance() {{(pid=95467) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 08:10:21 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 08:10:21 user nova-compute[95467]: DEBUG nova.compute.manager [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Start building block device mappings for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 08:10:21 user nova-compute[95467]: DEBUG nova.policy [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5c29ac74b4e745a09af7ecedde0f5697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18fe2aa7cd7c4943a8c848dd52b9697b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95467) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 08:10:22 user nova-compute[95467]: DEBUG nova.compute.manager [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Start spawning the instance on the hypervisor. {{(pid=95467) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 08:10:22 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Creating instance directory {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 08:10:22 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Creating image(s)
Nov 15 08:10:22 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Acquiring lock "/opt/stack/data/nova/instances/0917b083-2bbf-4baf-a0b8-d59ba3e2256b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:10:22 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Lock "/opt/stack/data/nova/instances/0917b083-2bbf-4baf-a0b8-d59ba3e2256b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:10:22 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Lock "/opt/stack/data/nova/instances/0917b083-2bbf-4baf-a0b8-d59ba3e2256b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:10:22 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:22 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] Acquiring lock "a259558e-87ea-48c2-8b72-7443c0510d81" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:10:22 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] Lock "a259558e-87ea-48c2-8b72-7443c0510d81" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:10:22 user nova-compute[95467]: DEBUG nova.compute.manager [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Starting instance... {{(pid=95467) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 08:10:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:22 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.416s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:22 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Acquiring lock "a3fcf60225fcefd310404971cd18ab9851c548dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:10:22 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.054s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:10:22 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:22 user nova-compute[95467]: DEBUG nova.network.neutron [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Successfully created port: f6d25344-c8fc-4794-b302-a3665c62b78c {{(pid=95467) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 08:10:22 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:10:22 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:10:22 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=95467) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 08:10:22 user nova-compute[95467]: INFO nova.compute.claims [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Claim successful on node user
Nov 15 08:10:22 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.331s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:22 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/0917b083-2bbf-4baf-a0b8-d59ba3e2256b/disk 1073741824 {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:22 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/0917b083-2bbf-4baf-a0b8-d59ba3e2256b/disk 1073741824" returned: 0 in 0.082s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:22 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.422s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:10:22 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:23 user nova-compute[95467]: DEBUG nova.compute.manager [req-c098cb87-086c-46fc-8797-f2a43e924682 req-ff7aa14b-244e-47db-91e5-029102cdce02 service nova] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Received event network-vif-plugged-193139f8-f050-4caf-89d7-106a3a504625 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:10:23 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-c098cb87-086c-46fc-8797-f2a43e924682 req-ff7aa14b-244e-47db-91e5-029102cdce02 service nova] Acquiring lock "1edf7591-3991-4df9-98c9-ebc4ca9e5a4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:10:23 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-c098cb87-086c-46fc-8797-f2a43e924682 req-ff7aa14b-244e-47db-91e5-029102cdce02 service nova] Lock "1edf7591-3991-4df9-98c9-ebc4ca9e5a4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:10:23 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-c098cb87-086c-46fc-8797-f2a43e924682 req-ff7aa14b-244e-47db-91e5-029102cdce02 service nova] Lock "1edf7591-3991-4df9-98c9-ebc4ca9e5a4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:10:23 user nova-compute[95467]: DEBUG nova.compute.manager [req-c098cb87-086c-46fc-8797-f2a43e924682 req-ff7aa14b-244e-47db-91e5-029102cdce02 service nova] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] No waiting events found dispatching network-vif-plugged-193139f8-f050-4caf-89d7-106a3a504625 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:10:23 user nova-compute[95467]: WARNING nova.compute.manager [req-c098cb87-086c-46fc-8797-f2a43e924682 req-ff7aa14b-244e-47db-91e5-029102cdce02 service nova] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Received unexpected event network-vif-plugged-193139f8-f050-4caf-89d7-106a3a504625 for instance with vm_state building and task_state spawning.
Nov 15 08:10:23 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.241s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:23 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0917b083-2bbf-4baf-a0b8-d59ba3e2256b/disk. size=1073741824 {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 08:10:23 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0917b083-2bbf-4baf-a0b8-d59ba3e2256b/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:23 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0917b083-2bbf-4baf-a0b8-d59ba3e2256b/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:23 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Cannot resize image /opt/stack/data/nova/instances/0917b083-2bbf-4baf-a0b8-d59ba3e2256b/disk to a smaller size. {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 08:10:23 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Created local disks {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 08:10:23 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Ensure instance console log exists: /opt/stack/data/nova/instances/0917b083-2bbf-4baf-a0b8-d59ba3e2256b/console.log {{(pid=95467) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 08:10:23 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:10:23 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:10:23 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:10:23 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:23 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:23 user nova-compute[95467]: DEBUG nova.compute.manager [req-92b2abf3-59e0-449b-b3b6-a73b3a473e74 req-6d0e225a-66f7-4636-b4b3-752db14fb486 service nova] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Received event network-vif-plugged-5b51bd20-90a5-4fb1-816c-3d8e8824cb41 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:10:23 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-92b2abf3-59e0-449b-b3b6-a73b3a473e74 req-6d0e225a-66f7-4636-b4b3-752db14fb486 service nova] Acquiring lock "36dccf43-d4a3-47aa-bd73-de9646e1020c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:10:23 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-92b2abf3-59e0-449b-b3b6-a73b3a473e74 req-6d0e225a-66f7-4636-b4b3-752db14fb486 service nova] Lock "36dccf43-d4a3-47aa-bd73-de9646e1020c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:10:23 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-92b2abf3-59e0-449b-b3b6-a73b3a473e74 req-6d0e225a-66f7-4636-b4b3-752db14fb486 service nova] Lock "36dccf43-d4a3-47aa-bd73-de9646e1020c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:10:23 user nova-compute[95467]: DEBUG nova.compute.manager [req-92b2abf3-59e0-449b-b3b6-a73b3a473e74 req-6d0e225a-66f7-4636-b4b3-752db14fb486 service nova] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] No waiting events found dispatching network-vif-plugged-5b51bd20-90a5-4fb1-816c-3d8e8824cb41 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:10:23 user nova-compute[95467]: WARNING nova.compute.manager [req-92b2abf3-59e0-449b-b3b6-a73b3a473e74 req-6d0e225a-66f7-4636-b4b3-752db14fb486 service nova] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Received unexpected event network-vif-plugged-5b51bd20-90a5-4fb1-816c-3d8e8824cb41 for instance with vm_state active and task_state None.
Nov 15 08:10:23 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:10:23 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:10:23 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.104s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:10:23 user nova-compute[95467]: DEBUG nova.compute.manager [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Start building networks asynchronously for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG nova.compute.manager [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Allocating IP information in the background. {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG nova.network.neutron [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] allocate_for_instance() {{(pid=95467) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 08:10:24 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 08:10:24 user nova-compute[95467]: DEBUG nova.compute.manager [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Start building block device mappings for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG nova.policy [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '21401887c3f04e238f5399da20d7be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6ae375b97347d6b1b757bb74cd3c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95467) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG nova.compute.manager [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Start spawning the instance on the hypervisor. {{(pid=95467) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Creating instance directory {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 08:10:24 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Creating image(s)
Nov 15 08:10:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] Acquiring lock "/opt/stack/data/nova/instances/a259558e-87ea-48c2-8b72-7443c0510d81/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] Lock "/opt/stack/data/nova/instances/a259558e-87ea-48c2-8b72-7443c0510d81/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] Lock "/opt/stack/data/nova/instances/a259558e-87ea-48c2-8b72-7443c0510d81/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Start spawning the instance on the hypervisor. {{(pid=95467) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Creating instance directory {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 08:10:24 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Creating image(s)
Nov 15 08:10:24 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Did not create local disks {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Ensure instance console log exists: /opt/stack/data/nova/instances/7e53d93e-1222-4b1a-9745-d512da0f7925/console.log {{(pid=95467) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Start _get_guest_xml network_info=[{"id": "1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2", "address": "fa:16:3e:b1:d4:80", "network": {"id": "d8daee94-e2d9-42cf-9675-8c06e7292d36", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-765825262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81b11067a2d84bba8e6929713034b422", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d8e0cf8-c3", "ovs_interfaceid": "1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '8b18566e-4f7e-40d4-8b28-96c352ca1d28', 'delete_on_termination': True, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mZKOEzLI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7e53d93e-1222-4b1a-9745-d512da0f7925', 'attached_at': '', 'detached_at': '', 'volume_id': '01b18fa8-0d71-4fef-b5f2-44b7afba773f', 'serial': '01b18fa8-0d71-4fef-b5f2-44b7afba773f'}, 'volume_type': None} {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:10:24 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:10:24 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:10:24 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG os_brick.initiator.connector [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Factory for ISCSI on None {{(pid=95467) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Calling os-brick to attach iSCSI Volume {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mZKOEzLI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:10:24 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:10:24 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:10:24 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:10:24 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:10:24 user nova-compute[95467]: INFO os_brick.initiator.connectors.iscsi [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 08:10:24 user nova-compute[95467]: DEBUG nova.network.neutron [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Successfully updated port: f6d25344-c8fc-4794-b302-a3665c62b78c {{(pid=95467) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f -p 172.16.0.220:3260 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Acquiring lock "refresh_cache-0917b083-2bbf-4baf-a0b8-d59ba3e2256b" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Acquired lock "refresh_cache-0917b083-2bbf-4baf-a0b8-d59ba3e2256b" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG nova.network.neutron [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ac0b87-d2f8-4dbe-adc8-ce7424409684]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.256s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 08:10:24 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] Acquiring lock "a3fcf60225fcefd310404971cd18ab9851c548dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f -p 172.16.0.220:3260 --interface default --op new {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f03351-f1dd-4756-b1fd-674c1882a349]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f] added\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f] added
Nov 15 08:10:24 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[687cdd2c-f82b-44ff-a127-a8a9a819ed59]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16c80bb-dc13-4aa1-80c5-a0ebc014db6e]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mZKOEzLI {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mZKOEzLI" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12c3ed4-c784-4977-a374-2dc8a63278c5]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mZKOEzLI'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG nova.network.neutron [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Instance cache missing network info. {{(pid=95467) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34026d6-8730-41e0-a1db-18968cf34499]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2cda34e-fea0-4fdc-90bd-01ad31375e69]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 08:10:24 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 08:10:24 user nova-compute[95467]:  {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:10:24 user nova-compute[95467]: WARNING os_brick.initiator.connectors.iscsi [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 08:10:24 user nova-compute[95467]: 
Nov 15 08:10:24 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f -p 172.16.0.220:3260 --login {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.218s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/a259558e-87ea-48c2-8b72-7443c0510d81/disk 1073741824 {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[058d175c-8ec6-4f70-b6b0-46be5a43db62]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f, portal: 172.16.0.220,3260]
Nov 15 08:10:24 user nova-compute[95467]: Login to [iface: default, target: iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f, portal: 172.16.0.220,3260] successful.
Nov 15 08:10:24 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/a259558e-87ea-48c2-8b72-7443c0510d81/disk 1073741824" returned: 0 in 0.070s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.292s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b262c3ec-8c23-4c30-88f5-18f4231cd0f4]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5d6a28-316f-48bc-950d-7db98ac82571]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)
Nov 15 08:10:24 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)
Nov 15 08:10:24 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.435s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Connected to 172.16.0.220:3260 {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=95467) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=95467) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 08:10:24 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c666602-678f-4f06-9d03-1cfd421d178d]: (4, ('- - 0', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mZKOEzLI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.189s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a259558e-87ea-48c2-8b72-7443c0510d81/disk. size=1073741824 {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a259558e-87ea-48c2-8b72-7443c0510d81/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG nova.compute.manager [req-b6595634-f1a9-4d6b-9afd-a3b97d10d626 req-8acbc289-37bb-4d98-8a75-79dcc9202959 service nova] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Received event network-vif-plugged-193139f8-f050-4caf-89d7-106a3a504625 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b6595634-f1a9-4d6b-9afd-a3b97d10d626 req-8acbc289-37bb-4d98-8a75-79dcc9202959 service nova] Acquiring lock "1edf7591-3991-4df9-98c9-ebc4ca9e5a4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b6595634-f1a9-4d6b-9afd-a3b97d10d626 req-8acbc289-37bb-4d98-8a75-79dcc9202959 service nova] Lock "1edf7591-3991-4df9-98c9-ebc4ca9e5a4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b6595634-f1a9-4d6b-9afd-a3b97d10d626 req-8acbc289-37bb-4d98-8a75-79dcc9202959 service nova] Lock "1edf7591-3991-4df9-98c9-ebc4ca9e5a4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG nova.compute.manager [req-b6595634-f1a9-4d6b-9afd-a3b97d10d626 req-8acbc289-37bb-4d98-8a75-79dcc9202959 service nova] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] No waiting events found dispatching network-vif-plugged-193139f8-f050-4caf-89d7-106a3a504625 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:10:25 user nova-compute[95467]: WARNING nova.compute.manager [req-b6595634-f1a9-4d6b-9afd-a3b97d10d626 req-8acbc289-37bb-4d98-8a75-79dcc9202959 service nova] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Received unexpected event network-vif-plugged-193139f8-f050-4caf-89d7-106a3a504625 for instance with vm_state building and task_state spawning.
Nov 15 08:10:25 user nova-compute[95467]: DEBUG nova.network.neutron [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Successfully created port: 6026878a-0f2b-467a-be5a-b500e3776ed6 {{(pid=95467) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG nova.network.neutron [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Updating instance_info_cache with network_info: [{"id": "f6d25344-c8fc-4794-b302-a3665c62b78c", "address": "fa:16:3e:b4:72:56", "network": {"id": "76e3f53b-50a0-47d5-9e18-0bb9c42d5ba3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-182207081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18fe2aa7cd7c4943a8c848dd52b9697b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6d25344-c8", "ovs_interfaceid": "f6d25344-c8fc-4794-b302-a3665c62b78c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG nova.compute.manager [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Instance event wait completed in 0 seconds for  {{(pid=95467) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Guest created on hypervisor {{(pid=95467) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 08:10:25 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Instance spawned successfully.
Nov 15 08:10:25 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Releasing lock "refresh_cache-0917b083-2bbf-4baf-a0b8-d59ba3e2256b" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG nova.compute.manager [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Instance network_info: |[{"id": "f6d25344-c8fc-4794-b302-a3665c62b78c", "address": "fa:16:3e:b4:72:56", "network": {"id": "76e3f53b-50a0-47d5-9e18-0bb9c42d5ba3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-182207081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18fe2aa7cd7c4943a8c848dd52b9697b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6d25344-c8", "ovs_interfaceid": "f6d25344-c8fc-4794-b302-a3665c62b78c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Start _get_guest_xml network_info=[{"id": "f6d25344-c8fc-4794-b302-a3665c62b78c", "address": "fa:16:3e:b4:72:56", "network": {"id": "76e3f53b-50a0-47d5-9e18-0bb9c42d5ba3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-182207081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18fe2aa7cd7c4943a8c848dd52b9697b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6d25344-c8", "ovs_interfaceid": "f6d25344-c8fc-4794-b302-a3665c62b78c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'ed9c48aa-ce73-4b3b-9db1-235898be671b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a259558e-87ea-48c2-8b72-7443c0510d81/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] Cannot resize image /opt/stack/data/nova/instances/a259558e-87ea-48c2-8b72-7443c0510d81/disk to a smaller size. {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Created local disks {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Ensure instance console log exists: /opt/stack/data/nova/instances/a259558e-87ea-48c2-8b72-7443c0510d81/console.log {{(pid=95467) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Found default for hw_cdrom_bus of ide {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Found default for hw_disk_bus of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Found default for hw_input_bus of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Found default for hw_pointer_model of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Found default for hw_video_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Found default for hw_vif_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:10:25 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:10:25 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:10:25 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T08:10:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-940506734',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-940506734',id=9,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOGNo6GmVxPWDErmWkQ6fepU8heeIoJyOQ4cdNTLpFz1E0Ctc05CX23OX/CDepMfdF3Ar0clX85i/1Lr4zTu3ZjElr//sRBIxLqJHKfdYZdCUYYo+kOnMpjx+ZoNdO+nnQ==',key_name='tempest-keypair-1459138786',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18fe2aa7cd7c4943a8c848dd52b9697b',ramdisk_id='',reservation_id='r-edurmax0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-2023837645',owner_user_name='tempest-TaggedAttachmentsTest-2023837645-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:10:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c29ac74b4e745a09af7ecedde0f5697',uuid=0917b083-2bbf-4baf-a0b8-d59ba3e2256b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f6d25344-c8fc-4794-b302-a3665c62b78c", "address": "fa:16:3e:b4:72:56", "network": {"id": "76e3f53b-50a0-47d5-9e18-0bb9c42d5ba3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-182207081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18fe2aa7cd7c4943a8c848dd52b9697b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6d25344-c8", "ovs_interfaceid": "f6d25344-c8fc-4794-b302-a3665c62b78c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Converting VIF {"id": "f6d25344-c8fc-4794-b302-a3665c62b78c", "address": "fa:16:3e:b4:72:56", "network": {"id": "76e3f53b-50a0-47d5-9e18-0bb9c42d5ba3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-182207081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18fe2aa7cd7c4943a8c848dd52b9697b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6d25344-c8", "ovs_interfaceid": "f6d25344-c8fc-4794-b302-a3665c62b78c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:72:56,bridge_name='br-int',has_traffic_filtering=True,id=f6d25344-c8fc-4794-b302-a3665c62b78c,network=Network(76e3f53b-50a0-47d5-9e18-0bb9c42d5ba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6d25344-c8') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG nova.objects.instance [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Lazy-loading 'pci_devices' on Instance uuid 0917b083-2bbf-4baf-a0b8-d59ba3e2256b {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:10:25 user nova-compute[95467]:   <uuid>0917b083-2bbf-4baf-a0b8-d59ba3e2256b</uuid>
Nov 15 08:10:25 user nova-compute[95467]:   <name>instance-00000009</name>
Nov 15 08:10:25 user nova-compute[95467]:   <memory>524288</memory>
Nov 15 08:10:25 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:10:25 user nova-compute[95467]:   <metadata>
Nov 15 08:10:25 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:10:25 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:10:25 user nova-compute[95467]:       <nova:name>tempest-device-tagging-server-940506734</nova:name>
Nov 15 08:10:25 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:10:25</nova:creationTime>
Nov 15 08:10:25 user nova-compute[95467]:       <nova:flavor name="m1.tiny">
Nov 15 08:10:25 user nova-compute[95467]:         <nova:memory>512</nova:memory>
Nov 15 08:10:25 user nova-compute[95467]:         <nova:disk>1</nova:disk>
Nov 15 08:10:25 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:10:25 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:10:25 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:10:25 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:10:25 user nova-compute[95467]:       <nova:owner>
Nov 15 08:10:25 user nova-compute[95467]:         <nova:user uuid="5c29ac74b4e745a09af7ecedde0f5697">tempest-TaggedAttachmentsTest-2023837645-project-member</nova:user>
Nov 15 08:10:25 user nova-compute[95467]:         <nova:project uuid="18fe2aa7cd7c4943a8c848dd52b9697b">tempest-TaggedAttachmentsTest-2023837645</nova:project>
Nov 15 08:10:25 user nova-compute[95467]:       </nova:owner>
Nov 15 08:10:25 user nova-compute[95467]:       <nova:root type="image" uuid="ed9c48aa-ce73-4b3b-9db1-235898be671b"/>
Nov 15 08:10:25 user nova-compute[95467]:       <nova:ports>
Nov 15 08:10:25 user nova-compute[95467]:         <nova:port uuid="f6d25344-c8fc-4794-b302-a3665c62b78c">
Nov 15 08:10:25 user nova-compute[95467]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 08:10:25 user nova-compute[95467]:         </nova:port>
Nov 15 08:10:25 user nova-compute[95467]:       </nova:ports>
Nov 15 08:10:25 user nova-compute[95467]:     </nova:instance>
Nov 15 08:10:25 user nova-compute[95467]:   </metadata>
Nov 15 08:10:25 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:10:25 user nova-compute[95467]:     <system>
Nov 15 08:10:25 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:10:25 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:10:25 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:10:25 user nova-compute[95467]:       <entry name="serial">0917b083-2bbf-4baf-a0b8-d59ba3e2256b</entry>
Nov 15 08:10:25 user nova-compute[95467]:       <entry name="uuid">0917b083-2bbf-4baf-a0b8-d59ba3e2256b</entry>
Nov 15 08:10:25 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:10:25 user nova-compute[95467]:     </system>
Nov 15 08:10:25 user nova-compute[95467]:   </sysinfo>
Nov 15 08:10:25 user nova-compute[95467]:   <os>
Nov 15 08:10:25 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:10:25 user nova-compute[95467]:     <boot dev="hd"/>
Nov 15 08:10:25 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:10:25 user nova-compute[95467]:   </os>
Nov 15 08:10:25 user nova-compute[95467]:   <features>
Nov 15 08:10:25 user nova-compute[95467]:     <acpi/>
Nov 15 08:10:25 user nova-compute[95467]:     <apic/>
Nov 15 08:10:25 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:10:25 user nova-compute[95467]:   </features>
Nov 15 08:10:25 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:10:25 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:10:25 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:10:25 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:10:25 user nova-compute[95467]:   </clock>
Nov 15 08:10:25 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:10:25 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:10:25 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:10:25 user nova-compute[95467]:   </cpu>
Nov 15 08:10:25 user nova-compute[95467]:   <devices>
Nov 15 08:10:25 user nova-compute[95467]:     <disk type="file" device="disk">
Nov 15 08:10:25 user nova-compute[95467]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 08:10:25 user nova-compute[95467]:       <source file="/opt/stack/data/nova/instances/0917b083-2bbf-4baf-a0b8-d59ba3e2256b/disk"/>
Nov 15 08:10:25 user nova-compute[95467]:       <target dev="vda" bus="virtio"/>
Nov 15 08:10:25 user nova-compute[95467]:     </disk>
Nov 15 08:10:25 user nova-compute[95467]:     <disk type="file" device="cdrom">
Nov 15 08:10:25 user nova-compute[95467]:       <driver name="qemu" type="raw" cache="none"/>
Nov 15 08:10:25 user nova-compute[95467]:       <source file="/opt/stack/data/nova/instances/0917b083-2bbf-4baf-a0b8-d59ba3e2256b/disk.config"/>
Nov 15 08:10:25 user nova-compute[95467]:       <target dev="hda" bus="ide"/>
Nov 15 08:10:25 user nova-compute[95467]:     </disk>
Nov 15 08:10:25 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:10:25 user nova-compute[95467]:       <mac address="fa:16:3e:b4:72:56"/>
Nov 15 08:10:25 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:10:25 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:10:25 user nova-compute[95467]:       <target dev="tapf6d25344-c8"/>
Nov 15 08:10:25 user nova-compute[95467]:     </interface>
Nov 15 08:10:25 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:10:25 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/0917b083-2bbf-4baf-a0b8-d59ba3e2256b/console.log" append="off"/>
Nov 15 08:10:25 user nova-compute[95467]:     </serial>
Nov 15 08:10:25 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:10:25 user nova-compute[95467]:     <video>
Nov 15 08:10:25 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:10:25 user nova-compute[95467]:     </video>
Nov 15 08:10:25 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:10:25 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:10:25 user nova-compute[95467]:     </rng>
Nov 15 08:10:25 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:10:25 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:10:25 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:10:25 user nova-compute[95467]:     </memballoon>
Nov 15 08:10:25 user nova-compute[95467]:   </devices>
Nov 15 08:10:25 user nova-compute[95467]: </domain>
Nov 15 08:10:25 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T08:10:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-940506734',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-940506734',id=9,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOGNo6GmVxPWDErmWkQ6fepU8heeIoJyOQ4cdNTLpFz1E0Ctc05CX23OX/CDepMfdF3Ar0clX85i/1Lr4zTu3ZjElr//sRBIxLqJHKfdYZdCUYYo+kOnMpjx+ZoNdO+nnQ==',key_name='tempest-keypair-1459138786',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18fe2aa7cd7c4943a8c848dd52b9697b',ramdisk_id='',reservation_id='r-edurmax0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-2023837645',owner_user_name='tempest-TaggedAttachmentsTest-2023837645-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:10:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c29ac74b4e745a09af7ecedde0f5697',uuid=0917b083-2bbf-4baf-a0b8-d59ba3e2256b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f6d25344-c8fc-4794-b302-a3665c62b78c", "address": "fa:16:3e:b4:72:56", "network": {"id": "76e3f53b-50a0-47d5-9e18-0bb9c42d5ba3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-182207081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18fe2aa7cd7c4943a8c848dd52b9697b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6d25344-c8", "ovs_interfaceid": "f6d25344-c8fc-4794-b302-a3665c62b78c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Converting VIF {"id": "f6d25344-c8fc-4794-b302-a3665c62b78c", "address": "fa:16:3e:b4:72:56", "network": {"id": "76e3f53b-50a0-47d5-9e18-0bb9c42d5ba3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-182207081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18fe2aa7cd7c4943a8c848dd52b9697b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6d25344-c8", "ovs_interfaceid": "f6d25344-c8fc-4794-b302-a3665c62b78c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:72:56,bridge_name='br-int',has_traffic_filtering=True,id=f6d25344-c8fc-4794-b302-a3665c62b78c,network=Network(76e3f53b-50a0-47d5-9e18-0bb9c42d5ba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6d25344-c8') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG os_vif [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:72:56,bridge_name='br-int',has_traffic_filtering=True,id=f6d25344-c8fc-4794-b302-a3665c62b78c,network=Network(76e3f53b-50a0-47d5-9e18-0bb9c42d5ba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6d25344-c8') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dcb56350-01b0-5b82-ac48-615bece75720', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf6d25344-c8, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf6d25344-c8, col_values=(('qos', UUID('5d30567e-722c-4a7b-8bb9-047dd125e517')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf6d25344-c8, col_values=(('external_ids', {'iface-id': 'f6d25344-c8fc-4794-b302-a3665c62b78c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:72:56', 'vm-uuid': '0917b083-2bbf-4baf-a0b8-d59ba3e2256b'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:25 user nova-compute[95467]: INFO os_vif [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:72:56,bridge_name='br-int',has_traffic_filtering=True,id=f6d25344-c8fc-4794-b302-a3665c62b78c,network=Network(76e3f53b-50a0-47d5-9e18-0bb9c42d5ba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6d25344-c8')
Nov 15 08:10:25 user nova-compute[95467]: INFO nova.compute.manager [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Took 10.31 seconds to spawn the instance on the hypervisor.
Nov 15 08:10:25 user nova-compute[95467]: DEBUG nova.compute.manager [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] No BDM found with device name hda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] No VIF found with MAC fa:16:3e:b4:72:56, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:10:25 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Using config drive
Nov 15 08:10:25 user nova-compute[95467]: INFO nova.compute.manager [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Took 11.87 seconds to build instance.
Nov 15 08:10:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-15792d46-1e96-4b71-a5fe-a35278ffe22c tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Lock "1edf7591-3991-4df9-98c9-ebc4ca9e5a4a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.061s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG nova.compute.manager [req-c392aedf-4c4c-4863-a18c-0e086ee3e035 req-a691ecc9-ec2e-4a8f-9bd3-222fcf6d0bc3 service nova] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Received event network-vif-plugged-5b51bd20-90a5-4fb1-816c-3d8e8824cb41 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-c392aedf-4c4c-4863-a18c-0e086ee3e035 req-a691ecc9-ec2e-4a8f-9bd3-222fcf6d0bc3 service nova] Acquiring lock "36dccf43-d4a3-47aa-bd73-de9646e1020c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-c392aedf-4c4c-4863-a18c-0e086ee3e035 req-a691ecc9-ec2e-4a8f-9bd3-222fcf6d0bc3 service nova] Lock "36dccf43-d4a3-47aa-bd73-de9646e1020c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-c392aedf-4c4c-4863-a18c-0e086ee3e035 req-a691ecc9-ec2e-4a8f-9bd3-222fcf6d0bc3 service nova] Lock "36dccf43-d4a3-47aa-bd73-de9646e1020c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG nova.compute.manager [req-c392aedf-4c4c-4863-a18c-0e086ee3e035 req-a691ecc9-ec2e-4a8f-9bd3-222fcf6d0bc3 service nova] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] No waiting events found dispatching network-vif-plugged-5b51bd20-90a5-4fb1-816c-3d8e8824cb41 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:10:25 user nova-compute[95467]: WARNING nova.compute.manager [req-c392aedf-4c4c-4863-a18c-0e086ee3e035 req-a691ecc9-ec2e-4a8f-9bd3-222fcf6d0bc3 service nova] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Received unexpected event network-vif-plugged-5b51bd20-90a5-4fb1-816c-3d8e8824cb41 for instance with vm_state active and task_state None.
Nov 15 08:10:25 user nova-compute[95467]: DEBUG nova.compute.manager [req-c392aedf-4c4c-4863-a18c-0e086ee3e035 req-a691ecc9-ec2e-4a8f-9bd3-222fcf6d0bc3 service nova] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Received event network-changed-f6d25344-c8fc-4794-b302-a3665c62b78c {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG nova.compute.manager [req-c392aedf-4c4c-4863-a18c-0e086ee3e035 req-a691ecc9-ec2e-4a8f-9bd3-222fcf6d0bc3 service nova] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Refreshing instance network info cache due to event network-changed-f6d25344-c8fc-4794-b302-a3665c62b78c. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-c392aedf-4c4c-4863-a18c-0e086ee3e035 req-a691ecc9-ec2e-4a8f-9bd3-222fcf6d0bc3 service nova] Acquiring lock "refresh_cache-0917b083-2bbf-4baf-a0b8-d59ba3e2256b" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-c392aedf-4c4c-4863-a18c-0e086ee3e035 req-a691ecc9-ec2e-4a8f-9bd3-222fcf6d0bc3 service nova] Acquired lock "refresh_cache-0917b083-2bbf-4baf-a0b8-d59ba3e2256b" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG nova.network.neutron [req-c392aedf-4c4c-4863-a18c-0e086ee3e035 req-a691ecc9-ec2e-4a8f-9bd3-222fcf6d0bc3 service nova] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Refreshing network info cache for port f6d25344-c8fc-4794-b302-a3665c62b78c {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG nova.network.neutron [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Successfully updated port: 6026878a-0f2b-467a-be5a-b500e3776ed6 {{(pid=95467) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] Acquiring lock "refresh_cache-a259558e-87ea-48c2-8b72-7443c0510d81" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] Acquired lock "refresh_cache-a259558e-87ea-48c2-8b72-7443c0510d81" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:10:25 user nova-compute[95467]: DEBUG nova.network.neutron [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.483s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] <== connect_volume: return (1484ms) {'type': 'block', 'scsi_wwn': '23466333731396463', 'path': '/dev/sdb'} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23466333731396463', 'path': '/dev/sdb'} {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG nova.compute.manager [req-5b783474-1ac2-44eb-bcb5-79709528e218 req-3874af9a-7baa-4652-b5bd-e2f986f40e2a service nova] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Received event network-changed-6026878a-0f2b-467a-be5a-b500e3776ed6 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG nova.compute.manager [req-5b783474-1ac2-44eb-bcb5-79709528e218 req-3874af9a-7baa-4652-b5bd-e2f986f40e2a service nova] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Refreshing instance network info cache due to event network-changed-6026878a-0f2b-467a-be5a-b500e3776ed6. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-5b783474-1ac2-44eb-bcb5-79709528e218 req-3874af9a-7baa-4652-b5bd-e2f986f40e2a service nova] Acquiring lock "refresh_cache-a259558e-87ea-48c2-8b72-7443c0510d81" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:10:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-123252793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-123252793',id=7,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAC1BuAs3ejJ+aRw6D/CB1xzKj78ip7ytDqvO2vvfGnTsB6+r8q33E0IAISM3h9/kVw6ZoQQmHwLT2P/3YuBA4w/px39kz5Vj5TaIA4bkzJYmqXkT5MBbT73nDHHxYjkVA==',key_name='tempest-keypair-986720723',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81b11067a2d84bba8e6929713034b422',ramdisk_id='',reservation_id='r-pdz8drr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1288833049',owner_user_name='tempest-ServerActionsV293TestJSON-1288833049-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:10:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='54bfe816a1bf4ee485e055604f0b7609',uuid=7e53d93e-1222-4b1a-9745-d512da0f7925,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2", "address": "fa:16:3e:b1:d4:80", "network": {"id": "d8daee94-e2d9-42cf-9675-8c06e7292d36", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-765825262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81b11067a2d84bba8e6929713034b422", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d8e0cf8-c3", "ovs_interfaceid": "1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Converting VIF {"id": "1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2", "address": "fa:16:3e:b1:d4:80", "network": {"id": "d8daee94-e2d9-42cf-9675-8c06e7292d36", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-765825262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81b11067a2d84bba8e6929713034b422", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d8e0cf8-c3", "ovs_interfaceid": "1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:d4:80,bridge_name='br-int',has_traffic_filtering=True,id=1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2,network=Network(d8daee94-e2d9-42cf-9675-8c06e7292d36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d8e0cf8-c3') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG nova.objects.instance [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Lazy-loading 'pci_devices' on Instance uuid 7e53d93e-1222-4b1a-9745-d512da0f7925 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:10:26 user nova-compute[95467]:   <uuid>7e53d93e-1222-4b1a-9745-d512da0f7925</uuid>
Nov 15 08:10:26 user nova-compute[95467]:   <name>instance-00000007</name>
Nov 15 08:10:26 user nova-compute[95467]:   <memory>524288</memory>
Nov 15 08:10:26 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:10:26 user nova-compute[95467]:   <metadata>
Nov 15 08:10:26 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:10:26 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:10:26 user nova-compute[95467]:       <nova:name>tempest-ServerActionsV293TestJSON-server-123252793</nova:name>
Nov 15 08:10:26 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:10:24</nova:creationTime>
Nov 15 08:10:26 user nova-compute[95467]:       <nova:flavor name="m1.tiny">
Nov 15 08:10:26 user nova-compute[95467]:         <nova:memory>512</nova:memory>
Nov 15 08:10:26 user nova-compute[95467]:         <nova:disk>1</nova:disk>
Nov 15 08:10:26 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:10:26 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:10:26 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:10:26 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:10:26 user nova-compute[95467]:       <nova:owner>
Nov 15 08:10:26 user nova-compute[95467]:         <nova:user uuid="54bfe816a1bf4ee485e055604f0b7609">tempest-ServerActionsV293TestJSON-1288833049-project-member</nova:user>
Nov 15 08:10:26 user nova-compute[95467]:         <nova:project uuid="81b11067a2d84bba8e6929713034b422">tempest-ServerActionsV293TestJSON-1288833049</nova:project>
Nov 15 08:10:26 user nova-compute[95467]:       </nova:owner>
Nov 15 08:10:26 user nova-compute[95467]:       <nova:ports>
Nov 15 08:10:26 user nova-compute[95467]:         <nova:port uuid="1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2">
Nov 15 08:10:26 user nova-compute[95467]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 08:10:26 user nova-compute[95467]:         </nova:port>
Nov 15 08:10:26 user nova-compute[95467]:       </nova:ports>
Nov 15 08:10:26 user nova-compute[95467]:     </nova:instance>
Nov 15 08:10:26 user nova-compute[95467]:   </metadata>
Nov 15 08:10:26 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:10:26 user nova-compute[95467]:     <system>
Nov 15 08:10:26 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:10:26 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:10:26 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:10:26 user nova-compute[95467]:       <entry name="serial">7e53d93e-1222-4b1a-9745-d512da0f7925</entry>
Nov 15 08:10:26 user nova-compute[95467]:       <entry name="uuid">7e53d93e-1222-4b1a-9745-d512da0f7925</entry>
Nov 15 08:10:26 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:10:26 user nova-compute[95467]:     </system>
Nov 15 08:10:26 user nova-compute[95467]:   </sysinfo>
Nov 15 08:10:26 user nova-compute[95467]:   <os>
Nov 15 08:10:26 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:10:26 user nova-compute[95467]:     <boot dev="hd"/>
Nov 15 08:10:26 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:10:26 user nova-compute[95467]:   </os>
Nov 15 08:10:26 user nova-compute[95467]:   <features>
Nov 15 08:10:26 user nova-compute[95467]:     <acpi/>
Nov 15 08:10:26 user nova-compute[95467]:     <apic/>
Nov 15 08:10:26 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:10:26 user nova-compute[95467]:   </features>
Nov 15 08:10:26 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:10:26 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:10:26 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:10:26 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:10:26 user nova-compute[95467]:   </clock>
Nov 15 08:10:26 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:10:26 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:10:26 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:10:26 user nova-compute[95467]:   </cpu>
Nov 15 08:10:26 user nova-compute[95467]:   <devices>
Nov 15 08:10:26 user nova-compute[95467]:     <disk type="block" device="disk">
Nov 15 08:10:26 user nova-compute[95467]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:10:26 user nova-compute[95467]:       <source dev="/dev/sdb"/>
Nov 15 08:10:26 user nova-compute[95467]:       <target dev="vda" bus="virtio"/>
Nov 15 08:10:26 user nova-compute[95467]:       <serial>01b18fa8-0d71-4fef-b5f2-44b7afba773f</serial>
Nov 15 08:10:26 user nova-compute[95467]:     </disk>
Nov 15 08:10:26 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:10:26 user nova-compute[95467]:       <mac address="fa:16:3e:b1:d4:80"/>
Nov 15 08:10:26 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:10:26 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:10:26 user nova-compute[95467]:       <target dev="tap1d8e0cf8-c3"/>
Nov 15 08:10:26 user nova-compute[95467]:     </interface>
Nov 15 08:10:26 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:10:26 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/7e53d93e-1222-4b1a-9745-d512da0f7925/console.log" append="off"/>
Nov 15 08:10:26 user nova-compute[95467]:     </serial>
Nov 15 08:10:26 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:10:26 user nova-compute[95467]:     <video>
Nov 15 08:10:26 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:10:26 user nova-compute[95467]:     </video>
Nov 15 08:10:26 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:10:26 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:10:26 user nova-compute[95467]:     </rng>
Nov 15 08:10:26 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:10:26 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:10:26 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:10:26 user nova-compute[95467]:     </memballoon>
Nov 15 08:10:26 user nova-compute[95467]:   </devices>
Nov 15 08:10:26 user nova-compute[95467]: </domain>
Nov 15 08:10:26 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:10:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-123252793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-123252793',id=7,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAC1BuAs3ejJ+aRw6D/CB1xzKj78ip7ytDqvO2vvfGnTsB6+r8q33E0IAISM3h9/kVw6ZoQQmHwLT2P/3YuBA4w/px39kz5Vj5TaIA4bkzJYmqXkT5MBbT73nDHHxYjkVA==',key_name='tempest-keypair-986720723',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81b11067a2d84bba8e6929713034b422',ramdisk_id='',reservation_id='r-pdz8drr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1288833049',owner_user_name='tempest-ServerActionsV293TestJSON-1288833049-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:10:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='54bfe816a1bf4ee485e055604f0b7609',uuid=7e53d93e-1222-4b1a-9745-d512da0f7925,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2", "address": "fa:16:3e:b1:d4:80", "network": {"id": "d8daee94-e2d9-42cf-9675-8c06e7292d36", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-765825262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81b11067a2d84bba8e6929713034b422", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d8e0cf8-c3", "ovs_interfaceid": "1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Converting VIF {"id": "1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2", "address": "fa:16:3e:b1:d4:80", "network": {"id": "d8daee94-e2d9-42cf-9675-8c06e7292d36", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-765825262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81b11067a2d84bba8e6929713034b422", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d8e0cf8-c3", "ovs_interfaceid": "1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:d4:80,bridge_name='br-int',has_traffic_filtering=True,id=1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2,network=Network(d8daee94-e2d9-42cf-9675-8c06e7292d36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d8e0cf8-c3') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG os_vif [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:d4:80,bridge_name='br-int',has_traffic_filtering=True,id=1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2,network=Network(d8daee94-e2d9-42cf-9675-8c06e7292d36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d8e0cf8-c3') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5b1cccca-2ae6-5b26-bf7b-8c6efd97bf97', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1d8e0cf8-c3, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1d8e0cf8-c3, col_values=(('qos', UUID('8c64b544-3add-4b76-94a3-cfd689ee8ff4')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1d8e0cf8-c3, col_values=(('external_ids', {'iface-id': '1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:d4:80', 'vm-uuid': '7e53d93e-1222-4b1a-9745-d512da0f7925'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG nova.network.neutron [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Instance cache missing network info. {{(pid=95467) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:26 user nova-compute[95467]: INFO os_vif [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:d4:80,bridge_name='br-int',has_traffic_filtering=True,id=1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2,network=Network(d8daee94-e2d9-42cf-9675-8c06e7292d36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d8e0cf8-c3')
Nov 15 08:10:26 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] No VIF found with MAC fa:16:3e:b1:d4:80, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:10:26 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Creating config drive at /opt/stack/data/nova/instances/0917b083-2bbf-4baf-a0b8-d59ba3e2256b/disk.config
Nov 15 08:10:26 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0917b083-2bbf-4baf-a0b8-d59ba3e2256b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmph4o94q39 {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0917b083-2bbf-4baf-a0b8-d59ba3e2256b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmph4o94q39" returned: 0 in 0.069s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG nova.network.neutron [req-c392aedf-4c4c-4863-a18c-0e086ee3e035 req-a691ecc9-ec2e-4a8f-9bd3-222fcf6d0bc3 service nova] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Updated VIF entry in instance network info cache for port f6d25344-c8fc-4794-b302-a3665c62b78c. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG nova.network.neutron [req-c392aedf-4c4c-4863-a18c-0e086ee3e035 req-a691ecc9-ec2e-4a8f-9bd3-222fcf6d0bc3 service nova] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Updating instance_info_cache with network_info: [{"id": "f6d25344-c8fc-4794-b302-a3665c62b78c", "address": "fa:16:3e:b4:72:56", "network": {"id": "76e3f53b-50a0-47d5-9e18-0bb9c42d5ba3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-182207081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18fe2aa7cd7c4943a8c848dd52b9697b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6d25344-c8", "ovs_interfaceid": "f6d25344-c8fc-4794-b302-a3665c62b78c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-c392aedf-4c4c-4863-a18c-0e086ee3e035 req-a691ecc9-ec2e-4a8f-9bd3-222fcf6d0bc3 service nova] Releasing lock "refresh_cache-0917b083-2bbf-4baf-a0b8-d59ba3e2256b" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG nova.compute.manager [req-c392aedf-4c4c-4863-a18c-0e086ee3e035 req-a691ecc9-ec2e-4a8f-9bd3-222fcf6d0bc3 service nova] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Received event network-vif-plugged-10ed2f01-5666-4615-be28-c574ff652c1d {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-c392aedf-4c4c-4863-a18c-0e086ee3e035 req-a691ecc9-ec2e-4a8f-9bd3-222fcf6d0bc3 service nova] Acquiring lock "68264a44-5adf-4873-b380-26bcafe2ba04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-c392aedf-4c4c-4863-a18c-0e086ee3e035 req-a691ecc9-ec2e-4a8f-9bd3-222fcf6d0bc3 service nova] Lock "68264a44-5adf-4873-b380-26bcafe2ba04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-c392aedf-4c4c-4863-a18c-0e086ee3e035 req-a691ecc9-ec2e-4a8f-9bd3-222fcf6d0bc3 service nova] Lock "68264a44-5adf-4873-b380-26bcafe2ba04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG nova.compute.manager [req-c392aedf-4c4c-4863-a18c-0e086ee3e035 req-a691ecc9-ec2e-4a8f-9bd3-222fcf6d0bc3 service nova] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] No waiting events found dispatching network-vif-plugged-10ed2f01-5666-4615-be28-c574ff652c1d {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:10:26 user nova-compute[95467]: WARNING nova.compute.manager [req-c392aedf-4c4c-4863-a18c-0e086ee3e035 req-a691ecc9-ec2e-4a8f-9bd3-222fcf6d0bc3 service nova] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Received unexpected event network-vif-plugged-10ed2f01-5666-4615-be28-c574ff652c1d for instance with vm_state active and task_state None.
Nov 15 08:10:26 user nova-compute[95467]: DEBUG nova.compute.manager [req-c392aedf-4c4c-4863-a18c-0e086ee3e035 req-a691ecc9-ec2e-4a8f-9bd3-222fcf6d0bc3 service nova] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Received event network-vif-plugged-10ed2f01-5666-4615-be28-c574ff652c1d {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-c392aedf-4c4c-4863-a18c-0e086ee3e035 req-a691ecc9-ec2e-4a8f-9bd3-222fcf6d0bc3 service nova] Acquiring lock "68264a44-5adf-4873-b380-26bcafe2ba04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-c392aedf-4c4c-4863-a18c-0e086ee3e035 req-a691ecc9-ec2e-4a8f-9bd3-222fcf6d0bc3 service nova] Lock "68264a44-5adf-4873-b380-26bcafe2ba04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-c392aedf-4c4c-4863-a18c-0e086ee3e035 req-a691ecc9-ec2e-4a8f-9bd3-222fcf6d0bc3 service nova] Lock "68264a44-5adf-4873-b380-26bcafe2ba04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG nova.compute.manager [req-c392aedf-4c4c-4863-a18c-0e086ee3e035 req-a691ecc9-ec2e-4a8f-9bd3-222fcf6d0bc3 service nova] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] No waiting events found dispatching network-vif-plugged-10ed2f01-5666-4615-be28-c574ff652c1d {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:10:26 user nova-compute[95467]: WARNING nova.compute.manager [req-c392aedf-4c4c-4863-a18c-0e086ee3e035 req-a691ecc9-ec2e-4a8f-9bd3-222fcf6d0bc3 service nova] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Received unexpected event network-vif-plugged-10ed2f01-5666-4615-be28-c574ff652c1d for instance with vm_state active and task_state None.
Nov 15 08:10:26 user nova-compute[95467]: DEBUG nova.network.neutron [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Updating instance_info_cache with network_info: [{"id": "6026878a-0f2b-467a-be5a-b500e3776ed6", "address": "fa:16:3e:fc:81:b9", "network": {"id": "66c77f59-de52-498a-8294-ec7ac812074b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-943726914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd6ae375b97347d6b1b757bb74cd3c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6026878a-0f", "ovs_interfaceid": "6026878a-0f2b-467a-be5a-b500e3776ed6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] Releasing lock "refresh_cache-a259558e-87ea-48c2-8b72-7443c0510d81" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG nova.compute.manager [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Instance network_info: |[{"id": "6026878a-0f2b-467a-be5a-b500e3776ed6", "address": "fa:16:3e:fc:81:b9", "network": {"id": "66c77f59-de52-498a-8294-ec7ac812074b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-943726914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd6ae375b97347d6b1b757bb74cd3c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6026878a-0f", "ovs_interfaceid": "6026878a-0f2b-467a-be5a-b500e3776ed6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-5b783474-1ac2-44eb-bcb5-79709528e218 req-3874af9a-7baa-4652-b5bd-e2f986f40e2a service nova] Acquired lock "refresh_cache-a259558e-87ea-48c2-8b72-7443c0510d81" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG nova.network.neutron [req-5b783474-1ac2-44eb-bcb5-79709528e218 req-3874af9a-7baa-4652-b5bd-e2f986f40e2a service nova] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Refreshing network info cache for port 6026878a-0f2b-467a-be5a-b500e3776ed6 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Start _get_guest_xml network_info=[{"id": "6026878a-0f2b-467a-be5a-b500e3776ed6", "address": "fa:16:3e:fc:81:b9", "network": {"id": "66c77f59-de52-498a-8294-ec7ac812074b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-943726914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd6ae375b97347d6b1b757bb74cd3c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6026878a-0f", "ovs_interfaceid": "6026878a-0f2b-467a-be5a-b500e3776ed6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'ed9c48aa-ce73-4b3b-9db1-235898be671b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:10:26 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:10:26 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:10:26 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:10:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-928383486',display_name='tempest-VolumesAssistedSnapshotsTest-server-928383486',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-928383486',id=10,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEYCs5SdFlFaD1XhVN4K3XS66xNGhwMkVPDb0+LtFoq6bFwIvN0FYHLyNJVkcr+3Vfl1gTXWrYQcTSlhFZlz5N5XpBKSHX1ez4NflzskasVetjH6WyOLnnKv8115SrrxZA==',key_name='tempest-keypair-854904367',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd6ae375b97347d6b1b757bb74cd3c50',ramdisk_id='',reservation_id='r-6jaq6n69',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1565892016',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1565892016-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:10:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21401887c3f04e238f5399da20d7be71',uuid=a259558e-87ea-48c2-8b72-7443c0510d81,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6026878a-0f2b-467a-be5a-b500e3776ed6", "address": "fa:16:3e:fc:81:b9", "network": {"id": "66c77f59-de52-498a-8294-ec7ac812074b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-943726914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd6ae375b97347d6b1b757bb74cd3c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6026878a-0f", "ovs_interfaceid": "6026878a-0f2b-467a-be5a-b500e3776ed6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] Converting VIF {"id": "6026878a-0f2b-467a-be5a-b500e3776ed6", "address": "fa:16:3e:fc:81:b9", "network": {"id": "66c77f59-de52-498a-8294-ec7ac812074b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-943726914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd6ae375b97347d6b1b757bb74cd3c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6026878a-0f", "ovs_interfaceid": "6026878a-0f2b-467a-be5a-b500e3776ed6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:81:b9,bridge_name='br-int',has_traffic_filtering=True,id=6026878a-0f2b-467a-be5a-b500e3776ed6,network=Network(66c77f59-de52-498a-8294-ec7ac812074b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6026878a-0f') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG nova.objects.instance [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] Lazy-loading 'pci_devices' on Instance uuid a259558e-87ea-48c2-8b72-7443c0510d81 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:10:26 user nova-compute[95467]:   <uuid>a259558e-87ea-48c2-8b72-7443c0510d81</uuid>
Nov 15 08:10:26 user nova-compute[95467]:   <name>instance-0000000a</name>
Nov 15 08:10:26 user nova-compute[95467]:   <memory>524288</memory>
Nov 15 08:10:26 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:10:26 user nova-compute[95467]:   <metadata>
Nov 15 08:10:26 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:10:26 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:10:26 user nova-compute[95467]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-928383486</nova:name>
Nov 15 08:10:26 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:10:26</nova:creationTime>
Nov 15 08:10:26 user nova-compute[95467]:       <nova:flavor name="m1.tiny">
Nov 15 08:10:26 user nova-compute[95467]:         <nova:memory>512</nova:memory>
Nov 15 08:10:26 user nova-compute[95467]:         <nova:disk>1</nova:disk>
Nov 15 08:10:26 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:10:26 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:10:26 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:10:26 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:10:26 user nova-compute[95467]:       <nova:owner>
Nov 15 08:10:26 user nova-compute[95467]:         <nova:user uuid="21401887c3f04e238f5399da20d7be71">tempest-VolumesAssistedSnapshotsTest-1565892016-project-member</nova:user>
Nov 15 08:10:26 user nova-compute[95467]:         <nova:project uuid="bd6ae375b97347d6b1b757bb74cd3c50">tempest-VolumesAssistedSnapshotsTest-1565892016</nova:project>
Nov 15 08:10:26 user nova-compute[95467]:       </nova:owner>
Nov 15 08:10:26 user nova-compute[95467]:       <nova:root type="image" uuid="ed9c48aa-ce73-4b3b-9db1-235898be671b"/>
Nov 15 08:10:26 user nova-compute[95467]:       <nova:ports>
Nov 15 08:10:26 user nova-compute[95467]:         <nova:port uuid="6026878a-0f2b-467a-be5a-b500e3776ed6">
Nov 15 08:10:26 user nova-compute[95467]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 08:10:26 user nova-compute[95467]:         </nova:port>
Nov 15 08:10:26 user nova-compute[95467]:       </nova:ports>
Nov 15 08:10:26 user nova-compute[95467]:     </nova:instance>
Nov 15 08:10:26 user nova-compute[95467]:   </metadata>
Nov 15 08:10:26 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:10:26 user nova-compute[95467]:     <system>
Nov 15 08:10:26 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:10:26 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:10:26 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:10:26 user nova-compute[95467]:       <entry name="serial">a259558e-87ea-48c2-8b72-7443c0510d81</entry>
Nov 15 08:10:26 user nova-compute[95467]:       <entry name="uuid">a259558e-87ea-48c2-8b72-7443c0510d81</entry>
Nov 15 08:10:26 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:10:26 user nova-compute[95467]:     </system>
Nov 15 08:10:26 user nova-compute[95467]:   </sysinfo>
Nov 15 08:10:26 user nova-compute[95467]:   <os>
Nov 15 08:10:26 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:10:26 user nova-compute[95467]:     <boot dev="hd"/>
Nov 15 08:10:26 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:10:26 user nova-compute[95467]:   </os>
Nov 15 08:10:26 user nova-compute[95467]:   <features>
Nov 15 08:10:26 user nova-compute[95467]:     <acpi/>
Nov 15 08:10:26 user nova-compute[95467]:     <apic/>
Nov 15 08:10:26 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:10:26 user nova-compute[95467]:   </features>
Nov 15 08:10:26 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:10:26 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:10:26 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:10:26 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:10:26 user nova-compute[95467]:   </clock>
Nov 15 08:10:26 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:10:26 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:10:26 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:10:26 user nova-compute[95467]:   </cpu>
Nov 15 08:10:26 user nova-compute[95467]:   <devices>
Nov 15 08:10:26 user nova-compute[95467]:     <disk type="file" device="disk">
Nov 15 08:10:26 user nova-compute[95467]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 08:10:26 user nova-compute[95467]:       <source file="/opt/stack/data/nova/instances/a259558e-87ea-48c2-8b72-7443c0510d81/disk"/>
Nov 15 08:10:26 user nova-compute[95467]:       <target dev="vda" bus="virtio"/>
Nov 15 08:10:26 user nova-compute[95467]:     </disk>
Nov 15 08:10:26 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:10:26 user nova-compute[95467]:       <mac address="fa:16:3e:fc:81:b9"/>
Nov 15 08:10:26 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:10:26 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:10:26 user nova-compute[95467]:       <target dev="tap6026878a-0f"/>
Nov 15 08:10:26 user nova-compute[95467]:     </interface>
Nov 15 08:10:26 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:10:26 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/a259558e-87ea-48c2-8b72-7443c0510d81/console.log" append="off"/>
Nov 15 08:10:26 user nova-compute[95467]:     </serial>
Nov 15 08:10:26 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:10:26 user nova-compute[95467]:     <video>
Nov 15 08:10:26 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:10:26 user nova-compute[95467]:     </video>
Nov 15 08:10:26 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:10:26 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:10:26 user nova-compute[95467]:     </rng>
Nov 15 08:10:26 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:10:26 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:10:26 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:10:26 user nova-compute[95467]:     </memballoon>
Nov 15 08:10:26 user nova-compute[95467]:   </devices>
Nov 15 08:10:26 user nova-compute[95467]: </domain>
Nov 15 08:10:26 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:10:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-928383486',display_name='tempest-VolumesAssistedSnapshotsTest-server-928383486',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-928383486',id=10,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEYCs5SdFlFaD1XhVN4K3XS66xNGhwMkVPDb0+LtFoq6bFwIvN0FYHLyNJVkcr+3Vfl1gTXWrYQcTSlhFZlz5N5XpBKSHX1ez4NflzskasVetjH6WyOLnnKv8115SrrxZA==',key_name='tempest-keypair-854904367',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd6ae375b97347d6b1b757bb74cd3c50',ramdisk_id='',reservation_id='r-6jaq6n69',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1565892016',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1565892016-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:10:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21401887c3f04e238f5399da20d7be71',uuid=a259558e-87ea-48c2-8b72-7443c0510d81,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6026878a-0f2b-467a-be5a-b500e3776ed6", "address": "fa:16:3e:fc:81:b9", "network": {"id": "66c77f59-de52-498a-8294-ec7ac812074b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-943726914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd6ae375b97347d6b1b757bb74cd3c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6026878a-0f", "ovs_interfaceid": "6026878a-0f2b-467a-be5a-b500e3776ed6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] Converting VIF {"id": "6026878a-0f2b-467a-be5a-b500e3776ed6", "address": "fa:16:3e:fc:81:b9", "network": {"id": "66c77f59-de52-498a-8294-ec7ac812074b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-943726914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd6ae375b97347d6b1b757bb74cd3c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6026878a-0f", "ovs_interfaceid": "6026878a-0f2b-467a-be5a-b500e3776ed6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:81:b9,bridge_name='br-int',has_traffic_filtering=True,id=6026878a-0f2b-467a-be5a-b500e3776ed6,network=Network(66c77f59-de52-498a-8294-ec7ac812074b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6026878a-0f') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG os_vif [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:81:b9,bridge_name='br-int',has_traffic_filtering=True,id=6026878a-0f2b-467a-be5a-b500e3776ed6,network=Network(66c77f59-de52-498a-8294-ec7ac812074b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6026878a-0f') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '403d3722-c41f-5f66-bd30-459119f6e285', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6026878a-0f, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6026878a-0f, col_values=(('qos', UUID('d5e14cf1-47f1-42df-b824-835e4ce8205d')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6026878a-0f, col_values=(('external_ids', {'iface-id': '6026878a-0f2b-467a-be5a-b500e3776ed6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:81:b9', 'vm-uuid': 'a259558e-87ea-48c2-8b72-7443c0510d81'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:10:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:26 user nova-compute[95467]: INFO os_vif [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:81:b9,bridge_name='br-int',has_traffic_filtering=True,id=6026878a-0f2b-467a-be5a-b500e3776ed6,network=Network(66c77f59-de52-498a-8294-ec7ac812074b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6026878a-0f')
Nov 15 08:10:27 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:10:27 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] No VIF found with MAC fa:16:3e:fc:81:b9, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:10:27 user nova-compute[95467]: DEBUG nova.network.neutron [req-5b783474-1ac2-44eb-bcb5-79709528e218 req-3874af9a-7baa-4652-b5bd-e2f986f40e2a service nova] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Updated VIF entry in instance network info cache for port 6026878a-0f2b-467a-be5a-b500e3776ed6. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:10:27 user nova-compute[95467]: DEBUG nova.network.neutron [req-5b783474-1ac2-44eb-bcb5-79709528e218 req-3874af9a-7baa-4652-b5bd-e2f986f40e2a service nova] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Updating instance_info_cache with network_info: [{"id": "6026878a-0f2b-467a-be5a-b500e3776ed6", "address": "fa:16:3e:fc:81:b9", "network": {"id": "66c77f59-de52-498a-8294-ec7ac812074b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-943726914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd6ae375b97347d6b1b757bb74cd3c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6026878a-0f", "ovs_interfaceid": "6026878a-0f2b-467a-be5a-b500e3776ed6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:10:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-5b783474-1ac2-44eb-bcb5-79709528e218 req-3874af9a-7baa-4652-b5bd-e2f986f40e2a service nova] Releasing lock "refresh_cache-a259558e-87ea-48c2-8b72-7443c0510d81" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:10:30 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:30 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:30 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:30 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:30 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:30 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:30 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:30 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:30 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:10:30 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Cleaning up deleted instances {{(pid=95467) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 08:10:30 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] There are 0 instances to clean {{(pid=95467) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 08:10:30 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:10:30 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Cleaning up deleted instances with incomplete migration  {{(pid=95467) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 08:10:30 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:10:30 user nova-compute[95467]: DEBUG nova.compute.manager [req-b9c178d8-0fd8-4dba-bd92-4339a9740813 req-4dc0d472-5f69-4cb8-b785-8190809ef62b service nova] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Received event network-vif-plugged-6026878a-0f2b-467a-be5a-b500e3776ed6 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:10:30 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b9c178d8-0fd8-4dba-bd92-4339a9740813 req-4dc0d472-5f69-4cb8-b785-8190809ef62b service nova] Acquiring lock "a259558e-87ea-48c2-8b72-7443c0510d81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:10:30 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b9c178d8-0fd8-4dba-bd92-4339a9740813 req-4dc0d472-5f69-4cb8-b785-8190809ef62b service nova] Lock "a259558e-87ea-48c2-8b72-7443c0510d81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:10:30 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b9c178d8-0fd8-4dba-bd92-4339a9740813 req-4dc0d472-5f69-4cb8-b785-8190809ef62b service nova] Lock "a259558e-87ea-48c2-8b72-7443c0510d81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:10:30 user nova-compute[95467]: DEBUG nova.compute.manager [req-b9c178d8-0fd8-4dba-bd92-4339a9740813 req-4dc0d472-5f69-4cb8-b785-8190809ef62b service nova] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] No waiting events found dispatching network-vif-plugged-6026878a-0f2b-467a-be5a-b500e3776ed6 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:10:30 user nova-compute[95467]: WARNING nova.compute.manager [req-b9c178d8-0fd8-4dba-bd92-4339a9740813 req-4dc0d472-5f69-4cb8-b785-8190809ef62b service nova] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Received unexpected event network-vif-plugged-6026878a-0f2b-467a-be5a-b500e3776ed6 for instance with vm_state building and task_state spawning.
Nov 15 08:10:30 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:30 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:30 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:30 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:31 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:31 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:31 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:31 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:31 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:31 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:31 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:31 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:31 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:32 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:10:32 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=95467) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 08:10:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Acquiring lock "35e88686-253e-452a-9649-8aa2a04128ce" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:10:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Lock "35e88686-253e-452a-9649-8aa2a04128ce" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:10:32 user nova-compute[95467]: DEBUG nova.compute.manager [req-b769ca43-9d52-4e55-8a4d-4e9d5c4d2aa5 req-dbac5cdd-1237-4207-a101-b1aa3f795218 service nova] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Received event network-vif-plugged-6026878a-0f2b-467a-be5a-b500e3776ed6 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:10:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b769ca43-9d52-4e55-8a4d-4e9d5c4d2aa5 req-dbac5cdd-1237-4207-a101-b1aa3f795218 service nova] Acquiring lock "a259558e-87ea-48c2-8b72-7443c0510d81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:10:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b769ca43-9d52-4e55-8a4d-4e9d5c4d2aa5 req-dbac5cdd-1237-4207-a101-b1aa3f795218 service nova] Lock "a259558e-87ea-48c2-8b72-7443c0510d81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:10:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b769ca43-9d52-4e55-8a4d-4e9d5c4d2aa5 req-dbac5cdd-1237-4207-a101-b1aa3f795218 service nova] Lock "a259558e-87ea-48c2-8b72-7443c0510d81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:10:32 user nova-compute[95467]: DEBUG nova.compute.manager [req-b769ca43-9d52-4e55-8a4d-4e9d5c4d2aa5 req-dbac5cdd-1237-4207-a101-b1aa3f795218 service nova] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] No waiting events found dispatching network-vif-plugged-6026878a-0f2b-467a-be5a-b500e3776ed6 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:10:32 user nova-compute[95467]: WARNING nova.compute.manager [req-b769ca43-9d52-4e55-8a4d-4e9d5c4d2aa5 req-dbac5cdd-1237-4207-a101-b1aa3f795218 service nova] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Received unexpected event network-vif-plugged-6026878a-0f2b-467a-be5a-b500e3776ed6 for instance with vm_state building and task_state spawning.
Nov 15 08:10:32 user nova-compute[95467]: DEBUG nova.compute.manager [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Starting instance... {{(pid=95467) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 08:10:33 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:10:33 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:10:33 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=95467) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 08:10:33 user nova-compute[95467]: INFO nova.compute.claims [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Claim successful on node user
Nov 15 08:10:33 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:10:33 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:10:33 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:10:33 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.738s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:10:33 user nova-compute[95467]: DEBUG nova.compute.manager [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Start building networks asynchronously for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 08:10:33 user nova-compute[95467]: DEBUG nova.compute.manager [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Allocating IP information in the background. {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 08:10:33 user nova-compute[95467]: DEBUG nova.network.neutron [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] allocate_for_instance() {{(pid=95467) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 08:10:33 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 08:10:33 user nova-compute[95467]: DEBUG nova.compute.manager [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Start building block device mappings for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 08:10:34 user nova-compute[95467]: INFO nova.virt.block_device [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Booting with volume 8d4b7008-9243-4206-a1e7-bddc82e2d5c8 at /dev/vda
Nov 15 08:10:34 user nova-compute[95467]: DEBUG nova.compute.manager [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Instance event wait completed in 0 seconds for  {{(pid=95467) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 08:10:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Guest created on hypervisor {{(pid=95467) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 08:10:34 user nova-compute[95467]: DEBUG nova.compute.manager [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Instance event wait completed in 0 seconds for  {{(pid=95467) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 08:10:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Guest created on hypervisor {{(pid=95467) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 08:10:34 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Instance spawned successfully.
Nov 15 08:10:34 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Instance spawned successfully.
Nov 15 08:10:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 08:10:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 08:10:34 user nova-compute[95467]: DEBUG os_brick.utils [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:10:34 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:34 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:34 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce93be2-7944-413e-badc-2b57f4719aca]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:882ae90641f\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:10:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Found default for hw_cdrom_bus of ide {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:10:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Found default for hw_disk_bus of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:10:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Found default for hw_input_bus of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:10:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Found default for hw_pointer_model of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:10:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Found default for hw_video_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:10:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Found default for hw_vif_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:10:34 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Found default for hw_cdrom_bus of ide {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:10:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Found default for hw_disk_bus of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:10:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Found default for hw_input_bus of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:10:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Found default for hw_pointer_model of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:10:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Found default for hw_video_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:10:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Found default for hw_vif_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:10:34 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Instance event wait completed in 0 seconds for  {{(pid=95467) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 08:10:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Guest created on hypervisor {{(pid=95467) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 08:10:34 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:34 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5227219-4cb4-4dcb-bcec-a2fe5f138d3a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:10:34 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:34 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Instance spawned successfully.
Nov 15 08:10:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 08:10:34 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.037s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:34 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6cbab63-6acb-4673-9457-7143ac8890e9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:10:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Found default for hw_cdrom_bus of ide {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:10:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Found default for hw_disk_bus of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:10:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Found default for hw_input_bus of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:10:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Found default for hw_pointer_model of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:10:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Found default for hw_video_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:10:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Found default for hw_vif_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:10:34 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8121ec00-ed4a-4d5b-b225-668141d7143e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:10:34 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Running cmd (subprocess): nvme version {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:34 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] 'nvme version' failed. Not Retrying. {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:10:34 user nova-compute[95467]: DEBUG nova.policy [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '30338a0bc0734be2beb2cb994fdb85d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2ffe5715db4f6ebcd4237eaa12305a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95467) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 08:10:34 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] nvme not present on system {{(pid=95467) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 08:10:34 user nova-compute[95467]: INFO nova.compute.manager [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Took 12.27 seconds to spawn the instance on the hypervisor.
Nov 15 08:10:34 user nova-compute[95467]: DEBUG nova.compute.manager [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:10:34 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:34 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:10:34 user nova-compute[95467]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 08:10:34 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08229ae-7549-410e-bcf7-3342b3df55ba]: (4, '') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:10:34 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=95467) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 08:10:34 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 08:10:34 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] LIGHTOS: no hostnqn found. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 08:10:34 user nova-compute[95467]: DEBUG os_brick.utils [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] <== get_connector_properties: return (183ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:882ae90641f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:10:34 user nova-compute[95467]: DEBUG nova.virt.block_device [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Updating existing volume attachment record: 27eb6355-1fc1-4f02-bb68-4e36215faeec {{(pid=95467) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 08:10:34 user nova-compute[95467]: INFO nova.compute.manager [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Took 9.89 seconds to spawn the instance on the hypervisor.
Nov 15 08:10:34 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:10:34 user nova-compute[95467]: INFO nova.compute.manager [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Took 10.08 seconds to spawn the instance on the hypervisor.
Nov 15 08:10:34 user nova-compute[95467]: DEBUG nova.compute.manager [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:10:34 user nova-compute[95467]: INFO nova.compute.manager [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Took 22.72 seconds to build instance.
Nov 15 08:10:34 user nova-compute[95467]: INFO nova.compute.manager [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Took 13.58 seconds to build instance.
Nov 15 08:10:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3bc660b3-f200-4e50-9446-117017078622 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Lock "7e53d93e-1222-4b1a-9745-d512da0f7925" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.916s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:10:34 user nova-compute[95467]: INFO nova.compute.manager [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Took 11.85 seconds to build instance.
Nov 15 08:10:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-aa68cf7a-311d-44aa-b77b-d5e9bb5f8307 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Lock "0917b083-2bbf-4baf-a0b8-d59ba3e2256b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.835s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:10:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1b5261ef-54d3-4e52-aa12-7d67807c5686 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] Lock "a259558e-87ea-48c2-8b72-7443c0510d81" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.208s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:10:34 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:10:34 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:10:35 user nova-compute[95467]: DEBUG nova.compute.manager [req-0d3bba9d-89b6-488e-84d6-ae99ec9781b7 req-fdf45697-d54c-4a07-aed2-f3bd05d3beac service nova] [instance: b9210bbe-e728-4724-924b-1963226c092d] Received event network-vif-plugged-9599d4c0-f08b-4498-9c9a-119d83caa185 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:10:35 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-0d3bba9d-89b6-488e-84d6-ae99ec9781b7 req-fdf45697-d54c-4a07-aed2-f3bd05d3beac service nova] Acquiring lock "b9210bbe-e728-4724-924b-1963226c092d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:10:35 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-0d3bba9d-89b6-488e-84d6-ae99ec9781b7 req-fdf45697-d54c-4a07-aed2-f3bd05d3beac service nova] Lock "b9210bbe-e728-4724-924b-1963226c092d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:10:35 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-0d3bba9d-89b6-488e-84d6-ae99ec9781b7 req-fdf45697-d54c-4a07-aed2-f3bd05d3beac service nova] Lock "b9210bbe-e728-4724-924b-1963226c092d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:10:35 user nova-compute[95467]: DEBUG nova.compute.manager [req-0d3bba9d-89b6-488e-84d6-ae99ec9781b7 req-fdf45697-d54c-4a07-aed2-f3bd05d3beac service nova] [instance: b9210bbe-e728-4724-924b-1963226c092d] No waiting events found dispatching network-vif-plugged-9599d4c0-f08b-4498-9c9a-119d83caa185 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:10:35 user nova-compute[95467]: WARNING nova.compute.manager [req-0d3bba9d-89b6-488e-84d6-ae99ec9781b7 req-fdf45697-d54c-4a07-aed2-f3bd05d3beac service nova] [instance: b9210bbe-e728-4724-924b-1963226c092d] Received unexpected event network-vif-plugged-9599d4c0-f08b-4498-9c9a-119d83caa185 for instance with vm_state active and task_state None.
Nov 15 08:10:35 user nova-compute[95467]: DEBUG nova.network.neutron [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Successfully created port: 89c9bfb4-6b7a-4635-ba8d-2b0370fafb8b {{(pid=95467) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 08:10:35 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager.update_available_resource {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:10:35 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:10:35 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:10:35 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:10:35 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Auditing locally available compute resources for user (node: user) {{(pid=95467) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 08:10:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:36 user nova-compute[95467]: DEBUG nova.network.neutron [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Successfully created port: cdfe5e3f-2910-43a2-8d16-132d69d647d5 {{(pid=95467) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 08:10:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68264a44-5adf-4873-b380-26bcafe2ba04/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68264a44-5adf-4873-b380-26bcafe2ba04/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68264a44-5adf-4873-b380-26bcafe2ba04/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:36 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68264a44-5adf-4873-b380-26bcafe2ba04/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5748cf5d-9c57-4477-8952-ec39d0d18f55/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:36 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:37 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5748cf5d-9c57-4477-8952-ec39d0d18f55/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:37 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5748cf5d-9c57-4477-8952-ec39d0d18f55/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:37 user nova-compute[95467]: DEBUG nova.compute.manager [req-a3c552c4-8e70-4fd5-8478-033dd2844ba7 req-0445f57c-42f4-4792-9741-1214dea23128 service nova] [instance: b9210bbe-e728-4724-924b-1963226c092d] Received event network-vif-plugged-9599d4c0-f08b-4498-9c9a-119d83caa185 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:10:37 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-a3c552c4-8e70-4fd5-8478-033dd2844ba7 req-0445f57c-42f4-4792-9741-1214dea23128 service nova] Acquiring lock "b9210bbe-e728-4724-924b-1963226c092d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:10:37 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-a3c552c4-8e70-4fd5-8478-033dd2844ba7 req-0445f57c-42f4-4792-9741-1214dea23128 service nova] Lock "b9210bbe-e728-4724-924b-1963226c092d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:10:37 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-a3c552c4-8e70-4fd5-8478-033dd2844ba7 req-0445f57c-42f4-4792-9741-1214dea23128 service nova] Lock "b9210bbe-e728-4724-924b-1963226c092d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:10:37 user nova-compute[95467]: DEBUG nova.compute.manager [req-a3c552c4-8e70-4fd5-8478-033dd2844ba7 req-0445f57c-42f4-4792-9741-1214dea23128 service nova] [instance: b9210bbe-e728-4724-924b-1963226c092d] No waiting events found dispatching network-vif-plugged-9599d4c0-f08b-4498-9c9a-119d83caa185 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:10:37 user nova-compute[95467]: WARNING nova.compute.manager [req-a3c552c4-8e70-4fd5-8478-033dd2844ba7 req-0445f57c-42f4-4792-9741-1214dea23128 service nova] [instance: b9210bbe-e728-4724-924b-1963226c092d] Received unexpected event network-vif-plugged-9599d4c0-f08b-4498-9c9a-119d83caa185 for instance with vm_state active and task_state None.
Nov 15 08:10:37 user nova-compute[95467]: DEBUG nova.compute.manager [req-a3c552c4-8e70-4fd5-8478-033dd2844ba7 req-0445f57c-42f4-4792-9741-1214dea23128 service nova] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] Received event network-vif-plugged-015c421f-8bfc-4576-a9cc-bf990e3803ab {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:10:37 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-a3c552c4-8e70-4fd5-8478-033dd2844ba7 req-0445f57c-42f4-4792-9741-1214dea23128 service nova] Acquiring lock "5748cf5d-9c57-4477-8952-ec39d0d18f55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:10:37 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-a3c552c4-8e70-4fd5-8478-033dd2844ba7 req-0445f57c-42f4-4792-9741-1214dea23128 service nova] Lock "5748cf5d-9c57-4477-8952-ec39d0d18f55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:10:37 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-a3c552c4-8e70-4fd5-8478-033dd2844ba7 req-0445f57c-42f4-4792-9741-1214dea23128 service nova] Lock "5748cf5d-9c57-4477-8952-ec39d0d18f55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:10:37 user nova-compute[95467]: DEBUG nova.compute.manager [req-a3c552c4-8e70-4fd5-8478-033dd2844ba7 req-0445f57c-42f4-4792-9741-1214dea23128 service nova] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] No waiting events found dispatching network-vif-plugged-015c421f-8bfc-4576-a9cc-bf990e3803ab {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:10:37 user nova-compute[95467]: WARNING nova.compute.manager [req-a3c552c4-8e70-4fd5-8478-033dd2844ba7 req-0445f57c-42f4-4792-9741-1214dea23128 service nova] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] Received unexpected event network-vif-plugged-015c421f-8bfc-4576-a9cc-bf990e3803ab for instance with vm_state active and task_state None.
Nov 15 08:10:37 user nova-compute[95467]: DEBUG nova.compute.manager [req-a3c552c4-8e70-4fd5-8478-033dd2844ba7 req-0445f57c-42f4-4792-9741-1214dea23128 service nova] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] Received event network-vif-plugged-015c421f-8bfc-4576-a9cc-bf990e3803ab {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:10:37 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-a3c552c4-8e70-4fd5-8478-033dd2844ba7 req-0445f57c-42f4-4792-9741-1214dea23128 service nova] Acquiring lock "5748cf5d-9c57-4477-8952-ec39d0d18f55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:10:37 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-a3c552c4-8e70-4fd5-8478-033dd2844ba7 req-0445f57c-42f4-4792-9741-1214dea23128 service nova] Lock "5748cf5d-9c57-4477-8952-ec39d0d18f55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:10:37 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-a3c552c4-8e70-4fd5-8478-033dd2844ba7 req-0445f57c-42f4-4792-9741-1214dea23128 service nova] Lock "5748cf5d-9c57-4477-8952-ec39d0d18f55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:10:37 user nova-compute[95467]: DEBUG nova.compute.manager [req-a3c552c4-8e70-4fd5-8478-033dd2844ba7 req-0445f57c-42f4-4792-9741-1214dea23128 service nova] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] No waiting events found dispatching network-vif-plugged-015c421f-8bfc-4576-a9cc-bf990e3803ab {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:10:37 user nova-compute[95467]: WARNING nova.compute.manager [req-a3c552c4-8e70-4fd5-8478-033dd2844ba7 req-0445f57c-42f4-4792-9741-1214dea23128 service nova] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] Received unexpected event network-vif-plugged-015c421f-8bfc-4576-a9cc-bf990e3803ab for instance with vm_state active and task_state None.
Nov 15 08:10:37 user nova-compute[95467]: DEBUG nova.network.neutron [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Successfully created port: aa13aa7e-d38c-487f-8c4f-0f1cd51a18eb {{(pid=95467) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 08:10:37 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5748cf5d-9c57-4477-8952-ec39d0d18f55/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:37 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1edf7591-3991-4df9-98c9-ebc4ca9e5a4a/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:37 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1edf7591-3991-4df9-98c9-ebc4ca9e5a4a/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:37 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1edf7591-3991-4df9-98c9-ebc4ca9e5a4a/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:37 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1edf7591-3991-4df9-98c9-ebc4ca9e5a4a/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:37 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:10:37 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a259558e-87ea-48c2-8b72-7443c0510d81/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a259558e-87ea-48c2-8b72-7443c0510d81/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a259558e-87ea-48c2-8b72-7443c0510d81/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:38 user nova-compute[95467]: DEBUG nova.network.neutron [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Successfully created port: 48912f9e-eeae-4f51-8123-8316a6fcc15e {{(pid=95467) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 08:10:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a259558e-87ea-48c2-8b72-7443c0510d81/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9210bbe-e728-4724-924b-1963226c092d/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9210bbe-e728-4724-924b-1963226c092d/disk --force-share --output=json" returned: 0 in 0.312s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9210bbe-e728-4724-924b-1963226c092d/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:38 user nova-compute[95467]: DEBUG nova.network.neutron [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Successfully created port: 0a35017f-b57c-4937-9479-22494bffb5b7 {{(pid=95467) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 08:10:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9210bbe-e728-4724-924b-1963226c092d/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36dccf43-d4a3-47aa-bd73-de9646e1020c/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:39 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36dccf43-d4a3-47aa-bd73-de9646e1020c/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:39 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36dccf43-d4a3-47aa-bd73-de9646e1020c/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:39 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36dccf43-d4a3-47aa-bd73-de9646e1020c/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:39 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0917b083-2bbf-4baf-a0b8-d59ba3e2256b/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:39 user nova-compute[95467]: DEBUG nova.network.neutron [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Successfully updated port: 89c9bfb4-6b7a-4635-ba8d-2b0370fafb8b {{(pid=95467) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 08:10:39 user nova-compute[95467]: DEBUG nova.compute.manager [req-a69fcaf6-3683-48b3-bd9a-284b3b2d0b3c req-d11b5c41-54bd-47a9-9347-ef23e7ae32d0 service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Received event network-changed-89c9bfb4-6b7a-4635-ba8d-2b0370fafb8b {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:10:39 user nova-compute[95467]: DEBUG nova.compute.manager [req-a69fcaf6-3683-48b3-bd9a-284b3b2d0b3c req-d11b5c41-54bd-47a9-9347-ef23e7ae32d0 service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Refreshing instance network info cache due to event network-changed-89c9bfb4-6b7a-4635-ba8d-2b0370fafb8b. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:10:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-a69fcaf6-3683-48b3-bd9a-284b3b2d0b3c req-d11b5c41-54bd-47a9-9347-ef23e7ae32d0 service nova] Acquiring lock "refresh_cache-35e88686-253e-452a-9649-8aa2a04128ce" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:10:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-a69fcaf6-3683-48b3-bd9a-284b3b2d0b3c req-d11b5c41-54bd-47a9-9347-ef23e7ae32d0 service nova] Acquired lock "refresh_cache-35e88686-253e-452a-9649-8aa2a04128ce" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:10:39 user nova-compute[95467]: DEBUG nova.network.neutron [req-a69fcaf6-3683-48b3-bd9a-284b3b2d0b3c req-d11b5c41-54bd-47a9-9347-ef23e7ae32d0 service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Refreshing network info cache for port 89c9bfb4-6b7a-4635-ba8d-2b0370fafb8b {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:10:39 user nova-compute[95467]: DEBUG nova.network.neutron [req-a69fcaf6-3683-48b3-bd9a-284b3b2d0b3c req-d11b5c41-54bd-47a9-9347-ef23e7ae32d0 service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Instance cache missing network info. {{(pid=95467) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 08:10:39 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0917b083-2bbf-4baf-a0b8-d59ba3e2256b/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:39 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0917b083-2bbf-4baf-a0b8-d59ba3e2256b/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Acquiring lock "fa82104f-d822-49fa-a06b-643733e27b06" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:10:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Lock "fa82104f-d822-49fa-a06b-643733e27b06" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:10:39 user nova-compute[95467]: DEBUG nova.network.neutron [req-a69fcaf6-3683-48b3-bd9a-284b3b2d0b3c req-d11b5c41-54bd-47a9-9347-ef23e7ae32d0 service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:10:40 user nova-compute[95467]: DEBUG nova.compute.manager [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] [instance: fa82104f-d822-49fa-a06b-643733e27b06] Starting instance... {{(pid=95467) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 08:10:40 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-a69fcaf6-3683-48b3-bd9a-284b3b2d0b3c req-d11b5c41-54bd-47a9-9347-ef23e7ae32d0 service nova] Releasing lock "refresh_cache-35e88686-253e-452a-9649-8aa2a04128ce" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:10:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0917b083-2bbf-4baf-a0b8-d59ba3e2256b/disk --force-share --output=json" returned: 0 in 0.293s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2aa477-6786-483a-b088-d8ec204fe6aa/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:40 user nova-compute[95467]: INFO nova.virt.block_device [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Booting with volume aee0d1b6-eb0f-452e-90e9-fcabb9014c05 at /dev/vdb
Nov 15 08:10:40 user nova-compute[95467]: DEBUG os_brick.utils [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:10:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2aa477-6786-483a-b088-d8ec204fe6aa/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2aa477-6786-483a-b088-d8ec204fe6aa/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.025s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:40 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4e99b4-ea9e-4692-abe0-e178c0b14085]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:882ae90641f\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:10:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:40 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[873b04ad-0a7e-4b79-965a-025d6ff73820]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:10:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:40 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a409947b-e32f-4c84-a2a3-b28cceb034b5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:10:40 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[483f993d-8375-47c5-8880-cc8ea5deebc7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:10:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Running cmd (subprocess): nvme version {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] 'nvme version' failed. Not Retrying. {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:10:40 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] nvme not present on system {{(pid=95467) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 08:10:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:10:40 user nova-compute[95467]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 08:10:40 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5cb4654-6a8c-4945-b2ca-2962251044a4]: (4, '') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:10:40 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:10:40 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:10:40 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=95467) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 08:10:40 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 08:10:40 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] LIGHTOS: no hostnqn found. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 08:10:40 user nova-compute[95467]: DEBUG os_brick.utils [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] <== get_connector_properties: return (194ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:882ae90641f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:10:40 user nova-compute[95467]: DEBUG nova.virt.block_device [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Updating existing volume attachment record: fe8dab3e-8331-4c0c-885e-880b71fb51e1 {{(pid=95467) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 08:10:40 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=95467) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 08:10:40 user nova-compute[95467]: INFO nova.compute.claims [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] [instance: fa82104f-d822-49fa-a06b-643733e27b06] Claim successful on node user
Nov 15 08:10:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2aa477-6786-483a-b088-d8ec204fe6aa/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:41 user nova-compute[95467]: DEBUG nova.network.neutron [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Successfully updated port: 92307630-ea94-407f-b852-ee250debc046 {{(pid=95467) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 08:10:41 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Refreshing inventories for resource provider f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 08:10:41 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:10:41 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:10:41 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Hypervisor/Node resource view: name=user free_ram=7511MB free_disk=25.703182220458984GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=95467) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 08:10:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:10:41 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Updating ProviderTree inventory for provider f56c3524-ed11-494e-82e4-b1a23920d1ae from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 08:10:41 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Updating inventory in ProviderTree for provider f56c3524-ed11-494e-82e4-b1a23920d1ae with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 08:10:41 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Refreshing aggregate associations for resource provider f56c3524-ed11-494e-82e4-b1a23920d1ae, aggregates: None {{(pid=95467) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 08:10:41 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Refreshing trait associations for resource provider f56c3524-ed11-494e-82e4-b1a23920d1ae, traits: COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSSE3,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI {{(pid=95467) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 08:10:41 user nova-compute[95467]: DEBUG nova.compute.manager [req-69128983-15b5-46f4-93af-8e1a3e46cda4 req-ff32165c-0acc-4781-9342-c7f2296793a9 service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Received event network-changed-92307630-ea94-407f-b852-ee250debc046 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:10:41 user nova-compute[95467]: DEBUG nova.compute.manager [req-69128983-15b5-46f4-93af-8e1a3e46cda4 req-ff32165c-0acc-4781-9342-c7f2296793a9 service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Refreshing instance network info cache due to event network-changed-92307630-ea94-407f-b852-ee250debc046. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:10:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-69128983-15b5-46f4-93af-8e1a3e46cda4 req-ff32165c-0acc-4781-9342-c7f2296793a9 service nova] Acquiring lock "refresh_cache-35e88686-253e-452a-9649-8aa2a04128ce" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:10:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-69128983-15b5-46f4-93af-8e1a3e46cda4 req-ff32165c-0acc-4781-9342-c7f2296793a9 service nova] Acquired lock "refresh_cache-35e88686-253e-452a-9649-8aa2a04128ce" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:10:41 user nova-compute[95467]: DEBUG nova.network.neutron [req-69128983-15b5-46f4-93af-8e1a3e46cda4 req-ff32165c-0acc-4781-9342-c7f2296793a9 service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Refreshing network info cache for port 92307630-ea94-407f-b852-ee250debc046 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:10:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:41 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:10:41 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:10:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.339s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:10:41 user nova-compute[95467]: DEBUG nova.compute.manager [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] [instance: fa82104f-d822-49fa-a06b-643733e27b06] Start building networks asynchronously for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 08:10:41 user nova-compute[95467]: DEBUG nova.network.neutron [req-69128983-15b5-46f4-93af-8e1a3e46cda4 req-ff32165c-0acc-4781-9342-c7f2296793a9 service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Instance cache missing network info. {{(pid=95467) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 08:10:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.683s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:10:41 user nova-compute[95467]: DEBUG nova.compute.manager [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] [instance: fa82104f-d822-49fa-a06b-643733e27b06] Allocating IP information in the background. {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 08:10:41 user nova-compute[95467]: DEBUG nova.network.neutron [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] [instance: fa82104f-d822-49fa-a06b-643733e27b06] allocate_for_instance() {{(pid=95467) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 08:10:41 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] [instance: fa82104f-d822-49fa-a06b-643733e27b06] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 08:10:41 user nova-compute[95467]: DEBUG nova.compute.manager [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] [instance: fa82104f-d822-49fa-a06b-643733e27b06] Start building block device mappings for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 08:10:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:42 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance ee2aa477-6786-483a-b088-d8ec204fe6aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:10:42 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance b9210bbe-e728-4724-924b-1963226c092d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:10:42 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 5748cf5d-9c57-4477-8952-ec39d0d18f55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:10:42 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 73fe8852-c47a-47ab-a56f-6864c8ed5479 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:10:42 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 36dccf43-d4a3-47aa-bd73-de9646e1020c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:10:42 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 68264a44-5adf-4873-b380-26bcafe2ba04 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:10:42 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 7e53d93e-1222-4b1a-9745-d512da0f7925 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:10:42 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:10:42 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 0917b083-2bbf-4baf-a0b8-d59ba3e2256b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:10:42 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance a259558e-87ea-48c2-8b72-7443c0510d81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:10:42 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 35e88686-253e-452a-9649-8aa2a04128ce actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:10:42 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance fa82104f-d822-49fa-a06b-643733e27b06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:10:42 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 08:10:42 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 08:10:42 user nova-compute[95467]: DEBUG nova.network.neutron [req-69128983-15b5-46f4-93af-8e1a3e46cda4 req-ff32165c-0acc-4781-9342-c7f2296793a9 service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:10:42 user nova-compute[95467]: DEBUG nova.policy [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '566c5d2645e64505837fe9897bbac064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbfad19c5ef40fa9fedc7990c81d433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95467) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 08:10:42 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-69128983-15b5-46f4-93af-8e1a3e46cda4 req-ff32165c-0acc-4781-9342-c7f2296793a9 service nova] Releasing lock "refresh_cache-35e88686-253e-452a-9649-8aa2a04128ce" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:10:42 user nova-compute[95467]: DEBUG nova.compute.manager [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] [instance: fa82104f-d822-49fa-a06b-643733e27b06] Start spawning the instance on the hypervisor. {{(pid=95467) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 08:10:42 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] [instance: fa82104f-d822-49fa-a06b-643733e27b06] Creating instance directory {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 08:10:42 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] [instance: fa82104f-d822-49fa-a06b-643733e27b06] Creating image(s)
Nov 15 08:10:42 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Acquiring lock "/opt/stack/data/nova/instances/fa82104f-d822-49fa-a06b-643733e27b06/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:10:42 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Lock "/opt/stack/data/nova/instances/fa82104f-d822-49fa-a06b-643733e27b06/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:10:42 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Lock "/opt/stack/data/nova/instances/fa82104f-d822-49fa-a06b-643733e27b06/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:10:42 user nova-compute[95467]: DEBUG nova.network.neutron [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Successfully updated port: fae94c7c-6554-49a7-a221-43d18d1e95e0 {{(pid=95467) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 08:10:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.231s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:42 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Acquiring lock "a3fcf60225fcefd310404971cd18ab9851c548dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:10:42 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:10:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:42 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:10:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.183s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/fa82104f-d822-49fa-a06b-643733e27b06/disk 1073741824 {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:42 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:10:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/fa82104f-d822-49fa-a06b-643733e27b06/disk 1073741824" returned: 0 in 0.130s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:42 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.318s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:10:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:42 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Compute_service record updated for user:user {{(pid=95467) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 08:10:42 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.982s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:10:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.191s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:42 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fa82104f-d822-49fa-a06b-643733e27b06/disk. size=1073741824 {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 08:10:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa82104f-d822-49fa-a06b-643733e27b06/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:43 user nova-compute[95467]: DEBUG nova.network.neutron [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] [instance: fa82104f-d822-49fa-a06b-643733e27b06] Successfully created port: 21218f5a-82fe-4212-9f29-38468f27afb3 {{(pid=95467) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 08:10:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa82104f-d822-49fa-a06b-643733e27b06/disk --force-share --output=json" returned: 0 in 0.286s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:43 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Cannot resize image /opt/stack/data/nova/instances/fa82104f-d822-49fa-a06b-643733e27b06/disk to a smaller size. {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 08:10:43 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] [instance: fa82104f-d822-49fa-a06b-643733e27b06] Created local disks {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 08:10:43 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] [instance: fa82104f-d822-49fa-a06b-643733e27b06] Ensure instance console log exists: /opt/stack/data/nova/instances/fa82104f-d822-49fa-a06b-643733e27b06/console.log {{(pid=95467) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 08:10:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:10:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:10:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:10:43 user nova-compute[95467]: DEBUG nova.network.neutron [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Successfully updated port: cdfe5e3f-2910-43a2-8d16-132d69d647d5 {{(pid=95467) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 08:10:43 user nova-compute[95467]: DEBUG nova.network.neutron [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] [instance: fa82104f-d822-49fa-a06b-643733e27b06] Successfully updated port: 21218f5a-82fe-4212-9f29-38468f27afb3 {{(pid=95467) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 08:10:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Acquiring lock "refresh_cache-fa82104f-d822-49fa-a06b-643733e27b06" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:10:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Acquired lock "refresh_cache-fa82104f-d822-49fa-a06b-643733e27b06" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:10:43 user nova-compute[95467]: DEBUG nova.network.neutron [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] [instance: fa82104f-d822-49fa-a06b-643733e27b06] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:10:43 user nova-compute[95467]: DEBUG nova.compute.manager [req-18ddf1e5-8b51-4698-8e44-1ba91bc5a1e9 req-71939d8b-5d7c-40ee-ab20-ff4ed2cb79d9 service nova] [instance: fa82104f-d822-49fa-a06b-643733e27b06] Received event network-changed-21218f5a-82fe-4212-9f29-38468f27afb3 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:10:43 user nova-compute[95467]: DEBUG nova.compute.manager [req-18ddf1e5-8b51-4698-8e44-1ba91bc5a1e9 req-71939d8b-5d7c-40ee-ab20-ff4ed2cb79d9 service nova] [instance: fa82104f-d822-49fa-a06b-643733e27b06] Refreshing instance network info cache due to event network-changed-21218f5a-82fe-4212-9f29-38468f27afb3. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:10:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-18ddf1e5-8b51-4698-8e44-1ba91bc5a1e9 req-71939d8b-5d7c-40ee-ab20-ff4ed2cb79d9 service nova] Acquiring lock "refresh_cache-fa82104f-d822-49fa-a06b-643733e27b06" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:10:43 user nova-compute[95467]: DEBUG nova.compute.manager [req-06daf64d-1c6f-427c-bf9a-8b7c69d290ec req-8d2c8a2f-6152-4b72-885a-7a19d19e05fd service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Received event network-changed-fae94c7c-6554-49a7-a221-43d18d1e95e0 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:10:43 user nova-compute[95467]: DEBUG nova.compute.manager [req-06daf64d-1c6f-427c-bf9a-8b7c69d290ec req-8d2c8a2f-6152-4b72-885a-7a19d19e05fd service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Refreshing instance network info cache due to event network-changed-fae94c7c-6554-49a7-a221-43d18d1e95e0. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:10:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-06daf64d-1c6f-427c-bf9a-8b7c69d290ec req-8d2c8a2f-6152-4b72-885a-7a19d19e05fd service nova] Acquiring lock "refresh_cache-35e88686-253e-452a-9649-8aa2a04128ce" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:10:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-06daf64d-1c6f-427c-bf9a-8b7c69d290ec req-8d2c8a2f-6152-4b72-885a-7a19d19e05fd service nova] Acquired lock "refresh_cache-35e88686-253e-452a-9649-8aa2a04128ce" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:10:43 user nova-compute[95467]: DEBUG nova.network.neutron [req-06daf64d-1c6f-427c-bf9a-8b7c69d290ec req-8d2c8a2f-6152-4b72-885a-7a19d19e05fd service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Refreshing network info cache for port fae94c7c-6554-49a7-a221-43d18d1e95e0 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:10:43 user nova-compute[95467]: DEBUG nova.network.neutron [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] [instance: fa82104f-d822-49fa-a06b-643733e27b06] Instance cache missing network info. {{(pid=95467) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 08:10:43 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:10:43 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:10:43 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Starting heal instance info cache {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 08:10:43 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Rebuilding the list of instances to heal {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 08:10:43 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Skipping network cache update for instance because it is Building. {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 15 08:10:43 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: fa82104f-d822-49fa-a06b-643733e27b06] Skipping network cache update for instance because it is Building. {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 15 08:10:43 user nova-compute[95467]: DEBUG nova.network.neutron [req-06daf64d-1c6f-427c-bf9a-8b7c69d290ec req-8d2c8a2f-6152-4b72-885a-7a19d19e05fd service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Instance cache missing network info. {{(pid=95467) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 08:10:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "refresh_cache-ee2aa477-6786-483a-b088-d8ec204fe6aa" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:10:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquired lock "refresh_cache-ee2aa477-6786-483a-b088-d8ec204fe6aa" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:10:43 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: ee2aa477-6786-483a-b088-d8ec204fe6aa] Forcefully refreshing network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 08:10:43 user nova-compute[95467]: DEBUG nova.objects.instance [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lazy-loading 'info_cache' on Instance uuid ee2aa477-6786-483a-b088-d8ec204fe6aa {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:10:44 user nova-compute[95467]: DEBUG nova.network.neutron [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] [instance: fa82104f-d822-49fa-a06b-643733e27b06] Updating instance_info_cache with network_info: [{"id": "21218f5a-82fe-4212-9f29-38468f27afb3", "address": "fa:16:3e:c6:32:45", "network": {"id": "59688126-3d6d-4bbd-89e7-dfc59e199581", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d7a38b3c02f7432780351fffae6b27d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21218f5a-82", "ovs_interfaceid": "21218f5a-82fe-4212-9f29-38468f27afb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:10:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Releasing lock "refresh_cache-fa82104f-d822-49fa-a06b-643733e27b06" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:10:44 user nova-compute[95467]: DEBUG nova.compute.manager [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] [instance: fa82104f-d822-49fa-a06b-643733e27b06] Instance network_info: |[{"id": "21218f5a-82fe-4212-9f29-38468f27afb3", "address": "fa:16:3e:c6:32:45", "network": {"id": "59688126-3d6d-4bbd-89e7-dfc59e199581", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d7a38b3c02f7432780351fffae6b27d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21218f5a-82", "ovs_interfaceid": "21218f5a-82fe-4212-9f29-38468f27afb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 08:10:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-18ddf1e5-8b51-4698-8e44-1ba91bc5a1e9 req-71939d8b-5d7c-40ee-ab20-ff4ed2cb79d9 service nova] Acquired lock "refresh_cache-fa82104f-d822-49fa-a06b-643733e27b06" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:10:44 user nova-compute[95467]: DEBUG nova.network.neutron [req-18ddf1e5-8b51-4698-8e44-1ba91bc5a1e9 req-71939d8b-5d7c-40ee-ab20-ff4ed2cb79d9 service nova] [instance: fa82104f-d822-49fa-a06b-643733e27b06] Refreshing network info cache for port 21218f5a-82fe-4212-9f29-38468f27afb3 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:10:44 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] [instance: fa82104f-d822-49fa-a06b-643733e27b06] Start _get_guest_xml network_info=[{"id": "21218f5a-82fe-4212-9f29-38468f27afb3", "address": "fa:16:3e:c6:32:45", "network": {"id": "59688126-3d6d-4bbd-89e7-dfc59e199581", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d7a38b3c02f7432780351fffae6b27d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21218f5a-82", "ovs_interfaceid": "21218f5a-82fe-4212-9f29-38468f27afb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'ed9c48aa-ce73-4b3b-9db1-235898be671b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:10:44 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:10:44 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:10:44 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:10:44 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:10:44 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:10:44 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:10:44 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:10:44 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:10:44 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:10:44 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:10:44 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:10:44 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:10:44 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:10:44 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:10:44 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:10:44 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:10:44 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:10:44 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:10:44 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:10:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-84573768',display_name='tempest-VolumesNegativeTest-instance-84573768',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-84573768',id=12,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5bbfad19c5ef40fa9fedc7990c81d433',ramdisk_id='',reservation_id='r-54in150e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-961110799',owner_user_name='tempest-VolumesNegativeTest-961110799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:10:42Z,user_data=None,user_id='566c5d2645e64505837fe9897bbac064',uuid=fa82104f-d822-49fa-a06b-643733e27b06,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21218f5a-82fe-4212-9f29-38468f27afb3", "address": "fa:16:3e:c6:32:45", "network": {"id": "59688126-3d6d-4bbd-89e7-dfc59e199581", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d7a38b3c02f7432780351fffae6b27d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21218f5a-82", "ovs_interfaceid": "21218f5a-82fe-4212-9f29-38468f27afb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:10:44 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Converting VIF {"id": "21218f5a-82fe-4212-9f29-38468f27afb3", "address": "fa:16:3e:c6:32:45", "network": {"id": "59688126-3d6d-4bbd-89e7-dfc59e199581", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d7a38b3c02f7432780351fffae6b27d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21218f5a-82", "ovs_interfaceid": "21218f5a-82fe-4212-9f29-38468f27afb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:10:44 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:32:45,bridge_name='br-int',has_traffic_filtering=True,id=21218f5a-82fe-4212-9f29-38468f27afb3,network=Network(59688126-3d6d-4bbd-89e7-dfc59e199581),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21218f5a-82') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:10:44 user nova-compute[95467]: DEBUG nova.objects.instance [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Lazy-loading 'pci_devices' on Instance uuid fa82104f-d822-49fa-a06b-643733e27b06 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:10:44 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] [instance: fa82104f-d822-49fa-a06b-643733e27b06] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:10:44 user nova-compute[95467]:   <uuid>fa82104f-d822-49fa-a06b-643733e27b06</uuid>
Nov 15 08:10:44 user nova-compute[95467]:   <name>instance-0000000c</name>
Nov 15 08:10:44 user nova-compute[95467]:   <memory>524288</memory>
Nov 15 08:10:44 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:10:44 user nova-compute[95467]:   <metadata>
Nov 15 08:10:44 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:10:44 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:10:44 user nova-compute[95467]:       <nova:name>tempest-VolumesNegativeTest-instance-84573768</nova:name>
Nov 15 08:10:44 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:10:44</nova:creationTime>
Nov 15 08:10:44 user nova-compute[95467]:       <nova:flavor name="m1.tiny">
Nov 15 08:10:44 user nova-compute[95467]:         <nova:memory>512</nova:memory>
Nov 15 08:10:44 user nova-compute[95467]:         <nova:disk>1</nova:disk>
Nov 15 08:10:44 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:10:44 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:10:44 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:10:44 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:10:44 user nova-compute[95467]:       <nova:owner>
Nov 15 08:10:44 user nova-compute[95467]:         <nova:user uuid="566c5d2645e64505837fe9897bbac064">tempest-VolumesNegativeTest-961110799-project-member</nova:user>
Nov 15 08:10:44 user nova-compute[95467]:         <nova:project uuid="5bbfad19c5ef40fa9fedc7990c81d433">tempest-VolumesNegativeTest-961110799</nova:project>
Nov 15 08:10:44 user nova-compute[95467]:       </nova:owner>
Nov 15 08:10:44 user nova-compute[95467]:       <nova:root type="image" uuid="ed9c48aa-ce73-4b3b-9db1-235898be671b"/>
Nov 15 08:10:44 user nova-compute[95467]:       <nova:ports>
Nov 15 08:10:44 user nova-compute[95467]:         <nova:port uuid="21218f5a-82fe-4212-9f29-38468f27afb3">
Nov 15 08:10:44 user nova-compute[95467]:           <nova:ip type="fixed" address="192.168.233.38" ipVersion="4"/>
Nov 15 08:10:44 user nova-compute[95467]:         </nova:port>
Nov 15 08:10:44 user nova-compute[95467]:       </nova:ports>
Nov 15 08:10:44 user nova-compute[95467]:     </nova:instance>
Nov 15 08:10:44 user nova-compute[95467]:   </metadata>
Nov 15 08:10:44 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:10:44 user nova-compute[95467]:     <system>
Nov 15 08:10:44 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:10:44 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:10:44 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:10:44 user nova-compute[95467]:       <entry name="serial">fa82104f-d822-49fa-a06b-643733e27b06</entry>
Nov 15 08:10:44 user nova-compute[95467]:       <entry name="uuid">fa82104f-d822-49fa-a06b-643733e27b06</entry>
Nov 15 08:10:44 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:10:44 user nova-compute[95467]:     </system>
Nov 15 08:10:44 user nova-compute[95467]:   </sysinfo>
Nov 15 08:10:44 user nova-compute[95467]:   <os>
Nov 15 08:10:44 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:10:44 user nova-compute[95467]:     <boot dev="hd"/>
Nov 15 08:10:44 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:10:44 user nova-compute[95467]:   </os>
Nov 15 08:10:44 user nova-compute[95467]:   <features>
Nov 15 08:10:44 user nova-compute[95467]:     <acpi/>
Nov 15 08:10:44 user nova-compute[95467]:     <apic/>
Nov 15 08:10:44 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:10:44 user nova-compute[95467]:   </features>
Nov 15 08:10:44 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:10:44 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:10:44 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:10:44 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:10:44 user nova-compute[95467]:   </clock>
Nov 15 08:10:44 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:10:44 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:10:44 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:10:44 user nova-compute[95467]:   </cpu>
Nov 15 08:10:44 user nova-compute[95467]:   <devices>
Nov 15 08:10:44 user nova-compute[95467]:     <disk type="file" device="disk">
Nov 15 08:10:44 user nova-compute[95467]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 08:10:44 user nova-compute[95467]:       <source file="/opt/stack/data/nova/instances/fa82104f-d822-49fa-a06b-643733e27b06/disk"/>
Nov 15 08:10:44 user nova-compute[95467]:       <target dev="vda" bus="virtio"/>
Nov 15 08:10:44 user nova-compute[95467]:     </disk>
Nov 15 08:10:44 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:10:44 user nova-compute[95467]:       <mac address="fa:16:3e:c6:32:45"/>
Nov 15 08:10:44 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:10:44 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:10:44 user nova-compute[95467]:       <target dev="tap21218f5a-82"/>
Nov 15 08:10:44 user nova-compute[95467]:     </interface>
Nov 15 08:10:44 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:10:44 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/fa82104f-d822-49fa-a06b-643733e27b06/console.log" append="off"/>
Nov 15 08:10:44 user nova-compute[95467]:     </serial>
Nov 15 08:10:44 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:10:44 user nova-compute[95467]:     <video>
Nov 15 08:10:44 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:10:44 user nova-compute[95467]:     </video>
Nov 15 08:10:44 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:10:44 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:10:44 user nova-compute[95467]:     </rng>
Nov 15 08:10:44 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:10:44 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:10:44 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:10:44 user nova-compute[95467]:     </memballoon>
Nov 15 08:10:44 user nova-compute[95467]:   </devices>
Nov 15 08:10:44 user nova-compute[95467]: </domain>
Nov 15 08:10:44 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:10:44 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:10:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-84573768',display_name='tempest-VolumesNegativeTest-instance-84573768',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-84573768',id=12,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5bbfad19c5ef40fa9fedc7990c81d433',ramdisk_id='',reservation_id='r-54in150e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-961110799',owner_user_name='tempest-VolumesNegativeTest-961110799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:10:42Z,user_data=None,user_id='566c5d2645e64505837fe9897bbac064',uuid=fa82104f-d822-49fa-a06b-643733e27b06,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21218f5a-82fe-4212-9f29-38468f27afb3", "address": "fa:16:3e:c6:32:45", "network": {"id": "59688126-3d6d-4bbd-89e7-dfc59e199581", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d7a38b3c02f7432780351fffae6b27d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21218f5a-82", "ovs_interfaceid": "21218f5a-82fe-4212-9f29-38468f27afb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:10:44 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Converting VIF {"id": "21218f5a-82fe-4212-9f29-38468f27afb3", "address": "fa:16:3e:c6:32:45", "network": {"id": "59688126-3d6d-4bbd-89e7-dfc59e199581", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d7a38b3c02f7432780351fffae6b27d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21218f5a-82", "ovs_interfaceid": "21218f5a-82fe-4212-9f29-38468f27afb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:10:44 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:32:45,bridge_name='br-int',has_traffic_filtering=True,id=21218f5a-82fe-4212-9f29-38468f27afb3,network=Network(59688126-3d6d-4bbd-89e7-dfc59e199581),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21218f5a-82') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:10:44 user nova-compute[95467]: DEBUG os_vif [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:32:45,bridge_name='br-int',has_traffic_filtering=True,id=21218f5a-82fe-4212-9f29-38468f27afb3,network=Network(59688126-3d6d-4bbd-89e7-dfc59e199581),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21218f5a-82') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:10:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:10:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e0ae3fbb-463e-54a2-9355-6c8d44f029fd', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:44 user nova-compute[95467]: DEBUG nova.network.neutron [req-06daf64d-1c6f-427c-bf9a-8b7c69d290ec req-8d2c8a2f-6152-4b72-885a-7a19d19e05fd service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:10:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:10:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap21218f5a-82, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap21218f5a-82, col_values=(('qos', UUID('5bb2e099-f045-4ffe-a241-228a5a5ec815')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap21218f5a-82, col_values=(('external_ids', {'iface-id': '21218f5a-82fe-4212-9f29-38468f27afb3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:32:45', 'vm-uuid': 'fa82104f-d822-49fa-a06b-643733e27b06'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-06daf64d-1c6f-427c-bf9a-8b7c69d290ec req-8d2c8a2f-6152-4b72-885a-7a19d19e05fd service nova] Releasing lock "refresh_cache-35e88686-253e-452a-9649-8aa2a04128ce" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:10:44 user nova-compute[95467]: DEBUG nova.compute.manager [req-06daf64d-1c6f-427c-bf9a-8b7c69d290ec req-8d2c8a2f-6152-4b72-885a-7a19d19e05fd service nova] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] Received event network-vif-plugged-d7e5ca44-eee3-4452-9649-5fcbfe5ed5ad {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:10:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-06daf64d-1c6f-427c-bf9a-8b7c69d290ec req-8d2c8a2f-6152-4b72-885a-7a19d19e05fd service nova] Acquiring lock "73fe8852-c47a-47ab-a56f-6864c8ed5479-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:10:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-06daf64d-1c6f-427c-bf9a-8b7c69d290ec req-8d2c8a2f-6152-4b72-885a-7a19d19e05fd service nova] Lock "73fe8852-c47a-47ab-a56f-6864c8ed5479-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:10:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-06daf64d-1c6f-427c-bf9a-8b7c69d290ec req-8d2c8a2f-6152-4b72-885a-7a19d19e05fd service nova] Lock "73fe8852-c47a-47ab-a56f-6864c8ed5479-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:10:44 user nova-compute[95467]: DEBUG nova.compute.manager [req-06daf64d-1c6f-427c-bf9a-8b7c69d290ec req-8d2c8a2f-6152-4b72-885a-7a19d19e05fd service nova] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] No waiting events found dispatching network-vif-plugged-d7e5ca44-eee3-4452-9649-5fcbfe5ed5ad {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:10:44 user nova-compute[95467]: WARNING nova.compute.manager [req-06daf64d-1c6f-427c-bf9a-8b7c69d290ec req-8d2c8a2f-6152-4b72-885a-7a19d19e05fd service nova] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] Received unexpected event network-vif-plugged-d7e5ca44-eee3-4452-9649-5fcbfe5ed5ad for instance with vm_state active and task_state None.
Nov 15 08:10:44 user nova-compute[95467]: DEBUG nova.compute.manager [req-06daf64d-1c6f-427c-bf9a-8b7c69d290ec req-8d2c8a2f-6152-4b72-885a-7a19d19e05fd service nova] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] Received event network-vif-plugged-d7e5ca44-eee3-4452-9649-5fcbfe5ed5ad {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:10:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-06daf64d-1c6f-427c-bf9a-8b7c69d290ec req-8d2c8a2f-6152-4b72-885a-7a19d19e05fd service nova] Acquiring lock "73fe8852-c47a-47ab-a56f-6864c8ed5479-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:10:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-06daf64d-1c6f-427c-bf9a-8b7c69d290ec req-8d2c8a2f-6152-4b72-885a-7a19d19e05fd service nova] Lock "73fe8852-c47a-47ab-a56f-6864c8ed5479-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:10:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-06daf64d-1c6f-427c-bf9a-8b7c69d290ec req-8d2c8a2f-6152-4b72-885a-7a19d19e05fd service nova] Lock "73fe8852-c47a-47ab-a56f-6864c8ed5479-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:10:44 user nova-compute[95467]: DEBUG nova.compute.manager [req-06daf64d-1c6f-427c-bf9a-8b7c69d290ec req-8d2c8a2f-6152-4b72-885a-7a19d19e05fd service nova] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] No waiting events found dispatching network-vif-plugged-d7e5ca44-eee3-4452-9649-5fcbfe5ed5ad {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:10:44 user nova-compute[95467]: WARNING nova.compute.manager [req-06daf64d-1c6f-427c-bf9a-8b7c69d290ec req-8d2c8a2f-6152-4b72-885a-7a19d19e05fd service nova] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] Received unexpected event network-vif-plugged-d7e5ca44-eee3-4452-9649-5fcbfe5ed5ad for instance with vm_state active and task_state None.
Nov 15 08:10:44 user nova-compute[95467]: DEBUG nova.compute.manager [req-06daf64d-1c6f-427c-bf9a-8b7c69d290ec req-8d2c8a2f-6152-4b72-885a-7a19d19e05fd service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Received event network-changed-cdfe5e3f-2910-43a2-8d16-132d69d647d5 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:10:44 user nova-compute[95467]: DEBUG nova.compute.manager [req-06daf64d-1c6f-427c-bf9a-8b7c69d290ec req-8d2c8a2f-6152-4b72-885a-7a19d19e05fd service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Refreshing instance network info cache due to event network-changed-cdfe5e3f-2910-43a2-8d16-132d69d647d5. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:10:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-06daf64d-1c6f-427c-bf9a-8b7c69d290ec req-8d2c8a2f-6152-4b72-885a-7a19d19e05fd service nova] Acquiring lock "refresh_cache-35e88686-253e-452a-9649-8aa2a04128ce" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:10:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-06daf64d-1c6f-427c-bf9a-8b7c69d290ec req-8d2c8a2f-6152-4b72-885a-7a19d19e05fd service nova] Acquired lock "refresh_cache-35e88686-253e-452a-9649-8aa2a04128ce" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:10:44 user nova-compute[95467]: DEBUG nova.network.neutron [req-06daf64d-1c6f-427c-bf9a-8b7c69d290ec req-8d2c8a2f-6152-4b72-885a-7a19d19e05fd service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Refreshing network info cache for port cdfe5e3f-2910-43a2-8d16-132d69d647d5 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:10:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:10:44 user nova-compute[95467]: INFO os_vif [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:32:45,bridge_name='br-int',has_traffic_filtering=True,id=21218f5a-82fe-4212-9f29-38468f27afb3,network=Network(59688126-3d6d-4bbd-89e7-dfc59e199581),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21218f5a-82')
Nov 15 08:10:44 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:10:44 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] No VIF found with MAC fa:16:3e:c6:32:45, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:10:44 user nova-compute[95467]: DEBUG nova.network.neutron [req-06daf64d-1c6f-427c-bf9a-8b7c69d290ec req-8d2c8a2f-6152-4b72-885a-7a19d19e05fd service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Instance cache missing network info. {{(pid=95467) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 08:10:44 user nova-compute[95467]: DEBUG nova.network.neutron [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Successfully updated port: aa13aa7e-d38c-487f-8c4f-0f1cd51a18eb {{(pid=95467) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 08:10:45 user nova-compute[95467]: DEBUG nova.network.neutron [req-06daf64d-1c6f-427c-bf9a-8b7c69d290ec req-8d2c8a2f-6152-4b72-885a-7a19d19e05fd service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:10:45 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: ee2aa477-6786-483a-b088-d8ec204fe6aa] Updating instance_info_cache with network_info: [{"id": "5e362799-1ab1-48d5-9ef2-1a90ce83cd80", "address": "fa:16:3e:2e:62:d2", "network": {"id": "9fc550b3-b517-4f14-93cd-f1c2866d1b29", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1976605572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1312e86f799549eb8adb4c846576262c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e362799-1a", "ovs_interfaceid": "5e362799-1ab1-48d5-9ef2-1a90ce83cd80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:10:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-06daf64d-1c6f-427c-bf9a-8b7c69d290ec req-8d2c8a2f-6152-4b72-885a-7a19d19e05fd service nova] Releasing lock "refresh_cache-35e88686-253e-452a-9649-8aa2a04128ce" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:10:45 user nova-compute[95467]: DEBUG nova.compute.manager [req-06daf64d-1c6f-427c-bf9a-8b7c69d290ec req-8d2c8a2f-6152-4b72-885a-7a19d19e05fd service nova] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Received event network-vif-plugged-f6d25344-c8fc-4794-b302-a3665c62b78c {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:10:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-06daf64d-1c6f-427c-bf9a-8b7c69d290ec req-8d2c8a2f-6152-4b72-885a-7a19d19e05fd service nova] Acquiring lock "0917b083-2bbf-4baf-a0b8-d59ba3e2256b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:10:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-06daf64d-1c6f-427c-bf9a-8b7c69d290ec req-8d2c8a2f-6152-4b72-885a-7a19d19e05fd service nova] Lock "0917b083-2bbf-4baf-a0b8-d59ba3e2256b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:10:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-06daf64d-1c6f-427c-bf9a-8b7c69d290ec req-8d2c8a2f-6152-4b72-885a-7a19d19e05fd service nova] Lock "0917b083-2bbf-4baf-a0b8-d59ba3e2256b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:10:45 user nova-compute[95467]: DEBUG nova.compute.manager [req-06daf64d-1c6f-427c-bf9a-8b7c69d290ec req-8d2c8a2f-6152-4b72-885a-7a19d19e05fd service nova] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] No waiting events found dispatching network-vif-plugged-f6d25344-c8fc-4794-b302-a3665c62b78c {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:10:45 user nova-compute[95467]: WARNING nova.compute.manager [req-06daf64d-1c6f-427c-bf9a-8b7c69d290ec req-8d2c8a2f-6152-4b72-885a-7a19d19e05fd service nova] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Received unexpected event network-vif-plugged-f6d25344-c8fc-4794-b302-a3665c62b78c for instance with vm_state active and task_state None.
Nov 15 08:10:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Releasing lock "refresh_cache-ee2aa477-6786-483a-b088-d8ec204fe6aa" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:10:45 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: ee2aa477-6786-483a-b088-d8ec204fe6aa] Updated the network info_cache for instance {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 08:10:45 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:10:45 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:10:45 user nova-compute[95467]: DEBUG nova.network.neutron [req-18ddf1e5-8b51-4698-8e44-1ba91bc5a1e9 req-71939d8b-5d7c-40ee-ab20-ff4ed2cb79d9 service nova] [instance: fa82104f-d822-49fa-a06b-643733e27b06] Updated VIF entry in instance network info cache for port 21218f5a-82fe-4212-9f29-38468f27afb3. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:10:45 user nova-compute[95467]: DEBUG nova.network.neutron [req-18ddf1e5-8b51-4698-8e44-1ba91bc5a1e9 req-71939d8b-5d7c-40ee-ab20-ff4ed2cb79d9 service nova] [instance: fa82104f-d822-49fa-a06b-643733e27b06] Updating instance_info_cache with network_info: [{"id": "21218f5a-82fe-4212-9f29-38468f27afb3", "address": "fa:16:3e:c6:32:45", "network": {"id": "59688126-3d6d-4bbd-89e7-dfc59e199581", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d7a38b3c02f7432780351fffae6b27d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21218f5a-82", "ovs_interfaceid": "21218f5a-82fe-4212-9f29-38468f27afb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:10:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-18ddf1e5-8b51-4698-8e44-1ba91bc5a1e9 req-71939d8b-5d7c-40ee-ab20-ff4ed2cb79d9 service nova] Releasing lock "refresh_cache-fa82104f-d822-49fa-a06b-643733e27b06" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:10:45 user nova-compute[95467]: DEBUG nova.compute.manager [req-dac79baa-07e1-4f42-ba76-0ce9bcbbbef1 req-4e398678-518c-461a-9db1-c522585cbb12 service nova] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Received event network-vif-plugged-f6d25344-c8fc-4794-b302-a3665c62b78c {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:10:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-dac79baa-07e1-4f42-ba76-0ce9bcbbbef1 req-4e398678-518c-461a-9db1-c522585cbb12 service nova] Acquiring lock "0917b083-2bbf-4baf-a0b8-d59ba3e2256b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:10:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-dac79baa-07e1-4f42-ba76-0ce9bcbbbef1 req-4e398678-518c-461a-9db1-c522585cbb12 service nova] Lock "0917b083-2bbf-4baf-a0b8-d59ba3e2256b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:10:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-dac79baa-07e1-4f42-ba76-0ce9bcbbbef1 req-4e398678-518c-461a-9db1-c522585cbb12 service nova] Lock "0917b083-2bbf-4baf-a0b8-d59ba3e2256b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:10:45 user nova-compute[95467]: DEBUG nova.compute.manager [req-dac79baa-07e1-4f42-ba76-0ce9bcbbbef1 req-4e398678-518c-461a-9db1-c522585cbb12 service nova] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] No waiting events found dispatching network-vif-plugged-f6d25344-c8fc-4794-b302-a3665c62b78c {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:10:45 user nova-compute[95467]: WARNING nova.compute.manager [req-dac79baa-07e1-4f42-ba76-0ce9bcbbbef1 req-4e398678-518c-461a-9db1-c522585cbb12 service nova] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Received unexpected event network-vif-plugged-f6d25344-c8fc-4794-b302-a3665c62b78c for instance with vm_state active and task_state None.
Nov 15 08:10:45 user nova-compute[95467]: DEBUG nova.compute.manager [req-dac79baa-07e1-4f42-ba76-0ce9bcbbbef1 req-4e398678-518c-461a-9db1-c522585cbb12 service nova] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Received event network-vif-plugged-1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:10:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-dac79baa-07e1-4f42-ba76-0ce9bcbbbef1 req-4e398678-518c-461a-9db1-c522585cbb12 service nova] Acquiring lock "7e53d93e-1222-4b1a-9745-d512da0f7925-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:10:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-dac79baa-07e1-4f42-ba76-0ce9bcbbbef1 req-4e398678-518c-461a-9db1-c522585cbb12 service nova] Lock "7e53d93e-1222-4b1a-9745-d512da0f7925-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:10:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-dac79baa-07e1-4f42-ba76-0ce9bcbbbef1 req-4e398678-518c-461a-9db1-c522585cbb12 service nova] Lock "7e53d93e-1222-4b1a-9745-d512da0f7925-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:10:45 user nova-compute[95467]: DEBUG nova.compute.manager [req-dac79baa-07e1-4f42-ba76-0ce9bcbbbef1 req-4e398678-518c-461a-9db1-c522585cbb12 service nova] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] No waiting events found dispatching network-vif-plugged-1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:10:45 user nova-compute[95467]: WARNING nova.compute.manager [req-dac79baa-07e1-4f42-ba76-0ce9bcbbbef1 req-4e398678-518c-461a-9db1-c522585cbb12 service nova] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Received unexpected event network-vif-plugged-1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2 for instance with vm_state active and task_state None.
Nov 15 08:10:45 user nova-compute[95467]: DEBUG nova.compute.manager [req-dac79baa-07e1-4f42-ba76-0ce9bcbbbef1 req-4e398678-518c-461a-9db1-c522585cbb12 service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Received event network-changed-aa13aa7e-d38c-487f-8c4f-0f1cd51a18eb {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:10:45 user nova-compute[95467]: DEBUG nova.compute.manager [req-dac79baa-07e1-4f42-ba76-0ce9bcbbbef1 req-4e398678-518c-461a-9db1-c522585cbb12 service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Refreshing instance network info cache due to event network-changed-aa13aa7e-d38c-487f-8c4f-0f1cd51a18eb. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:10:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-dac79baa-07e1-4f42-ba76-0ce9bcbbbef1 req-4e398678-518c-461a-9db1-c522585cbb12 service nova] Acquiring lock "refresh_cache-35e88686-253e-452a-9649-8aa2a04128ce" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:10:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-dac79baa-07e1-4f42-ba76-0ce9bcbbbef1 req-4e398678-518c-461a-9db1-c522585cbb12 service nova] Acquired lock "refresh_cache-35e88686-253e-452a-9649-8aa2a04128ce" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:10:45 user nova-compute[95467]: DEBUG nova.network.neutron [req-dac79baa-07e1-4f42-ba76-0ce9bcbbbef1 req-4e398678-518c-461a-9db1-c522585cbb12 service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Refreshing network info cache for port aa13aa7e-d38c-487f-8c4f-0f1cd51a18eb {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:10:45 user nova-compute[95467]: DEBUG nova.network.neutron [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Successfully updated port: 48912f9e-eeae-4f51-8123-8316a6fcc15e {{(pid=95467) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 08:10:45 user nova-compute[95467]: DEBUG nova.network.neutron [req-dac79baa-07e1-4f42-ba76-0ce9bcbbbef1 req-4e398678-518c-461a-9db1-c522585cbb12 service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Instance cache missing network info. {{(pid=95467) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 08:10:46 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:46 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:46 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:46 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:46 user nova-compute[95467]: DEBUG nova.network.neutron [req-dac79baa-07e1-4f42-ba76-0ce9bcbbbef1 req-4e398678-518c-461a-9db1-c522585cbb12 service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:10:46 user nova-compute[95467]: INFO nova.virt.block_device [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Booting with volume 5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 at /dev/vdc
Nov 15 08:10:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-dac79baa-07e1-4f42-ba76-0ce9bcbbbef1 req-4e398678-518c-461a-9db1-c522585cbb12 service nova] Releasing lock "refresh_cache-35e88686-253e-452a-9649-8aa2a04128ce" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:10:46 user nova-compute[95467]: DEBUG nova.compute.manager [req-dac79baa-07e1-4f42-ba76-0ce9bcbbbef1 req-4e398678-518c-461a-9db1-c522585cbb12 service nova] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Received event network-vif-plugged-1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:10:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-dac79baa-07e1-4f42-ba76-0ce9bcbbbef1 req-4e398678-518c-461a-9db1-c522585cbb12 service nova] Acquiring lock "7e53d93e-1222-4b1a-9745-d512da0f7925-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:10:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-dac79baa-07e1-4f42-ba76-0ce9bcbbbef1 req-4e398678-518c-461a-9db1-c522585cbb12 service nova] Lock "7e53d93e-1222-4b1a-9745-d512da0f7925-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:10:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-dac79baa-07e1-4f42-ba76-0ce9bcbbbef1 req-4e398678-518c-461a-9db1-c522585cbb12 service nova] Lock "7e53d93e-1222-4b1a-9745-d512da0f7925-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:10:46 user nova-compute[95467]: DEBUG nova.compute.manager [req-dac79baa-07e1-4f42-ba76-0ce9bcbbbef1 req-4e398678-518c-461a-9db1-c522585cbb12 service nova] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] No waiting events found dispatching network-vif-plugged-1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:10:46 user nova-compute[95467]: WARNING nova.compute.manager [req-dac79baa-07e1-4f42-ba76-0ce9bcbbbef1 req-4e398678-518c-461a-9db1-c522585cbb12 service nova] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Received unexpected event network-vif-plugged-1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2 for instance with vm_state active and task_state None.
Nov 15 08:10:46 user nova-compute[95467]: DEBUG os_brick.utils [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:10:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.044s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:46 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66904f2-4780-446d-ac4b-238c3473a230]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:882ae90641f\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:10:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:46 user nova-compute[95467]: DEBUG nova.compute.manager [req-29545a70-3cb2-480c-95d8-dd4d659f7218 req-40dde528-c357-486b-9e23-6d980d1d823a service nova] [instance: fa82104f-d822-49fa-a06b-643733e27b06] Received event network-vif-plugged-21218f5a-82fe-4212-9f29-38468f27afb3 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:10:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-29545a70-3cb2-480c-95d8-dd4d659f7218 req-40dde528-c357-486b-9e23-6d980d1d823a service nova] Acquiring lock "fa82104f-d822-49fa-a06b-643733e27b06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:10:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-29545a70-3cb2-480c-95d8-dd4d659f7218 req-40dde528-c357-486b-9e23-6d980d1d823a service nova] Lock "fa82104f-d822-49fa-a06b-643733e27b06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:10:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-29545a70-3cb2-480c-95d8-dd4d659f7218 req-40dde528-c357-486b-9e23-6d980d1d823a service nova] Lock "fa82104f-d822-49fa-a06b-643733e27b06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:10:46 user nova-compute[95467]: DEBUG nova.compute.manager [req-29545a70-3cb2-480c-95d8-dd4d659f7218 req-40dde528-c357-486b-9e23-6d980d1d823a service nova] [instance: fa82104f-d822-49fa-a06b-643733e27b06] No waiting events found dispatching network-vif-plugged-21218f5a-82fe-4212-9f29-38468f27afb3 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:10:46 user nova-compute[95467]: WARNING nova.compute.manager [req-29545a70-3cb2-480c-95d8-dd4d659f7218 req-40dde528-c357-486b-9e23-6d980d1d823a service nova] [instance: fa82104f-d822-49fa-a06b-643733e27b06] Received unexpected event network-vif-plugged-21218f5a-82fe-4212-9f29-38468f27afb3 for instance with vm_state building and task_state spawning.
Nov 15 08:10:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:46 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d0a23c-b395-464c-8f36-150c62b1b39d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:10:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:46 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e30b2e-8891-49ad-8d54-dfdb67f337ba]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:10:46 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b1671a-50e3-4ddf-aa26-e7fafba4dd47]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:10:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Running cmd (subprocess): nvme version {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] 'nvme version' failed. Not Retrying. {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:10:46 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] nvme not present on system {{(pid=95467) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 08:10:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:10:46 user nova-compute[95467]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 08:10:46 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46c12c7-10a2-4a81-a947-f5faddc83d88]: (4, '') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:10:46 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=95467) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 08:10:46 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 08:10:46 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] LIGHTOS: no hostnqn found. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 08:10:46 user nova-compute[95467]: DEBUG os_brick.utils [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] <== get_connector_properties: return (190ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:882ae90641f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:10:46 user nova-compute[95467]: DEBUG nova.virt.block_device [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Updating existing volume attachment record: 116970fb-407d-472c-9a3d-0d3a2fa533ed {{(pid=95467) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 08:10:46 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:46 user nova-compute[95467]: DEBUG nova.network.neutron [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Successfully updated port: 0a35017f-b57c-4937-9479-22494bffb5b7 {{(pid=95467) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 08:10:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Acquiring lock "refresh_cache-35e88686-253e-452a-9649-8aa2a04128ce" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:10:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Acquired lock "refresh_cache-35e88686-253e-452a-9649-8aa2a04128ce" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:10:46 user nova-compute[95467]: DEBUG nova.network.neutron [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:10:46 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:46 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:46 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:46 user nova-compute[95467]: DEBUG nova.network.neutron [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Instance cache missing network info. {{(pid=95467) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 08:10:46 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:47 user nova-compute[95467]: DEBUG nova.compute.manager [req-394ca3e0-a424-434d-91b1-f557fd64deda req-e8f4a4b2-08e0-433c-b750-2038e49094b6 service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Received event network-changed-48912f9e-eeae-4f51-8123-8316a6fcc15e {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:10:47 user nova-compute[95467]: DEBUG nova.compute.manager [req-394ca3e0-a424-434d-91b1-f557fd64deda req-e8f4a4b2-08e0-433c-b750-2038e49094b6 service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Refreshing instance network info cache due to event network-changed-48912f9e-eeae-4f51-8123-8316a6fcc15e. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:10:47 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-394ca3e0-a424-434d-91b1-f557fd64deda req-e8f4a4b2-08e0-433c-b750-2038e49094b6 service nova] Acquiring lock "refresh_cache-35e88686-253e-452a-9649-8aa2a04128ce" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:10:48 user nova-compute[95467]: DEBUG nova.compute.manager [req-9dea1c20-7995-4a26-98e4-5323e6d16182 req-79ac064e-1d70-47f1-b8c0-3bb819c582a8 service nova] [instance: fa82104f-d822-49fa-a06b-643733e27b06] Received event network-vif-plugged-21218f5a-82fe-4212-9f29-38468f27afb3 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:10:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-9dea1c20-7995-4a26-98e4-5323e6d16182 req-79ac064e-1d70-47f1-b8c0-3bb819c582a8 service nova] Acquiring lock "fa82104f-d822-49fa-a06b-643733e27b06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:10:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-9dea1c20-7995-4a26-98e4-5323e6d16182 req-79ac064e-1d70-47f1-b8c0-3bb819c582a8 service nova] Lock "fa82104f-d822-49fa-a06b-643733e27b06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:10:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-9dea1c20-7995-4a26-98e4-5323e6d16182 req-79ac064e-1d70-47f1-b8c0-3bb819c582a8 service nova] Lock "fa82104f-d822-49fa-a06b-643733e27b06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:10:48 user nova-compute[95467]: DEBUG nova.compute.manager [req-9dea1c20-7995-4a26-98e4-5323e6d16182 req-79ac064e-1d70-47f1-b8c0-3bb819c582a8 service nova] [instance: fa82104f-d822-49fa-a06b-643733e27b06] No waiting events found dispatching network-vif-plugged-21218f5a-82fe-4212-9f29-38468f27afb3 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:10:48 user nova-compute[95467]: WARNING nova.compute.manager [req-9dea1c20-7995-4a26-98e4-5323e6d16182 req-79ac064e-1d70-47f1-b8c0-3bb819c582a8 service nova] [instance: fa82104f-d822-49fa-a06b-643733e27b06] Received unexpected event network-vif-plugged-21218f5a-82fe-4212-9f29-38468f27afb3 for instance with vm_state building and task_state spawning.
Nov 15 08:10:48 user nova-compute[95467]: DEBUG nova.compute.manager [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] [instance: fa82104f-d822-49fa-a06b-643733e27b06] Instance event wait completed in 0 seconds for  {{(pid=95467) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 08:10:48 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] [instance: fa82104f-d822-49fa-a06b-643733e27b06] Guest created on hypervisor {{(pid=95467) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 08:10:48 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: fa82104f-d822-49fa-a06b-643733e27b06] Instance spawned successfully.
Nov 15 08:10:48 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] [instance: fa82104f-d822-49fa-a06b-643733e27b06] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 08:10:48 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] [instance: fa82104f-d822-49fa-a06b-643733e27b06] Found default for hw_cdrom_bus of ide {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:10:48 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] [instance: fa82104f-d822-49fa-a06b-643733e27b06] Found default for hw_disk_bus of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:10:48 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] [instance: fa82104f-d822-49fa-a06b-643733e27b06] Found default for hw_input_bus of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:10:48 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] [instance: fa82104f-d822-49fa-a06b-643733e27b06] Found default for hw_pointer_model of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:10:48 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] [instance: fa82104f-d822-49fa-a06b-643733e27b06] Found default for hw_video_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:10:48 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] [instance: fa82104f-d822-49fa-a06b-643733e27b06] Found default for hw_vif_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:10:48 user nova-compute[95467]: INFO nova.compute.manager [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] [instance: fa82104f-d822-49fa-a06b-643733e27b06] Took 6.53 seconds to spawn the instance on the hypervisor.
Nov 15 08:10:48 user nova-compute[95467]: DEBUG nova.compute.manager [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] [instance: fa82104f-d822-49fa-a06b-643733e27b06] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:10:48 user nova-compute[95467]: INFO nova.compute.manager [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] [instance: fa82104f-d822-49fa-a06b-643733e27b06] Took 8.65 seconds to build instance.
Nov 15 08:10:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-ca8838f5-2894-4cee-a89d-334a3dcd7607 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Lock "fa82104f-d822-49fa-a06b-643733e27b06" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.811s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:10:49 user nova-compute[95467]: DEBUG nova.network.neutron [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Updating instance_info_cache with network_info: [{"id": "89c9bfb4-6b7a-4635-ba8d-2b0370fafb8b", "address": "fa:16:3e:51:c9:81", "network": {"id": "40744d2e-cc7c-4ca4-88b6-de3cb34a5da5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1986770176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89c9bfb4-6b", "ovs_interfaceid": "89c9bfb4-6b7a-4635-ba8d-2b0370fafb8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "92307630-ea94-407f-b852-ee250debc046", "address": "fa:16:3e:7f:f7:1a", "network": {"id": "22cdcc96-2021-437d-9fa1-bece0497025d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1206155458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92307630-ea", "ovs_interfaceid": "92307630-ea94-407f-b852-ee250debc046", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fae94c7c-6554-49a7-a221-43d18d1e95e0", "address": "fa:16:3e:d9:9d:86", "network": {"id": "22cdcc96-2021-437d-9fa1-bece0497025d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1206155458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfae94c7c-65", "ovs_interfaceid": "fae94c7c-6554-49a7-a221-43d18d1e95e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cdfe5e3f-2910-43a2-8d16-132d69d647d5", "address": "fa:16:3e:9e:d6:aa", "network": {"id": "22cdcc96-2021-437d-9fa1-bece0497025d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1206155458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdfe5e3f-29", "ovs_interfaceid": "cdfe5e3f-2910-43a2-8d16-132d69d647d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "aa13aa7e-d38c-487f-8c4f-0f1cd51a18eb", "address": "fa:16:3e:0f:9b:7a", "network": {"id": "22cdcc96-2021-437d-9fa1-bece0497025d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1206155458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa13aa7e-d3", "ovs_interfaceid": "aa13aa7e-d38c-487f-8c4f-0f1cd51a18eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "48912f9e-eeae-4f51-8123-8316a6fcc15e", "address": "fa:16:3e:92:f8:11", "network": {"id": "1e721803-a83d-4c10-ba12-7b70b3b0fa23", "bridge": "br-int", "label": "tempest-device-tagging-net2-1574523632", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48912f9e-ee", "ovs_interfaceid": "48912f9e-eeae-4f51-8123-8316a6fcc15e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0a35017f-b57c-4937-9479-22494bffb5b7", "address": "fa:16:3e:42:0c:b6", "network": {"id": "1e721803-a83d-4c10-ba12-7b70b3b0fa23", "bridge": "br-int", "label": "tempest-device-tagging-net2-1574523632", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a35017f-b5", "ovs_interfaceid": "0a35017f-b57c-4937-9479-22494bffb5b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:10:49 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Releasing lock "refresh_cache-35e88686-253e-452a-9649-8aa2a04128ce" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:10:49 user nova-compute[95467]: DEBUG nova.compute.manager [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Instance network_info: |[{"id": "89c9bfb4-6b7a-4635-ba8d-2b0370fafb8b", "address": "fa:16:3e:51:c9:81", "network": {"id": "40744d2e-cc7c-4ca4-88b6-de3cb34a5da5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1986770176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89c9bfb4-6b", "ovs_interfaceid": "89c9bfb4-6b7a-4635-ba8d-2b0370fafb8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "92307630-ea94-407f-b852-ee250debc046", "address": "fa:16:3e:7f:f7:1a", "network": {"id": "22cdcc96-2021-437d-9fa1-bece0497025d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1206155458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92307630-ea", "ovs_interfaceid": "92307630-ea94-407f-b852-ee250debc046", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fae94c7c-6554-49a7-a221-43d18d1e95e0", "address": "fa:16:3e:d9:9d:86", "network": {"id": "22cdcc96-2021-437d-9fa1-bece0497025d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1206155458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfae94c7c-65", "ovs_interfaceid": "fae94c7c-6554-49a7-a221-43d18d1e95e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cdfe5e3f-2910-43a2-8d16-132d69d647d5", "address": "fa:16:3e:9e:d6:aa", "network": {"id": "22cdcc96-2021-437d-9fa1-bece0497025d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1206155458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdfe5e3f-29", "ovs_interfaceid": "cdfe5e3f-2910-43a2-8d16-132d69d647d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "aa13aa7e-d38c-487f-8c4f-0f1cd51a18eb", "address": "fa:16:3e:0f:9b:7a", "network": {"id": "22cdcc96-2021-437d-9fa1-bece0497025d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1206155458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa13aa7e-d3", "ovs_interfaceid": "aa13aa7e-d38c-487f-8c4f-0f1cd51a18eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "48912f9e-eeae-4f51-8123-8316a6fcc15e", "address": "fa:16:3e:92:f8:11", "network": {"id": "1e721803-a83d-4c10-ba12-7b70b3b0fa23", "bridge": "br-int", "label": "tempest-device-tagging-net2-1574523632", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48912f9e-ee", "ovs_interfaceid": "48912f9e-eeae-4f51-8123-8316a6fcc15e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0a35017f-b57c-4937-9479-22494bffb5b7", "address": "fa:16:3e:42:0c:b6", "network": {"id": "1e721803-a83d-4c10-ba12-7b70b3b0fa23", "bridge": "br-int", "label": "tempest-device-tagging-net2-1574523632", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a35017f-b5", "ovs_interfaceid": "0a35017f-b57c-4937-9479-22494bffb5b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 08:10:49 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-394ca3e0-a424-434d-91b1-f557fd64deda req-e8f4a4b2-08e0-433c-b750-2038e49094b6 service nova] Acquired lock "refresh_cache-35e88686-253e-452a-9649-8aa2a04128ce" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:10:49 user nova-compute[95467]: DEBUG nova.network.neutron [req-394ca3e0-a424-434d-91b1-f557fd64deda req-e8f4a4b2-08e0-433c-b750-2038e49094b6 service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Refreshing network info cache for port 48912f9e-eeae-4f51-8123-8316a6fcc15e {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:10:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:50 user nova-compute[95467]: DEBUG nova.network.neutron [req-394ca3e0-a424-434d-91b1-f557fd64deda req-e8f4a4b2-08e0-433c-b750-2038e49094b6 service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Updated VIF entry in instance network info cache for port 48912f9e-eeae-4f51-8123-8316a6fcc15e. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:10:50 user nova-compute[95467]: DEBUG nova.network.neutron [req-394ca3e0-a424-434d-91b1-f557fd64deda req-e8f4a4b2-08e0-433c-b750-2038e49094b6 service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Updating instance_info_cache with network_info: [{"id": "89c9bfb4-6b7a-4635-ba8d-2b0370fafb8b", "address": "fa:16:3e:51:c9:81", "network": {"id": "40744d2e-cc7c-4ca4-88b6-de3cb34a5da5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1986770176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89c9bfb4-6b", "ovs_interfaceid": "89c9bfb4-6b7a-4635-ba8d-2b0370fafb8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "92307630-ea94-407f-b852-ee250debc046", "address": "fa:16:3e:7f:f7:1a", "network": {"id": "22cdcc96-2021-437d-9fa1-bece0497025d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1206155458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92307630-ea", "ovs_interfaceid": "92307630-ea94-407f-b852-ee250debc046", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fae94c7c-6554-49a7-a221-43d18d1e95e0", "address": "fa:16:3e:d9:9d:86", "network": {"id": "22cdcc96-2021-437d-9fa1-bece0497025d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1206155458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfae94c7c-65", "ovs_interfaceid": "fae94c7c-6554-49a7-a221-43d18d1e95e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cdfe5e3f-2910-43a2-8d16-132d69d647d5", "address": "fa:16:3e:9e:d6:aa", "network": {"id": "22cdcc96-2021-437d-9fa1-bece0497025d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1206155458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdfe5e3f-29", "ovs_interfaceid": "cdfe5e3f-2910-43a2-8d16-132d69d647d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "aa13aa7e-d38c-487f-8c4f-0f1cd51a18eb", "address": "fa:16:3e:0f:9b:7a", "network": {"id": "22cdcc96-2021-437d-9fa1-bece0497025d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1206155458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa13aa7e-d3", "ovs_interfaceid": "aa13aa7e-d38c-487f-8c4f-0f1cd51a18eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "48912f9e-eeae-4f51-8123-8316a6fcc15e", "address": "fa:16:3e:92:f8:11", "network": {"id": "1e721803-a83d-4c10-ba12-7b70b3b0fa23", "bridge": "br-int", "label": "tempest-device-tagging-net2-1574523632", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48912f9e-ee", "ovs_interfaceid": "48912f9e-eeae-4f51-8123-8316a6fcc15e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0a35017f-b57c-4937-9479-22494bffb5b7", "address": "fa:16:3e:42:0c:b6", "network": {"id": "1e721803-a83d-4c10-ba12-7b70b3b0fa23", "bridge": "br-int", "label": "tempest-device-tagging-net2-1574523632", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a35017f-b5", "ovs_interfaceid": "0a35017f-b57c-4937-9479-22494bffb5b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:10:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-394ca3e0-a424-434d-91b1-f557fd64deda req-e8f4a4b2-08e0-433c-b750-2038e49094b6 service nova] Releasing lock "refresh_cache-35e88686-253e-452a-9649-8aa2a04128ce" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:10:50 user nova-compute[95467]: DEBUG nova.compute.manager [req-394ca3e0-a424-434d-91b1-f557fd64deda req-e8f4a4b2-08e0-433c-b750-2038e49094b6 service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Received event network-changed-0a35017f-b57c-4937-9479-22494bffb5b7 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:10:50 user nova-compute[95467]: DEBUG nova.compute.manager [req-394ca3e0-a424-434d-91b1-f557fd64deda req-e8f4a4b2-08e0-433c-b750-2038e49094b6 service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Refreshing instance network info cache due to event network-changed-0a35017f-b57c-4937-9479-22494bffb5b7. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:10:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-394ca3e0-a424-434d-91b1-f557fd64deda req-e8f4a4b2-08e0-433c-b750-2038e49094b6 service nova] Acquiring lock "refresh_cache-35e88686-253e-452a-9649-8aa2a04128ce" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:10:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-394ca3e0-a424-434d-91b1-f557fd64deda req-e8f4a4b2-08e0-433c-b750-2038e49094b6 service nova] Acquired lock "refresh_cache-35e88686-253e-452a-9649-8aa2a04128ce" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:10:50 user nova-compute[95467]: DEBUG nova.network.neutron [req-394ca3e0-a424-434d-91b1-f557fd64deda req-e8f4a4b2-08e0-433c-b750-2038e49094b6 service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Refreshing network info cache for port 0a35017f-b57c-4937-9479-22494bffb5b7 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:10:50 user nova-compute[95467]: DEBUG nova.network.neutron [req-394ca3e0-a424-434d-91b1-f557fd64deda req-e8f4a4b2-08e0-433c-b750-2038e49094b6 service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Updated VIF entry in instance network info cache for port 0a35017f-b57c-4937-9479-22494bffb5b7. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:10:50 user nova-compute[95467]: DEBUG nova.network.neutron [req-394ca3e0-a424-434d-91b1-f557fd64deda req-e8f4a4b2-08e0-433c-b750-2038e49094b6 service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Updating instance_info_cache with network_info: [{"id": "89c9bfb4-6b7a-4635-ba8d-2b0370fafb8b", "address": "fa:16:3e:51:c9:81", "network": {"id": "40744d2e-cc7c-4ca4-88b6-de3cb34a5da5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1986770176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89c9bfb4-6b", "ovs_interfaceid": "89c9bfb4-6b7a-4635-ba8d-2b0370fafb8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "92307630-ea94-407f-b852-ee250debc046", "address": "fa:16:3e:7f:f7:1a", "network": {"id": "22cdcc96-2021-437d-9fa1-bece0497025d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1206155458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92307630-ea", "ovs_interfaceid": "92307630-ea94-407f-b852-ee250debc046", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fae94c7c-6554-49a7-a221-43d18d1e95e0", "address": "fa:16:3e:d9:9d:86", "network": {"id": "22cdcc96-2021-437d-9fa1-bece0497025d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1206155458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfae94c7c-65", "ovs_interfaceid": "fae94c7c-6554-49a7-a221-43d18d1e95e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cdfe5e3f-2910-43a2-8d16-132d69d647d5", "address": "fa:16:3e:9e:d6:aa", "network": {"id": "22cdcc96-2021-437d-9fa1-bece0497025d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1206155458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdfe5e3f-29", "ovs_interfaceid": "cdfe5e3f-2910-43a2-8d16-132d69d647d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "aa13aa7e-d38c-487f-8c4f-0f1cd51a18eb", "address": "fa:16:3e:0f:9b:7a", "network": {"id": "22cdcc96-2021-437d-9fa1-bece0497025d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1206155458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa13aa7e-d3", "ovs_interfaceid": "aa13aa7e-d38c-487f-8c4f-0f1cd51a18eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "48912f9e-eeae-4f51-8123-8316a6fcc15e", "address": "fa:16:3e:92:f8:11", "network": {"id": "1e721803-a83d-4c10-ba12-7b70b3b0fa23", "bridge": "br-int", "label": "tempest-device-tagging-net2-1574523632", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48912f9e-ee", "ovs_interfaceid": "48912f9e-eeae-4f51-8123-8316a6fcc15e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0a35017f-b57c-4937-9479-22494bffb5b7", "address": "fa:16:3e:42:0c:b6", "network": {"id": "1e721803-a83d-4c10-ba12-7b70b3b0fa23", "bridge": "br-int", "label": "tempest-device-tagging-net2-1574523632", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a35017f-b5", "ovs_interfaceid": "0a35017f-b57c-4937-9479-22494bffb5b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:10:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-394ca3e0-a424-434d-91b1-f557fd64deda req-e8f4a4b2-08e0-433c-b750-2038e49094b6 service nova] Releasing lock "refresh_cache-35e88686-253e-452a-9649-8aa2a04128ce" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:10:51 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:52 user nova-compute[95467]: DEBUG nova.compute.manager [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Start spawning the instance on the hypervisor. {{(pid=95467) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 08:10:52 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Creating instance directory {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 08:10:52 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Creating image(s)
Nov 15 08:10:52 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Did not create local disks {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 08:10:52 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Ensure instance console log exists: /opt/stack/data/nova/instances/35e88686-253e-452a-9649-8aa2a04128ce/console.log {{(pid=95467) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 08:10:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:10:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:10:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:10:52 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Start _get_guest_xml network_info=[{"id": "89c9bfb4-6b7a-4635-ba8d-2b0370fafb8b", "address": "fa:16:3e:51:c9:81", "network": {"id": "40744d2e-cc7c-4ca4-88b6-de3cb34a5da5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1986770176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89c9bfb4-6b", "ovs_interfaceid": "89c9bfb4-6b7a-4635-ba8d-2b0370fafb8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "92307630-ea94-407f-b852-ee250debc046", "address": "fa:16:3e:7f:f7:1a", "network": {"id": "22cdcc96-2021-437d-9fa1-bece0497025d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1206155458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92307630-ea", "ovs_interfaceid": "92307630-ea94-407f-b852-ee250debc046", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fae94c7c-6554-49a7-a221-43d18d1e95e0", "address": "fa:16:3e:d9:9d:86", "network": {"id": "22cdcc96-2021-437d-9fa1-bece0497025d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1206155458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfae94c7c-65", "ovs_interfaceid": "fae94c7c-6554-49a7-a221-43d18d1e95e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cdfe5e3f-2910-43a2-8d16-132d69d647d5", "address": "fa:16:3e:9e:d6:aa", "network": {"id": "22cdcc96-2021-437d-9fa1-bece0497025d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1206155458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdfe5e3f-29", "ovs_interfaceid": "cdfe5e3f-2910-43a2-8d16-132d69d647d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "aa13aa7e-d38c-487f-8c4f-0f1cd51a18eb", "address": "fa:16:3e:0f:9b:7a", "network": {"id": "22cdcc96-2021-437d-9fa1-bece0497025d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1206155458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa13aa7e-d3", "ovs_interfaceid": "aa13aa7e-d38c-487f-8c4f-0f1cd51a18eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "48912f9e-eeae-4f51-8123-8316a6fcc15e", "address": "fa:16:3e:92:f8:11", "network": {"id": "1e721803-a83d-4c10-ba12-7b70b3b0fa23", "bridge": "br-int", "label": "tempest-device-tagging-net2-1574523632", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48912f9e-ee", "ovs_interfaceid": "48912f9e-eeae-4f51-8123-8316a6fcc15e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0a35017f-b57c-4937-9479-22494bffb5b7", "address": "fa:16:3e:42:0c:b6", "network": {"id": "1e721803-a83d-4c10-ba12-7b70b3b0fa23", "bridge": "br-int", "label": "tempest-device-tagging-net2-1574523632", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a35017f-b5", "ovs_interfaceid": "0a35017f-b57c-4937-9479-22494bffb5b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '27eb6355-1fc1-4f02-bb68-4e36215faeec', 'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RpxtXbBF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '35e88686-253e-452a-9649-8aa2a04128ce', 'attached_at': '', 'detached_at': '', 'volume_id': '8d4b7008-9243-4206-a1e7-bddc82e2d5c8', 'serial': '8d4b7008-9243-4206-a1e7-bddc82e2d5c8'}, 'volume_type': None}, {'attachment_id': 'fe8dab3e-8331-4c0c-885e-880b71fb51e1', 'delete_on_termination': False, 'boot_index': 1, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VDMlFcgO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '35e88686-253e-452a-9649-8aa2a04128ce', 'attached_at': '', 'detached_at': '', 'volume_id': 'aee0d1b6-eb0f-452e-90e9-fcabb9014c05', 'serial': 'aee0d1b6-eb0f-452e-90e9-fcabb9014c05'}, 'volume_type': None}, {'attachment_id': '116970fb-407d-472c-9a3d-0d3a2fa533ed', 'delete_on_termination': False, 'boot_index': 2, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gNTcCWOs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '35e88686-253e-452a-9649-8aa2a04128ce', 'attached_at': '', 'detached_at': '', 'volume_id': '5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5', 'serial': '5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5'}, 'volume_type': None} {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:10:52 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:10:52 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:10:52 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:10:52 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:10:52 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:10:52 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:10:52 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:10:52 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:10:52 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:10:52 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:10:52 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:10:52 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:10:52 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:10:52 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:10:52 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:10:52 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:10:52 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:10:52 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:10:52 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Calling os-brick to attach iSCSI Volume {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 08:10:52 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RpxtXbBF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:10:52 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:10:52 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:10:52 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:10:52 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:10:52 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:10:52 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:10:52 user nova-compute[95467]: INFO os_brick.initiator.connectors.iscsi [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 08:10:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 -p 172.16.0.220:3260 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:52 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73a914c-115d-4e57-8cec-fc0cf27d96cc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:10:52 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 08:10:52 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:10:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 -p 172.16.0.220:3260 --interface default --op new {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:52 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b787aa-981f-4317-9452-76de362d9b50]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8] added\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:10:52 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8] added
Nov 15 08:10:52 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:10:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.043s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:52 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[28353ccc-434b-4949-a1af-48e0d52d13e9]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:10:52 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:10:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.050s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:52 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[365f59a1-fdfa-4562-b8a5-cbdc92414724]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:10:52 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:10:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RpxtXbBF {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RpxtXbBF" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:52 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7479615-bbdd-478a-aeb1-6dca3125ec6c]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:10:52 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RpxtXbBF'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:10:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:52 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a023a4-d8f7-4cb0-829d-d103b7a0db60]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:10:52 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:10:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:52 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd5a99f-8032-4792-9398-ae2880b269e3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:10:52 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)
Nov 15 08:10:52 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:10:52 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)
Nov 15 08:10:52 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:10:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 -p 172.16.0.220:3260 --login {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:53 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e33ae65-db51-48bc-bf76-2cea95b90087]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:10:53 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8, portal: 172.16.0.220,3260]
Nov 15 08:10:53 user nova-compute[95467]: Login to [iface: default, target: iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8, portal: 172.16.0.220,3260] successful.
Nov 15 08:10:53 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:10:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:53 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c846a49d-c3b6-47cd-906b-fe6996bca35e]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:10:53 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:10:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:53 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9fc809-7701-494a-8d64-041d56b7d886]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:10:53 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)
Nov 15 08:10:53 user nova-compute[95467]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)
Nov 15 08:10:53 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:10:53 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)
Nov 15 08:10:53 user nova-compute[95467]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)
Nov 15 08:10:53 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:10:53 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.401s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:10:53 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Connected to 172.16.0.220:3260 {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 08:10:53 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=95467) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 08:10:53 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=95467) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 08:10:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:53 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f657b387-2fb7-4d40-8b3e-edd1e52df3f4]: (4, ('- - 0', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:10:53 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: None {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:10:54 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:10:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RpxtXbBF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 08:10:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.435s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:10:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] <== connect_volume: return (1436ms) {'type': 'block', 'scsi_wwn': '26235336430656665', 'path': '/dev/sdc'} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:10:54 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235336430656665', 'path': '/dev/sdc'} {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 08:10:54 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Calling os-brick to attach iSCSI Volume {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 08:10:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VDMlFcgO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:10:54 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:10:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:10:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:10:54 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:10:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:10:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:10:54 user nova-compute[95467]: INFO os_brick.initiator.connectors.iscsi [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 08:10:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 -p 172.16.0.220:3260 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:54 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f758f91a-a1cc-48be-97e4-d69aa3609039]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:10:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 08:10:54 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:10:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 -p 172.16.0.220:3260 --interface default --op new {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:54 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b627a869-772f-4e18-833c-e35aef4b24b4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05] added\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:10:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05] added
Nov 15 08:10:54 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:10:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:54 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[978fcece-c96e-4cab-b27d-531699a0875b]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:10:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:10:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:54 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[89bc127f-350c-4162-990b-7e2e3e87be00]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:10:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:10:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VDMlFcgO {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VDMlFcgO" returned: 0 in 0.022s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:54 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce3cc852-bacf-4454-83f2-b35bc9c2b90e]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:10:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VDMlFcgO'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:10:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:54 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[e819616c-a28a-4ce9-a14c-4aba6fe6317d]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:10:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:10:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:54 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ffe461c-6f9e-4ed8-8df3-4671f3e4f59e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:10:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)
Nov 15 08:10:54 user nova-compute[95467]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)
Nov 15 08:10:54 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:10:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)
Nov 15 08:10:54 user nova-compute[95467]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)
Nov 15 08:10:54 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:10:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 -p 172.16.0.220:3260 --login {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:54 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e9095b-17d9-4194-9394-a3b5b93c9c9e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:10:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05, portal: 172.16.0.220,3260]
Nov 15 08:10:54 user nova-compute[95467]: Login to [iface: default, target: iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05, portal: 172.16.0.220,3260] successful.
Nov 15 08:10:54 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:10:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.075s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:54 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf893a84-c881-490b-af8a-ffff94429834]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:10:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:10:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:54 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[23414381-dd4e-4d25-95b9-567708b1efd4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:10:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)
Nov 15 08:10:54 user nova-compute[95467]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)
Nov 15 08:10:54 user nova-compute[95467]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)
Nov 15 08:10:54 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:10:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)
Nov 15 08:10:54 user nova-compute[95467]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)
Nov 15 08:10:54 user nova-compute[95467]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)
Nov 15 08:10:54 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:10:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:10:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Connected to 172.16.0.220:3260 {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 08:10:54 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=95467) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 08:10:54 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=95467) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 08:10:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.037s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:54 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4a1295-1815-4663-8cda-8bd6976d5e80]: (4, ('- - 0', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:10:54 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:10:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VDMlFcgO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 08:10:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:10:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '26261333361353138', 'path': '/dev/sdd'} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:10:55 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26261333361353138', 'path': '/dev/sdd'} {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 08:10:55 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Calling os-brick to attach iSCSI Volume {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 08:10:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gNTcCWOs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:10:55 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:10:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:10:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:10:55 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:10:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:10:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:10:55 user nova-compute[95467]: INFO os_brick.initiator.connectors.iscsi [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 08:10:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 -p 172.16.0.220:3260 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:55 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa97ad7-0bb8-46af-b01b-40becb361e87]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:10:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 08:10:55 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:10:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 -p 172.16.0.220:3260 --interface default --op new {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:55 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[02085778-58c0-4111-953c-af18b28e48ec]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5] added\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:10:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5] added
Nov 15 08:10:55 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:10:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:55 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2c9b96-8dbc-4722-9a48-01fd6545f9b5]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:10:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:10:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:55 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d107ce7b-71ff-4f1b-9708-4975a563749a]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:10:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:10:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gNTcCWOs {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gNTcCWOs" returned: 0 in 0.027s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:55 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[78826dd6-68b2-4cfe-bf41-c986b73e4d35]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:10:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gNTcCWOs'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:10:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:55 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b72cf7-777f-437f-9f53-6352cea012b9]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:10:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:10:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:55 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1fa56e3-dfc1-479a-820f-bc1aa0c76866]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:10:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)
Nov 15 08:10:55 user nova-compute[95467]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)
Nov 15 08:10:55 user nova-compute[95467]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)
Nov 15 08:10:55 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:10:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)
Nov 15 08:10:55 user nova-compute[95467]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)
Nov 15 08:10:55 user nova-compute[95467]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)
Nov 15 08:10:55 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:10:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 -p 172.16.0.220:3260 --login {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:55 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff886302-d77b-403f-ac49-158c53bac7f7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:10:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5, portal: 172.16.0.220,3260]
Nov 15 08:10:55 user nova-compute[95467]: Login to [iface: default, target: iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5, portal: 172.16.0.220,3260] successful.
Nov 15 08:10:55 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:10:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:55 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb411bf-2483-42ed-a76e-fe45e8e16fb1]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:10:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:10:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:55 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b1c794-c8d0-44ec-b31f-5e553f807178]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:10:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)
Nov 15 08:10:55 user nova-compute[95467]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)
Nov 15 08:10:55 user nova-compute[95467]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)
Nov 15 08:10:55 user nova-compute[95467]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 (non-flash)
Nov 15 08:10:55 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:10:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)
Nov 15 08:10:55 user nova-compute[95467]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)
Nov 15 08:10:55 user nova-compute[95467]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)
Nov 15 08:10:55 user nova-compute[95467]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 (non-flash)
Nov 15 08:10:55 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:10:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:10:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Connected to 172.16.0.220:3260 {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 08:10:55 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=95467) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 08:10:55 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=95467) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 08:10:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:55 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c80b42-d9f2-4932-bea8-3c04c1df476c]: (4, ('- - 0', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:10:55 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:10:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gNTcCWOs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 08:10:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:56 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:10:56 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23732393338303133', 'path': '/dev/sde'} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:10:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23732393338303133', 'path': '/dev/sde'} {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 08:10:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T08:10:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-758967957',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-758967957',id=11,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbZVUH/X9/g3qhx/QO8l72lfDEt+C9X9Z6weUibGQiHc28yEhmZMMQoZFFfhUqXnOPDCGgwnjkX76jUoX2h70Sx75kIWvX0KaOE6PQPo0AMGmDacZo4ev1tywwnYEkgNg==',key_name='tempest-keypair-786167401',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e2ffe5715db4f6ebcd4237eaa12305a',ramdisk_id='',reservation_id='r-wkd8jere',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1329538542',owner_user_name='tempest-TaggedBootDevicesTest_v242-1329538542-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:10:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30338a0bc0734be2beb2cb994fdb85d7',uuid=35e88686-253e-452a-9649-8aa2a04128ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89c9bfb4-6b7a-4635-ba8d-2b0370fafb8b", "address": "fa:16:3e:51:c9:81", "network": {"id": "40744d2e-cc7c-4ca4-88b6-de3cb34a5da5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1986770176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89c9bfb4-6b", "ovs_interfaceid": "89c9bfb4-6b7a-4635-ba8d-2b0370fafb8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:10:56 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Converting VIF {"id": "89c9bfb4-6b7a-4635-ba8d-2b0370fafb8b", "address": "fa:16:3e:51:c9:81", "network": {"id": "40744d2e-cc7c-4ca4-88b6-de3cb34a5da5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1986770176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89c9bfb4-6b", "ovs_interfaceid": "89c9bfb4-6b7a-4635-ba8d-2b0370fafb8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:10:56 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:c9:81,bridge_name='br-int',has_traffic_filtering=True,id=89c9bfb4-6b7a-4635-ba8d-2b0370fafb8b,network=Network(40744d2e-cc7c-4ca4-88b6-de3cb34a5da5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89c9bfb4-6b') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:10:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T08:10:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-758967957',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-758967957',id=11,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbZVUH/X9/g3qhx/QO8l72lfDEt+C9X9Z6weUibGQiHc28yEhmZMMQoZFFfhUqXnOPDCGgwnjkX76jUoX2h70Sx75kIWvX0KaOE6PQPo0AMGmDacZo4ev1tywwnYEkgNg==',key_name='tempest-keypair-786167401',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e2ffe5715db4f6ebcd4237eaa12305a',ramdisk_id='',reservation_id='r-wkd8jere',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1329538542',owner_user_name='tempest-TaggedBootDevicesTest_v242-1329538542-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:10:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30338a0bc0734be2beb2cb994fdb85d7',uuid=35e88686-253e-452a-9649-8aa2a04128ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92307630-ea94-407f-b852-ee250debc046", "address": "fa:16:3e:7f:f7:1a", "network": {"id": "22cdcc96-2021-437d-9fa1-bece0497025d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1206155458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92307630-ea", "ovs_interfaceid": "92307630-ea94-407f-b852-ee250debc046", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:10:56 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Converting VIF {"id": "92307630-ea94-407f-b852-ee250debc046", "address": "fa:16:3e:7f:f7:1a", "network": {"id": "22cdcc96-2021-437d-9fa1-bece0497025d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1206155458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92307630-ea", "ovs_interfaceid": "92307630-ea94-407f-b852-ee250debc046", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:10:56 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:f7:1a,bridge_name='br-int',has_traffic_filtering=True,id=92307630-ea94-407f-b852-ee250debc046,network=Network(22cdcc96-2021-437d-9fa1-bece0497025d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap92307630-ea') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:10:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T08:10:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-758967957',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-758967957',id=11,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbZVUH/X9/g3qhx/QO8l72lfDEt+C9X9Z6weUibGQiHc28yEhmZMMQoZFFfhUqXnOPDCGgwnjkX76jUoX2h70Sx75kIWvX0KaOE6PQPo0AMGmDacZo4ev1tywwnYEkgNg==',key_name='tempest-keypair-786167401',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e2ffe5715db4f6ebcd4237eaa12305a',ramdisk_id='',reservation_id='r-wkd8jere',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1329538542',owner_user_name='tempest-TaggedBootDevicesTest_v242-1329538542-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:10:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30338a0bc0734be2beb2cb994fdb85d7',uuid=35e88686-253e-452a-9649-8aa2a04128ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fae94c7c-6554-49a7-a221-43d18d1e95e0", "address": "fa:16:3e:d9:9d:86", "network": {"id": "22cdcc96-2021-437d-9fa1-bece0497025d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1206155458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfae94c7c-65", "ovs_interfaceid": "fae94c7c-6554-49a7-a221-43d18d1e95e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:10:56 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Converting VIF {"id": "fae94c7c-6554-49a7-a221-43d18d1e95e0", "address": "fa:16:3e:d9:9d:86", "network": {"id": "22cdcc96-2021-437d-9fa1-bece0497025d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1206155458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfae94c7c-65", "ovs_interfaceid": "fae94c7c-6554-49a7-a221-43d18d1e95e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:10:56 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:9d:86,bridge_name='br-int',has_traffic_filtering=True,id=fae94c7c-6554-49a7-a221-43d18d1e95e0,network=Network(22cdcc96-2021-437d-9fa1-bece0497025d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfae94c7c-65') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:10:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T08:10:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-758967957',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-758967957',id=11,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbZVUH/X9/g3qhx/QO8l72lfDEt+C9X9Z6weUibGQiHc28yEhmZMMQoZFFfhUqXnOPDCGgwnjkX76jUoX2h70Sx75kIWvX0KaOE6PQPo0AMGmDacZo4ev1tywwnYEkgNg==',key_name='tempest-keypair-786167401',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e2ffe5715db4f6ebcd4237eaa12305a',ramdisk_id='',reservation_id='r-wkd8jere',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1329538542',owner_user_name='tempest-TaggedBootDevicesTest_v242-1329538542-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:10:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30338a0bc0734be2beb2cb994fdb85d7',uuid=35e88686-253e-452a-9649-8aa2a04128ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cdfe5e3f-2910-43a2-8d16-132d69d647d5", "address": "fa:16:3e:9e:d6:aa", "network": {"id": "22cdcc96-2021-437d-9fa1-bece0497025d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1206155458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdfe5e3f-29", "ovs_interfaceid": "cdfe5e3f-2910-43a2-8d16-132d69d647d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:10:56 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Converting VIF {"id": "cdfe5e3f-2910-43a2-8d16-132d69d647d5", "address": "fa:16:3e:9e:d6:aa", "network": {"id": "22cdcc96-2021-437d-9fa1-bece0497025d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1206155458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdfe5e3f-29", "ovs_interfaceid": "cdfe5e3f-2910-43a2-8d16-132d69d647d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:10:56 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:d6:aa,bridge_name='br-int',has_traffic_filtering=True,id=cdfe5e3f-2910-43a2-8d16-132d69d647d5,network=Network(22cdcc96-2021-437d-9fa1-bece0497025d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdfe5e3f-29') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:10:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T08:10:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-758967957',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-758967957',id=11,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbZVUH/X9/g3qhx/QO8l72lfDEt+C9X9Z6weUibGQiHc28yEhmZMMQoZFFfhUqXnOPDCGgwnjkX76jUoX2h70Sx75kIWvX0KaOE6PQPo0AMGmDacZo4ev1tywwnYEkgNg==',key_name='tempest-keypair-786167401',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e2ffe5715db4f6ebcd4237eaa12305a',ramdisk_id='',reservation_id='r-wkd8jere',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1329538542',owner_user_name='tempest-TaggedBootDevicesTest_v242-1329538542-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:10:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30338a0bc0734be2beb2cb994fdb85d7',uuid=35e88686-253e-452a-9649-8aa2a04128ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa13aa7e-d38c-487f-8c4f-0f1cd51a18eb", "address": "fa:16:3e:0f:9b:7a", "network": {"id": "22cdcc96-2021-437d-9fa1-bece0497025d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1206155458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa13aa7e-d3", "ovs_interfaceid": "aa13aa7e-d38c-487f-8c4f-0f1cd51a18eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:10:56 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Converting VIF {"id": "aa13aa7e-d38c-487f-8c4f-0f1cd51a18eb", "address": "fa:16:3e:0f:9b:7a", "network": {"id": "22cdcc96-2021-437d-9fa1-bece0497025d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1206155458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa13aa7e-d3", "ovs_interfaceid": "aa13aa7e-d38c-487f-8c4f-0f1cd51a18eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:10:56 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:9b:7a,bridge_name='br-int',has_traffic_filtering=True,id=aa13aa7e-d38c-487f-8c4f-0f1cd51a18eb,network=Network(22cdcc96-2021-437d-9fa1-bece0497025d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa13aa7e-d3') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:10:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T08:10:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-758967957',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-758967957',id=11,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbZVUH/X9/g3qhx/QO8l72lfDEt+C9X9Z6weUibGQiHc28yEhmZMMQoZFFfhUqXnOPDCGgwnjkX76jUoX2h70Sx75kIWvX0KaOE6PQPo0AMGmDacZo4ev1tywwnYEkgNg==',key_name='tempest-keypair-786167401',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e2ffe5715db4f6ebcd4237eaa12305a',ramdisk_id='',reservation_id='r-wkd8jere',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1329538542',owner_user_name='tempest-TaggedBootDevicesTest_v242-1329538542-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:10:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30338a0bc0734be2beb2cb994fdb85d7',uuid=35e88686-253e-452a-9649-8aa2a04128ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48912f9e-eeae-4f51-8123-8316a6fcc15e", "address": "fa:16:3e:92:f8:11", "network": {"id": "1e721803-a83d-4c10-ba12-7b70b3b0fa23", "bridge": "br-int", "label": "tempest-device-tagging-net2-1574523632", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48912f9e-ee", "ovs_interfaceid": "48912f9e-eeae-4f51-8123-8316a6fcc15e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:10:56 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Converting VIF {"id": "48912f9e-eeae-4f51-8123-8316a6fcc15e", "address": "fa:16:3e:92:f8:11", "network": {"id": "1e721803-a83d-4c10-ba12-7b70b3b0fa23", "bridge": "br-int", "label": "tempest-device-tagging-net2-1574523632", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48912f9e-ee", "ovs_interfaceid": "48912f9e-eeae-4f51-8123-8316a6fcc15e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:10:56 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:f8:11,bridge_name='br-int',has_traffic_filtering=True,id=48912f9e-eeae-4f51-8123-8316a6fcc15e,network=Network(1e721803-a83d-4c10-ba12-7b70b3b0fa23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48912f9e-ee') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:10:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T08:10:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-758967957',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-758967957',id=11,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbZVUH/X9/g3qhx/QO8l72lfDEt+C9X9Z6weUibGQiHc28yEhmZMMQoZFFfhUqXnOPDCGgwnjkX76jUoX2h70Sx75kIWvX0KaOE6PQPo0AMGmDacZo4ev1tywwnYEkgNg==',key_name='tempest-keypair-786167401',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e2ffe5715db4f6ebcd4237eaa12305a',ramdisk_id='',reservation_id='r-wkd8jere',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1329538542',owner_user_name='tempest-TaggedBootDevicesTest_v242-1329538542-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:10:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30338a0bc0734be2beb2cb994fdb85d7',uuid=35e88686-253e-452a-9649-8aa2a04128ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a35017f-b57c-4937-9479-22494bffb5b7", "address": "fa:16:3e:42:0c:b6", "network": {"id": "1e721803-a83d-4c10-ba12-7b70b3b0fa23", "bridge": "br-int", "label": "tempest-device-tagging-net2-1574523632", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a35017f-b5", "ovs_interfaceid": "0a35017f-b57c-4937-9479-22494bffb5b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:10:56 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Converting VIF {"id": "0a35017f-b57c-4937-9479-22494bffb5b7", "address": "fa:16:3e:42:0c:b6", "network": {"id": "1e721803-a83d-4c10-ba12-7b70b3b0fa23", "bridge": "br-int", "label": "tempest-device-tagging-net2-1574523632", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a35017f-b5", "ovs_interfaceid": "0a35017f-b57c-4937-9479-22494bffb5b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:10:56 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:0c:b6,bridge_name='br-int',has_traffic_filtering=True,id=0a35017f-b57c-4937-9479-22494bffb5b7,network=Network(1e721803-a83d-4c10-ba12-7b70b3b0fa23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a35017f-b5') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:10:56 user nova-compute[95467]: DEBUG nova.objects.instance [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Lazy-loading 'pci_devices' on Instance uuid 35e88686-253e-452a-9649-8aa2a04128ce {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:10:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:10:56 user nova-compute[95467]:   <uuid>35e88686-253e-452a-9649-8aa2a04128ce</uuid>
Nov 15 08:10:56 user nova-compute[95467]:   <name>instance-0000000b</name>
Nov 15 08:10:56 user nova-compute[95467]:   <memory>524288</memory>
Nov 15 08:10:56 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:10:56 user nova-compute[95467]:   <metadata>
Nov 15 08:10:56 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:10:56 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:10:56 user nova-compute[95467]:       <nova:name>tempest-device-tagging-server-758967957</nova:name>
Nov 15 08:10:56 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:10:52</nova:creationTime>
Nov 15 08:10:56 user nova-compute[95467]:       <nova:flavor name="m1.tiny">
Nov 15 08:10:56 user nova-compute[95467]:         <nova:memory>512</nova:memory>
Nov 15 08:10:56 user nova-compute[95467]:         <nova:disk>1</nova:disk>
Nov 15 08:10:56 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:10:56 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:10:56 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:10:56 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:10:56 user nova-compute[95467]:       <nova:owner>
Nov 15 08:10:56 user nova-compute[95467]:         <nova:user uuid="30338a0bc0734be2beb2cb994fdb85d7">tempest-TaggedBootDevicesTest_v242-1329538542-project-member</nova:user>
Nov 15 08:10:56 user nova-compute[95467]:         <nova:project uuid="0e2ffe5715db4f6ebcd4237eaa12305a">tempest-TaggedBootDevicesTest_v242-1329538542</nova:project>
Nov 15 08:10:56 user nova-compute[95467]:       </nova:owner>
Nov 15 08:10:56 user nova-compute[95467]:       <nova:root type="image" uuid="ed9c48aa-ce73-4b3b-9db1-235898be671b"/>
Nov 15 08:10:56 user nova-compute[95467]:       <nova:ports>
Nov 15 08:10:56 user nova-compute[95467]:         <nova:port uuid="89c9bfb4-6b7a-4635-ba8d-2b0370fafb8b">
Nov 15 08:10:56 user nova-compute[95467]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 08:10:56 user nova-compute[95467]:         </nova:port>
Nov 15 08:10:56 user nova-compute[95467]:         <nova:port uuid="92307630-ea94-407f-b852-ee250debc046">
Nov 15 08:10:56 user nova-compute[95467]:           <nova:ip type="fixed" address="10.1.1.24" ipVersion="4"/>
Nov 15 08:10:56 user nova-compute[95467]:         </nova:port>
Nov 15 08:10:56 user nova-compute[95467]:         <nova:port uuid="fae94c7c-6554-49a7-a221-43d18d1e95e0">
Nov 15 08:10:56 user nova-compute[95467]:           <nova:ip type="fixed" address="10.1.1.64" ipVersion="4"/>
Nov 15 08:10:56 user nova-compute[95467]:         </nova:port>
Nov 15 08:10:56 user nova-compute[95467]:         <nova:port uuid="cdfe5e3f-2910-43a2-8d16-132d69d647d5">
Nov 15 08:10:56 user nova-compute[95467]:           <nova:ip type="fixed" address="10.1.1.183" ipVersion="4"/>
Nov 15 08:10:56 user nova-compute[95467]:         </nova:port>
Nov 15 08:10:56 user nova-compute[95467]:         <nova:port uuid="aa13aa7e-d38c-487f-8c4f-0f1cd51a18eb">
Nov 15 08:10:56 user nova-compute[95467]:           <nova:ip type="fixed" address="10.1.1.21" ipVersion="4"/>
Nov 15 08:10:56 user nova-compute[95467]:         </nova:port>
Nov 15 08:10:56 user nova-compute[95467]:         <nova:port uuid="48912f9e-eeae-4f51-8123-8316a6fcc15e">
Nov 15 08:10:56 user nova-compute[95467]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 15 08:10:56 user nova-compute[95467]:         </nova:port>
Nov 15 08:10:56 user nova-compute[95467]:         <nova:port uuid="0a35017f-b57c-4937-9479-22494bffb5b7">
Nov 15 08:10:56 user nova-compute[95467]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 15 08:10:56 user nova-compute[95467]:         </nova:port>
Nov 15 08:10:56 user nova-compute[95467]:       </nova:ports>
Nov 15 08:10:56 user nova-compute[95467]:     </nova:instance>
Nov 15 08:10:56 user nova-compute[95467]:   </metadata>
Nov 15 08:10:56 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:10:56 user nova-compute[95467]:     <system>
Nov 15 08:10:56 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:10:56 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:10:56 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:10:56 user nova-compute[95467]:       <entry name="serial">35e88686-253e-452a-9649-8aa2a04128ce</entry>
Nov 15 08:10:56 user nova-compute[95467]:       <entry name="uuid">35e88686-253e-452a-9649-8aa2a04128ce</entry>
Nov 15 08:10:56 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:10:56 user nova-compute[95467]:     </system>
Nov 15 08:10:56 user nova-compute[95467]:   </sysinfo>
Nov 15 08:10:56 user nova-compute[95467]:   <os>
Nov 15 08:10:56 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:10:56 user nova-compute[95467]:     <boot dev="hd"/>
Nov 15 08:10:56 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:10:56 user nova-compute[95467]:   </os>
Nov 15 08:10:56 user nova-compute[95467]:   <features>
Nov 15 08:10:56 user nova-compute[95467]:     <acpi/>
Nov 15 08:10:56 user nova-compute[95467]:     <apic/>
Nov 15 08:10:56 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:10:56 user nova-compute[95467]:   </features>
Nov 15 08:10:56 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:10:56 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:10:56 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:10:56 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:10:56 user nova-compute[95467]:   </clock>
Nov 15 08:10:56 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:10:56 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:10:56 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:10:56 user nova-compute[95467]:   </cpu>
Nov 15 08:10:56 user nova-compute[95467]:   <devices>
Nov 15 08:10:56 user nova-compute[95467]:     <disk type="file" device="cdrom">
Nov 15 08:10:56 user nova-compute[95467]:       <driver name="qemu" type="raw" cache="none"/>
Nov 15 08:10:56 user nova-compute[95467]:       <source file="/opt/stack/data/nova/instances/35e88686-253e-452a-9649-8aa2a04128ce/disk.config"/>
Nov 15 08:10:56 user nova-compute[95467]:       <target dev="hda" bus="ide"/>
Nov 15 08:10:56 user nova-compute[95467]:     </disk>
Nov 15 08:10:56 user nova-compute[95467]:     <disk type="block" device="disk">
Nov 15 08:10:56 user nova-compute[95467]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:10:56 user nova-compute[95467]:       <source dev="/dev/sdc"/>
Nov 15 08:10:56 user nova-compute[95467]:       <target dev="vda" bus="virtio"/>
Nov 15 08:10:56 user nova-compute[95467]:       <serial>8d4b7008-9243-4206-a1e7-bddc82e2d5c8</serial>
Nov 15 08:10:56 user nova-compute[95467]:     </disk>
Nov 15 08:10:56 user nova-compute[95467]:     <disk type="block" device="disk">
Nov 15 08:10:56 user nova-compute[95467]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:10:56 user nova-compute[95467]:       <source dev="/dev/sdd"/>
Nov 15 08:10:56 user nova-compute[95467]:       <target dev="vdb" bus="virtio"/>
Nov 15 08:10:56 user nova-compute[95467]:       <serial>aee0d1b6-eb0f-452e-90e9-fcabb9014c05</serial>
Nov 15 08:10:56 user nova-compute[95467]:     </disk>
Nov 15 08:10:56 user nova-compute[95467]:     <disk type="block" device="disk">
Nov 15 08:10:56 user nova-compute[95467]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:10:56 user nova-compute[95467]:       <source dev="/dev/sde"/>
Nov 15 08:10:56 user nova-compute[95467]:       <target dev="vdc" bus="virtio"/>
Nov 15 08:10:56 user nova-compute[95467]:       <serial>5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5</serial>
Nov 15 08:10:56 user nova-compute[95467]:     </disk>
Nov 15 08:10:56 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:10:56 user nova-compute[95467]:       <mac address="fa:16:3e:51:c9:81"/>
Nov 15 08:10:56 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:10:56 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:10:56 user nova-compute[95467]:       <target dev="tap89c9bfb4-6b"/>
Nov 15 08:10:56 user nova-compute[95467]:     </interface>
Nov 15 08:10:56 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:10:56 user nova-compute[95467]:       <mac address="fa:16:3e:7f:f7:1a"/>
Nov 15 08:10:56 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:10:56 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:10:56 user nova-compute[95467]:       <target dev="tap92307630-ea"/>
Nov 15 08:10:56 user nova-compute[95467]:     </interface>
Nov 15 08:10:56 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:10:56 user nova-compute[95467]:       <mac address="fa:16:3e:d9:9d:86"/>
Nov 15 08:10:56 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:10:56 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:10:56 user nova-compute[95467]:       <target dev="tapfae94c7c-65"/>
Nov 15 08:10:56 user nova-compute[95467]:     </interface>
Nov 15 08:10:56 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:10:56 user nova-compute[95467]:       <mac address="fa:16:3e:9e:d6:aa"/>
Nov 15 08:10:56 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:10:56 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:10:56 user nova-compute[95467]:       <target dev="tapcdfe5e3f-29"/>
Nov 15 08:10:56 user nova-compute[95467]:     </interface>
Nov 15 08:10:56 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:10:56 user nova-compute[95467]:       <mac address="fa:16:3e:0f:9b:7a"/>
Nov 15 08:10:56 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:10:56 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:10:56 user nova-compute[95467]:       <target dev="tapaa13aa7e-d3"/>
Nov 15 08:10:56 user nova-compute[95467]:     </interface>
Nov 15 08:10:56 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:10:56 user nova-compute[95467]:       <mac address="fa:16:3e:92:f8:11"/>
Nov 15 08:10:56 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:10:56 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:10:56 user nova-compute[95467]:       <target dev="tap48912f9e-ee"/>
Nov 15 08:10:56 user nova-compute[95467]:     </interface>
Nov 15 08:10:56 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:10:56 user nova-compute[95467]:       <mac address="fa:16:3e:42:0c:b6"/>
Nov 15 08:10:56 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:10:56 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:10:56 user nova-compute[95467]:       <target dev="tap0a35017f-b5"/>
Nov 15 08:10:56 user nova-compute[95467]:     </interface>
Nov 15 08:10:56 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:10:56 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/35e88686-253e-452a-9649-8aa2a04128ce/console.log" append="off"/>
Nov 15 08:10:56 user nova-compute[95467]:     </serial>
Nov 15 08:10:56 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:10:56 user nova-compute[95467]:     <video>
Nov 15 08:10:56 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:10:56 user nova-compute[95467]:     </video>
Nov 15 08:10:56 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:10:56 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:10:56 user nova-compute[95467]:     </rng>
Nov 15 08:10:56 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:10:56 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:10:56 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:10:56 user nova-compute[95467]:     </memballoon>
Nov 15 08:10:56 user nova-compute[95467]:   </devices>
Nov 15 08:10:56 user nova-compute[95467]: </domain>
Nov 15 08:10:56 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:10:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T08:10:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-758967957',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-758967957',id=11,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbZVUH/X9/g3qhx/QO8l72lfDEt+C9X9Z6weUibGQiHc28yEhmZMMQoZFFfhUqXnOPDCGgwnjkX76jUoX2h70Sx75kIWvX0KaOE6PQPo0AMGmDacZo4ev1tywwnYEkgNg==',key_name='tempest-keypair-786167401',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e2ffe5715db4f6ebcd4237eaa12305a',ramdisk_id='',reservation_id='r-wkd8jere',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1329538542',owner_user_name='tempest-TaggedBootDevicesTest_v242-1329538542-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:10:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30338a0bc0734be2beb2cb994fdb85d7',uuid=35e88686-253e-452a-9649-8aa2a04128ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89c9bfb4-6b7a-4635-ba8d-2b0370fafb8b", "address": "fa:16:3e:51:c9:81", "network": {"id": "40744d2e-cc7c-4ca4-88b6-de3cb34a5da5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1986770176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89c9bfb4-6b", "ovs_interfaceid": "89c9bfb4-6b7a-4635-ba8d-2b0370fafb8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:10:56 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Converting VIF {"id": "89c9bfb4-6b7a-4635-ba8d-2b0370fafb8b", "address": "fa:16:3e:51:c9:81", "network": {"id": "40744d2e-cc7c-4ca4-88b6-de3cb34a5da5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1986770176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89c9bfb4-6b", "ovs_interfaceid": "89c9bfb4-6b7a-4635-ba8d-2b0370fafb8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:10:56 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:c9:81,bridge_name='br-int',has_traffic_filtering=True,id=89c9bfb4-6b7a-4635-ba8d-2b0370fafb8b,network=Network(40744d2e-cc7c-4ca4-88b6-de3cb34a5da5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89c9bfb4-6b') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:10:56 user nova-compute[95467]: DEBUG os_vif [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:c9:81,bridge_name='br-int',has_traffic_filtering=True,id=89c9bfb4-6b7a-4635-ba8d-2b0370fafb8b,network=Network(40744d2e-cc7c-4ca4-88b6-de3cb34a5da5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89c9bfb4-6b') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:10:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:10:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2b530e29-bf3c-56de-9df9-e1cd1c295bab', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:10:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap89c9bfb4-6b, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap89c9bfb4-6b, col_values=(('qos', UUID('d5484bd9-2e89-4ba0-a011-5e831825a976')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap89c9bfb4-6b, col_values=(('external_ids', {'iface-id': '89c9bfb4-6b7a-4635-ba8d-2b0370fafb8b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:c9:81', 'vm-uuid': '35e88686-253e-452a-9649-8aa2a04128ce'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:10:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:56 user nova-compute[95467]: INFO os_vif [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:c9:81,bridge_name='br-int',has_traffic_filtering=True,id=89c9bfb4-6b7a-4635-ba8d-2b0370fafb8b,network=Network(40744d2e-cc7c-4ca4-88b6-de3cb34a5da5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89c9bfb4-6b')
Nov 15 08:10:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T08:10:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-758967957',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-758967957',id=11,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbZVUH/X9/g3qhx/QO8l72lfDEt+C9X9Z6weUibGQiHc28yEhmZMMQoZFFfhUqXnOPDCGgwnjkX76jUoX2h70Sx75kIWvX0KaOE6PQPo0AMGmDacZo4ev1tywwnYEkgNg==',key_name='tempest-keypair-786167401',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e2ffe5715db4f6ebcd4237eaa12305a',ramdisk_id='',reservation_id='r-wkd8jere',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1329538542',owner_user_name='tempest-TaggedBootDevicesTest_v242-1329538542-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:10:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30338a0bc0734be2beb2cb994fdb85d7',uuid=35e88686-253e-452a-9649-8aa2a04128ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92307630-ea94-407f-b852-ee250debc046", "address": "fa:16:3e:7f:f7:1a", "network": {"id": "22cdcc96-2021-437d-9fa1-bece0497025d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1206155458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92307630-ea", "ovs_interfaceid": "92307630-ea94-407f-b852-ee250debc046", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:10:56 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Converting VIF {"id": "92307630-ea94-407f-b852-ee250debc046", "address": "fa:16:3e:7f:f7:1a", "network": {"id": "22cdcc96-2021-437d-9fa1-bece0497025d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1206155458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92307630-ea", "ovs_interfaceid": "92307630-ea94-407f-b852-ee250debc046", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:10:56 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:f7:1a,bridge_name='br-int',has_traffic_filtering=True,id=92307630-ea94-407f-b852-ee250debc046,network=Network(22cdcc96-2021-437d-9fa1-bece0497025d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap92307630-ea') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:10:56 user nova-compute[95467]: DEBUG os_vif [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:f7:1a,bridge_name='br-int',has_traffic_filtering=True,id=92307630-ea94-407f-b852-ee250debc046,network=Network(22cdcc96-2021-437d-9fa1-bece0497025d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap92307630-ea') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:10:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:10:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '88ac48ad-e210-5c14-be57-a0778d1b5158', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:10:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap92307630-ea, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap92307630-ea, col_values=(('qos', UUID('1b8f6a36-9ef4-4697-bdd3-0242a182a667')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap92307630-ea, col_values=(('external_ids', {'iface-id': '92307630-ea94-407f-b852-ee250debc046', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:f7:1a', 'vm-uuid': '35e88686-253e-452a-9649-8aa2a04128ce'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:10:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:56 user nova-compute[95467]: INFO os_vif [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:f7:1a,bridge_name='br-int',has_traffic_filtering=True,id=92307630-ea94-407f-b852-ee250debc046,network=Network(22cdcc96-2021-437d-9fa1-bece0497025d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap92307630-ea')
Nov 15 08:10:57 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T08:10:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-758967957',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-758967957',id=11,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbZVUH/X9/g3qhx/QO8l72lfDEt+C9X9Z6weUibGQiHc28yEhmZMMQoZFFfhUqXnOPDCGgwnjkX76jUoX2h70Sx75kIWvX0KaOE6PQPo0AMGmDacZo4ev1tywwnYEkgNg==',key_name='tempest-keypair-786167401',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e2ffe5715db4f6ebcd4237eaa12305a',ramdisk_id='',reservation_id='r-wkd8jere',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1329538542',owner_user_name='tempest-TaggedBootDevicesTest_v242-1329538542-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:10:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30338a0bc0734be2beb2cb994fdb85d7',uuid=35e88686-253e-452a-9649-8aa2a04128ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fae94c7c-6554-49a7-a221-43d18d1e95e0", "address": "fa:16:3e:d9:9d:86", "network": {"id": "22cdcc96-2021-437d-9fa1-bece0497025d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1206155458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfae94c7c-65", "ovs_interfaceid": "fae94c7c-6554-49a7-a221-43d18d1e95e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Converting VIF {"id": "fae94c7c-6554-49a7-a221-43d18d1e95e0", "address": "fa:16:3e:d9:9d:86", "network": {"id": "22cdcc96-2021-437d-9fa1-bece0497025d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1206155458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfae94c7c-65", "ovs_interfaceid": "fae94c7c-6554-49a7-a221-43d18d1e95e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:9d:86,bridge_name='br-int',has_traffic_filtering=True,id=fae94c7c-6554-49a7-a221-43d18d1e95e0,network=Network(22cdcc96-2021-437d-9fa1-bece0497025d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfae94c7c-65') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG os_vif [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:9d:86,bridge_name='br-int',has_traffic_filtering=True,id=fae94c7c-6554-49a7-a221-43d18d1e95e0,network=Network(22cdcc96-2021-437d-9fa1-bece0497025d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfae94c7c-65') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd205b209-8af8-5784-8c37-ec86ed8d39dc', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfae94c7c-65, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfae94c7c-65, col_values=(('qos', UUID('1428496d-2394-49bd-87e2-7669fc466a8e')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfae94c7c-65, col_values=(('external_ids', {'iface-id': 'fae94c7c-6554-49a7-a221-43d18d1e95e0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:9d:86', 'vm-uuid': '35e88686-253e-452a-9649-8aa2a04128ce'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:57 user nova-compute[95467]: INFO os_vif [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:9d:86,bridge_name='br-int',has_traffic_filtering=True,id=fae94c7c-6554-49a7-a221-43d18d1e95e0,network=Network(22cdcc96-2021-437d-9fa1-bece0497025d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfae94c7c-65')
Nov 15 08:10:57 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T08:10:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-758967957',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-758967957',id=11,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbZVUH/X9/g3qhx/QO8l72lfDEt+C9X9Z6weUibGQiHc28yEhmZMMQoZFFfhUqXnOPDCGgwnjkX76jUoX2h70Sx75kIWvX0KaOE6PQPo0AMGmDacZo4ev1tywwnYEkgNg==',key_name='tempest-keypair-786167401',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e2ffe5715db4f6ebcd4237eaa12305a',ramdisk_id='',reservation_id='r-wkd8jere',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1329538542',owner_user_name='tempest-TaggedBootDevicesTest_v242-1329538542-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:10:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30338a0bc0734be2beb2cb994fdb85d7',uuid=35e88686-253e-452a-9649-8aa2a04128ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cdfe5e3f-2910-43a2-8d16-132d69d647d5", "address": "fa:16:3e:9e:d6:aa", "network": {"id": "22cdcc96-2021-437d-9fa1-bece0497025d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1206155458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdfe5e3f-29", "ovs_interfaceid": "cdfe5e3f-2910-43a2-8d16-132d69d647d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Converting VIF {"id": "cdfe5e3f-2910-43a2-8d16-132d69d647d5", "address": "fa:16:3e:9e:d6:aa", "network": {"id": "22cdcc96-2021-437d-9fa1-bece0497025d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1206155458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdfe5e3f-29", "ovs_interfaceid": "cdfe5e3f-2910-43a2-8d16-132d69d647d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:d6:aa,bridge_name='br-int',has_traffic_filtering=True,id=cdfe5e3f-2910-43a2-8d16-132d69d647d5,network=Network(22cdcc96-2021-437d-9fa1-bece0497025d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdfe5e3f-29') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG os_vif [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:d6:aa,bridge_name='br-int',has_traffic_filtering=True,id=cdfe5e3f-2910-43a2-8d16-132d69d647d5,network=Network(22cdcc96-2021-437d-9fa1-bece0497025d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdfe5e3f-29') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'baa7d366-ea1d-5c8b-953c-ddbfde6003b5', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcdfe5e3f-29, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcdfe5e3f-29, col_values=(('qos', UUID('7c6bd6c5-8030-4b42-b204-6fdf75f7e68d')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcdfe5e3f-29, col_values=(('external_ids', {'iface-id': 'cdfe5e3f-2910-43a2-8d16-132d69d647d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:d6:aa', 'vm-uuid': '35e88686-253e-452a-9649-8aa2a04128ce'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:57 user nova-compute[95467]: INFO os_vif [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:d6:aa,bridge_name='br-int',has_traffic_filtering=True,id=cdfe5e3f-2910-43a2-8d16-132d69d647d5,network=Network(22cdcc96-2021-437d-9fa1-bece0497025d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdfe5e3f-29')
Nov 15 08:10:57 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T08:10:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-758967957',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-758967957',id=11,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbZVUH/X9/g3qhx/QO8l72lfDEt+C9X9Z6weUibGQiHc28yEhmZMMQoZFFfhUqXnOPDCGgwnjkX76jUoX2h70Sx75kIWvX0KaOE6PQPo0AMGmDacZo4ev1tywwnYEkgNg==',key_name='tempest-keypair-786167401',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e2ffe5715db4f6ebcd4237eaa12305a',ramdisk_id='',reservation_id='r-wkd8jere',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1329538542',owner_user_name='tempest-TaggedBootDevicesTest_v242-1329538542-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:10:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30338a0bc0734be2beb2cb994fdb85d7',uuid=35e88686-253e-452a-9649-8aa2a04128ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa13aa7e-d38c-487f-8c4f-0f1cd51a18eb", "address": "fa:16:3e:0f:9b:7a", "network": {"id": "22cdcc96-2021-437d-9fa1-bece0497025d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1206155458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa13aa7e-d3", "ovs_interfaceid": "aa13aa7e-d38c-487f-8c4f-0f1cd51a18eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Converting VIF {"id": "aa13aa7e-d38c-487f-8c4f-0f1cd51a18eb", "address": "fa:16:3e:0f:9b:7a", "network": {"id": "22cdcc96-2021-437d-9fa1-bece0497025d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1206155458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa13aa7e-d3", "ovs_interfaceid": "aa13aa7e-d38c-487f-8c4f-0f1cd51a18eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:9b:7a,bridge_name='br-int',has_traffic_filtering=True,id=aa13aa7e-d38c-487f-8c4f-0f1cd51a18eb,network=Network(22cdcc96-2021-437d-9fa1-bece0497025d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa13aa7e-d3') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG os_vif [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:9b:7a,bridge_name='br-int',has_traffic_filtering=True,id=aa13aa7e-d38c-487f-8c4f-0f1cd51a18eb,network=Network(22cdcc96-2021-437d-9fa1-bece0497025d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa13aa7e-d3') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '73435df4-5744-55fe-a229-da1792aec144', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaa13aa7e-d3, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaa13aa7e-d3, col_values=(('qos', UUID('902eedcd-54e5-4354-a1e6-42bdb11c1d3a')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaa13aa7e-d3, col_values=(('external_ids', {'iface-id': 'aa13aa7e-d38c-487f-8c4f-0f1cd51a18eb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:9b:7a', 'vm-uuid': '35e88686-253e-452a-9649-8aa2a04128ce'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:57 user nova-compute[95467]: INFO os_vif [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:9b:7a,bridge_name='br-int',has_traffic_filtering=True,id=aa13aa7e-d38c-487f-8c4f-0f1cd51a18eb,network=Network(22cdcc96-2021-437d-9fa1-bece0497025d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa13aa7e-d3')
Nov 15 08:10:57 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T08:10:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-758967957',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-758967957',id=11,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbZVUH/X9/g3qhx/QO8l72lfDEt+C9X9Z6weUibGQiHc28yEhmZMMQoZFFfhUqXnOPDCGgwnjkX76jUoX2h70Sx75kIWvX0KaOE6PQPo0AMGmDacZo4ev1tywwnYEkgNg==',key_name='tempest-keypair-786167401',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e2ffe5715db4f6ebcd4237eaa12305a',ramdisk_id='',reservation_id='r-wkd8jere',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1329538542',owner_user_name='tempest-TaggedBootDevicesTest_v242-1329538542-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:10:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30338a0bc0734be2beb2cb994fdb85d7',uuid=35e88686-253e-452a-9649-8aa2a04128ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48912f9e-eeae-4f51-8123-8316a6fcc15e", "address": "fa:16:3e:92:f8:11", "network": {"id": "1e721803-a83d-4c10-ba12-7b70b3b0fa23", "bridge": "br-int", "label": "tempest-device-tagging-net2-1574523632", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48912f9e-ee", "ovs_interfaceid": "48912f9e-eeae-4f51-8123-8316a6fcc15e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Converting VIF {"id": "48912f9e-eeae-4f51-8123-8316a6fcc15e", "address": "fa:16:3e:92:f8:11", "network": {"id": "1e721803-a83d-4c10-ba12-7b70b3b0fa23", "bridge": "br-int", "label": "tempest-device-tagging-net2-1574523632", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48912f9e-ee", "ovs_interfaceid": "48912f9e-eeae-4f51-8123-8316a6fcc15e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:f8:11,bridge_name='br-int',has_traffic_filtering=True,id=48912f9e-eeae-4f51-8123-8316a6fcc15e,network=Network(1e721803-a83d-4c10-ba12-7b70b3b0fa23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48912f9e-ee') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG os_vif [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:f8:11,bridge_name='br-int',has_traffic_filtering=True,id=48912f9e-eeae-4f51-8123-8316a6fcc15e,network=Network(1e721803-a83d-4c10-ba12-7b70b3b0fa23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48912f9e-ee') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '78b00268-f357-561f-a6cd-fed0a5c65afa', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap48912f9e-ee, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap48912f9e-ee, col_values=(('qos', UUID('4249ad38-0432-43ec-8d64-457a81d634e9')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap48912f9e-ee, col_values=(('external_ids', {'iface-id': '48912f9e-eeae-4f51-8123-8316a6fcc15e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:f8:11', 'vm-uuid': '35e88686-253e-452a-9649-8aa2a04128ce'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:57 user nova-compute[95467]: INFO os_vif [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:f8:11,bridge_name='br-int',has_traffic_filtering=True,id=48912f9e-eeae-4f51-8123-8316a6fcc15e,network=Network(1e721803-a83d-4c10-ba12-7b70b3b0fa23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48912f9e-ee')
Nov 15 08:10:57 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T08:10:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-758967957',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-758967957',id=11,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbZVUH/X9/g3qhx/QO8l72lfDEt+C9X9Z6weUibGQiHc28yEhmZMMQoZFFfhUqXnOPDCGgwnjkX76jUoX2h70Sx75kIWvX0KaOE6PQPo0AMGmDacZo4ev1tywwnYEkgNg==',key_name='tempest-keypair-786167401',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e2ffe5715db4f6ebcd4237eaa12305a',ramdisk_id='',reservation_id='r-wkd8jere',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1329538542',owner_user_name='tempest-TaggedBootDevicesTest_v242-1329538542-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:10:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30338a0bc0734be2beb2cb994fdb85d7',uuid=35e88686-253e-452a-9649-8aa2a04128ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a35017f-b57c-4937-9479-22494bffb5b7", "address": "fa:16:3e:42:0c:b6", "network": {"id": "1e721803-a83d-4c10-ba12-7b70b3b0fa23", "bridge": "br-int", "label": "tempest-device-tagging-net2-1574523632", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a35017f-b5", "ovs_interfaceid": "0a35017f-b57c-4937-9479-22494bffb5b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Converting VIF {"id": "0a35017f-b57c-4937-9479-22494bffb5b7", "address": "fa:16:3e:42:0c:b6", "network": {"id": "1e721803-a83d-4c10-ba12-7b70b3b0fa23", "bridge": "br-int", "label": "tempest-device-tagging-net2-1574523632", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a35017f-b5", "ovs_interfaceid": "0a35017f-b57c-4937-9479-22494bffb5b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:0c:b6,bridge_name='br-int',has_traffic_filtering=True,id=0a35017f-b57c-4937-9479-22494bffb5b7,network=Network(1e721803-a83d-4c10-ba12-7b70b3b0fa23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a35017f-b5') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG os_vif [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:0c:b6,bridge_name='br-int',has_traffic_filtering=True,id=0a35017f-b57c-4937-9479-22494bffb5b7,network=Network(1e721803-a83d-4c10-ba12-7b70b3b0fa23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a35017f-b5') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '82a779ac-6851-5b1c-b24d-c079e5388ebf', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0a35017f-b5, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0a35017f-b5, col_values=(('qos', UUID('421aefdd-e5b3-41a8-b680-36be60b0911c')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0a35017f-b5, col_values=(('external_ids', {'iface-id': '0a35017f-b57c-4937-9479-22494bffb5b7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:0c:b6', 'vm-uuid': '35e88686-253e-452a-9649-8aa2a04128ce'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:57 user nova-compute[95467]: INFO os_vif [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:0c:b6,bridge_name='br-int',has_traffic_filtering=True,id=0a35017f-b57c-4937-9479-22494bffb5b7,network=Network(1e721803-a83d-4c10-ba12-7b70b3b0fa23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a35017f-b5')
Nov 15 08:10:57 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] No BDM found with device name hda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] No BDM found with device name vdc, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] No VIF found with MAC fa:16:3e:51:c9:81, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] No VIF found with MAC fa:16:3e:0f:9b:7a, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:10:57 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Using config drive
Nov 15 08:10:57 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Creating config drive at /opt/stack/data/nova/instances/35e88686-253e-452a-9649-8aa2a04128ce/disk.config
Nov 15 08:10:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/35e88686-253e-452a-9649-8aa2a04128ce/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp61qo9trj {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:10:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/35e88686-253e-452a-9649-8aa2a04128ce/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp61qo9trj" returned: 0 in 0.067s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:10:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:59 user nova-compute[95467]: DEBUG nova.compute.manager [req-fce3b197-3df2-476c-b977-0bff33480085 req-2e24ff7e-f618-4225-9f24-4e42ad62c516 service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Received event network-vif-plugged-89c9bfb4-6b7a-4635-ba8d-2b0370fafb8b {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:10:59 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-fce3b197-3df2-476c-b977-0bff33480085 req-2e24ff7e-f618-4225-9f24-4e42ad62c516 service nova] Acquiring lock "35e88686-253e-452a-9649-8aa2a04128ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:10:59 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-fce3b197-3df2-476c-b977-0bff33480085 req-2e24ff7e-f618-4225-9f24-4e42ad62c516 service nova] Lock "35e88686-253e-452a-9649-8aa2a04128ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:10:59 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-fce3b197-3df2-476c-b977-0bff33480085 req-2e24ff7e-f618-4225-9f24-4e42ad62c516 service nova] Lock "35e88686-253e-452a-9649-8aa2a04128ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:10:59 user nova-compute[95467]: DEBUG nova.compute.manager [req-fce3b197-3df2-476c-b977-0bff33480085 req-2e24ff7e-f618-4225-9f24-4e42ad62c516 service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] No waiting events found dispatching network-vif-plugged-89c9bfb4-6b7a-4635-ba8d-2b0370fafb8b {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:10:59 user nova-compute[95467]: WARNING nova.compute.manager [req-fce3b197-3df2-476c-b977-0bff33480085 req-2e24ff7e-f618-4225-9f24-4e42ad62c516 service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Received unexpected event network-vif-plugged-89c9bfb4-6b7a-4635-ba8d-2b0370fafb8b for instance with vm_state building and task_state spawning.
Nov 15 08:10:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:10:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:00 user nova-compute[95467]: DEBUG nova.compute.manager [req-d66caab0-97e2-4301-9f40-ded2c30f088f req-734b0518-9583-4a2c-9ae7-f1c12e578664 service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Received event network-vif-plugged-92307630-ea94-407f-b852-ee250debc046 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:11:00 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-d66caab0-97e2-4301-9f40-ded2c30f088f req-734b0518-9583-4a2c-9ae7-f1c12e578664 service nova] Acquiring lock "35e88686-253e-452a-9649-8aa2a04128ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:11:00 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-d66caab0-97e2-4301-9f40-ded2c30f088f req-734b0518-9583-4a2c-9ae7-f1c12e578664 service nova] Lock "35e88686-253e-452a-9649-8aa2a04128ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:11:00 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-d66caab0-97e2-4301-9f40-ded2c30f088f req-734b0518-9583-4a2c-9ae7-f1c12e578664 service nova] Lock "35e88686-253e-452a-9649-8aa2a04128ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:11:00 user nova-compute[95467]: DEBUG nova.compute.manager [req-d66caab0-97e2-4301-9f40-ded2c30f088f req-734b0518-9583-4a2c-9ae7-f1c12e578664 service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] No waiting events found dispatching network-vif-plugged-92307630-ea94-407f-b852-ee250debc046 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:11:00 user nova-compute[95467]: WARNING nova.compute.manager [req-d66caab0-97e2-4301-9f40-ded2c30f088f req-734b0518-9583-4a2c-9ae7-f1c12e578664 service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Received unexpected event network-vif-plugged-92307630-ea94-407f-b852-ee250debc046 for instance with vm_state building and task_state spawning.
Nov 15 08:11:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:00 user nova-compute[95467]: DEBUG nova.compute.manager [req-0b9f4f28-4b70-46fd-91dd-4151643bc194 req-402c61ed-1f4c-437e-b9c2-c7789f8e0173 service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Received event network-vif-plugged-fae94c7c-6554-49a7-a221-43d18d1e95e0 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:11:00 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-0b9f4f28-4b70-46fd-91dd-4151643bc194 req-402c61ed-1f4c-437e-b9c2-c7789f8e0173 service nova] Acquiring lock "35e88686-253e-452a-9649-8aa2a04128ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:11:00 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-0b9f4f28-4b70-46fd-91dd-4151643bc194 req-402c61ed-1f4c-437e-b9c2-c7789f8e0173 service nova] Lock "35e88686-253e-452a-9649-8aa2a04128ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:11:00 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-0b9f4f28-4b70-46fd-91dd-4151643bc194 req-402c61ed-1f4c-437e-b9c2-c7789f8e0173 service nova] Lock "35e88686-253e-452a-9649-8aa2a04128ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:11:00 user nova-compute[95467]: DEBUG nova.compute.manager [req-0b9f4f28-4b70-46fd-91dd-4151643bc194 req-402c61ed-1f4c-437e-b9c2-c7789f8e0173 service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] No waiting events found dispatching network-vif-plugged-fae94c7c-6554-49a7-a221-43d18d1e95e0 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:11:00 user nova-compute[95467]: WARNING nova.compute.manager [req-0b9f4f28-4b70-46fd-91dd-4151643bc194 req-402c61ed-1f4c-437e-b9c2-c7789f8e0173 service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Received unexpected event network-vif-plugged-fae94c7c-6554-49a7-a221-43d18d1e95e0 for instance with vm_state building and task_state spawning.
Nov 15 08:11:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:01 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:01 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:01 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:01 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:01 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:01 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:01 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:01 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:01 user nova-compute[95467]: DEBUG nova.compute.manager [req-ce10e057-cfaa-4b66-a702-1864031feb61 req-3b721034-73f0-4d89-9dc2-76062aa8408a service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Received event network-vif-plugged-89c9bfb4-6b7a-4635-ba8d-2b0370fafb8b {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:11:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ce10e057-cfaa-4b66-a702-1864031feb61 req-3b721034-73f0-4d89-9dc2-76062aa8408a service nova] Acquiring lock "35e88686-253e-452a-9649-8aa2a04128ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:11:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ce10e057-cfaa-4b66-a702-1864031feb61 req-3b721034-73f0-4d89-9dc2-76062aa8408a service nova] Lock "35e88686-253e-452a-9649-8aa2a04128ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:11:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ce10e057-cfaa-4b66-a702-1864031feb61 req-3b721034-73f0-4d89-9dc2-76062aa8408a service nova] Lock "35e88686-253e-452a-9649-8aa2a04128ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:11:01 user nova-compute[95467]: DEBUG nova.compute.manager [req-ce10e057-cfaa-4b66-a702-1864031feb61 req-3b721034-73f0-4d89-9dc2-76062aa8408a service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] No waiting events found dispatching network-vif-plugged-89c9bfb4-6b7a-4635-ba8d-2b0370fafb8b {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:11:01 user nova-compute[95467]: WARNING nova.compute.manager [req-ce10e057-cfaa-4b66-a702-1864031feb61 req-3b721034-73f0-4d89-9dc2-76062aa8408a service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Received unexpected event network-vif-plugged-89c9bfb4-6b7a-4635-ba8d-2b0370fafb8b for instance with vm_state building and task_state spawning.
Nov 15 08:11:01 user nova-compute[95467]: DEBUG nova.compute.manager [req-ce10e057-cfaa-4b66-a702-1864031feb61 req-3b721034-73f0-4d89-9dc2-76062aa8408a service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Received event network-vif-plugged-48912f9e-eeae-4f51-8123-8316a6fcc15e {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:11:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ce10e057-cfaa-4b66-a702-1864031feb61 req-3b721034-73f0-4d89-9dc2-76062aa8408a service nova] Acquiring lock "35e88686-253e-452a-9649-8aa2a04128ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:11:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ce10e057-cfaa-4b66-a702-1864031feb61 req-3b721034-73f0-4d89-9dc2-76062aa8408a service nova] Lock "35e88686-253e-452a-9649-8aa2a04128ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:11:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ce10e057-cfaa-4b66-a702-1864031feb61 req-3b721034-73f0-4d89-9dc2-76062aa8408a service nova] Lock "35e88686-253e-452a-9649-8aa2a04128ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:11:01 user nova-compute[95467]: DEBUG nova.compute.manager [req-ce10e057-cfaa-4b66-a702-1864031feb61 req-3b721034-73f0-4d89-9dc2-76062aa8408a service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] No waiting events found dispatching network-vif-plugged-48912f9e-eeae-4f51-8123-8316a6fcc15e {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:11:01 user nova-compute[95467]: WARNING nova.compute.manager [req-ce10e057-cfaa-4b66-a702-1864031feb61 req-3b721034-73f0-4d89-9dc2-76062aa8408a service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Received unexpected event network-vif-plugged-48912f9e-eeae-4f51-8123-8316a6fcc15e for instance with vm_state building and task_state spawning.
Nov 15 08:11:01 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:01 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:01 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:01 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:02 user nova-compute[95467]: DEBUG nova.compute.manager [req-94e77571-d18f-4167-9285-e21f27ead57f req-8b106dde-58a1-441c-888a-759b17a67fed service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Received event network-vif-plugged-92307630-ea94-407f-b852-ee250debc046 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:11:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-94e77571-d18f-4167-9285-e21f27ead57f req-8b106dde-58a1-441c-888a-759b17a67fed service nova] Acquiring lock "35e88686-253e-452a-9649-8aa2a04128ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:11:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-94e77571-d18f-4167-9285-e21f27ead57f req-8b106dde-58a1-441c-888a-759b17a67fed service nova] Lock "35e88686-253e-452a-9649-8aa2a04128ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:11:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-94e77571-d18f-4167-9285-e21f27ead57f req-8b106dde-58a1-441c-888a-759b17a67fed service nova] Lock "35e88686-253e-452a-9649-8aa2a04128ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:11:02 user nova-compute[95467]: DEBUG nova.compute.manager [req-94e77571-d18f-4167-9285-e21f27ead57f req-8b106dde-58a1-441c-888a-759b17a67fed service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] No waiting events found dispatching network-vif-plugged-92307630-ea94-407f-b852-ee250debc046 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:11:02 user nova-compute[95467]: WARNING nova.compute.manager [req-94e77571-d18f-4167-9285-e21f27ead57f req-8b106dde-58a1-441c-888a-759b17a67fed service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Received unexpected event network-vif-plugged-92307630-ea94-407f-b852-ee250debc046 for instance with vm_state building and task_state spawning.
Nov 15 08:11:02 user nova-compute[95467]: DEBUG nova.compute.manager [req-94e77571-d18f-4167-9285-e21f27ead57f req-8b106dde-58a1-441c-888a-759b17a67fed service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Received event network-vif-plugged-aa13aa7e-d38c-487f-8c4f-0f1cd51a18eb {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:11:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-94e77571-d18f-4167-9285-e21f27ead57f req-8b106dde-58a1-441c-888a-759b17a67fed service nova] Acquiring lock "35e88686-253e-452a-9649-8aa2a04128ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:11:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-94e77571-d18f-4167-9285-e21f27ead57f req-8b106dde-58a1-441c-888a-759b17a67fed service nova] Lock "35e88686-253e-452a-9649-8aa2a04128ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:11:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-94e77571-d18f-4167-9285-e21f27ead57f req-8b106dde-58a1-441c-888a-759b17a67fed service nova] Lock "35e88686-253e-452a-9649-8aa2a04128ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:11:02 user nova-compute[95467]: DEBUG nova.compute.manager [req-94e77571-d18f-4167-9285-e21f27ead57f req-8b106dde-58a1-441c-888a-759b17a67fed service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] No waiting events found dispatching network-vif-plugged-aa13aa7e-d38c-487f-8c4f-0f1cd51a18eb {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:11:02 user nova-compute[95467]: WARNING nova.compute.manager [req-94e77571-d18f-4167-9285-e21f27ead57f req-8b106dde-58a1-441c-888a-759b17a67fed service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Received unexpected event network-vif-plugged-aa13aa7e-d38c-487f-8c4f-0f1cd51a18eb for instance with vm_state building and task_state spawning.
Nov 15 08:11:02 user nova-compute[95467]: DEBUG nova.compute.manager [req-94e77571-d18f-4167-9285-e21f27ead57f req-8b106dde-58a1-441c-888a-759b17a67fed service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Received event network-vif-plugged-aa13aa7e-d38c-487f-8c4f-0f1cd51a18eb {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:11:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-94e77571-d18f-4167-9285-e21f27ead57f req-8b106dde-58a1-441c-888a-759b17a67fed service nova] Acquiring lock "35e88686-253e-452a-9649-8aa2a04128ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:11:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-94e77571-d18f-4167-9285-e21f27ead57f req-8b106dde-58a1-441c-888a-759b17a67fed service nova] Lock "35e88686-253e-452a-9649-8aa2a04128ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:11:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-94e77571-d18f-4167-9285-e21f27ead57f req-8b106dde-58a1-441c-888a-759b17a67fed service nova] Lock "35e88686-253e-452a-9649-8aa2a04128ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:11:02 user nova-compute[95467]: DEBUG nova.compute.manager [req-94e77571-d18f-4167-9285-e21f27ead57f req-8b106dde-58a1-441c-888a-759b17a67fed service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] No waiting events found dispatching network-vif-plugged-aa13aa7e-d38c-487f-8c4f-0f1cd51a18eb {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:11:02 user nova-compute[95467]: WARNING nova.compute.manager [req-94e77571-d18f-4167-9285-e21f27ead57f req-8b106dde-58a1-441c-888a-759b17a67fed service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Received unexpected event network-vif-plugged-aa13aa7e-d38c-487f-8c4f-0f1cd51a18eb for instance with vm_state building and task_state spawning.
Nov 15 08:11:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:02 user nova-compute[95467]: DEBUG nova.compute.manager [req-ae71ee8f-2cd5-4e25-be71-0c5adaad8f6c req-d6394412-6df2-435a-97e8-a8ab11788da8 service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Received event network-vif-plugged-fae94c7c-6554-49a7-a221-43d18d1e95e0 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:11:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ae71ee8f-2cd5-4e25-be71-0c5adaad8f6c req-d6394412-6df2-435a-97e8-a8ab11788da8 service nova] Acquiring lock "35e88686-253e-452a-9649-8aa2a04128ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:11:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ae71ee8f-2cd5-4e25-be71-0c5adaad8f6c req-d6394412-6df2-435a-97e8-a8ab11788da8 service nova] Lock "35e88686-253e-452a-9649-8aa2a04128ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:11:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ae71ee8f-2cd5-4e25-be71-0c5adaad8f6c req-d6394412-6df2-435a-97e8-a8ab11788da8 service nova] Lock "35e88686-253e-452a-9649-8aa2a04128ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:11:02 user nova-compute[95467]: DEBUG nova.compute.manager [req-ae71ee8f-2cd5-4e25-be71-0c5adaad8f6c req-d6394412-6df2-435a-97e8-a8ab11788da8 service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] No waiting events found dispatching network-vif-plugged-fae94c7c-6554-49a7-a221-43d18d1e95e0 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:11:02 user nova-compute[95467]: WARNING nova.compute.manager [req-ae71ee8f-2cd5-4e25-be71-0c5adaad8f6c req-d6394412-6df2-435a-97e8-a8ab11788da8 service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Received unexpected event network-vif-plugged-fae94c7c-6554-49a7-a221-43d18d1e95e0 for instance with vm_state building and task_state spawning.
Nov 15 08:11:02 user nova-compute[95467]: DEBUG nova.compute.manager [req-ae71ee8f-2cd5-4e25-be71-0c5adaad8f6c req-d6394412-6df2-435a-97e8-a8ab11788da8 service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Received event network-vif-plugged-cdfe5e3f-2910-43a2-8d16-132d69d647d5 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:11:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ae71ee8f-2cd5-4e25-be71-0c5adaad8f6c req-d6394412-6df2-435a-97e8-a8ab11788da8 service nova] Acquiring lock "35e88686-253e-452a-9649-8aa2a04128ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:11:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ae71ee8f-2cd5-4e25-be71-0c5adaad8f6c req-d6394412-6df2-435a-97e8-a8ab11788da8 service nova] Lock "35e88686-253e-452a-9649-8aa2a04128ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:11:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ae71ee8f-2cd5-4e25-be71-0c5adaad8f6c req-d6394412-6df2-435a-97e8-a8ab11788da8 service nova] Lock "35e88686-253e-452a-9649-8aa2a04128ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:11:02 user nova-compute[95467]: DEBUG nova.compute.manager [req-ae71ee8f-2cd5-4e25-be71-0c5adaad8f6c req-d6394412-6df2-435a-97e8-a8ab11788da8 service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] No waiting events found dispatching network-vif-plugged-cdfe5e3f-2910-43a2-8d16-132d69d647d5 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:11:02 user nova-compute[95467]: WARNING nova.compute.manager [req-ae71ee8f-2cd5-4e25-be71-0c5adaad8f6c req-d6394412-6df2-435a-97e8-a8ab11788da8 service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Received unexpected event network-vif-plugged-cdfe5e3f-2910-43a2-8d16-132d69d647d5 for instance with vm_state building and task_state spawning.
Nov 15 08:11:02 user nova-compute[95467]: DEBUG nova.compute.manager [req-ae71ee8f-2cd5-4e25-be71-0c5adaad8f6c req-d6394412-6df2-435a-97e8-a8ab11788da8 service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Received event network-vif-plugged-cdfe5e3f-2910-43a2-8d16-132d69d647d5 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:11:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ae71ee8f-2cd5-4e25-be71-0c5adaad8f6c req-d6394412-6df2-435a-97e8-a8ab11788da8 service nova] Acquiring lock "35e88686-253e-452a-9649-8aa2a04128ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:11:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ae71ee8f-2cd5-4e25-be71-0c5adaad8f6c req-d6394412-6df2-435a-97e8-a8ab11788da8 service nova] Lock "35e88686-253e-452a-9649-8aa2a04128ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:11:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ae71ee8f-2cd5-4e25-be71-0c5adaad8f6c req-d6394412-6df2-435a-97e8-a8ab11788da8 service nova] Lock "35e88686-253e-452a-9649-8aa2a04128ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:11:02 user nova-compute[95467]: DEBUG nova.compute.manager [req-ae71ee8f-2cd5-4e25-be71-0c5adaad8f6c req-d6394412-6df2-435a-97e8-a8ab11788da8 service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] No waiting events found dispatching network-vif-plugged-cdfe5e3f-2910-43a2-8d16-132d69d647d5 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:11:02 user nova-compute[95467]: WARNING nova.compute.manager [req-ae71ee8f-2cd5-4e25-be71-0c5adaad8f6c req-d6394412-6df2-435a-97e8-a8ab11788da8 service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Received unexpected event network-vif-plugged-cdfe5e3f-2910-43a2-8d16-132d69d647d5 for instance with vm_state building and task_state spawning.
Nov 15 08:11:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:03 user nova-compute[95467]: DEBUG nova.compute.manager [req-f1cc23f8-d147-456f-9803-f6ce6ec6f52c req-fb8bb773-9dae-4eaf-9571-be6b6a89d6ee service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Received event network-vif-plugged-48912f9e-eeae-4f51-8123-8316a6fcc15e {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:11:03 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-f1cc23f8-d147-456f-9803-f6ce6ec6f52c req-fb8bb773-9dae-4eaf-9571-be6b6a89d6ee service nova] Acquiring lock "35e88686-253e-452a-9649-8aa2a04128ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:11:03 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-f1cc23f8-d147-456f-9803-f6ce6ec6f52c req-fb8bb773-9dae-4eaf-9571-be6b6a89d6ee service nova] Lock "35e88686-253e-452a-9649-8aa2a04128ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:11:03 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-f1cc23f8-d147-456f-9803-f6ce6ec6f52c req-fb8bb773-9dae-4eaf-9571-be6b6a89d6ee service nova] Lock "35e88686-253e-452a-9649-8aa2a04128ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:11:03 user nova-compute[95467]: DEBUG nova.compute.manager [req-f1cc23f8-d147-456f-9803-f6ce6ec6f52c req-fb8bb773-9dae-4eaf-9571-be6b6a89d6ee service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] No waiting events found dispatching network-vif-plugged-48912f9e-eeae-4f51-8123-8316a6fcc15e {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:11:03 user nova-compute[95467]: WARNING nova.compute.manager [req-f1cc23f8-d147-456f-9803-f6ce6ec6f52c req-fb8bb773-9dae-4eaf-9571-be6b6a89d6ee service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Received unexpected event network-vif-plugged-48912f9e-eeae-4f51-8123-8316a6fcc15e for instance with vm_state building and task_state spawning.
Nov 15 08:11:03 user nova-compute[95467]: DEBUG nova.compute.manager [req-f1cc23f8-d147-456f-9803-f6ce6ec6f52c req-fb8bb773-9dae-4eaf-9571-be6b6a89d6ee service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Received event network-vif-plugged-0a35017f-b57c-4937-9479-22494bffb5b7 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:11:03 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-f1cc23f8-d147-456f-9803-f6ce6ec6f52c req-fb8bb773-9dae-4eaf-9571-be6b6a89d6ee service nova] Acquiring lock "35e88686-253e-452a-9649-8aa2a04128ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:11:03 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-f1cc23f8-d147-456f-9803-f6ce6ec6f52c req-fb8bb773-9dae-4eaf-9571-be6b6a89d6ee service nova] Lock "35e88686-253e-452a-9649-8aa2a04128ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:11:03 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-f1cc23f8-d147-456f-9803-f6ce6ec6f52c req-fb8bb773-9dae-4eaf-9571-be6b6a89d6ee service nova] Lock "35e88686-253e-452a-9649-8aa2a04128ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:11:03 user nova-compute[95467]: DEBUG nova.compute.manager [req-f1cc23f8-d147-456f-9803-f6ce6ec6f52c req-fb8bb773-9dae-4eaf-9571-be6b6a89d6ee service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] No waiting events found dispatching network-vif-plugged-0a35017f-b57c-4937-9479-22494bffb5b7 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:11:03 user nova-compute[95467]: WARNING nova.compute.manager [req-f1cc23f8-d147-456f-9803-f6ce6ec6f52c req-fb8bb773-9dae-4eaf-9571-be6b6a89d6ee service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Received unexpected event network-vif-plugged-0a35017f-b57c-4937-9479-22494bffb5b7 for instance with vm_state building and task_state spawning.
Nov 15 08:11:03 user nova-compute[95467]: DEBUG nova.compute.manager [req-f1cc23f8-d147-456f-9803-f6ce6ec6f52c req-fb8bb773-9dae-4eaf-9571-be6b6a89d6ee service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Received event network-vif-plugged-0a35017f-b57c-4937-9479-22494bffb5b7 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:11:03 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-f1cc23f8-d147-456f-9803-f6ce6ec6f52c req-fb8bb773-9dae-4eaf-9571-be6b6a89d6ee service nova] Acquiring lock "35e88686-253e-452a-9649-8aa2a04128ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:11:03 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-f1cc23f8-d147-456f-9803-f6ce6ec6f52c req-fb8bb773-9dae-4eaf-9571-be6b6a89d6ee service nova] Lock "35e88686-253e-452a-9649-8aa2a04128ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:11:03 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-f1cc23f8-d147-456f-9803-f6ce6ec6f52c req-fb8bb773-9dae-4eaf-9571-be6b6a89d6ee service nova] Lock "35e88686-253e-452a-9649-8aa2a04128ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:11:03 user nova-compute[95467]: DEBUG nova.compute.manager [req-f1cc23f8-d147-456f-9803-f6ce6ec6f52c req-fb8bb773-9dae-4eaf-9571-be6b6a89d6ee service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] No waiting events found dispatching network-vif-plugged-0a35017f-b57c-4937-9479-22494bffb5b7 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:11:03 user nova-compute[95467]: WARNING nova.compute.manager [req-f1cc23f8-d147-456f-9803-f6ce6ec6f52c req-fb8bb773-9dae-4eaf-9571-be6b6a89d6ee service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Received unexpected event network-vif-plugged-0a35017f-b57c-4937-9479-22494bffb5b7 for instance with vm_state building and task_state spawning.
Nov 15 08:11:04 user nova-compute[95467]: DEBUG nova.compute.manager [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Instance event wait completed in 0 seconds for  {{(pid=95467) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 08:11:04 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Guest created on hypervisor {{(pid=95467) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 08:11:04 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Instance spawned successfully.
Nov 15 08:11:04 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 08:11:04 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Found default for hw_cdrom_bus of ide {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:11:04 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Found default for hw_disk_bus of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:11:04 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Found default for hw_input_bus of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:11:04 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Found default for hw_pointer_model of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:11:04 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Found default for hw_video_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:11:04 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Found default for hw_vif_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:11:04 user nova-compute[95467]: INFO nova.compute.manager [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Took 11.72 seconds to spawn the instance on the hypervisor.
Nov 15 08:11:04 user nova-compute[95467]: DEBUG nova.compute.manager [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:11:04 user nova-compute[95467]: INFO nova.compute.manager [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Took 31.39 seconds to build instance.
Nov 15 08:11:04 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-cdb11be9-53b3-49d7-9209-ae9ee9513a32 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Lock "35e88686-253e-452a-9649-8aa2a04128ce" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 31.577s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:11:06 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:07 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:11 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:16 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:17 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:21 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:31 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:32 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:11:32 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=95467) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 08:11:33 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:11:35 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Acquiring lock "43f602f1-89c4-40b4-92f4-f054b980ce8a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:11:35 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Lock "43f602f1-89c4-40b4-92f4-f054b980ce8a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:11:35 user nova-compute[95467]: DEBUG nova.compute.manager [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: 43f602f1-89c4-40b4-92f4-f054b980ce8a] Starting instance... {{(pid=95467) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 08:11:35 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:11:35 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:11:35 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=95467) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 08:11:35 user nova-compute[95467]: INFO nova.compute.claims [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: 43f602f1-89c4-40b4-92f4-f054b980ce8a] Claim successful on node user
Nov 15 08:11:35 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:11:35 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:11:35 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:11:35 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:11:35 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:11:35 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.527s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:11:35 user nova-compute[95467]: DEBUG nova.compute.manager [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: 43f602f1-89c4-40b4-92f4-f054b980ce8a] Start building networks asynchronously for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 08:11:36 user nova-compute[95467]: DEBUG nova.compute.manager [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: 43f602f1-89c4-40b4-92f4-f054b980ce8a] Allocating IP information in the background. {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 08:11:36 user nova-compute[95467]: DEBUG nova.network.neutron [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: 43f602f1-89c4-40b4-92f4-f054b980ce8a] allocate_for_instance() {{(pid=95467) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 08:11:36 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: 43f602f1-89c4-40b4-92f4-f054b980ce8a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 08:11:36 user nova-compute[95467]: DEBUG nova.compute.manager [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: 43f602f1-89c4-40b4-92f4-f054b980ce8a] Start building block device mappings for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 08:11:36 user nova-compute[95467]: DEBUG nova.policy [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1b2841a0788845f79ea0fccef74eda25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1312e86f799549eb8adb4c846576262c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95467) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 08:11:36 user nova-compute[95467]: DEBUG nova.compute.manager [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: 43f602f1-89c4-40b4-92f4-f054b980ce8a] Start spawning the instance on the hypervisor. {{(pid=95467) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 08:11:36 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: 43f602f1-89c4-40b4-92f4-f054b980ce8a] Creating instance directory {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 08:11:36 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: 43f602f1-89c4-40b4-92f4-f054b980ce8a] Creating image(s)
Nov 15 08:11:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Acquiring lock "/opt/stack/data/nova/instances/43f602f1-89c4-40b4-92f4-f054b980ce8a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:11:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Lock "/opt/stack/data/nova/instances/43f602f1-89c4-40b4-92f4-f054b980ce8a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:11:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Lock "/opt/stack/data/nova/instances/43f602f1-89c4-40b4-92f4-f054b980ce8a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:11:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.224s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Acquiring lock "a3fcf60225fcefd310404971cd18ab9851c548dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:11:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:11:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.167s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/43f602f1-89c4-40b4-92f4-f054b980ce8a/disk 1073741824 {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:36 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager.update_available_resource {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:11:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/43f602f1-89c4-40b4-92f4-f054b980ce8a/disk 1073741824" returned: 0 in 0.068s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:11:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:11:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:11:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:11:36 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Auditing locally available compute resources for user (node: user) {{(pid=95467) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 08:11:36 user nova-compute[95467]: DEBUG nova.network.neutron [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: 43f602f1-89c4-40b4-92f4-f054b980ce8a] Successfully created port: fe613d21-e0c1-49b3-8b93-0dd6b2926fc3 {{(pid=95467) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 08:11:36 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.179s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:36 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Checking if we can resize image /opt/stack/data/nova/instances/43f602f1-89c4-40b4-92f4-f054b980ce8a/disk. size=1073741824 {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 08:11:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43f602f1-89c4-40b4-92f4-f054b980ce8a/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43f602f1-89c4-40b4-92f4-f054b980ce8a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Cannot resize image /opt/stack/data/nova/instances/43f602f1-89c4-40b4-92f4-f054b980ce8a/disk to a smaller size. {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: 43f602f1-89c4-40b4-92f4-f054b980ce8a] Created local disks {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: 43f602f1-89c4-40b4-92f4-f054b980ce8a] Ensure instance console log exists: /opt/stack/data/nova/instances/43f602f1-89c4-40b4-92f4-f054b980ce8a/console.log {{(pid=95467) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68264a44-5adf-4873-b380-26bcafe2ba04/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG nova.network.neutron [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: 43f602f1-89c4-40b4-92f4-f054b980ce8a] Successfully updated port: fe613d21-e0c1-49b3-8b93-0dd6b2926fc3 {{(pid=95467) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Acquiring lock "refresh_cache-43f602f1-89c4-40b4-92f4-f054b980ce8a" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Acquired lock "refresh_cache-43f602f1-89c4-40b4-92f4-f054b980ce8a" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG nova.network.neutron [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: 43f602f1-89c4-40b4-92f4-f054b980ce8a] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG nova.compute.manager [req-ace29481-dffc-4c83-aec4-729ae658e45e req-9aa070d1-a4ea-47e8-a34a-e1b611e90974 service nova] [instance: 43f602f1-89c4-40b4-92f4-f054b980ce8a] Received event network-changed-fe613d21-e0c1-49b3-8b93-0dd6b2926fc3 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG nova.compute.manager [req-ace29481-dffc-4c83-aec4-729ae658e45e req-9aa070d1-a4ea-47e8-a34a-e1b611e90974 service nova] [instance: 43f602f1-89c4-40b4-92f4-f054b980ce8a] Refreshing instance network info cache due to event network-changed-fe613d21-e0c1-49b3-8b93-0dd6b2926fc3. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ace29481-dffc-4c83-aec4-729ae658e45e req-9aa070d1-a4ea-47e8-a34a-e1b611e90974 service nova] Acquiring lock "refresh_cache-43f602f1-89c4-40b4-92f4-f054b980ce8a" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG nova.network.neutron [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: 43f602f1-89c4-40b4-92f4-f054b980ce8a] Instance cache missing network info. {{(pid=95467) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68264a44-5adf-4873-b380-26bcafe2ba04/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68264a44-5adf-4873-b380-26bcafe2ba04/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68264a44-5adf-4873-b380-26bcafe2ba04/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa82104f-d822-49fa-a06b-643733e27b06/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG nova.network.neutron [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: 43f602f1-89c4-40b4-92f4-f054b980ce8a] Updating instance_info_cache with network_info: [{"id": "fe613d21-e0c1-49b3-8b93-0dd6b2926fc3", "address": "fa:16:3e:f5:bf:a5", "network": {"id": "9fc550b3-b517-4f14-93cd-f1c2866d1b29", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1976605572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1312e86f799549eb8adb4c846576262c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe613d21-e0", "ovs_interfaceid": "fe613d21-e0c1-49b3-8b93-0dd6b2926fc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Releasing lock "refresh_cache-43f602f1-89c4-40b4-92f4-f054b980ce8a" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG nova.compute.manager [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: 43f602f1-89c4-40b4-92f4-f054b980ce8a] Instance network_info: |[{"id": "fe613d21-e0c1-49b3-8b93-0dd6b2926fc3", "address": "fa:16:3e:f5:bf:a5", "network": {"id": "9fc550b3-b517-4f14-93cd-f1c2866d1b29", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1976605572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1312e86f799549eb8adb4c846576262c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe613d21-e0", "ovs_interfaceid": "fe613d21-e0c1-49b3-8b93-0dd6b2926fc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ace29481-dffc-4c83-aec4-729ae658e45e req-9aa070d1-a4ea-47e8-a34a-e1b611e90974 service nova] Acquired lock "refresh_cache-43f602f1-89c4-40b4-92f4-f054b980ce8a" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG nova.network.neutron [req-ace29481-dffc-4c83-aec4-729ae658e45e req-9aa070d1-a4ea-47e8-a34a-e1b611e90974 service nova] [instance: 43f602f1-89c4-40b4-92f4-f054b980ce8a] Refreshing network info cache for port fe613d21-e0c1-49b3-8b93-0dd6b2926fc3 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: 43f602f1-89c4-40b4-92f4-f054b980ce8a] Start _get_guest_xml network_info=[{"id": "fe613d21-e0c1-49b3-8b93-0dd6b2926fc3", "address": "fa:16:3e:f5:bf:a5", "network": {"id": "9fc550b3-b517-4f14-93cd-f1c2866d1b29", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1976605572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1312e86f799549eb8adb4c846576262c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe613d21-e0", "ovs_interfaceid": "fe613d21-e0c1-49b3-8b93-0dd6b2926fc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'ed9c48aa-ce73-4b3b-9db1-235898be671b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:11:37 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:11:37 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:11:37 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:11:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1678114168',display_name='tempest-ServersNegativeTestJSON-server-1678114168',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1678114168',id=13,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1312e86f799549eb8adb4c846576262c',ramdisk_id='',reservation_id='r-z780zsyl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-146474397',owner_user_name='tempest-ServersNegativeTestJSON-146474397-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:11:36Z,user_data=None,user_id='1b2841a0788845f79ea0fccef74eda25',uuid=43f602f1-89c4-40b4-92f4-f054b980ce8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe613d21-e0c1-49b3-8b93-0dd6b2926fc3", "address": "fa:16:3e:f5:bf:a5", "network": {"id": "9fc550b3-b517-4f14-93cd-f1c2866d1b29", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1976605572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1312e86f799549eb8adb4c846576262c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe613d21-e0", "ovs_interfaceid": "fe613d21-e0c1-49b3-8b93-0dd6b2926fc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Converting VIF {"id": "fe613d21-e0c1-49b3-8b93-0dd6b2926fc3", "address": "fa:16:3e:f5:bf:a5", "network": {"id": "9fc550b3-b517-4f14-93cd-f1c2866d1b29", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1976605572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1312e86f799549eb8adb4c846576262c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe613d21-e0", "ovs_interfaceid": "fe613d21-e0c1-49b3-8b93-0dd6b2926fc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:bf:a5,bridge_name='br-int',has_traffic_filtering=True,id=fe613d21-e0c1-49b3-8b93-0dd6b2926fc3,network=Network(9fc550b3-b517-4f14-93cd-f1c2866d1b29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe613d21-e0') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG nova.objects.instance [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Lazy-loading 'pci_devices' on Instance uuid 43f602f1-89c4-40b4-92f4-f054b980ce8a {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: 43f602f1-89c4-40b4-92f4-f054b980ce8a] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:11:37 user nova-compute[95467]:   <uuid>43f602f1-89c4-40b4-92f4-f054b980ce8a</uuid>
Nov 15 08:11:37 user nova-compute[95467]:   <name>instance-0000000d</name>
Nov 15 08:11:37 user nova-compute[95467]:   <memory>524288</memory>
Nov 15 08:11:37 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:11:37 user nova-compute[95467]:   <metadata>
Nov 15 08:11:37 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:11:37 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:11:37 user nova-compute[95467]:       <nova:name>tempest-ServersNegativeTestJSON-server-1678114168</nova:name>
Nov 15 08:11:37 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:11:37</nova:creationTime>
Nov 15 08:11:37 user nova-compute[95467]:       <nova:flavor name="m1.tiny">
Nov 15 08:11:37 user nova-compute[95467]:         <nova:memory>512</nova:memory>
Nov 15 08:11:37 user nova-compute[95467]:         <nova:disk>1</nova:disk>
Nov 15 08:11:37 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:11:37 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:11:37 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:11:37 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:11:37 user nova-compute[95467]:       <nova:owner>
Nov 15 08:11:37 user nova-compute[95467]:         <nova:user uuid="1b2841a0788845f79ea0fccef74eda25">tempest-ServersNegativeTestJSON-146474397-project-member</nova:user>
Nov 15 08:11:37 user nova-compute[95467]:         <nova:project uuid="1312e86f799549eb8adb4c846576262c">tempest-ServersNegativeTestJSON-146474397</nova:project>
Nov 15 08:11:37 user nova-compute[95467]:       </nova:owner>
Nov 15 08:11:37 user nova-compute[95467]:       <nova:root type="image" uuid="ed9c48aa-ce73-4b3b-9db1-235898be671b"/>
Nov 15 08:11:37 user nova-compute[95467]:       <nova:ports>
Nov 15 08:11:37 user nova-compute[95467]:         <nova:port uuid="fe613d21-e0c1-49b3-8b93-0dd6b2926fc3">
Nov 15 08:11:37 user nova-compute[95467]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 08:11:37 user nova-compute[95467]:         </nova:port>
Nov 15 08:11:37 user nova-compute[95467]:       </nova:ports>
Nov 15 08:11:37 user nova-compute[95467]:     </nova:instance>
Nov 15 08:11:37 user nova-compute[95467]:   </metadata>
Nov 15 08:11:37 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:11:37 user nova-compute[95467]:     <system>
Nov 15 08:11:37 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:11:37 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:11:37 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:11:37 user nova-compute[95467]:       <entry name="serial">43f602f1-89c4-40b4-92f4-f054b980ce8a</entry>
Nov 15 08:11:37 user nova-compute[95467]:       <entry name="uuid">43f602f1-89c4-40b4-92f4-f054b980ce8a</entry>
Nov 15 08:11:37 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:11:37 user nova-compute[95467]:     </system>
Nov 15 08:11:37 user nova-compute[95467]:   </sysinfo>
Nov 15 08:11:37 user nova-compute[95467]:   <os>
Nov 15 08:11:37 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:11:37 user nova-compute[95467]:     <boot dev="hd"/>
Nov 15 08:11:37 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:11:37 user nova-compute[95467]:   </os>
Nov 15 08:11:37 user nova-compute[95467]:   <features>
Nov 15 08:11:37 user nova-compute[95467]:     <acpi/>
Nov 15 08:11:37 user nova-compute[95467]:     <apic/>
Nov 15 08:11:37 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:11:37 user nova-compute[95467]:   </features>
Nov 15 08:11:37 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:11:37 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:11:37 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:11:37 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:11:37 user nova-compute[95467]:   </clock>
Nov 15 08:11:37 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:11:37 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:11:37 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:11:37 user nova-compute[95467]:   </cpu>
Nov 15 08:11:37 user nova-compute[95467]:   <devices>
Nov 15 08:11:37 user nova-compute[95467]:     <disk type="file" device="disk">
Nov 15 08:11:37 user nova-compute[95467]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 08:11:37 user nova-compute[95467]:       <source file="/opt/stack/data/nova/instances/43f602f1-89c4-40b4-92f4-f054b980ce8a/disk"/>
Nov 15 08:11:37 user nova-compute[95467]:       <target dev="vda" bus="virtio"/>
Nov 15 08:11:37 user nova-compute[95467]:     </disk>
Nov 15 08:11:37 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:11:37 user nova-compute[95467]:       <mac address="fa:16:3e:f5:bf:a5"/>
Nov 15 08:11:37 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:11:37 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:11:37 user nova-compute[95467]:       <target dev="tapfe613d21-e0"/>
Nov 15 08:11:37 user nova-compute[95467]:     </interface>
Nov 15 08:11:37 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:11:37 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/43f602f1-89c4-40b4-92f4-f054b980ce8a/console.log" append="off"/>
Nov 15 08:11:37 user nova-compute[95467]:     </serial>
Nov 15 08:11:37 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:11:37 user nova-compute[95467]:     <video>
Nov 15 08:11:37 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:11:37 user nova-compute[95467]:     </video>
Nov 15 08:11:37 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:11:37 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:11:37 user nova-compute[95467]:     </rng>
Nov 15 08:11:37 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:11:37 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:11:37 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:11:37 user nova-compute[95467]:     </memballoon>
Nov 15 08:11:37 user nova-compute[95467]:   </devices>
Nov 15 08:11:37 user nova-compute[95467]: </domain>
Nov 15 08:11:37 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:11:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1678114168',display_name='tempest-ServersNegativeTestJSON-server-1678114168',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1678114168',id=13,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1312e86f799549eb8adb4c846576262c',ramdisk_id='',reservation_id='r-z780zsyl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-146474397',owner_user_name='tempest-ServersNegativeTestJSON-146474397-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:11:36Z,user_data=None,user_id='1b2841a0788845f79ea0fccef74eda25',uuid=43f602f1-89c4-40b4-92f4-f054b980ce8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe613d21-e0c1-49b3-8b93-0dd6b2926fc3", "address": "fa:16:3e:f5:bf:a5", "network": {"id": "9fc550b3-b517-4f14-93cd-f1c2866d1b29", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1976605572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1312e86f799549eb8adb4c846576262c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe613d21-e0", "ovs_interfaceid": "fe613d21-e0c1-49b3-8b93-0dd6b2926fc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Converting VIF {"id": "fe613d21-e0c1-49b3-8b93-0dd6b2926fc3", "address": "fa:16:3e:f5:bf:a5", "network": {"id": "9fc550b3-b517-4f14-93cd-f1c2866d1b29", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1976605572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1312e86f799549eb8adb4c846576262c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe613d21-e0", "ovs_interfaceid": "fe613d21-e0c1-49b3-8b93-0dd6b2926fc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:bf:a5,bridge_name='br-int',has_traffic_filtering=True,id=fe613d21-e0c1-49b3-8b93-0dd6b2926fc3,network=Network(9fc550b3-b517-4f14-93cd-f1c2866d1b29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe613d21-e0') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG os_vif [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:bf:a5,bridge_name='br-int',has_traffic_filtering=True,id=fe613d21-e0c1-49b3-8b93-0dd6b2926fc3,network=Network(9fc550b3-b517-4f14-93cd-f1c2866d1b29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe613d21-e0') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2ebb616c-b8c3-5d44-be33-68804eee0653', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa82104f-d822-49fa-a06b-643733e27b06/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa82104f-d822-49fa-a06b-643733e27b06/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe613d21-e0, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfe613d21-e0, col_values=(('qos', UUID('f1e7223b-8bd6-4182-8d36-eef2a3796565')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfe613d21-e0, col_values=(('external_ids', {'iface-id': 'fe613d21-e0c1-49b3-8b93-0dd6b2926fc3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:bf:a5', 'vm-uuid': '43f602f1-89c4-40b4-92f4-f054b980ce8a'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:11:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:37 user nova-compute[95467]: INFO os_vif [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:bf:a5,bridge_name='br-int',has_traffic_filtering=True,id=fe613d21-e0c1-49b3-8b93-0dd6b2926fc3,network=Network(9fc550b3-b517-4f14-93cd-f1c2866d1b29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe613d21-e0')
Nov 15 08:11:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa82104f-d822-49fa-a06b-643733e27b06/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5748cf5d-9c57-4477-8952-ec39d0d18f55/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5748cf5d-9c57-4477-8952-ec39d0d18f55/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5748cf5d-9c57-4477-8952-ec39d0d18f55/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:38 user nova-compute[95467]: DEBUG nova.network.neutron [req-ace29481-dffc-4c83-aec4-729ae658e45e req-9aa070d1-a4ea-47e8-a34a-e1b611e90974 service nova] [instance: 43f602f1-89c4-40b4-92f4-f054b980ce8a] Updated VIF entry in instance network info cache for port fe613d21-e0c1-49b3-8b93-0dd6b2926fc3. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:11:38 user nova-compute[95467]: DEBUG nova.network.neutron [req-ace29481-dffc-4c83-aec4-729ae658e45e req-9aa070d1-a4ea-47e8-a34a-e1b611e90974 service nova] [instance: 43f602f1-89c4-40b4-92f4-f054b980ce8a] Updating instance_info_cache with network_info: [{"id": "fe613d21-e0c1-49b3-8b93-0dd6b2926fc3", "address": "fa:16:3e:f5:bf:a5", "network": {"id": "9fc550b3-b517-4f14-93cd-f1c2866d1b29", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1976605572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1312e86f799549eb8adb4c846576262c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe613d21-e0", "ovs_interfaceid": "fe613d21-e0c1-49b3-8b93-0dd6b2926fc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:11:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:11:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] No VIF found with MAC fa:16:3e:f5:bf:a5, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:11:38 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ace29481-dffc-4c83-aec4-729ae658e45e req-9aa070d1-a4ea-47e8-a34a-e1b611e90974 service nova] Releasing lock "refresh_cache-43f602f1-89c4-40b4-92f4-f054b980ce8a" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:11:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5748cf5d-9c57-4477-8952-ec39d0d18f55/disk --force-share --output=json" returned: 0 in 0.410s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1edf7591-3991-4df9-98c9-ebc4ca9e5a4a/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1edf7591-3991-4df9-98c9-ebc4ca9e5a4a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1edf7591-3991-4df9-98c9-ebc4ca9e5a4a/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:39 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1edf7591-3991-4df9-98c9-ebc4ca9e5a4a/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:39 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:11:39 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a259558e-87ea-48c2-8b72-7443c0510d81/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:39 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a259558e-87ea-48c2-8b72-7443c0510d81/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:39 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a259558e-87ea-48c2-8b72-7443c0510d81/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:39 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a259558e-87ea-48c2-8b72-7443c0510d81/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:39 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9210bbe-e728-4724-924b-1963226c092d/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:39 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:39 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9210bbe-e728-4724-924b-1963226c092d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:39 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9210bbe-e728-4724-924b-1963226c092d/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:39 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:39 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:39 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9210bbe-e728-4724-924b-1963226c092d/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:39 user nova-compute[95467]: DEBUG nova.compute.manager [req-4b0e98cc-1e1c-4fc8-a124-4da0fdb33a2d req-04aa09f0-999f-441f-a92a-185fb9ce2935 service nova] [instance: 43f602f1-89c4-40b4-92f4-f054b980ce8a] Received event network-vif-plugged-fe613d21-e0c1-49b3-8b93-0dd6b2926fc3 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:11:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-4b0e98cc-1e1c-4fc8-a124-4da0fdb33a2d req-04aa09f0-999f-441f-a92a-185fb9ce2935 service nova] Acquiring lock "43f602f1-89c4-40b4-92f4-f054b980ce8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:11:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-4b0e98cc-1e1c-4fc8-a124-4da0fdb33a2d req-04aa09f0-999f-441f-a92a-185fb9ce2935 service nova] Lock "43f602f1-89c4-40b4-92f4-f054b980ce8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:11:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-4b0e98cc-1e1c-4fc8-a124-4da0fdb33a2d req-04aa09f0-999f-441f-a92a-185fb9ce2935 service nova] Lock "43f602f1-89c4-40b4-92f4-f054b980ce8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:11:39 user nova-compute[95467]: DEBUG nova.compute.manager [req-4b0e98cc-1e1c-4fc8-a124-4da0fdb33a2d req-04aa09f0-999f-441f-a92a-185fb9ce2935 service nova] [instance: 43f602f1-89c4-40b4-92f4-f054b980ce8a] No waiting events found dispatching network-vif-plugged-fe613d21-e0c1-49b3-8b93-0dd6b2926fc3 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:11:39 user nova-compute[95467]: WARNING nova.compute.manager [req-4b0e98cc-1e1c-4fc8-a124-4da0fdb33a2d req-04aa09f0-999f-441f-a92a-185fb9ce2935 service nova] [instance: 43f602f1-89c4-40b4-92f4-f054b980ce8a] Received unexpected event network-vif-plugged-fe613d21-e0c1-49b3-8b93-0dd6b2926fc3 for instance with vm_state building and task_state spawning.
Nov 15 08:11:39 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36dccf43-d4a3-47aa-bd73-de9646e1020c/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:39 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-03837ee7-2992-4f24-a6f7-914a30622c25 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Acquiring lock "b9210bbe-e728-4724-924b-1963226c092d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:11:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-03837ee7-2992-4f24-a6f7-914a30622c25 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Lock "b9210bbe-e728-4724-924b-1963226c092d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:11:39 user nova-compute[95467]: DEBUG nova.objects.instance [None req-03837ee7-2992-4f24-a6f7-914a30622c25 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Lazy-loading 'flavor' on Instance uuid b9210bbe-e728-4724-924b-1963226c092d {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:11:39 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:40 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-03837ee7-2992-4f24-a6f7-914a30622c25 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Lock "b9210bbe-e728-4724-924b-1963226c092d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.090s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:11:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36dccf43-d4a3-47aa-bd73-de9646e1020c/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36dccf43-d4a3-47aa-bd73-de9646e1020c/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:40 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-03837ee7-2992-4f24-a6f7-914a30622c25 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Acquiring lock "b9210bbe-e728-4724-924b-1963226c092d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:11:40 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-03837ee7-2992-4f24-a6f7-914a30622c25 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Lock "b9210bbe-e728-4724-924b-1963226c092d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:11:40 user nova-compute[95467]: INFO nova.compute.manager [None req-03837ee7-2992-4f24-a6f7-914a30622c25 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] [instance: b9210bbe-e728-4724-924b-1963226c092d] Attaching volume 3155bfd1-3cb8-4fe3-8db9-38d58acdbad8 to /dev/vdb
Nov 15 08:11:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36dccf43-d4a3-47aa-bd73-de9646e1020c/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:40 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:11:40 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:11:40 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:11:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0917b083-2bbf-4baf-a0b8-d59ba3e2256b/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:40 user nova-compute[95467]: DEBUG os_brick.utils [None req-03837ee7-2992-4f24-a6f7-914a30622c25 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:11:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:40 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce56e6ea-50ca-4ae7-860d-74c43b73c9da]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:882ae90641f\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:11:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:40 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aaa2c4a-068e-4632-af51-0a5a65f506f0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:11:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.034s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:40 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb8282f-f605-4989-a165-8cd8c104ce42]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:11:40 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c13ed82-0414-43d6-8791-57e095016ef8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:11:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-03837ee7-2992-4f24-a6f7-914a30622c25 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Running cmd (subprocess): nvme version {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-03837ee7-2992-4f24-a6f7-914a30622c25 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] 'nvme version' failed. Not Retrying. {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:11:40 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.nvmeof [None req-03837ee7-2992-4f24-a6f7-914a30622c25 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] nvme not present on system {{(pid=95467) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 08:11:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:11:40 user nova-compute[95467]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 08:11:40 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[170da27c-17fe-4b08-a594-659e3198e2a0]: (4, '') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:11:40 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-03837ee7-2992-4f24-a6f7-914a30622c25 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=95467) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 08:11:40 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-03837ee7-2992-4f24-a6f7-914a30622c25 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 08:11:40 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-03837ee7-2992-4f24-a6f7-914a30622c25 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] LIGHTOS: no hostnqn found. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 08:11:40 user nova-compute[95467]: DEBUG os_brick.utils [None req-03837ee7-2992-4f24-a6f7-914a30622c25 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:882ae90641f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:11:40 user nova-compute[95467]: DEBUG nova.virt.block_device [None req-03837ee7-2992-4f24-a6f7-914a30622c25 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] [instance: b9210bbe-e728-4724-924b-1963226c092d] Updating existing volume attachment record: fc77e44b-9139-4090-80bb-0ec1882cce06 {{(pid=95467) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 08:11:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0917b083-2bbf-4baf-a0b8-d59ba3e2256b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0917b083-2bbf-4baf-a0b8-d59ba3e2256b/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0917b083-2bbf-4baf-a0b8-d59ba3e2256b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2aa477-6786-483a-b088-d8ec204fe6aa/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2aa477-6786-483a-b088-d8ec204fe6aa/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2aa477-6786-483a-b088-d8ec204fe6aa/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2aa477-6786-483a-b088-d8ec204fe6aa/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:42 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:42 user nova-compute[95467]: DEBUG nova.compute.manager [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: 43f602f1-89c4-40b4-92f4-f054b980ce8a] Instance event wait completed in 0 seconds for  {{(pid=95467) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 08:11:42 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: 43f602f1-89c4-40b4-92f4-f054b980ce8a] Guest created on hypervisor {{(pid=95467) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 08:11:42 user nova-compute[95467]: DEBUG nova.compute.manager [req-4003b465-2a4e-4eb3-a19d-6d43f24fe10f req-a7ff8a47-f651-47c0-8c81-b977a42145c3 service nova] [instance: 43f602f1-89c4-40b4-92f4-f054b980ce8a] Received event network-vif-plugged-fe613d21-e0c1-49b3-8b93-0dd6b2926fc3 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:11:42 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-4003b465-2a4e-4eb3-a19d-6d43f24fe10f req-a7ff8a47-f651-47c0-8c81-b977a42145c3 service nova] Acquiring lock "43f602f1-89c4-40b4-92f4-f054b980ce8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:11:42 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-4003b465-2a4e-4eb3-a19d-6d43f24fe10f req-a7ff8a47-f651-47c0-8c81-b977a42145c3 service nova] Lock "43f602f1-89c4-40b4-92f4-f054b980ce8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:11:42 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-4003b465-2a4e-4eb3-a19d-6d43f24fe10f req-a7ff8a47-f651-47c0-8c81-b977a42145c3 service nova] Lock "43f602f1-89c4-40b4-92f4-f054b980ce8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:11:42 user nova-compute[95467]: DEBUG nova.compute.manager [req-4003b465-2a4e-4eb3-a19d-6d43f24fe10f req-a7ff8a47-f651-47c0-8c81-b977a42145c3 service nova] [instance: 43f602f1-89c4-40b4-92f4-f054b980ce8a] No waiting events found dispatching network-vif-plugged-fe613d21-e0c1-49b3-8b93-0dd6b2926fc3 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:11:42 user nova-compute[95467]: WARNING nova.compute.manager [req-4003b465-2a4e-4eb3-a19d-6d43f24fe10f req-a7ff8a47-f651-47c0-8c81-b977a42145c3 service nova] [instance: 43f602f1-89c4-40b4-92f4-f054b980ce8a] Received unexpected event network-vif-plugged-fe613d21-e0c1-49b3-8b93-0dd6b2926fc3 for instance with vm_state building and task_state spawning.
Nov 15 08:11:42 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:11:42 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:11:42 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Hypervisor/Node resource view: name=user free_ram=6652MB free_disk=25.576282501220703GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=95467) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 08:11:42 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:11:42 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:11:42 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 43f602f1-89c4-40b4-92f4-f054b980ce8a] Instance spawned successfully.
Nov 15 08:11:42 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: 43f602f1-89c4-40b4-92f4-f054b980ce8a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 08:11:42 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: 43f602f1-89c4-40b4-92f4-f054b980ce8a] Found default for hw_cdrom_bus of ide {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:11:42 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: 43f602f1-89c4-40b4-92f4-f054b980ce8a] Found default for hw_disk_bus of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:11:42 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: 43f602f1-89c4-40b4-92f4-f054b980ce8a] Found default for hw_input_bus of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:11:42 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: 43f602f1-89c4-40b4-92f4-f054b980ce8a] Found default for hw_pointer_model of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:11:42 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: 43f602f1-89c4-40b4-92f4-f054b980ce8a] Found default for hw_video_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:11:42 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: 43f602f1-89c4-40b4-92f4-f054b980ce8a] Found default for hw_vif_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:11:42 user nova-compute[95467]: DEBUG nova.compute.manager [req-a16373a3-8a63-479e-8a43-0971e57842f6 req-c18f12a3-fdc1-42b6-bb46-227398def1bd service nova] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] Received event network-changed-015c421f-8bfc-4576-a9cc-bf990e3803ab {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:11:42 user nova-compute[95467]: DEBUG nova.compute.manager [req-a16373a3-8a63-479e-8a43-0971e57842f6 req-c18f12a3-fdc1-42b6-bb46-227398def1bd service nova] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] Refreshing instance network info cache due to event network-changed-015c421f-8bfc-4576-a9cc-bf990e3803ab. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:11:42 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-a16373a3-8a63-479e-8a43-0971e57842f6 req-c18f12a3-fdc1-42b6-bb46-227398def1bd service nova] Acquiring lock "refresh_cache-5748cf5d-9c57-4477-8952-ec39d0d18f55" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:11:42 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-a16373a3-8a63-479e-8a43-0971e57842f6 req-c18f12a3-fdc1-42b6-bb46-227398def1bd service nova] Acquired lock "refresh_cache-5748cf5d-9c57-4477-8952-ec39d0d18f55" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:11:42 user nova-compute[95467]: DEBUG nova.network.neutron [req-a16373a3-8a63-479e-8a43-0971e57842f6 req-c18f12a3-fdc1-42b6-bb46-227398def1bd service nova] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] Refreshing network info cache for port 015c421f-8bfc-4576-a9cc-bf990e3803ab {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:11:42 user nova-compute[95467]: INFO nova.compute.manager [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: 43f602f1-89c4-40b4-92f4-f054b980ce8a] Took 5.97 seconds to spawn the instance on the hypervisor.
Nov 15 08:11:42 user nova-compute[95467]: DEBUG nova.compute.manager [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: 43f602f1-89c4-40b4-92f4-f054b980ce8a] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:11:42 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance ee2aa477-6786-483a-b088-d8ec204fe6aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:11:42 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance b9210bbe-e728-4724-924b-1963226c092d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:11:42 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 5748cf5d-9c57-4477-8952-ec39d0d18f55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:11:42 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 73fe8852-c47a-47ab-a56f-6864c8ed5479 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:11:42 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 36dccf43-d4a3-47aa-bd73-de9646e1020c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:11:42 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 68264a44-5adf-4873-b380-26bcafe2ba04 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:11:42 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 7e53d93e-1222-4b1a-9745-d512da0f7925 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:11:42 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:11:42 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 0917b083-2bbf-4baf-a0b8-d59ba3e2256b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:11:42 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance a259558e-87ea-48c2-8b72-7443c0510d81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:11:42 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 35e88686-253e-452a-9649-8aa2a04128ce actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:11:42 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance fa82104f-d822-49fa-a06b-643733e27b06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:11:42 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 43f602f1-89c4-40b4-92f4-f054b980ce8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:11:42 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 08:11:42 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 08:11:42 user nova-compute[95467]: INFO nova.compute.manager [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: 43f602f1-89c4-40b4-92f4-f054b980ce8a] Took 6.83 seconds to build instance.
Nov 15 08:11:42 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-aab256e6-c444-4b70-ad24-a96efb8b8d05 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Lock "43f602f1-89c4-40b4-92f4-f054b980ce8a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.931s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:11:42 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:11:42 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:11:42 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Compute_service record updated for user:user {{(pid=95467) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 08:11:42 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.645s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:11:42 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:42 user nova-compute[95467]: DEBUG nova.network.neutron [req-a16373a3-8a63-479e-8a43-0971e57842f6 req-c18f12a3-fdc1-42b6-bb46-227398def1bd service nova] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] Updated VIF entry in instance network info cache for port 015c421f-8bfc-4576-a9cc-bf990e3803ab. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:11:42 user nova-compute[95467]: DEBUG nova.network.neutron [req-a16373a3-8a63-479e-8a43-0971e57842f6 req-c18f12a3-fdc1-42b6-bb46-227398def1bd service nova] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] Updating instance_info_cache with network_info: [{"id": "015c421f-8bfc-4576-a9cc-bf990e3803ab", "address": "fa:16:3e:e1:8a:d4", "network": {"id": "27fd2b0f-65bd-4ae4-b5c8-dfca91668078", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1310727750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50e2fec6a90a41a5a586c6da227caacc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap015c421f-8b", "ovs_interfaceid": "015c421f-8bfc-4576-a9cc-bf990e3803ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:11:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-a16373a3-8a63-479e-8a43-0971e57842f6 req-c18f12a3-fdc1-42b6-bb46-227398def1bd service nova] Releasing lock "refresh_cache-5748cf5d-9c57-4477-8952-ec39d0d18f55" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:11:43 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:11:43 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:11:43 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Starting heal instance info cache {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 08:11:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "refresh_cache-b9210bbe-e728-4724-924b-1963226c092d" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:11:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquired lock "refresh_cache-b9210bbe-e728-4724-924b-1963226c092d" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:11:43 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: b9210bbe-e728-4724-924b-1963226c092d] Forcefully refreshing network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 08:11:43 user nova-compute[95467]: DEBUG nova.compute.manager [req-6982cbc1-ecf9-4f4b-ada4-6debcc0d328b req-df85ff69-d849-4ddb-865e-6a976b532870 service nova] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] Received event network-changed-d7e5ca44-eee3-4452-9649-5fcbfe5ed5ad {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:11:43 user nova-compute[95467]: DEBUG nova.compute.manager [req-6982cbc1-ecf9-4f4b-ada4-6debcc0d328b req-df85ff69-d849-4ddb-865e-6a976b532870 service nova] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] Refreshing instance network info cache due to event network-changed-d7e5ca44-eee3-4452-9649-5fcbfe5ed5ad. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:11:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-6982cbc1-ecf9-4f4b-ada4-6debcc0d328b req-df85ff69-d849-4ddb-865e-6a976b532870 service nova] Acquiring lock "refresh_cache-73fe8852-c47a-47ab-a56f-6864c8ed5479" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:11:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-6982cbc1-ecf9-4f4b-ada4-6debcc0d328b req-df85ff69-d849-4ddb-865e-6a976b532870 service nova] Acquired lock "refresh_cache-73fe8852-c47a-47ab-a56f-6864c8ed5479" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:11:43 user nova-compute[95467]: DEBUG nova.network.neutron [req-6982cbc1-ecf9-4f4b-ada4-6debcc0d328b req-df85ff69-d849-4ddb-865e-6a976b532870 service nova] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] Refreshing network info cache for port d7e5ca44-eee3-4452-9649-5fcbfe5ed5ad {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:11:44 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: b9210bbe-e728-4724-924b-1963226c092d] Updating instance_info_cache with network_info: [{"id": "9599d4c0-f08b-4498-9c9a-119d83caa185", "address": "fa:16:3e:35:33:4d", "network": {"id": "0a2ee949-f9ab-4b7b-a4da-f9f9cc4da5c5", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1737037548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb0f20d51854422c86b85377dd75f96d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9599d4c0-f0", "ovs_interfaceid": "9599d4c0-f08b-4498-9c9a-119d83caa185", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:11:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Releasing lock "refresh_cache-b9210bbe-e728-4724-924b-1963226c092d" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:11:44 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: b9210bbe-e728-4724-924b-1963226c092d] Updated the network info_cache for instance {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 08:11:44 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:11:44 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:11:44 user nova-compute[95467]: DEBUG nova.network.neutron [req-6982cbc1-ecf9-4f4b-ada4-6debcc0d328b req-df85ff69-d849-4ddb-865e-6a976b532870 service nova] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] Updated VIF entry in instance network info cache for port d7e5ca44-eee3-4452-9649-5fcbfe5ed5ad. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:11:44 user nova-compute[95467]: DEBUG nova.network.neutron [req-6982cbc1-ecf9-4f4b-ada4-6debcc0d328b req-df85ff69-d849-4ddb-865e-6a976b532870 service nova] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] Updating instance_info_cache with network_info: [{"id": "d7e5ca44-eee3-4452-9649-5fcbfe5ed5ad", "address": "fa:16:3e:e5:16:8b", "network": {"id": "d8a362dc-0dc8-49dd-b2da-0e0749d5edca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-256373617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a1aa4f562c64545a94157d4aaf8d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7e5ca44-ee", "ovs_interfaceid": "d7e5ca44-eee3-4452-9649-5fcbfe5ed5ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:11:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-6982cbc1-ecf9-4f4b-ada4-6debcc0d328b req-df85ff69-d849-4ddb-865e-6a976b532870 service nova] Releasing lock "refresh_cache-73fe8852-c47a-47ab-a56f-6864c8ed5479" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:11:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-2fd77541-93fe-4682-99f5-bd1e6d876c6c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Acquiring lock "5748cf5d-9c57-4477-8952-ec39d0d18f55" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:11:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-2fd77541-93fe-4682-99f5-bd1e6d876c6c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "5748cf5d-9c57-4477-8952-ec39d0d18f55" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:11:44 user nova-compute[95467]: DEBUG nova.objects.instance [None req-2fd77541-93fe-4682-99f5-bd1e6d876c6c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lazy-loading 'flavor' on Instance uuid 5748cf5d-9c57-4477-8952-ec39d0d18f55 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:11:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-2fd77541-93fe-4682-99f5-bd1e6d876c6c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "5748cf5d-9c57-4477-8952-ec39d0d18f55" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-2fd77541-93fe-4682-99f5-bd1e6d876c6c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Acquiring lock "5748cf5d-9c57-4477-8952-ec39d0d18f55" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-2fd77541-93fe-4682-99f5-bd1e6d876c6c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "5748cf5d-9c57-4477-8952-ec39d0d18f55" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:11:45 user nova-compute[95467]: INFO nova.compute.manager [None req-2fd77541-93fe-4682-99f5-bd1e6d876c6c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] Attaching volume 90e04b69-1404-4a84-a441-9de70a5ca0de to /dev/vdb
Nov 15 08:11:45 user nova-compute[95467]: DEBUG os_brick.utils [None req-2fd77541-93fe-4682-99f5-bd1e6d876c6c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.105s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[5446315e-cf99-4861-8204-ed63883ea2bc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:882ae90641f\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4e7b10-2c53-4386-8ccc-1f4efedc256c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d060f3-ccc3-4149-94b8-e8107eaba805]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5da1065-37bd-4c36-b522-7d5cb0debadc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-2fd77541-93fe-4682-99f5-bd1e6d876c6c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Running cmd (subprocess): nvme version {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-2fd77541-93fe-4682-99f5-bd1e6d876c6c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] 'nvme version' failed. Not Retrying. {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2fd77541-93fe-4682-99f5-bd1e6d876c6c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] nvme not present on system {{(pid=95467) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:11:45 user nova-compute[95467]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 08:11:45 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[22008ee9-cf62-41ce-9dfe-e04f3cea5859]: (4, '') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-2fd77541-93fe-4682-99f5-bd1e6d876c6c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=95467) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-2fd77541-93fe-4682-99f5-bd1e6d876c6c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-2fd77541-93fe-4682-99f5-bd1e6d876c6c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] LIGHTOS: no hostnqn found. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG os_brick.utils [None req-2fd77541-93fe-4682-99f5-bd1e6d876c6c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] <== get_connector_properties: return (202ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:882ae90641f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG nova.virt.block_device [None req-2fd77541-93fe-4682-99f5-bd1e6d876c6c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] Updating existing volume attachment record: 920a9f9c-fa7d-43d5-bce2-1b51ac12d53f {{(pid=95467) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03837ee7-2992-4f24-a6f7-914a30622c25 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] [instance: b9210bbe-e728-4724-924b-1963226c092d] Calling os-brick to attach iSCSI Volume {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-03837ee7-2992-4f24-a6f7-914a30622c25 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3155bfd1-3cb8-4fe3-8db9-38d58acdbad8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NRdLmaZr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:11:45 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-03837ee7-2992-4f24-a6f7-914a30622c25 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:11:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-03837ee7-2992-4f24-a6f7-914a30622c25 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-03837ee7-2992-4f24-a6f7-914a30622c25 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:11:45 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-03837ee7-2992-4f24-a6f7-914a30622c25 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:11:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-03837ee7-2992-4f24-a6f7-914a30622c25 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3155bfd1-3cb8-4fe3-8db9-38d58acdbad8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-03837ee7-2992-4f24-a6f7-914a30622c25 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3155bfd1-3cb8-4fe3-8db9-38d58acdbad8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:11:45 user nova-compute[95467]: INFO os_brick.initiator.connectors.iscsi [None req-03837ee7-2992-4f24-a6f7-914a30622c25 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 08:11:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3155bfd1-3cb8-4fe3-8db9-38d58acdbad8 -p 172.16.0.220:3260 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3155bfd1-3cb8-4fe3-8db9-38d58acdbad8 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[e814f025-24f4-4869-b036-963e567e1f6b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-03837ee7-2992-4f24-a6f7-914a30622c25 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 08:11:45 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3155bfd1-3cb8-4fe3-8db9-38d58acdbad8 -p 172.16.0.220:3260 --interface default --op new {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3155bfd1-3cb8-4fe3-8db9-38d58acdbad8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c5ce69-04ad-4615-880d-36c8dccf9887]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3155bfd1-3cb8-4fe3-8db9-38d58acdbad8] added\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-03837ee7-2992-4f24-a6f7-914a30622c25 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3155bfd1-3cb8-4fe3-8db9-38d58acdbad8] added
Nov 15 08:11:45 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3155bfd1-3cb8-4fe3-8db9-38d58acdbad8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3155bfd1-3cb8-4fe3-8db9-38d58acdbad8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb65a99-5f47-441a-8116-0055059ff781]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-03837ee7-2992-4f24-a6f7-914a30622c25 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3155bfd1-3cb8-4fe3-8db9-38d58acdbad8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3155bfd1-3cb8-4fe3-8db9-38d58acdbad8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b8e8fa5-4dab-49ae-a576-1c5284538452]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-03837ee7-2992-4f24-a6f7-914a30622c25 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3155bfd1-3cb8-4fe3-8db9-38d58acdbad8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NRdLmaZr {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3155bfd1-3cb8-4fe3-8db9-38d58acdbad8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NRdLmaZr" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8822e82e-c16c-4ba7-bef2-e2d478f8c367]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-03837ee7-2992-4f24-a6f7-914a30622c25 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NRdLmaZr'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3155bfd1-3cb8-4fe3-8db9-38d58acdbad8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3155bfd1-3cb8-4fe3-8db9-38d58acdbad8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a9a4aa-6380-4a5d-b3f4-451a0a6980d4]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-03837ee7-2992-4f24-a6f7-914a30622c25 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f95966-e31f-436c-a032-5729d061b2a8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-03837ee7-2992-4f24-a6f7-914a30622c25 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)
Nov 15 08:11:45 user nova-compute[95467]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)
Nov 15 08:11:45 user nova-compute[95467]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)
Nov 15 08:11:45 user nova-compute[95467]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 (non-flash)
Nov 15 08:11:45 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-03837ee7-2992-4f24-a6f7-914a30622c25 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)
Nov 15 08:11:45 user nova-compute[95467]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)
Nov 15 08:11:45 user nova-compute[95467]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)
Nov 15 08:11:45 user nova-compute[95467]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 (non-flash)
Nov 15 08:11:45 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3155bfd1-3cb8-4fe3-8db9-38d58acdbad8 -p 172.16.0.220:3260 --login {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3155bfd1-3cb8-4fe3-8db9-38d58acdbad8 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5fcca45-d744-4840-86d7-1eb70af13db3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3155bfd1-3cb8-4fe3-8db9-38d58acdbad8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3155bfd1-3cb8-4fe3-8db9-38d58acdbad8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-03837ee7-2992-4f24-a6f7-914a30622c25 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3155bfd1-3cb8-4fe3-8db9-38d58acdbad8, portal: 172.16.0.220,3260]
Nov 15 08:11:45 user nova-compute[95467]: Login to [iface: default, target: iqn.2010-10.org.openstack:3155bfd1-3cb8-4fe3-8db9-38d58acdbad8, portal: 172.16.0.220,3260] successful.
Nov 15 08:11:45 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3155bfd1-3cb8-4fe3-8db9-38d58acdbad8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3155bfd1-3cb8-4fe3-8db9-38d58acdbad8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff57b00-a777-435c-9eca-8e6ab12cfd5a]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-03837ee7-2992-4f24-a6f7-914a30622c25 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[421026ff-2652-4dc3-b8f0-05cfeed54725]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3155bfd1-3cb8-4fe3-8db9-38d58acdbad8 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-03837ee7-2992-4f24-a6f7-914a30622c25 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)
Nov 15 08:11:45 user nova-compute[95467]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)
Nov 15 08:11:45 user nova-compute[95467]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)
Nov 15 08:11:45 user nova-compute[95467]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 (non-flash)
Nov 15 08:11:45 user nova-compute[95467]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3155bfd1-3cb8-4fe3-8db9-38d58acdbad8 (non-flash)
Nov 15 08:11:45 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-03837ee7-2992-4f24-a6f7-914a30622c25 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)
Nov 15 08:11:45 user nova-compute[95467]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)
Nov 15 08:11:45 user nova-compute[95467]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)
Nov 15 08:11:45 user nova-compute[95467]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 (non-flash)
Nov 15 08:11:45 user nova-compute[95467]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3155bfd1-3cb8-4fe3-8db9-38d58acdbad8 (non-flash)
Nov 15 08:11:45 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-03837ee7-2992-4f24-a6f7-914a30622c25 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3155bfd1-3cb8-4fe3-8db9-38d58acdbad8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-03837ee7-2992-4f24-a6f7-914a30622c25 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Connected to 172.16.0.220:3260 {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-03837ee7-2992-4f24-a6f7-914a30622c25 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=95467) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-03837ee7-2992-4f24-a6f7-914a30622c25 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=95467) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[370c3fcf-5cfe-4cfe-aa58-9bd9183103b4]: (4, ('- - 0', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-03837ee7-2992-4f24-a6f7-914a30622c25 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:11:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-03837ee7-2992-4f24-a6f7-914a30622c25 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:3155bfd1-3cb8-4fe3-8db9-38d58acdbad8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NRdLmaZr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 08:11:46 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:46 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-03837ee7-2992-4f24-a6f7-914a30622c25 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:11:46 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-03837ee7-2992-4f24-a6f7-914a30622c25 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '26233613035386238', 'path': '/dev/sdf'} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:11:46 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03837ee7-2992-4f24-a6f7-914a30622c25 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] [instance: b9210bbe-e728-4724-924b-1963226c092d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233613035386238', 'path': '/dev/sdf'} {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 08:11:46 user nova-compute[95467]: DEBUG nova.objects.instance [None req-03837ee7-2992-4f24-a6f7-914a30622c25 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Lazy-loading 'flavor' on Instance uuid b9210bbe-e728-4724-924b-1963226c092d {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:11:46 user nova-compute[95467]: DEBUG nova.compute.manager [req-f9114d98-bc71-4f9b-a1c8-62666234e22d req-76f7413e-55a3-4626-aeac-e8b50872e505 service nova] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Received event network-changed-5b51bd20-90a5-4fb1-816c-3d8e8824cb41 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:11:46 user nova-compute[95467]: DEBUG nova.compute.manager [req-f9114d98-bc71-4f9b-a1c8-62666234e22d req-76f7413e-55a3-4626-aeac-e8b50872e505 service nova] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Refreshing instance network info cache due to event network-changed-5b51bd20-90a5-4fb1-816c-3d8e8824cb41. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:11:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-f9114d98-bc71-4f9b-a1c8-62666234e22d req-76f7413e-55a3-4626-aeac-e8b50872e505 service nova] Acquiring lock "refresh_cache-36dccf43-d4a3-47aa-bd73-de9646e1020c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:11:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-f9114d98-bc71-4f9b-a1c8-62666234e22d req-76f7413e-55a3-4626-aeac-e8b50872e505 service nova] Acquired lock "refresh_cache-36dccf43-d4a3-47aa-bd73-de9646e1020c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:11:46 user nova-compute[95467]: DEBUG nova.network.neutron [req-f9114d98-bc71-4f9b-a1c8-62666234e22d req-76f7413e-55a3-4626-aeac-e8b50872e505 service nova] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Refreshing network info cache for port 5b51bd20-90a5-4fb1-816c-3d8e8824cb41 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:11:47 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-03837ee7-2992-4f24-a6f7-914a30622c25 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 08:11:47 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:11:47 user nova-compute[95467]:   <source dev="/dev/sdf"/>
Nov 15 08:11:47 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:11:47 user nova-compute[95467]:   <serial>3155bfd1-3cb8-4fe3-8db9-38d58acdbad8</serial>
Nov 15 08:11:47 user nova-compute[95467]: </disk>
Nov 15 08:11:47 user nova-compute[95467]:  {{(pid=95467) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 08:11:47 user nova-compute[95467]: DEBUG nova.network.neutron [req-f9114d98-bc71-4f9b-a1c8-62666234e22d req-76f7413e-55a3-4626-aeac-e8b50872e505 service nova] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Updated VIF entry in instance network info cache for port 5b51bd20-90a5-4fb1-816c-3d8e8824cb41. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:11:47 user nova-compute[95467]: DEBUG nova.network.neutron [req-f9114d98-bc71-4f9b-a1c8-62666234e22d req-76f7413e-55a3-4626-aeac-e8b50872e505 service nova] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Updating instance_info_cache with network_info: [{"id": "5b51bd20-90a5-4fb1-816c-3d8e8824cb41", "address": "fa:16:3e:79:70:b1", "network": {"id": "f7871b75-73b3-4f0a-8e6c-814bc61ebd6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-945672014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b04c448c61451d8d46ebc7a61a5e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b51bd20-90", "ovs_interfaceid": "5b51bd20-90a5-4fb1-816c-3d8e8824cb41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:11:47 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-f9114d98-bc71-4f9b-a1c8-62666234e22d req-76f7413e-55a3-4626-aeac-e8b50872e505 service nova] Releasing lock "refresh_cache-36dccf43-d4a3-47aa-bd73-de9646e1020c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:11:47 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-03837ee7-2992-4f24-a6f7-914a30622c25 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:11:47 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-03837ee7-2992-4f24-a6f7-914a30622c25 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] No BDM found with device name vdb, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:11:47 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-03837ee7-2992-4f24-a6f7-914a30622c25 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] No VIF found with MAC fa:16:3e:35:33:4d, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:11:47 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-03837ee7-2992-4f24-a6f7-914a30622c25 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Lock "b9210bbe-e728-4724-924b-1963226c092d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.496s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:11:47 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4efe1a1f-567b-4fdd-82a0-775a8080a422 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Acquiring lock "b9210bbe-e728-4724-924b-1963226c092d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:11:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4efe1a1f-567b-4fdd-82a0-775a8080a422 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Lock "b9210bbe-e728-4724-924b-1963226c092d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:11:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4efe1a1f-567b-4fdd-82a0-775a8080a422 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Acquiring lock "b9210bbe-e728-4724-924b-1963226c092d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:11:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4efe1a1f-567b-4fdd-82a0-775a8080a422 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Lock "b9210bbe-e728-4724-924b-1963226c092d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:11:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4efe1a1f-567b-4fdd-82a0-775a8080a422 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Lock "b9210bbe-e728-4724-924b-1963226c092d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:11:48 user nova-compute[95467]: INFO nova.compute.manager [None req-4efe1a1f-567b-4fdd-82a0-775a8080a422 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] [instance: b9210bbe-e728-4724-924b-1963226c092d] Terminating instance
Nov 15 08:11:48 user nova-compute[95467]: DEBUG nova.compute.manager [None req-4efe1a1f-567b-4fdd-82a0-775a8080a422 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] [instance: b9210bbe-e728-4724-924b-1963226c092d] Start destroying the instance on the hypervisor. {{(pid=95467) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 08:11:48 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:48 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:48 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:48 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:48 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:48 user nova-compute[95467]: DEBUG nova.compute.manager [req-fafec76b-80ad-4861-aa7e-731a0bdb8be6 req-f20ac74a-e451-4f79-8a72-6ba18f813f4d service nova] [instance: b9210bbe-e728-4724-924b-1963226c092d] Received event network-vif-unplugged-9599d4c0-f08b-4498-9c9a-119d83caa185 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:11:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-fafec76b-80ad-4861-aa7e-731a0bdb8be6 req-f20ac74a-e451-4f79-8a72-6ba18f813f4d service nova] Acquiring lock "b9210bbe-e728-4724-924b-1963226c092d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:11:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-fafec76b-80ad-4861-aa7e-731a0bdb8be6 req-f20ac74a-e451-4f79-8a72-6ba18f813f4d service nova] Lock "b9210bbe-e728-4724-924b-1963226c092d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:11:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-fafec76b-80ad-4861-aa7e-731a0bdb8be6 req-f20ac74a-e451-4f79-8a72-6ba18f813f4d service nova] Lock "b9210bbe-e728-4724-924b-1963226c092d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:11:48 user nova-compute[95467]: DEBUG nova.compute.manager [req-fafec76b-80ad-4861-aa7e-731a0bdb8be6 req-f20ac74a-e451-4f79-8a72-6ba18f813f4d service nova] [instance: b9210bbe-e728-4724-924b-1963226c092d] No waiting events found dispatching network-vif-unplugged-9599d4c0-f08b-4498-9c9a-119d83caa185 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:11:48 user nova-compute[95467]: DEBUG nova.compute.manager [req-fafec76b-80ad-4861-aa7e-731a0bdb8be6 req-f20ac74a-e451-4f79-8a72-6ba18f813f4d service nova] [instance: b9210bbe-e728-4724-924b-1963226c092d] Received event network-vif-unplugged-9599d4c0-f08b-4498-9c9a-119d83caa185 for instance with task_state deleting. {{(pid=95467) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 08:11:49 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: b9210bbe-e728-4724-924b-1963226c092d] Instance destroyed successfully.
Nov 15 08:11:49 user nova-compute[95467]: DEBUG nova.objects.instance [None req-4efe1a1f-567b-4fdd-82a0-775a8080a422 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Lazy-loading 'resources' on Instance uuid b9210bbe-e728-4724-924b-1963226c092d {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:11:49 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-4efe1a1f-567b-4fdd-82a0-775a8080a422 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:09:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-626150831',display_name='tempest-DeleteServersTestJSON-server-626150831',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-626150831',id=2,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:10:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bb0f20d51854422c86b85377dd75f96d',ramdisk_id='',reservation_id='r-c5o0lhis',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-962386278',owner_user_name='tempest-DeleteServersTestJSON-962386278-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:10:02Z,user_data=None,user_id='d669a1577f0446dd8ceea49ed89b0bf1',uuid=b9210bbe-e728-4724-924b-1963226c092d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9599d4c0-f08b-4498-9c9a-119d83caa185", "address": "fa:16:3e:35:33:4d", "network": {"id": "0a2ee949-f9ab-4b7b-a4da-f9f9cc4da5c5", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1737037548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb0f20d51854422c86b85377dd75f96d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9599d4c0-f0", "ovs_interfaceid": "9599d4c0-f08b-4498-9c9a-119d83caa185", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:11:49 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-4efe1a1f-567b-4fdd-82a0-775a8080a422 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Converting VIF {"id": "9599d4c0-f08b-4498-9c9a-119d83caa185", "address": "fa:16:3e:35:33:4d", "network": {"id": "0a2ee949-f9ab-4b7b-a4da-f9f9cc4da5c5", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1737037548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb0f20d51854422c86b85377dd75f96d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9599d4c0-f0", "ovs_interfaceid": "9599d4c0-f08b-4498-9c9a-119d83caa185", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:11:49 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-4efe1a1f-567b-4fdd-82a0-775a8080a422 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:33:4d,bridge_name='br-int',has_traffic_filtering=True,id=9599d4c0-f08b-4498-9c9a-119d83caa185,network=Network(0a2ee949-f9ab-4b7b-a4da-f9f9cc4da5c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9599d4c0-f0') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:11:49 user nova-compute[95467]: DEBUG os_vif [None req-4efe1a1f-567b-4fdd-82a0-775a8080a422 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:33:4d,bridge_name='br-int',has_traffic_filtering=True,id=9599d4c0-f08b-4498-9c9a-119d83caa185,network=Network(0a2ee949-f9ab-4b7b-a4da-f9f9cc4da5c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9599d4c0-f0') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:11:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9599d4c0-f0, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:11:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:11:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1cad1968-7419-436d-957b-ca250a25075c) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:11:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:11:49 user nova-compute[95467]: INFO os_vif [None req-4efe1a1f-567b-4fdd-82a0-775a8080a422 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:33:4d,bridge_name='br-int',has_traffic_filtering=True,id=9599d4c0-f08b-4498-9c9a-119d83caa185,network=Network(0a2ee949-f9ab-4b7b-a4da-f9f9cc4da5c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9599d4c0-f0')
Nov 15 08:11:49 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4efe1a1f-567b-4fdd-82a0-775a8080a422 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] [instance: b9210bbe-e728-4724-924b-1963226c092d] calling os-brick to detach iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 08:11:49 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-4efe1a1f-567b-4fdd-82a0-775a8080a422 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, {'target_iqn': 'iqn.2010-10.org.openstack:3155bfd1-3cb8-4fe3-8db9-38d58acdbad8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NRdLmaZr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:11:49 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-4efe1a1f-567b-4fdd-82a0-775a8080a422 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:11:49 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-4efe1a1f-567b-4fdd-82a0-775a8080a422 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:11:49 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-4efe1a1f-567b-4fdd-82a0-775a8080a422 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:11:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:49 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[1358ae8d-6c3e-4021-a399-bfac1f1a0f44]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3155bfd1-3cb8-4fe3-8db9-38d58acdbad8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:11:49 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-4efe1a1f-567b-4fdd-82a0-775a8080a422 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 08:11:49 user nova-compute[95467]: No targets found.
Nov 15 08:11:49 user nova-compute[95467]: iSNS:
Nov 15 08:11:49 user nova-compute[95467]: No targets found.
Nov 15 08:11:49 user nova-compute[95467]: STATIC:
Nov 15 08:11:49 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f
Nov 15 08:11:49 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:11:49 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:11:49 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8
Nov 15 08:11:49 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:11:49 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:11:49 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:3155bfd1-3cb8-4fe3-8db9-38d58acdbad8
Nov 15 08:11:49 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:11:49 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:11:49 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05
Nov 15 08:11:49 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:11:49 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:11:49 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5
Nov 15 08:11:49 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:11:49 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:11:49 user nova-compute[95467]: FIRMWARE:
Nov 15 08:11:49 user nova-compute[95467]: No targets found.
Nov 15 08:11:49 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:11:49 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-4efe1a1f-567b-4fdd-82a0-775a8080a422 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 08:11:49 user nova-compute[95467]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 08:11:49 user nova-compute[95467]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=95467) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 08:11:49 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-4efe1a1f-567b-4fdd-82a0-775a8080a422 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3155bfd1-3cb8-4fe3-8db9-38d58acdbad8', 0)] {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 08:11:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:49 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[856c9844-788e-4370-b60f-07e699d48272]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3155bfd1-3cb8-4fe3-8db9-38d58acdbad8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:11:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:49 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[29435f80-0e1e-4409-86f2-144a167f1ef7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3155bfd1-3cb8-4fe3-8db9-38d58acdbad8 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:11:49 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-4efe1a1f-567b-4fdd-82a0-775a8080a422 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)
Nov 15 08:11:49 user nova-compute[95467]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)
Nov 15 08:11:49 user nova-compute[95467]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)
Nov 15 08:11:49 user nova-compute[95467]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 (non-flash)
Nov 15 08:11:49 user nova-compute[95467]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3155bfd1-3cb8-4fe3-8db9-38d58acdbad8 (non-flash)
Nov 15 08:11:49 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:11:49 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-4efe1a1f-567b-4fdd-82a0-775a8080a422 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)
Nov 15 08:11:49 user nova-compute[95467]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)
Nov 15 08:11:49 user nova-compute[95467]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)
Nov 15 08:11:49 user nova-compute[95467]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 (non-flash)
Nov 15 08:11:49 user nova-compute[95467]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3155bfd1-3cb8-4fe3-8db9-38d58acdbad8 (non-flash)
Nov 15 08:11:49 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:11:49 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-4efe1a1f-567b-4fdd-82a0-775a8080a422 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efed8334430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3155bfd1-3cb8-4fe3-8db9-38d58acdbad8'): ({'sdf'}, set())}) {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 08:11:49 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-4efe1a1f-567b-4fdd-82a0-775a8080a422 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Removing single pathed devices sdf {{(pid=95467) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 08:11:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:49 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[162c9f8b-d2dd-4f94-a899-adfcaba504d3]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:11:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.024s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:49 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[856785d2-f247-49e5-b5d2-be157b512554]: (4, ('ok\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:11:49 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-4efe1a1f-567b-4fdd-82a0-775a8080a422 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Flushing IO for device /dev/sdf {{(pid=95467) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 08:11:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:49 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8298d8b-98bb-4190-97cf-80271b3d67ed]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:11:49 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-4efe1a1f-567b-4fdd-82a0-775a8080a422 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=95467) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 08:11:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.037s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:49 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f770603d-2fd6-42ad-9a92-6c5bb82e9033]: (4, ('1', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:11:49 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-4efe1a1f-567b-4fdd-82a0-775a8080a422 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 08:11:49 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-4efe1a1f-567b-4fdd-82a0-775a8080a422 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] SCSI volumes sdf have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 08:11:49 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-4efe1a1f-567b-4fdd-82a0-775a8080a422 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3155bfd1-3cb8-4fe3-8db9-38d58acdbad8')] {{(pid=95467) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 08:11:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3155bfd1-3cb8-4fe3-8db9-38d58acdbad8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3155bfd1-3cb8-4fe3-8db9-38d58acdbad8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:49 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda66d2a-9845-40fa-9b78-fceb3e093de6]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:11:49 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-4efe1a1f-567b-4fdd-82a0-775a8080a422 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:11:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3155bfd1-3cb8-4fe3-8db9-38d58acdbad8 -p 172.16.0.220:3260 --logout {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3155bfd1-3cb8-4fe3-8db9-38d58acdbad8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:49 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea7ab91-4e04-4dd8-83c4-95a2679492ff]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:3155bfd1-3cb8-4fe3-8db9-38d58acdbad8, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:3155bfd1-3cb8-4fe3-8db9-38d58acdbad8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:11:49 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-4efe1a1f-567b-4fdd-82a0-775a8080a422 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:3155bfd1-3cb8-4fe3-8db9-38d58acdbad8, portal: 172.16.0.220,3260]
Nov 15 08:11:49 user nova-compute[95467]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:3155bfd1-3cb8-4fe3-8db9-38d58acdbad8, portal: 172.16.0.220,3260] successful.
Nov 15 08:11:49 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:11:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3155bfd1-3cb8-4fe3-8db9-38d58acdbad8 -p 172.16.0.220:3260 --op delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3155bfd1-3cb8-4fe3-8db9-38d58acdbad8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:49 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b436405-7ff2-400b-abd2-2bfb9bb12d88]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:11:49 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-4efe1a1f-567b-4fdd-82a0-775a8080a422 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:11:49 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-4efe1a1f-567b-4fdd-82a0-775a8080a422 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:11:49 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-4efe1a1f-567b-4fdd-82a0-775a8080a422 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] <== disconnect_volume: return (309ms) None {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:11:49 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4efe1a1f-567b-4fdd-82a0-775a8080a422 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] [instance: b9210bbe-e728-4724-924b-1963226c092d] Disconnected iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 08:11:49 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-4efe1a1f-567b-4fdd-82a0-775a8080a422 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] [instance: b9210bbe-e728-4724-924b-1963226c092d] Deleting instance files /opt/stack/data/nova/instances/b9210bbe-e728-4724-924b-1963226c092d_del
Nov 15 08:11:49 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-4efe1a1f-567b-4fdd-82a0-775a8080a422 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] [instance: b9210bbe-e728-4724-924b-1963226c092d] Deletion of /opt/stack/data/nova/instances/b9210bbe-e728-4724-924b-1963226c092d_del complete
Nov 15 08:11:49 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-4efe1a1f-567b-4fdd-82a0-775a8080a422 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Checking UEFI support for host arch (x86_64) {{(pid=95467) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 15 08:11:49 user nova-compute[95467]: INFO nova.virt.libvirt.host [None req-4efe1a1f-567b-4fdd-82a0-775a8080a422 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] UEFI support detected
Nov 15 08:11:49 user nova-compute[95467]: INFO nova.compute.manager [None req-4efe1a1f-567b-4fdd-82a0-775a8080a422 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] [instance: b9210bbe-e728-4724-924b-1963226c092d] Took 1.62 seconds to destroy the instance on the hypervisor.
Nov 15 08:11:49 user nova-compute[95467]: DEBUG oslo.service.loopingcall [None req-4efe1a1f-567b-4fdd-82a0-775a8080a422 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=95467) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 08:11:49 user nova-compute[95467]: DEBUG nova.compute.manager [-] [instance: b9210bbe-e728-4724-924b-1963226c092d] Deallocating network for instance {{(pid=95467) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 08:11:49 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: b9210bbe-e728-4724-924b-1963226c092d] deallocate_for_instance() {{(pid=95467) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 08:11:50 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: b9210bbe-e728-4724-924b-1963226c092d] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:11:50 user nova-compute[95467]: INFO nova.compute.manager [-] [instance: b9210bbe-e728-4724-924b-1963226c092d] Took 0.72 seconds to deallocate network for instance.
Nov 15 08:11:50 user nova-compute[95467]: DEBUG nova.compute.manager [req-aa5ce75b-44c5-49f3-9260-08dcc560bf92 req-88f3e0a4-c8ea-40e2-b04e-5624b044513c service nova] [instance: b9210bbe-e728-4724-924b-1963226c092d] Received event network-vif-deleted-9599d4c0-f08b-4498-9c9a-119d83caa185 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:11:50 user nova-compute[95467]: INFO nova.compute.manager [req-aa5ce75b-44c5-49f3-9260-08dcc560bf92 req-88f3e0a4-c8ea-40e2-b04e-5624b044513c service nova] [instance: b9210bbe-e728-4724-924b-1963226c092d] Neutron deleted interface 9599d4c0-f08b-4498-9c9a-119d83caa185; detaching it from the instance and deleting it from the info cache
Nov 15 08:11:50 user nova-compute[95467]: DEBUG nova.network.neutron [req-aa5ce75b-44c5-49f3-9260-08dcc560bf92 req-88f3e0a4-c8ea-40e2-b04e-5624b044513c service nova] [instance: b9210bbe-e728-4724-924b-1963226c092d] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:11:50 user nova-compute[95467]: DEBUG nova.compute.manager [req-aa5ce75b-44c5-49f3-9260-08dcc560bf92 req-88f3e0a4-c8ea-40e2-b04e-5624b044513c service nova] [instance: b9210bbe-e728-4724-924b-1963226c092d] Detach interface failed, port_id=9599d4c0-f08b-4498-9c9a-119d83caa185, reason: Instance b9210bbe-e728-4724-924b-1963226c092d could not be found. {{(pid=95467) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 08:11:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-044b1a66-c6e1-4daf-83ef-f3ffefc0b24e tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Acquiring lock "36dccf43-d4a3-47aa-bd73-de9646e1020c" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:11:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-044b1a66-c6e1-4daf-83ef-f3ffefc0b24e tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "36dccf43-d4a3-47aa-bd73-de9646e1020c" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:11:50 user nova-compute[95467]: INFO nova.compute.manager [None req-044b1a66-c6e1-4daf-83ef-f3ffefc0b24e tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Shelving
Nov 15 08:11:50 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:50 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:50 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:50 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:50 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:50 user nova-compute[95467]: DEBUG nova.compute.manager [req-789c00c3-2c9b-41b1-94f6-c53c78d688f8 req-b8a87427-8563-4a6a-a276-88ed0e0ab912 service nova] [instance: b9210bbe-e728-4724-924b-1963226c092d] Received event network-vif-plugged-9599d4c0-f08b-4498-9c9a-119d83caa185 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:11:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-789c00c3-2c9b-41b1-94f6-c53c78d688f8 req-b8a87427-8563-4a6a-a276-88ed0e0ab912 service nova] Acquiring lock "b9210bbe-e728-4724-924b-1963226c092d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:11:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-789c00c3-2c9b-41b1-94f6-c53c78d688f8 req-b8a87427-8563-4a6a-a276-88ed0e0ab912 service nova] Lock "b9210bbe-e728-4724-924b-1963226c092d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:11:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-789c00c3-2c9b-41b1-94f6-c53c78d688f8 req-b8a87427-8563-4a6a-a276-88ed0e0ab912 service nova] Lock "b9210bbe-e728-4724-924b-1963226c092d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:11:50 user nova-compute[95467]: DEBUG nova.compute.manager [req-789c00c3-2c9b-41b1-94f6-c53c78d688f8 req-b8a87427-8563-4a6a-a276-88ed0e0ab912 service nova] [instance: b9210bbe-e728-4724-924b-1963226c092d] No waiting events found dispatching network-vif-plugged-9599d4c0-f08b-4498-9c9a-119d83caa185 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:11:50 user nova-compute[95467]: WARNING nova.compute.manager [req-789c00c3-2c9b-41b1-94f6-c53c78d688f8 req-b8a87427-8563-4a6a-a276-88ed0e0ab912 service nova] [instance: b9210bbe-e728-4724-924b-1963226c092d] Received unexpected event network-vif-plugged-9599d4c0-f08b-4498-9c9a-119d83caa185 for instance with vm_state active and task_state deleting.
Nov 15 08:11:51 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2fd77541-93fe-4682-99f5-bd1e6d876c6c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] Calling os-brick to attach iSCSI Volume {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 08:11:51 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd77541-93fe-4682-99f5-bd1e6d876c6c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aqDmsYSV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:11:51 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-2fd77541-93fe-4682-99f5-bd1e6d876c6c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:11:51 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-2fd77541-93fe-4682-99f5-bd1e6d876c6c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:11:51 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-2fd77541-93fe-4682-99f5-bd1e6d876c6c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:11:51 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-2fd77541-93fe-4682-99f5-bd1e6d876c6c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:11:51 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-2fd77541-93fe-4682-99f5-bd1e6d876c6c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:11:51 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-2fd77541-93fe-4682-99f5-bd1e6d876c6c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:11:51 user nova-compute[95467]: INFO os_brick.initiator.connectors.iscsi [None req-2fd77541-93fe-4682-99f5-bd1e6d876c6c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 08:11:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de -p 172.16.0.220:3260 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de -p 172.16.0.220:3260" returned: 21 in 0.030s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:51 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77966d3-f98c-4cd2-b64d-33bf0ca53d9e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:11:51 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd77541-93fe-4682-99f5-bd1e6d876c6c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 08:11:51 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:11:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de -p 172.16.0.220:3260 --interface default --op new {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:51 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d87e2aa-439b-4dca-a411-056f40f2b4f7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de] added\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:11:51 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd77541-93fe-4682-99f5-bd1e6d876c6c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de] added
Nov 15 08:11:51 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:11:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:51 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[598fd66a-7309-4f80-94f8-476c114d838b]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:11:51 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd77541-93fe-4682-99f5-bd1e6d876c6c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:11:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:51 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[3607fae1-05d4-491d-9738-621d1a2ce60e]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:11:51 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd77541-93fe-4682-99f5-bd1e6d876c6c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:11:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aqDmsYSV {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aqDmsYSV" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:51 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f3db81-a98a-4b3a-a489-9cb28798988f]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:11:51 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd77541-93fe-4682-99f5-bd1e6d876c6c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aqDmsYSV'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:11:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:51 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa9dc73-8aee-4b3c-b12f-fb33419799e3]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:11:51 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd77541-93fe-4682-99f5-bd1e6d876c6c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:11:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:51 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94ad5aa-d4c8-4d27-bc67-96a84a2846c2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:11:51 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd77541-93fe-4682-99f5-bd1e6d876c6c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)
Nov 15 08:11:51 user nova-compute[95467]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)
Nov 15 08:11:51 user nova-compute[95467]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)
Nov 15 08:11:51 user nova-compute[95467]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 (non-flash)
Nov 15 08:11:51 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:11:51 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd77541-93fe-4682-99f5-bd1e6d876c6c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)
Nov 15 08:11:51 user nova-compute[95467]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)
Nov 15 08:11:51 user nova-compute[95467]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)
Nov 15 08:11:51 user nova-compute[95467]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 (non-flash)
Nov 15 08:11:51 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:11:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de -p 172.16.0.220:3260 --login {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:51 user nova-compute[95467]: INFO nova.compute.manager [None req-4efe1a1f-567b-4fdd-82a0-775a8080a422 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] [instance: b9210bbe-e728-4724-924b-1963226c092d] Took 0.92 seconds to detach 1 volumes for instance.
Nov 15 08:11:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:51 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3038a71-6ee5-49dd-a52e-90af38dc2b23]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:11:51 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd77541-93fe-4682-99f5-bd1e6d876c6c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de, portal: 172.16.0.220,3260]
Nov 15 08:11:51 user nova-compute[95467]: Login to [iface: default, target: iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de, portal: 172.16.0.220,3260] successful.
Nov 15 08:11:51 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:11:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4efe1a1f-567b-4fdd-82a0-775a8080a422 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:11:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4efe1a1f-567b-4fdd-82a0-775a8080a422 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:11:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:51 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[5523198c-d464-42dd-8572-3c01e4fc7bfd]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:11:51 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd77541-93fe-4682-99f5-bd1e6d876c6c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:11:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:51 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Instance destroyed successfully.
Nov 15 08:11:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:51 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d70dbc-5d73-4ec3-86d7-f56b516abd8c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:11:51 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd77541-93fe-4682-99f5-bd1e6d876c6c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)
Nov 15 08:11:51 user nova-compute[95467]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)
Nov 15 08:11:51 user nova-compute[95467]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)
Nov 15 08:11:51 user nova-compute[95467]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 (non-flash)
Nov 15 08:11:51 user nova-compute[95467]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)
Nov 15 08:11:51 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:11:51 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd77541-93fe-4682-99f5-bd1e6d876c6c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)
Nov 15 08:11:51 user nova-compute[95467]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)
Nov 15 08:11:51 user nova-compute[95467]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)
Nov 15 08:11:51 user nova-compute[95467]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 (non-flash)
Nov 15 08:11:51 user nova-compute[95467]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)
Nov 15 08:11:51 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:11:51 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-2fd77541-93fe-4682-99f5-bd1e6d876c6c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:11:51 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd77541-93fe-4682-99f5-bd1e6d876c6c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Connected to 172.16.0.220:3260 {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 08:11:51 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-2fd77541-93fe-4682-99f5-bd1e6d876c6c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=95467) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 08:11:51 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-2fd77541-93fe-4682-99f5-bd1e6d876c6c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=95467) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 08:11:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:51 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bdaecd4-c040-48ba-8133-ac2f4c507e9f]: (4, ('- - 0', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:11:51 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-2fd77541-93fe-4682-99f5-bd1e6d876c6c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:11:51 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd77541-93fe-4682-99f5-bd1e6d876c6c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aqDmsYSV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 08:11:51 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-044b1a66-c6e1-4daf-83ef-f3ffefc0b24e tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Beginning cold snapshot process
Nov 15 08:11:51 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:51 user nova-compute[95467]: DEBUG nova.privsep.utils [None req-044b1a66-c6e1-4daf-83ef-f3ffefc0b24e tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=95467) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 08:11:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-044b1a66-c6e1-4daf-83ef-f3ffefc0b24e tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/36dccf43-d4a3-47aa-bd73-de9646e1020c/disk /opt/stack/data/nova/instances/snapshots/tmpopgmxko_/1f4a16b1990546b4b3e03124b467eec0 {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:51 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-4efe1a1f-567b-4fdd-82a0-775a8080a422 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:11:51 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-4efe1a1f-567b-4fdd-82a0-775a8080a422 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:11:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4efe1a1f-567b-4fdd-82a0-775a8080a422 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.479s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:11:52 user nova-compute[95467]: INFO nova.scheduler.client.report [None req-4efe1a1f-567b-4fdd-82a0-775a8080a422 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Deleted allocations for instance b9210bbe-e728-4724-924b-1963226c092d
Nov 15 08:11:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4efe1a1f-567b-4fdd-82a0-775a8080a422 tempest-DeleteServersTestJSON-962386278 tempest-DeleteServersTestJSON-962386278-project-member] Lock "b9210bbe-e728-4724-924b-1963226c092d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.028s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:11:52 user nova-compute[95467]: DEBUG nova.compute.manager [req-bfb10b20-bc0b-4fa5-9de9-fa638def9d38 req-89bdd914-3d04-4aaa-8d23-e843adbdedaa service nova] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Received event network-vif-unplugged-5b51bd20-90a5-4fb1-816c-3d8e8824cb41 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:11:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-bfb10b20-bc0b-4fa5-9de9-fa638def9d38 req-89bdd914-3d04-4aaa-8d23-e843adbdedaa service nova] Acquiring lock "36dccf43-d4a3-47aa-bd73-de9646e1020c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:11:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-bfb10b20-bc0b-4fa5-9de9-fa638def9d38 req-89bdd914-3d04-4aaa-8d23-e843adbdedaa service nova] Lock "36dccf43-d4a3-47aa-bd73-de9646e1020c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:11:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-bfb10b20-bc0b-4fa5-9de9-fa638def9d38 req-89bdd914-3d04-4aaa-8d23-e843adbdedaa service nova] Lock "36dccf43-d4a3-47aa-bd73-de9646e1020c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:11:52 user nova-compute[95467]: DEBUG nova.compute.manager [req-bfb10b20-bc0b-4fa5-9de9-fa638def9d38 req-89bdd914-3d04-4aaa-8d23-e843adbdedaa service nova] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] No waiting events found dispatching network-vif-unplugged-5b51bd20-90a5-4fb1-816c-3d8e8824cb41 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:11:52 user nova-compute[95467]: WARNING nova.compute.manager [req-bfb10b20-bc0b-4fa5-9de9-fa638def9d38 req-89bdd914-3d04-4aaa-8d23-e843adbdedaa service nova] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Received unexpected event network-vif-unplugged-5b51bd20-90a5-4fb1-816c-3d8e8824cb41 for instance with vm_state active and task_state shelving_image_pending_upload.
Nov 15 08:11:52 user nova-compute[95467]: DEBUG nova.compute.manager [req-bfb10b20-bc0b-4fa5-9de9-fa638def9d38 req-89bdd914-3d04-4aaa-8d23-e843adbdedaa service nova] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Received event network-vif-plugged-5b51bd20-90a5-4fb1-816c-3d8e8824cb41 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:11:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-bfb10b20-bc0b-4fa5-9de9-fa638def9d38 req-89bdd914-3d04-4aaa-8d23-e843adbdedaa service nova] Acquiring lock "36dccf43-d4a3-47aa-bd73-de9646e1020c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:11:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-bfb10b20-bc0b-4fa5-9de9-fa638def9d38 req-89bdd914-3d04-4aaa-8d23-e843adbdedaa service nova] Lock "36dccf43-d4a3-47aa-bd73-de9646e1020c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:11:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-bfb10b20-bc0b-4fa5-9de9-fa638def9d38 req-89bdd914-3d04-4aaa-8d23-e843adbdedaa service nova] Lock "36dccf43-d4a3-47aa-bd73-de9646e1020c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:11:52 user nova-compute[95467]: DEBUG nova.compute.manager [req-bfb10b20-bc0b-4fa5-9de9-fa638def9d38 req-89bdd914-3d04-4aaa-8d23-e843adbdedaa service nova] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] No waiting events found dispatching network-vif-plugged-5b51bd20-90a5-4fb1-816c-3d8e8824cb41 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:11:52 user nova-compute[95467]: WARNING nova.compute.manager [req-bfb10b20-bc0b-4fa5-9de9-fa638def9d38 req-89bdd914-3d04-4aaa-8d23-e843adbdedaa service nova] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Received unexpected event network-vif-plugged-5b51bd20-90a5-4fb1-816c-3d8e8824cb41 for instance with vm_state active and task_state shelving_image_pending_upload.
Nov 15 08:11:52 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-2fd77541-93fe-4682-99f5-bd1e6d876c6c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:11:52 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd77541-93fe-4682-99f5-bd1e6d876c6c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '26361346466353766', 'path': '/dev/sdf'} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:11:52 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2fd77541-93fe-4682-99f5-bd1e6d876c6c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26361346466353766', 'path': '/dev/sdf'} {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 08:11:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-044b1a66-c6e1-4daf-83ef-f3ffefc0b24e tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/36dccf43-d4a3-47aa-bd73-de9646e1020c/disk /opt/stack/data/nova/instances/snapshots/tmpopgmxko_/1f4a16b1990546b4b3e03124b467eec0" returned: 0 in 0.763s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:52 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-044b1a66-c6e1-4daf-83ef-f3ffefc0b24e tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Snapshot extracted, beginning image upload
Nov 15 08:11:52 user nova-compute[95467]: DEBUG nova.objects.instance [None req-2fd77541-93fe-4682-99f5-bd1e6d876c6c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lazy-loading 'flavor' on Instance uuid 5748cf5d-9c57-4477-8952-ec39d0d18f55 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:11:52 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-2fd77541-93fe-4682-99f5-bd1e6d876c6c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 08:11:52 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:11:52 user nova-compute[95467]:   <source dev="/dev/sdf"/>
Nov 15 08:11:52 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:11:52 user nova-compute[95467]:   <serial>90e04b69-1404-4a84-a441-9de70a5ca0de</serial>
Nov 15 08:11:52 user nova-compute[95467]: </disk>
Nov 15 08:11:52 user nova-compute[95467]:  {{(pid=95467) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 08:11:52 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-2fd77541-93fe-4682-99f5-bd1e6d876c6c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:11:52 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-2fd77541-93fe-4682-99f5-bd1e6d876c6c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] No BDM found with device name vdb, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:11:52 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-2fd77541-93fe-4682-99f5-bd1e6d876c6c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] No VIF found with MAC fa:16:3e:e1:8a:d4, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:11:53 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-2fd77541-93fe-4682-99f5-bd1e6d876c6c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "5748cf5d-9c57-4477-8952-ec39d0d18f55" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.989s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:11:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:55 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-044b1a66-c6e1-4daf-83ef-f3ffefc0b24e tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Snapshot image upload complete
Nov 15 08:11:55 user nova-compute[95467]: DEBUG nova.compute.manager [None req-044b1a66-c6e1-4daf-83ef-f3ffefc0b24e tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:11:55 user nova-compute[95467]: INFO nova.compute.manager [None req-044b1a66-c6e1-4daf-83ef-f3ffefc0b24e tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Shelve offloading
Nov 15 08:11:55 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Instance destroyed successfully.
Nov 15 08:11:55 user nova-compute[95467]: DEBUG nova.compute.manager [None req-044b1a66-c6e1-4daf-83ef-f3ffefc0b24e tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:11:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-044b1a66-c6e1-4daf-83ef-f3ffefc0b24e tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Acquiring lock "refresh_cache-36dccf43-d4a3-47aa-bd73-de9646e1020c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:11:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-044b1a66-c6e1-4daf-83ef-f3ffefc0b24e tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Acquired lock "refresh_cache-36dccf43-d4a3-47aa-bd73-de9646e1020c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:11:55 user nova-compute[95467]: DEBUG nova.network.neutron [None req-044b1a66-c6e1-4daf-83ef-f3ffefc0b24e tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:11:55 user nova-compute[95467]: DEBUG nova.network.neutron [None req-044b1a66-c6e1-4daf-83ef-f3ffefc0b24e tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Updating instance_info_cache with network_info: [{"id": "5b51bd20-90a5-4fb1-816c-3d8e8824cb41", "address": "fa:16:3e:79:70:b1", "network": {"id": "f7871b75-73b3-4f0a-8e6c-814bc61ebd6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-945672014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b04c448c61451d8d46ebc7a61a5e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b51bd20-90", "ovs_interfaceid": "5b51bd20-90a5-4fb1-816c-3d8e8824cb41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:11:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-044b1a66-c6e1-4daf-83ef-f3ffefc0b24e tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Releasing lock "refresh_cache-36dccf43-d4a3-47aa-bd73-de9646e1020c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:11:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Acquiring lock "60e20e77-6091-4abc-bbad-b5f21a2071c3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:11:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "60e20e77-6091-4abc-bbad-b5f21a2071c3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:11:56 user nova-compute[95467]: DEBUG nova.compute.manager [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 60e20e77-6091-4abc-bbad-b5f21a2071c3] Starting instance... {{(pid=95467) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 08:11:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:11:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:11:56 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=95467) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 08:11:56 user nova-compute[95467]: INFO nova.compute.claims [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 60e20e77-6091-4abc-bbad-b5f21a2071c3] Claim successful on node user
Nov 15 08:11:56 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:11:56 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:11:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.460s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:11:56 user nova-compute[95467]: DEBUG nova.compute.manager [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 60e20e77-6091-4abc-bbad-b5f21a2071c3] Start building networks asynchronously for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 08:11:56 user nova-compute[95467]: DEBUG nova.compute.manager [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 60e20e77-6091-4abc-bbad-b5f21a2071c3] Allocating IP information in the background. {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 08:11:56 user nova-compute[95467]: DEBUG nova.network.neutron [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 60e20e77-6091-4abc-bbad-b5f21a2071c3] allocate_for_instance() {{(pid=95467) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 08:11:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:56 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 60e20e77-6091-4abc-bbad-b5f21a2071c3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 08:11:56 user nova-compute[95467]: DEBUG nova.compute.manager [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 60e20e77-6091-4abc-bbad-b5f21a2071c3] Start building block device mappings for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 08:11:56 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Instance destroyed successfully.
Nov 15 08:11:56 user nova-compute[95467]: DEBUG nova.objects.instance [None req-044b1a66-c6e1-4daf-83ef-f3ffefc0b24e tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lazy-loading 'resources' on Instance uuid 36dccf43-d4a3-47aa-bd73-de9646e1020c {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:11:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-044b1a66-c6e1-4daf-83ef-f3ffefc0b24e tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:09:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1540652883',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1540652883',id=5,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPMudjIgLQ94PJgpuT923qN+L46wuVWcOs/AgJykHjR77r/+WQhcSpcm7aHqbK6GHFvMQ7s34dtAlIeCULffYjuYC9U228iElL9IbpM1YAAXm8GMSQ4zQ7BkpCVv6WHbg==',key_name='tempest-keypair-1788942377',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:10:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='94b04c448c61451d8d46ebc7a61a5e6e',ramdisk_id='',reservation_id='r-0d1eau01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1251988905',owner_user_name='tempest-AttachVolumeShelveTestJSON-1251988905-project-member',shelved_at='2023-11-15T08:11:55.202910',shelved_host='user',shelved_image_id='30ebae06-a194-4c9e-ba4b-9067f89f8a9c'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:11:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b03564d022e84f5cb133b9771e76bae8',uuid=36dccf43-d4a3-47aa-bd73-de9646e1020c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "5b51bd20-90a5-4fb1-816c-3d8e8824cb41", "address": "fa:16:3e:79:70:b1", "network": {"id": "f7871b75-73b3-4f0a-8e6c-814bc61ebd6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-945672014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b04c448c61451d8d46ebc7a61a5e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b51bd20-90", "ovs_interfaceid": "5b51bd20-90a5-4fb1-816c-3d8e8824cb41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:11:56 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-044b1a66-c6e1-4daf-83ef-f3ffefc0b24e tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Converting VIF {"id": "5b51bd20-90a5-4fb1-816c-3d8e8824cb41", "address": "fa:16:3e:79:70:b1", "network": {"id": "f7871b75-73b3-4f0a-8e6c-814bc61ebd6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-945672014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b04c448c61451d8d46ebc7a61a5e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b51bd20-90", "ovs_interfaceid": "5b51bd20-90a5-4fb1-816c-3d8e8824cb41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:11:56 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-044b1a66-c6e1-4daf-83ef-f3ffefc0b24e tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:70:b1,bridge_name='br-int',has_traffic_filtering=True,id=5b51bd20-90a5-4fb1-816c-3d8e8824cb41,network=Network(f7871b75-73b3-4f0a-8e6c-814bc61ebd6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b51bd20-90') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:11:56 user nova-compute[95467]: DEBUG os_vif [None req-044b1a66-c6e1-4daf-83ef-f3ffefc0b24e tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:70:b1,bridge_name='br-int',has_traffic_filtering=True,id=5b51bd20-90a5-4fb1-816c-3d8e8824cb41,network=Network(f7871b75-73b3-4f0a-8e6c-814bc61ebd6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b51bd20-90') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:11:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b51bd20-90, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:11:56 user nova-compute[95467]: DEBUG nova.compute.manager [req-53606145-2431-4f9c-9f7d-1d43b922bb4d req-68ed4f5a-b274-4e00-9c00-b211c52789e5 service nova] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Received event network-changed-5b51bd20-90a5-4fb1-816c-3d8e8824cb41 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:11:56 user nova-compute[95467]: DEBUG nova.compute.manager [req-53606145-2431-4f9c-9f7d-1d43b922bb4d req-68ed4f5a-b274-4e00-9c00-b211c52789e5 service nova] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Refreshing instance network info cache due to event network-changed-5b51bd20-90a5-4fb1-816c-3d8e8824cb41. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:11:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-53606145-2431-4f9c-9f7d-1d43b922bb4d req-68ed4f5a-b274-4e00-9c00-b211c52789e5 service nova] Acquiring lock "refresh_cache-36dccf43-d4a3-47aa-bd73-de9646e1020c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:11:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-53606145-2431-4f9c-9f7d-1d43b922bb4d req-68ed4f5a-b274-4e00-9c00-b211c52789e5 service nova] Acquired lock "refresh_cache-36dccf43-d4a3-47aa-bd73-de9646e1020c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:11:56 user nova-compute[95467]: DEBUG nova.network.neutron [req-53606145-2431-4f9c-9f7d-1d43b922bb4d req-68ed4f5a-b274-4e00-9c00-b211c52789e5 service nova] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Refreshing network info cache for port 5b51bd20-90a5-4fb1-816c-3d8e8824cb41 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:11:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:56 user nova-compute[95467]: DEBUG nova.compute.manager [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 60e20e77-6091-4abc-bbad-b5f21a2071c3] Start spawning the instance on the hypervisor. {{(pid=95467) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 08:11:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 60e20e77-6091-4abc-bbad-b5f21a2071c3] Creating instance directory {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 08:11:56 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 60e20e77-6091-4abc-bbad-b5f21a2071c3] Creating image(s)
Nov 15 08:11:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Acquiring lock "/opt/stack/data/nova/instances/60e20e77-6091-4abc-bbad-b5f21a2071c3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:11:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "/opt/stack/data/nova/instances/60e20e77-6091-4abc-bbad-b5f21a2071c3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:11:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "/opt/stack/data/nova/instances/60e20e77-6091-4abc-bbad-b5f21a2071c3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:11:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:11:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=15ee3c0b-6aa1-47a5-8594-7a8928f937a1) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:11:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:11:56 user nova-compute[95467]: INFO os_vif [None req-044b1a66-c6e1-4daf-83ef-f3ffefc0b24e tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:70:b1,bridge_name='br-int',has_traffic_filtering=True,id=5b51bd20-90a5-4fb1-816c-3d8e8824cb41,network=Network(f7871b75-73b3-4f0a-8e6c-814bc61ebd6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b51bd20-90')
Nov 15 08:11:56 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-044b1a66-c6e1-4daf-83ef-f3ffefc0b24e tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Deleting instance files /opt/stack/data/nova/instances/36dccf43-d4a3-47aa-bd73-de9646e1020c_del
Nov 15 08:11:56 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-044b1a66-c6e1-4daf-83ef-f3ffefc0b24e tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Deletion of /opt/stack/data/nova/instances/36dccf43-d4a3-47aa-bd73-de9646e1020c_del complete
Nov 15 08:11:56 user nova-compute[95467]: DEBUG nova.policy [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'acce273b07b64e44af6e062175afa92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e2fec6a90a41a5a586c6da227caacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95467) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 08:11:57 user nova-compute[95467]: INFO nova.scheduler.client.report [None req-044b1a66-c6e1-4daf-83ef-f3ffefc0b24e tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Deleted allocations for instance 36dccf43-d4a3-47aa-bd73-de9646e1020c
Nov 15 08:11:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.175s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Acquiring lock "a3fcf60225fcefd310404971cd18ab9851c548dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:11:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:11:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-044b1a66-c6e1-4daf-83ef-f3ffefc0b24e tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:11:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-044b1a66-c6e1-4daf-83ef-f3ffefc0b24e tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:11:57 user nova-compute[95467]: DEBUG nova.objects.instance [None req-044b1a66-c6e1-4daf-83ef-f3ffefc0b24e tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lazy-loading 'numa_topology' on Instance uuid 36dccf43-d4a3-47aa-bd73-de9646e1020c {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:11:57 user nova-compute[95467]: DEBUG nova.objects.base [None req-044b1a66-c6e1-4daf-83ef-f3ffefc0b24e tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Object Instance<36dccf43-d4a3-47aa-bd73-de9646e1020c> lazy-loaded attributes: resources,numa_topology {{(pid=95467) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 08:11:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.199s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/60e20e77-6091-4abc-bbad-b5f21a2071c3/disk 1073741824 {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:57 user nova-compute[95467]: DEBUG nova.network.neutron [req-53606145-2431-4f9c-9f7d-1d43b922bb4d req-68ed4f5a-b274-4e00-9c00-b211c52789e5 service nova] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Updated VIF entry in instance network info cache for port 5b51bd20-90a5-4fb1-816c-3d8e8824cb41. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:11:57 user nova-compute[95467]: DEBUG nova.network.neutron [req-53606145-2431-4f9c-9f7d-1d43b922bb4d req-68ed4f5a-b274-4e00-9c00-b211c52789e5 service nova] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Updating instance_info_cache with network_info: [{"id": "5b51bd20-90a5-4fb1-816c-3d8e8824cb41", "address": "fa:16:3e:79:70:b1", "network": {"id": "f7871b75-73b3-4f0a-8e6c-814bc61ebd6d", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-945672014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b04c448c61451d8d46ebc7a61a5e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap5b51bd20-90", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:11:57 user nova-compute[95467]: DEBUG nova.compute.manager [req-5b6e85f5-1ae9-4d92-938c-fb135563da1a req-6a5ae57f-bb35-47a1-beec-e7f42ea51f6c service nova] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Received event network-changed-10ed2f01-5666-4615-be28-c574ff652c1d {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:11:57 user nova-compute[95467]: DEBUG nova.compute.manager [req-5b6e85f5-1ae9-4d92-938c-fb135563da1a req-6a5ae57f-bb35-47a1-beec-e7f42ea51f6c service nova] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Refreshing instance network info cache due to event network-changed-10ed2f01-5666-4615-be28-c574ff652c1d. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:11:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-5b6e85f5-1ae9-4d92-938c-fb135563da1a req-6a5ae57f-bb35-47a1-beec-e7f42ea51f6c service nova] Acquiring lock "refresh_cache-68264a44-5adf-4873-b380-26bcafe2ba04" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:11:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-5b6e85f5-1ae9-4d92-938c-fb135563da1a req-6a5ae57f-bb35-47a1-beec-e7f42ea51f6c service nova] Acquired lock "refresh_cache-68264a44-5adf-4873-b380-26bcafe2ba04" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:11:57 user nova-compute[95467]: DEBUG nova.network.neutron [req-5b6e85f5-1ae9-4d92-938c-fb135563da1a req-6a5ae57f-bb35-47a1-beec-e7f42ea51f6c service nova] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Refreshing network info cache for port 10ed2f01-5666-4615-be28-c574ff652c1d {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:11:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/60e20e77-6091-4abc-bbad-b5f21a2071c3/disk 1073741824" returned: 0 in 0.070s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:11:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-53606145-2431-4f9c-9f7d-1d43b922bb4d req-68ed4f5a-b274-4e00-9c00-b211c52789e5 service nova] Releasing lock "refresh_cache-36dccf43-d4a3-47aa-bd73-de9646e1020c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:11:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.194s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:57 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Checking if we can resize image /opt/stack/data/nova/instances/60e20e77-6091-4abc-bbad-b5f21a2071c3/disk. size=1073741824 {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 08:11:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60e20e77-6091-4abc-bbad-b5f21a2071c3/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:57 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-044b1a66-c6e1-4daf-83ef-f3ffefc0b24e tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:11:57 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-044b1a66-c6e1-4daf-83ef-f3ffefc0b24e tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:11:57 user nova-compute[95467]: DEBUG nova.network.neutron [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 60e20e77-6091-4abc-bbad-b5f21a2071c3] Successfully created port: f5cfd0fc-8461-4ed8-aa91-08fe7a2eb6c0 {{(pid=95467) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 08:11:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-044b1a66-c6e1-4daf-83ef-f3ffefc0b24e tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.590s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:11:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60e20e77-6091-4abc-bbad-b5f21a2071c3/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:57 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Cannot resize image /opt/stack/data/nova/instances/60e20e77-6091-4abc-bbad-b5f21a2071c3/disk to a smaller size. {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 08:11:57 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 60e20e77-6091-4abc-bbad-b5f21a2071c3] Created local disks {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 08:11:57 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 60e20e77-6091-4abc-bbad-b5f21a2071c3] Ensure instance console log exists: /opt/stack/data/nova/instances/60e20e77-6091-4abc-bbad-b5f21a2071c3/console.log {{(pid=95467) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 08:11:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:11:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:11:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:11:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-044b1a66-c6e1-4daf-83ef-f3ffefc0b24e tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "36dccf43-d4a3-47aa-bd73-de9646e1020c" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.120s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:11:57 user nova-compute[95467]: DEBUG nova.network.neutron [req-5b6e85f5-1ae9-4d92-938c-fb135563da1a req-6a5ae57f-bb35-47a1-beec-e7f42ea51f6c service nova] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Updated VIF entry in instance network info cache for port 10ed2f01-5666-4615-be28-c574ff652c1d. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:11:57 user nova-compute[95467]: DEBUG nova.network.neutron [req-5b6e85f5-1ae9-4d92-938c-fb135563da1a req-6a5ae57f-bb35-47a1-beec-e7f42ea51f6c service nova] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Updating instance_info_cache with network_info: [{"id": "10ed2f01-5666-4615-be28-c574ff652c1d", "address": "fa:16:3e:82:8d:0f", "network": {"id": "4e5f387a-ee4d-4e5b-bbb3-0d3af738de45", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-839692973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6f1d989dd2242bfad9c3a5d7380c887", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10ed2f01-56", "ovs_interfaceid": "10ed2f01-5666-4615-be28-c574ff652c1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:11:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-5b6e85f5-1ae9-4d92-938c-fb135563da1a req-6a5ae57f-bb35-47a1-beec-e7f42ea51f6c service nova] Releasing lock "refresh_cache-68264a44-5adf-4873-b380-26bcafe2ba04" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:11:58 user nova-compute[95467]: DEBUG nova.network.neutron [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 60e20e77-6091-4abc-bbad-b5f21a2071c3] Successfully updated port: f5cfd0fc-8461-4ed8-aa91-08fe7a2eb6c0 {{(pid=95467) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 08:11:58 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Acquiring lock "refresh_cache-60e20e77-6091-4abc-bbad-b5f21a2071c3" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:11:58 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Acquired lock "refresh_cache-60e20e77-6091-4abc-bbad-b5f21a2071c3" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:11:58 user nova-compute[95467]: DEBUG nova.network.neutron [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 60e20e77-6091-4abc-bbad-b5f21a2071c3] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:11:58 user nova-compute[95467]: DEBUG nova.network.neutron [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 60e20e77-6091-4abc-bbad-b5f21a2071c3] Instance cache missing network info. {{(pid=95467) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 08:11:58 user nova-compute[95467]: DEBUG nova.network.neutron [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 60e20e77-6091-4abc-bbad-b5f21a2071c3] Updating instance_info_cache with network_info: [{"id": "f5cfd0fc-8461-4ed8-aa91-08fe7a2eb6c0", "address": "fa:16:3e:34:38:5d", "network": {"id": "27fd2b0f-65bd-4ae4-b5c8-dfca91668078", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1310727750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50e2fec6a90a41a5a586c6da227caacc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5cfd0fc-84", "ovs_interfaceid": "f5cfd0fc-8461-4ed8-aa91-08fe7a2eb6c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:11:58 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Releasing lock "refresh_cache-60e20e77-6091-4abc-bbad-b5f21a2071c3" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:11:58 user nova-compute[95467]: DEBUG nova.compute.manager [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 60e20e77-6091-4abc-bbad-b5f21a2071c3] Instance network_info: |[{"id": "f5cfd0fc-8461-4ed8-aa91-08fe7a2eb6c0", "address": "fa:16:3e:34:38:5d", "network": {"id": "27fd2b0f-65bd-4ae4-b5c8-dfca91668078", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1310727750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50e2fec6a90a41a5a586c6da227caacc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5cfd0fc-84", "ovs_interfaceid": "f5cfd0fc-8461-4ed8-aa91-08fe7a2eb6c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 08:11:58 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 60e20e77-6091-4abc-bbad-b5f21a2071c3] Start _get_guest_xml network_info=[{"id": "f5cfd0fc-8461-4ed8-aa91-08fe7a2eb6c0", "address": "fa:16:3e:34:38:5d", "network": {"id": "27fd2b0f-65bd-4ae4-b5c8-dfca91668078", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1310727750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50e2fec6a90a41a5a586c6da227caacc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5cfd0fc-84", "ovs_interfaceid": "f5cfd0fc-8461-4ed8-aa91-08fe7a2eb6c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'ed9c48aa-ce73-4b3b-9db1-235898be671b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:11:58 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:11:58 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:11:58 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:11:58 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:11:58 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:11:58 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:11:58 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:11:58 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:11:58 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:11:58 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:11:58 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:11:58 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:11:58 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:11:58 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:11:58 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:11:58 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:11:58 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:11:58 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:11:58 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:11:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1804987502',display_name='tempest-AttachVolumeNegativeTest-server-1804987502',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1804987502',id=14,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAJTP5SnvAN0j4EJK+a5w/6hkXDZoSBbTszMsD4b/7Zc3910mK5WZI3GsMsFoeELSAKCVxo2sJ/Le5sbATPGI/ViNcM5cmJ40+sP3Lwu4iJBHmdNrF5EDc20OMN3OmUUiw==',key_name='tempest-keypair-50938293',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50e2fec6a90a41a5a586c6da227caacc',ramdisk_id='',reservation_id='r-stlwbs0i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1750086293',owner_user_name='tempest-AttachVolumeNegativeTest-1750086293-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:11:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='acce273b07b64e44af6e062175afa92d',uuid=60e20e77-6091-4abc-bbad-b5f21a2071c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5cfd0fc-8461-4ed8-aa91-08fe7a2eb6c0", "address": "fa:16:3e:34:38:5d", "network": {"id": "27fd2b0f-65bd-4ae4-b5c8-dfca91668078", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1310727750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50e2fec6a90a41a5a586c6da227caacc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5cfd0fc-84", "ovs_interfaceid": "f5cfd0fc-8461-4ed8-aa91-08fe7a2eb6c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:11:58 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Converting VIF {"id": "f5cfd0fc-8461-4ed8-aa91-08fe7a2eb6c0", "address": "fa:16:3e:34:38:5d", "network": {"id": "27fd2b0f-65bd-4ae4-b5c8-dfca91668078", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1310727750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50e2fec6a90a41a5a586c6da227caacc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5cfd0fc-84", "ovs_interfaceid": "f5cfd0fc-8461-4ed8-aa91-08fe7a2eb6c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:11:58 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:38:5d,bridge_name='br-int',has_traffic_filtering=True,id=f5cfd0fc-8461-4ed8-aa91-08fe7a2eb6c0,network=Network(27fd2b0f-65bd-4ae4-b5c8-dfca91668078),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5cfd0fc-84') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:11:58 user nova-compute[95467]: DEBUG nova.objects.instance [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lazy-loading 'pci_devices' on Instance uuid 60e20e77-6091-4abc-bbad-b5f21a2071c3 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:11:58 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 60e20e77-6091-4abc-bbad-b5f21a2071c3] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:11:58 user nova-compute[95467]:   <uuid>60e20e77-6091-4abc-bbad-b5f21a2071c3</uuid>
Nov 15 08:11:58 user nova-compute[95467]:   <name>instance-0000000e</name>
Nov 15 08:11:58 user nova-compute[95467]:   <memory>524288</memory>
Nov 15 08:11:58 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:11:58 user nova-compute[95467]:   <metadata>
Nov 15 08:11:58 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:11:58 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:11:58 user nova-compute[95467]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1804987502</nova:name>
Nov 15 08:11:58 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:11:58</nova:creationTime>
Nov 15 08:11:58 user nova-compute[95467]:       <nova:flavor name="m1.tiny">
Nov 15 08:11:58 user nova-compute[95467]:         <nova:memory>512</nova:memory>
Nov 15 08:11:58 user nova-compute[95467]:         <nova:disk>1</nova:disk>
Nov 15 08:11:58 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:11:58 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:11:58 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:11:58 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:11:58 user nova-compute[95467]:       <nova:owner>
Nov 15 08:11:58 user nova-compute[95467]:         <nova:user uuid="acce273b07b64e44af6e062175afa92d">tempest-AttachVolumeNegativeTest-1750086293-project-member</nova:user>
Nov 15 08:11:58 user nova-compute[95467]:         <nova:project uuid="50e2fec6a90a41a5a586c6da227caacc">tempest-AttachVolumeNegativeTest-1750086293</nova:project>
Nov 15 08:11:58 user nova-compute[95467]:       </nova:owner>
Nov 15 08:11:58 user nova-compute[95467]:       <nova:root type="image" uuid="ed9c48aa-ce73-4b3b-9db1-235898be671b"/>
Nov 15 08:11:58 user nova-compute[95467]:       <nova:ports>
Nov 15 08:11:58 user nova-compute[95467]:         <nova:port uuid="f5cfd0fc-8461-4ed8-aa91-08fe7a2eb6c0">
Nov 15 08:11:58 user nova-compute[95467]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 08:11:58 user nova-compute[95467]:         </nova:port>
Nov 15 08:11:58 user nova-compute[95467]:       </nova:ports>
Nov 15 08:11:58 user nova-compute[95467]:     </nova:instance>
Nov 15 08:11:58 user nova-compute[95467]:   </metadata>
Nov 15 08:11:58 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:11:58 user nova-compute[95467]:     <system>
Nov 15 08:11:58 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:11:58 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:11:58 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:11:58 user nova-compute[95467]:       <entry name="serial">60e20e77-6091-4abc-bbad-b5f21a2071c3</entry>
Nov 15 08:11:58 user nova-compute[95467]:       <entry name="uuid">60e20e77-6091-4abc-bbad-b5f21a2071c3</entry>
Nov 15 08:11:58 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:11:58 user nova-compute[95467]:     </system>
Nov 15 08:11:58 user nova-compute[95467]:   </sysinfo>
Nov 15 08:11:58 user nova-compute[95467]:   <os>
Nov 15 08:11:58 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:11:58 user nova-compute[95467]:     <boot dev="hd"/>
Nov 15 08:11:58 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:11:58 user nova-compute[95467]:   </os>
Nov 15 08:11:58 user nova-compute[95467]:   <features>
Nov 15 08:11:58 user nova-compute[95467]:     <acpi/>
Nov 15 08:11:58 user nova-compute[95467]:     <apic/>
Nov 15 08:11:58 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:11:58 user nova-compute[95467]:   </features>
Nov 15 08:11:58 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:11:58 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:11:58 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:11:58 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:11:58 user nova-compute[95467]:   </clock>
Nov 15 08:11:58 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:11:58 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:11:58 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:11:58 user nova-compute[95467]:   </cpu>
Nov 15 08:11:58 user nova-compute[95467]:   <devices>
Nov 15 08:11:58 user nova-compute[95467]:     <disk type="file" device="disk">
Nov 15 08:11:58 user nova-compute[95467]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 08:11:58 user nova-compute[95467]:       <source file="/opt/stack/data/nova/instances/60e20e77-6091-4abc-bbad-b5f21a2071c3/disk"/>
Nov 15 08:11:58 user nova-compute[95467]:       <target dev="vda" bus="virtio"/>
Nov 15 08:11:58 user nova-compute[95467]:     </disk>
Nov 15 08:11:58 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:11:58 user nova-compute[95467]:       <mac address="fa:16:3e:34:38:5d"/>
Nov 15 08:11:58 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:11:58 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:11:58 user nova-compute[95467]:       <target dev="tapf5cfd0fc-84"/>
Nov 15 08:11:58 user nova-compute[95467]:     </interface>
Nov 15 08:11:58 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:11:58 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/60e20e77-6091-4abc-bbad-b5f21a2071c3/console.log" append="off"/>
Nov 15 08:11:58 user nova-compute[95467]:     </serial>
Nov 15 08:11:58 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:11:58 user nova-compute[95467]:     <video>
Nov 15 08:11:58 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:11:58 user nova-compute[95467]:     </video>
Nov 15 08:11:58 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:11:58 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:11:58 user nova-compute[95467]:     </rng>
Nov 15 08:11:58 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:11:58 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:11:58 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:11:58 user nova-compute[95467]:     </memballoon>
Nov 15 08:11:58 user nova-compute[95467]:   </devices>
Nov 15 08:11:58 user nova-compute[95467]: </domain>
Nov 15 08:11:58 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:11:58 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:11:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1804987502',display_name='tempest-AttachVolumeNegativeTest-server-1804987502',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1804987502',id=14,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAJTP5SnvAN0j4EJK+a5w/6hkXDZoSBbTszMsD4b/7Zc3910mK5WZI3GsMsFoeELSAKCVxo2sJ/Le5sbATPGI/ViNcM5cmJ40+sP3Lwu4iJBHmdNrF5EDc20OMN3OmUUiw==',key_name='tempest-keypair-50938293',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50e2fec6a90a41a5a586c6da227caacc',ramdisk_id='',reservation_id='r-stlwbs0i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1750086293',owner_user_name='tempest-AttachVolumeNegativeTest-1750086293-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:11:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='acce273b07b64e44af6e062175afa92d',uuid=60e20e77-6091-4abc-bbad-b5f21a2071c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5cfd0fc-8461-4ed8-aa91-08fe7a2eb6c0", "address": "fa:16:3e:34:38:5d", "network": {"id": "27fd2b0f-65bd-4ae4-b5c8-dfca91668078", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1310727750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50e2fec6a90a41a5a586c6da227caacc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5cfd0fc-84", "ovs_interfaceid": "f5cfd0fc-8461-4ed8-aa91-08fe7a2eb6c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:11:58 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Converting VIF {"id": "f5cfd0fc-8461-4ed8-aa91-08fe7a2eb6c0", "address": "fa:16:3e:34:38:5d", "network": {"id": "27fd2b0f-65bd-4ae4-b5c8-dfca91668078", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1310727750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50e2fec6a90a41a5a586c6da227caacc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5cfd0fc-84", "ovs_interfaceid": "f5cfd0fc-8461-4ed8-aa91-08fe7a2eb6c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:11:58 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:38:5d,bridge_name='br-int',has_traffic_filtering=True,id=f5cfd0fc-8461-4ed8-aa91-08fe7a2eb6c0,network=Network(27fd2b0f-65bd-4ae4-b5c8-dfca91668078),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5cfd0fc-84') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:11:58 user nova-compute[95467]: DEBUG os_vif [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:38:5d,bridge_name='br-int',has_traffic_filtering=True,id=f5cfd0fc-8461-4ed8-aa91-08fe7a2eb6c0,network=Network(27fd2b0f-65bd-4ae4-b5c8-dfca91668078),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5cfd0fc-84') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:11:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:11:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:11:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2a51d1c9-6641-5d05-abbd-cf014044a8bf', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:11:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf5cfd0fc-84, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:11:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf5cfd0fc-84, col_values=(('qos', UUID('c1c5bfed-5a8c-4ad3-ac01-04970fa33a69')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:11:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf5cfd0fc-84, col_values=(('external_ids', {'iface-id': 'f5cfd0fc-8461-4ed8-aa91-08fe7a2eb6c0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:38:5d', 'vm-uuid': '60e20e77-6091-4abc-bbad-b5f21a2071c3'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:11:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:11:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:11:58 user nova-compute[95467]: INFO os_vif [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:38:5d,bridge_name='br-int',has_traffic_filtering=True,id=f5cfd0fc-8461-4ed8-aa91-08fe7a2eb6c0,network=Network(27fd2b0f-65bd-4ae4-b5c8-dfca91668078),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5cfd0fc-84')
Nov 15 08:11:58 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-307f456a-cf34-46c9-8d0e-8c649e3d89d6 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Acquiring lock "68264a44-5adf-4873-b380-26bcafe2ba04" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:11:58 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-307f456a-cf34-46c9-8d0e-8c649e3d89d6 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Lock "68264a44-5adf-4873-b380-26bcafe2ba04" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:11:59 user nova-compute[95467]: DEBUG nova.objects.instance [None req-307f456a-cf34-46c9-8d0e-8c649e3d89d6 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Lazy-loading 'flavor' on Instance uuid 68264a44-5adf-4873-b380-26bcafe2ba04 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:11:59 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:11:59 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] No VIF found with MAC fa:16:3e:34:38:5d, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:11:59 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-307f456a-cf34-46c9-8d0e-8c649e3d89d6 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Lock "68264a44-5adf-4873-b380-26bcafe2ba04" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.082s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:11:59 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-307f456a-cf34-46c9-8d0e-8c649e3d89d6 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Acquiring lock "68264a44-5adf-4873-b380-26bcafe2ba04" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:11:59 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-307f456a-cf34-46c9-8d0e-8c649e3d89d6 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Lock "68264a44-5adf-4873-b380-26bcafe2ba04" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:11:59 user nova-compute[95467]: INFO nova.compute.manager [None req-307f456a-cf34-46c9-8d0e-8c649e3d89d6 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Attaching volume bc145840-7458-4ebe-aa31-f9350ac056ff to /dev/vdb
Nov 15 08:11:59 user nova-compute[95467]: DEBUG os_brick.utils [None req-307f456a-cf34-46c9-8d0e-8c649e3d89d6 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:11:59 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:59 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:59 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3add183-bc14-439f-811e-194dfd9c0617]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:882ae90641f\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:11:59 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:59 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:59 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada24db5-a473-4773-9bb2-bea2386e9796]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:11:59 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:59 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:11:59 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e60000-83cf-41a4-911d-9f0abacde68e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:11:59 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[260702b1-36f2-4ba2-b7c9-7f2181575013]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:11:59 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-307f456a-cf34-46c9-8d0e-8c649e3d89d6 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Running cmd (subprocess): nvme version {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:59 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-307f456a-cf34-46c9-8d0e-8c649e3d89d6 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] 'nvme version' failed. Not Retrying. {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:11:59 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.nvmeof [None req-307f456a-cf34-46c9-8d0e-8c649e3d89d6 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] nvme not present on system {{(pid=95467) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 08:11:59 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:11:59 user nova-compute[95467]: DEBUG nova.compute.manager [req-200542fd-2506-4b18-bd6f-96d09493ed2e req-0389c918-2e14-4ae1-870e-d79b320edbe3 service nova] [instance: 60e20e77-6091-4abc-bbad-b5f21a2071c3] Received event network-changed-f5cfd0fc-8461-4ed8-aa91-08fe7a2eb6c0 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:11:59 user nova-compute[95467]: DEBUG nova.compute.manager [req-200542fd-2506-4b18-bd6f-96d09493ed2e req-0389c918-2e14-4ae1-870e-d79b320edbe3 service nova] [instance: 60e20e77-6091-4abc-bbad-b5f21a2071c3] Refreshing instance network info cache due to event network-changed-f5cfd0fc-8461-4ed8-aa91-08fe7a2eb6c0. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:11:59 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-200542fd-2506-4b18-bd6f-96d09493ed2e req-0389c918-2e14-4ae1-870e-d79b320edbe3 service nova] Acquiring lock "refresh_cache-60e20e77-6091-4abc-bbad-b5f21a2071c3" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:11:59 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-200542fd-2506-4b18-bd6f-96d09493ed2e req-0389c918-2e14-4ae1-870e-d79b320edbe3 service nova] Acquired lock "refresh_cache-60e20e77-6091-4abc-bbad-b5f21a2071c3" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:11:59 user nova-compute[95467]: DEBUG nova.network.neutron [req-200542fd-2506-4b18-bd6f-96d09493ed2e req-0389c918-2e14-4ae1-870e-d79b320edbe3 service nova] [instance: 60e20e77-6091-4abc-bbad-b5f21a2071c3] Refreshing network info cache for port f5cfd0fc-8461-4ed8-aa91-08fe7a2eb6c0 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:11:59 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:11:59 user nova-compute[95467]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 08:11:59 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ebc4feb-227f-4bb4-937f-7890bc4e451f]: (4, '') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:11:59 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-307f456a-cf34-46c9-8d0e-8c649e3d89d6 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=95467) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 08:11:59 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-307f456a-cf34-46c9-8d0e-8c649e3d89d6 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 08:11:59 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-307f456a-cf34-46c9-8d0e-8c649e3d89d6 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] LIGHTOS: no hostnqn found. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 08:11:59 user nova-compute[95467]: DEBUG os_brick.utils [None req-307f456a-cf34-46c9-8d0e-8c649e3d89d6 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:882ae90641f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:11:59 user nova-compute[95467]: DEBUG nova.virt.block_device [None req-307f456a-cf34-46c9-8d0e-8c649e3d89d6 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Updating existing volume attachment record: 03a81f78-ef70-493c-9b35-7a933cee144f {{(pid=95467) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 08:11:59 user nova-compute[95467]: DEBUG nova.network.neutron [req-200542fd-2506-4b18-bd6f-96d09493ed2e req-0389c918-2e14-4ae1-870e-d79b320edbe3 service nova] [instance: 60e20e77-6091-4abc-bbad-b5f21a2071c3] Updated VIF entry in instance network info cache for port f5cfd0fc-8461-4ed8-aa91-08fe7a2eb6c0. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:11:59 user nova-compute[95467]: DEBUG nova.network.neutron [req-200542fd-2506-4b18-bd6f-96d09493ed2e req-0389c918-2e14-4ae1-870e-d79b320edbe3 service nova] [instance: 60e20e77-6091-4abc-bbad-b5f21a2071c3] Updating instance_info_cache with network_info: [{"id": "f5cfd0fc-8461-4ed8-aa91-08fe7a2eb6c0", "address": "fa:16:3e:34:38:5d", "network": {"id": "27fd2b0f-65bd-4ae4-b5c8-dfca91668078", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1310727750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50e2fec6a90a41a5a586c6da227caacc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5cfd0fc-84", "ovs_interfaceid": "f5cfd0fc-8461-4ed8-aa91-08fe7a2eb6c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:11:59 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-200542fd-2506-4b18-bd6f-96d09493ed2e req-0389c918-2e14-4ae1-870e-d79b320edbe3 service nova] Releasing lock "refresh_cache-60e20e77-6091-4abc-bbad-b5f21a2071c3" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:12:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:00 user nova-compute[95467]: DEBUG nova.compute.manager [req-066f1b6e-2950-4402-8877-bec861d9ac47 req-6d7e974e-aa00-4498-8172-f4b262673cd8 service nova] [instance: 60e20e77-6091-4abc-bbad-b5f21a2071c3] Received event network-vif-plugged-f5cfd0fc-8461-4ed8-aa91-08fe7a2eb6c0 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:12:00 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-066f1b6e-2950-4402-8877-bec861d9ac47 req-6d7e974e-aa00-4498-8172-f4b262673cd8 service nova] Acquiring lock "60e20e77-6091-4abc-bbad-b5f21a2071c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:12:00 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-066f1b6e-2950-4402-8877-bec861d9ac47 req-6d7e974e-aa00-4498-8172-f4b262673cd8 service nova] Lock "60e20e77-6091-4abc-bbad-b5f21a2071c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:12:00 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-066f1b6e-2950-4402-8877-bec861d9ac47 req-6d7e974e-aa00-4498-8172-f4b262673cd8 service nova] Lock "60e20e77-6091-4abc-bbad-b5f21a2071c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:12:00 user nova-compute[95467]: DEBUG nova.compute.manager [req-066f1b6e-2950-4402-8877-bec861d9ac47 req-6d7e974e-aa00-4498-8172-f4b262673cd8 service nova] [instance: 60e20e77-6091-4abc-bbad-b5f21a2071c3] No waiting events found dispatching network-vif-plugged-f5cfd0fc-8461-4ed8-aa91-08fe7a2eb6c0 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:12:00 user nova-compute[95467]: WARNING nova.compute.manager [req-066f1b6e-2950-4402-8877-bec861d9ac47 req-6d7e974e-aa00-4498-8172-f4b262673cd8 service nova] [instance: 60e20e77-6091-4abc-bbad-b5f21a2071c3] Received unexpected event network-vif-plugged-f5cfd0fc-8461-4ed8-aa91-08fe7a2eb6c0 for instance with vm_state building and task_state spawning.
Nov 15 08:12:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:01 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:02 user nova-compute[95467]: DEBUG nova.compute.manager [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 60e20e77-6091-4abc-bbad-b5f21a2071c3] Instance event wait completed in 0 seconds for  {{(pid=95467) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 08:12:02 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 60e20e77-6091-4abc-bbad-b5f21a2071c3] Guest created on hypervisor {{(pid=95467) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 08:12:02 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 60e20e77-6091-4abc-bbad-b5f21a2071c3] Instance spawned successfully.
Nov 15 08:12:02 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 60e20e77-6091-4abc-bbad-b5f21a2071c3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 08:12:02 user nova-compute[95467]: DEBUG nova.compute.manager [req-2e78ad45-f7c0-4722-bf97-4b7efd31cc9d req-41f67e1a-0795-45b2-9467-13cbde7fdec4 service nova] [instance: 60e20e77-6091-4abc-bbad-b5f21a2071c3] Received event network-vif-plugged-f5cfd0fc-8461-4ed8-aa91-08fe7a2eb6c0 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:12:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-2e78ad45-f7c0-4722-bf97-4b7efd31cc9d req-41f67e1a-0795-45b2-9467-13cbde7fdec4 service nova] Acquiring lock "60e20e77-6091-4abc-bbad-b5f21a2071c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:12:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-2e78ad45-f7c0-4722-bf97-4b7efd31cc9d req-41f67e1a-0795-45b2-9467-13cbde7fdec4 service nova] Lock "60e20e77-6091-4abc-bbad-b5f21a2071c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:12:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-2e78ad45-f7c0-4722-bf97-4b7efd31cc9d req-41f67e1a-0795-45b2-9467-13cbde7fdec4 service nova] Lock "60e20e77-6091-4abc-bbad-b5f21a2071c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:12:02 user nova-compute[95467]: DEBUG nova.compute.manager [req-2e78ad45-f7c0-4722-bf97-4b7efd31cc9d req-41f67e1a-0795-45b2-9467-13cbde7fdec4 service nova] [instance: 60e20e77-6091-4abc-bbad-b5f21a2071c3] No waiting events found dispatching network-vif-plugged-f5cfd0fc-8461-4ed8-aa91-08fe7a2eb6c0 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:12:02 user nova-compute[95467]: WARNING nova.compute.manager [req-2e78ad45-f7c0-4722-bf97-4b7efd31cc9d req-41f67e1a-0795-45b2-9467-13cbde7fdec4 service nova] [instance: 60e20e77-6091-4abc-bbad-b5f21a2071c3] Received unexpected event network-vif-plugged-f5cfd0fc-8461-4ed8-aa91-08fe7a2eb6c0 for instance with vm_state building and task_state spawning.
Nov 15 08:12:02 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 60e20e77-6091-4abc-bbad-b5f21a2071c3] Found default for hw_cdrom_bus of ide {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:12:02 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 60e20e77-6091-4abc-bbad-b5f21a2071c3] Found default for hw_disk_bus of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:12:02 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 60e20e77-6091-4abc-bbad-b5f21a2071c3] Found default for hw_input_bus of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:12:02 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 60e20e77-6091-4abc-bbad-b5f21a2071c3] Found default for hw_pointer_model of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:12:02 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 60e20e77-6091-4abc-bbad-b5f21a2071c3] Found default for hw_video_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:12:02 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 60e20e77-6091-4abc-bbad-b5f21a2071c3] Found default for hw_vif_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:12:02 user nova-compute[95467]: INFO nova.compute.manager [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 60e20e77-6091-4abc-bbad-b5f21a2071c3] Took 5.80 seconds to spawn the instance on the hypervisor.
Nov 15 08:12:02 user nova-compute[95467]: DEBUG nova.compute.manager [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 60e20e77-6091-4abc-bbad-b5f21a2071c3] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:12:02 user nova-compute[95467]: INFO nova.compute.manager [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 60e20e77-6091-4abc-bbad-b5f21a2071c3] Took 6.60 seconds to build instance.
Nov 15 08:12:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e9d791bd-b25d-41ce-bd0f-56f7e8769f87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "60e20e77-6091-4abc-bbad-b5f21a2071c3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.701s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:12:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:04 user nova-compute[95467]: DEBUG nova.compute.manager [req-a93cfd1c-95f2-42bb-b16b-348c1216169e req-522dbd40-cddf-48dd-90cb-74693d920ca2 service nova] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Received event network-changed-193139f8-f050-4caf-89d7-106a3a504625 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:12:04 user nova-compute[95467]: DEBUG nova.compute.manager [req-a93cfd1c-95f2-42bb-b16b-348c1216169e req-522dbd40-cddf-48dd-90cb-74693d920ca2 service nova] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Refreshing instance network info cache due to event network-changed-193139f8-f050-4caf-89d7-106a3a504625. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:12:04 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-a93cfd1c-95f2-42bb-b16b-348c1216169e req-522dbd40-cddf-48dd-90cb-74693d920ca2 service nova] Acquiring lock "refresh_cache-1edf7591-3991-4df9-98c9-ebc4ca9e5a4a" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:12:04 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-a93cfd1c-95f2-42bb-b16b-348c1216169e req-522dbd40-cddf-48dd-90cb-74693d920ca2 service nova] Acquired lock "refresh_cache-1edf7591-3991-4df9-98c9-ebc4ca9e5a4a" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:12:04 user nova-compute[95467]: DEBUG nova.network.neutron [req-a93cfd1c-95f2-42bb-b16b-348c1216169e req-522dbd40-cddf-48dd-90cb-74693d920ca2 service nova] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Refreshing network info cache for port 193139f8-f050-4caf-89d7-106a3a504625 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:12:04 user nova-compute[95467]: INFO nova.compute.manager [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Rebuilding instance
Nov 15 08:12:04 user nova-compute[95467]: DEBUG nova.compute.manager [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:12:04 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:04 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0bfa00b9-445a-4c99-b9db-8ebeb56cb317 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Acquiring lock "1edf7591-3991-4df9-98c9-ebc4ca9e5a4a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:12:04 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0bfa00b9-445a-4c99-b9db-8ebeb56cb317 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Lock "1edf7591-3991-4df9-98c9-ebc4ca9e5a4a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:12:04 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-307f456a-cf34-46c9-8d0e-8c649e3d89d6 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Calling os-brick to attach iSCSI Volume {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 08:12:04 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-307f456a-cf34-46c9-8d0e-8c649e3d89d6 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mQSRvXoK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:12:04 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-307f456a-cf34-46c9-8d0e-8c649e3d89d6 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:12:04 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-307f456a-cf34-46c9-8d0e-8c649e3d89d6 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:12:04 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-307f456a-cf34-46c9-8d0e-8c649e3d89d6 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:12:04 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-307f456a-cf34-46c9-8d0e-8c649e3d89d6 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:12:04 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-307f456a-cf34-46c9-8d0e-8c649e3d89d6 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:12:04 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-307f456a-cf34-46c9-8d0e-8c649e3d89d6 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:12:04 user nova-compute[95467]: INFO os_brick.initiator.connectors.iscsi [None req-307f456a-cf34-46c9-8d0e-8c649e3d89d6 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 08:12:04 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff -p 172.16.0.220:3260 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:04 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:04 user nova-compute[95467]: DEBUG nova.objects.instance [None req-0bfa00b9-445a-4c99-b9db-8ebeb56cb317 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Lazy-loading 'flavor' on Instance uuid 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:12:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:04 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[308eeb51-e4d6-40b9-93e9-0b0921b091a3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:04 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-307f456a-cf34-46c9-8d0e-8c649e3d89d6 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 08:12:04 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff -p 172.16.0.220:3260 --interface default --op new {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:04 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:04 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f68bc1-8e88-491a-a4f2-65b9bb27058c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff] added\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:04 user nova-compute[95467]: DEBUG nova.compute.manager [req-e1a8292d-fa3d-409c-b631-fce355437230 req-5fbc09a5-3503-446e-bfa2-72b7d39df424 service nova] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Received event network-changed-1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:12:04 user nova-compute[95467]: DEBUG nova.compute.manager [req-e1a8292d-fa3d-409c-b631-fce355437230 req-5fbc09a5-3503-446e-bfa2-72b7d39df424 service nova] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Refreshing instance network info cache due to event network-changed-1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:12:04 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-e1a8292d-fa3d-409c-b631-fce355437230 req-5fbc09a5-3503-446e-bfa2-72b7d39df424 service nova] Acquiring lock "refresh_cache-7e53d93e-1222-4b1a-9745-d512da0f7925" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:12:04 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-e1a8292d-fa3d-409c-b631-fce355437230 req-5fbc09a5-3503-446e-bfa2-72b7d39df424 service nova] Acquired lock "refresh_cache-7e53d93e-1222-4b1a-9745-d512da0f7925" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:12:04 user nova-compute[95467]: DEBUG nova.network.neutron [req-e1a8292d-fa3d-409c-b631-fce355437230 req-5fbc09a5-3503-446e-bfa2-72b7d39df424 service nova] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Refreshing network info cache for port 1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:12:04 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-307f456a-cf34-46c9-8d0e-8c649e3d89d6 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff] added
Nov 15 08:12:04 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:04 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0bfa00b9-445a-4c99-b9db-8ebeb56cb317 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Lock "1edf7591-3991-4df9-98c9-ebc4ca9e5a4a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.116s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:12:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:04 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[07705048-5ec0-43d5-ab67-5b032910b86d]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:04 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-307f456a-cf34-46c9-8d0e-8c649e3d89d6 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.035s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:04 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[5723c435-4115-4d60-9baf-fdc1e21ddeaf]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:04 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-307f456a-cf34-46c9-8d0e-8c649e3d89d6 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mQSRvXoK {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mQSRvXoK" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:04 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ae8ebd-b5fb-448f-ad5f-080cf61e6dc9]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:04 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-307f456a-cf34-46c9-8d0e-8c649e3d89d6 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mQSRvXoK'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:04 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[03047cfc-ef4b-418b-ac0f-9745efb57e9a]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:04 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-307f456a-cf34-46c9-8d0e-8c649e3d89d6 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:04 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7cd2f1-1a2c-46c3-97c1-19ac46da3e7b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:04 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-307f456a-cf34-46c9-8d0e-8c649e3d89d6 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)
Nov 15 08:12:04 user nova-compute[95467]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)
Nov 15 08:12:04 user nova-compute[95467]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)
Nov 15 08:12:04 user nova-compute[95467]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 (non-flash)
Nov 15 08:12:04 user nova-compute[95467]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)
Nov 15 08:12:04 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:12:04 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-307f456a-cf34-46c9-8d0e-8c649e3d89d6 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)
Nov 15 08:12:04 user nova-compute[95467]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)
Nov 15 08:12:04 user nova-compute[95467]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)
Nov 15 08:12:04 user nova-compute[95467]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 (non-flash)
Nov 15 08:12:04 user nova-compute[95467]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)
Nov 15 08:12:04 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:12:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff -p 172.16.0.220:3260 --login {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:04 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0bfa00b9-445a-4c99-b9db-8ebeb56cb317 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Acquiring lock "1edf7591-3991-4df9-98c9-ebc4ca9e5a4a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:12:04 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0bfa00b9-445a-4c99-b9db-8ebeb56cb317 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Lock "1edf7591-3991-4df9-98c9-ebc4ca9e5a4a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:12:04 user nova-compute[95467]: INFO nova.compute.manager [None req-0bfa00b9-445a-4c99-b9db-8ebeb56cb317 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Attaching volume 0b457e6b-86bf-4152-8f03-de5efd184fd5 to /dev/vdb
Nov 15 08:12:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff -p 172.16.0.220:3260 --login" returned: 0 in 0.112s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:04 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c83d54-291a-4291-a294-d9046784e168]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:04 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-307f456a-cf34-46c9-8d0e-8c649e3d89d6 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff, portal: 172.16.0.220,3260]
Nov 15 08:12:04 user nova-compute[95467]: Login to [iface: default, target: iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff, portal: 172.16.0.220,3260] successful.
Nov 15 08:12:04 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:04 user nova-compute[95467]: DEBUG os_brick.utils [None req-0bfa00b9-445a-4c99-b9db-8ebeb56cb317 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:12:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:04 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0fc72a0-114d-4cb7-92f6-a5d33ef0e490]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:04 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-307f456a-cf34-46c9-8d0e-8c649e3d89d6 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:04 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc985fd1-7ce8-4100-805b-b4ca5b8dc942]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:882ae90641f\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:05 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:05 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:05 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[16134b48-bea8-4e5e-b3ac-1679c81eccbc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:05 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:05 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:05 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[5011cfca-22e5-4881-888a-4addcb1fff9e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:05 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[5057b441-9e33-4ef9-a328-a992d0c492e3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:05 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-0bfa00b9-445a-4c99-b9db-8ebeb56cb317 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Running cmd (subprocess): nvme version {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:05 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-0bfa00b9-445a-4c99-b9db-8ebeb56cb317 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] 'nvme version' failed. Not Retrying. {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:12:05 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0bfa00b9-445a-4c99-b9db-8ebeb56cb317 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] nvme not present on system {{(pid=95467) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 08:12:05 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:05 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:12:05 user nova-compute[95467]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 08:12:05 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bded983-9388-4ce5-b9ab-cefba55d8ade]: (4, '') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:05 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-0bfa00b9-445a-4c99-b9db-8ebeb56cb317 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=95467) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 08:12:05 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-0bfa00b9-445a-4c99-b9db-8ebeb56cb317 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 08:12:05 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-0bfa00b9-445a-4c99-b9db-8ebeb56cb317 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] LIGHTOS: no hostnqn found. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 08:12:05 user nova-compute[95467]: DEBUG os_brick.utils [None req-0bfa00b9-445a-4c99-b9db-8ebeb56cb317 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:882ae90641f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:12:05 user nova-compute[95467]: DEBUG nova.virt.block_device [None req-0bfa00b9-445a-4c99-b9db-8ebeb56cb317 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Updating existing volume attachment record: 2f39da8d-0f7a-4724-a780-971c8cf5b843 {{(pid=95467) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 08:12:05 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.151s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:05 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[4283bc1c-44cc-4b8e-87fb-ffe86de9cc7d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:05 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-307f456a-cf34-46c9-8d0e-8c649e3d89d6 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)
Nov 15 08:12:05 user nova-compute[95467]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)
Nov 15 08:12:05 user nova-compute[95467]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)
Nov 15 08:12:05 user nova-compute[95467]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 (non-flash)
Nov 15 08:12:05 user nova-compute[95467]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)
Nov 15 08:12:05 user nova-compute[95467]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff (non-flash)
Nov 15 08:12:05 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:12:05 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-307f456a-cf34-46c9-8d0e-8c649e3d89d6 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)
Nov 15 08:12:05 user nova-compute[95467]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)
Nov 15 08:12:05 user nova-compute[95467]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)
Nov 15 08:12:05 user nova-compute[95467]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 (non-flash)
Nov 15 08:12:05 user nova-compute[95467]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)
Nov 15 08:12:05 user nova-compute[95467]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff (non-flash)
Nov 15 08:12:05 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:12:05 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-307f456a-cf34-46c9-8d0e-8c649e3d89d6 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.552s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:12:05 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-307f456a-cf34-46c9-8d0e-8c649e3d89d6 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Connected to 172.16.0.220:3260 {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 08:12:05 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-307f456a-cf34-46c9-8d0e-8c649e3d89d6 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=95467) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 08:12:05 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-307f456a-cf34-46c9-8d0e-8c649e3d89d6 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=95467) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 08:12:05 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:05 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.022s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:05 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b835c7-d047-4e54-9313-239e9eae9b8f]: (4, ('- - 0', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:05 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-307f456a-cf34-46c9-8d0e-8c649e3d89d6 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:12:05 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-307f456a-cf34-46c9-8d0e-8c649e3d89d6 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mQSRvXoK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 08:12:05 user nova-compute[95467]: DEBUG nova.network.neutron [req-a93cfd1c-95f2-42bb-b16b-348c1216169e req-522dbd40-cddf-48dd-90cb-74693d920ca2 service nova] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Updated VIF entry in instance network info cache for port 193139f8-f050-4caf-89d7-106a3a504625. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:12:05 user nova-compute[95467]: DEBUG nova.network.neutron [req-a93cfd1c-95f2-42bb-b16b-348c1216169e req-522dbd40-cddf-48dd-90cb-74693d920ca2 service nova] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Updating instance_info_cache with network_info: [{"id": "193139f8-f050-4caf-89d7-106a3a504625", "address": "fa:16:3e:ff:f2:53", "network": {"id": "f0b11bd0-0901-4ad2-982b-eda46e03fa1c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1915160333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f70df4261044d978ed77e71a44d51c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap193139f8-f0", "ovs_interfaceid": "193139f8-f050-4caf-89d7-106a3a504625", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:12:05 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-a93cfd1c-95f2-42bb-b16b-348c1216169e req-522dbd40-cddf-48dd-90cb-74693d920ca2 service nova] Releasing lock "refresh_cache-1edf7591-3991-4df9-98c9-ebc4ca9e5a4a" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:12:05 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Instance destroyed successfully.
Nov 15 08:12:05 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Instance destroyed successfully.
Nov 15 08:12:05 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:10:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1930677760',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-123252793',id=7,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAC1BuAs3ejJ+aRw6D/CB1xzKj78ip7ytDqvO2vvfGnTsB6+r8q33E0IAISM3h9/kVw6ZoQQmHwLT2P/3YuBA4w/px39kz5Vj5TaIA4bkzJYmqXkT5MBbT73nDHHxYjkVA==',key_name='tempest-keypair-986720723',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:10:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='81b11067a2d84bba8e6929713034b422',ramdisk_id='',reservation_id='r-pdz8drr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1288833049',owner_user_name='tempest-ServerActionsV293TestJSON-1288833049-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:12:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='54bfe816a1bf4ee485e055604f0b7609',uuid=7e53d93e-1222-4b1a-9745-d512da0f7925,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2", "address": "fa:16:3e:b1:d4:80", "network": {"id": "d8daee94-e2d9-42cf-9675-8c06e7292d36", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-765825262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81b11067a2d84bba8e6929713034b422", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d8e0cf8-c3", "ovs_interfaceid": "1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:12:05 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Converting VIF {"id": "1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2", "address": "fa:16:3e:b1:d4:80", "network": {"id": "d8daee94-e2d9-42cf-9675-8c06e7292d36", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-765825262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81b11067a2d84bba8e6929713034b422", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d8e0cf8-c3", "ovs_interfaceid": "1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:12:05 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:d4:80,bridge_name='br-int',has_traffic_filtering=True,id=1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2,network=Network(d8daee94-e2d9-42cf-9675-8c06e7292d36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d8e0cf8-c3') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:12:05 user nova-compute[95467]: DEBUG os_vif [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:d4:80,bridge_name='br-int',has_traffic_filtering=True,id=1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2,network=Network(d8daee94-e2d9-42cf-9675-8c06e7292d36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d8e0cf8-c3') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:12:05 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:05 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1d8e0cf8-c3, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:12:05 user nova-compute[95467]: DEBUG nova.network.neutron [req-e1a8292d-fa3d-409c-b631-fce355437230 req-5fbc09a5-3503-446e-bfa2-72b7d39df424 service nova] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Updated VIF entry in instance network info cache for port 1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:12:05 user nova-compute[95467]: DEBUG nova.network.neutron [req-e1a8292d-fa3d-409c-b631-fce355437230 req-5fbc09a5-3503-446e-bfa2-72b7d39df424 service nova] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Updating instance_info_cache with network_info: [{"id": "1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2", "address": "fa:16:3e:b1:d4:80", "network": {"id": "d8daee94-e2d9-42cf-9675-8c06e7292d36", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-765825262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81b11067a2d84bba8e6929713034b422", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d8e0cf8-c3", "ovs_interfaceid": "1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:12:05 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:05 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:12:05 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:05 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8c64b544-3add-4b76-94a3-cfd689ee8ff4) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:12:05 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:05 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:05 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-e1a8292d-fa3d-409c-b631-fce355437230 req-5fbc09a5-3503-446e-bfa2-72b7d39df424 service nova] Releasing lock "refresh_cache-7e53d93e-1222-4b1a-9745-d512da0f7925" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:12:05 user nova-compute[95467]: INFO os_vif [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:d4:80,bridge_name='br-int',has_traffic_filtering=True,id=1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2,network=Network(d8daee94-e2d9-42cf-9675-8c06e7292d36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d8e0cf8-c3')
Nov 15 08:12:05 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] calling os-brick to detach iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 08:12:05 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, {'target_iqn': 'iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mZKOEzLI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:12:05 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 08:12:05 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-307f456a-cf34-46c9-8d0e-8c649e3d89d6 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.604s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-307f456a-cf34-46c9-8d0e-8c649e3d89d6 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] <== connect_volume: return (1605ms) {'type': 'block', 'scsi_wwn': '23337323065636664', 'path': '/dev/sdg'} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-307f456a-cf34-46c9-8d0e-8c649e3d89d6 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337323065636664', 'path': '/dev/sdg'} {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.770s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG nova.objects.instance [None req-307f456a-cf34-46c9-8d0e-8c649e3d89d6 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Lazy-loading 'flavor' on Instance uuid 68264a44-5adf-4873-b380-26bcafe2ba04 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[40cdfafb-205b-416a-b9b1-72a9bf748b7c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 08:12:06 user nova-compute[95467]: No targets found.
Nov 15 08:12:06 user nova-compute[95467]: iSNS:
Nov 15 08:12:06 user nova-compute[95467]: No targets found.
Nov 15 08:12:06 user nova-compute[95467]: STATIC:
Nov 15 08:12:06 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f
Nov 15 08:12:06 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:12:06 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:12:06 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8
Nov 15 08:12:06 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:12:06 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:12:06 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de
Nov 15 08:12:06 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:12:06 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:12:06 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05
Nov 15 08:12:06 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:12:06 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:12:06 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5
Nov 15 08:12:06 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:12:06 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:12:06 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff
Nov 15 08:12:06 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:12:06 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:12:06 user nova-compute[95467]: FIRMWARE:
Nov 15 08:12:06 user nova-compute[95467]: No targets found.
Nov 15 08:12:06 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 08:12:06 user nova-compute[95467]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 08:12:06 user nova-compute[95467]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=95467) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f', 0)] {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-307f456a-cf34-46c9-8d0e-8c649e3d89d6 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 08:12:06 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:12:06 user nova-compute[95467]:   <source dev="/dev/sdg"/>
Nov 15 08:12:06 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:12:06 user nova-compute[95467]:   <serial>bc145840-7458-4ebe-aa31-f9350ac056ff</serial>
Nov 15 08:12:06 user nova-compute[95467]: </disk>
Nov 15 08:12:06 user nova-compute[95467]:  {{(pid=95467) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[3638f606-521c-45f2-ba86-12538ef7430e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4dfec9-656b-4426-ac6c-659c25287794]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)
Nov 15 08:12:06 user nova-compute[95467]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)
Nov 15 08:12:06 user nova-compute[95467]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)
Nov 15 08:12:06 user nova-compute[95467]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 (non-flash)
Nov 15 08:12:06 user nova-compute[95467]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)
Nov 15 08:12:06 user nova-compute[95467]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff (non-flash)
Nov 15 08:12:06 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)
Nov 15 08:12:06 user nova-compute[95467]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)
Nov 15 08:12:06 user nova-compute[95467]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)
Nov 15 08:12:06 user nova-compute[95467]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 (non-flash)
Nov 15 08:12:06 user nova-compute[95467]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)
Nov 15 08:12:06 user nova-compute[95467]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff (non-flash)
Nov 15 08:12:06 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efed8448040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f'): ({'sdb'}, set())}) {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Removing single pathed devices sdb {{(pid=95467) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[7762970a-0ae7-4d77-8ceb-5f972c65f385]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[e480cede-2b47-4b7b-b85b-15edff080437]: (4, ('ok\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Flushing IO for device /dev/sdb {{(pid=95467) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a090b3-70e9-4736-934a-ef26981bb0a3]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=95467) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG nova.compute.manager [req-9f3a4dc7-6563-49f4-84a3-6202a8f98a6d req-fb62ae67-5ddd-4746-9bb2-f0ba402f73ec service nova] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Received event network-vif-unplugged-1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-9f3a4dc7-6563-49f4-84a3-6202a8f98a6d req-fb62ae67-5ddd-4746-9bb2-f0ba402f73ec service nova] Acquiring lock "7e53d93e-1222-4b1a-9745-d512da0f7925-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-9f3a4dc7-6563-49f4-84a3-6202a8f98a6d req-fb62ae67-5ddd-4746-9bb2-f0ba402f73ec service nova] Lock "7e53d93e-1222-4b1a-9745-d512da0f7925-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-9f3a4dc7-6563-49f4-84a3-6202a8f98a6d req-fb62ae67-5ddd-4746-9bb2-f0ba402f73ec service nova] Lock "7e53d93e-1222-4b1a-9745-d512da0f7925-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG nova.compute.manager [req-9f3a4dc7-6563-49f4-84a3-6202a8f98a6d req-fb62ae67-5ddd-4746-9bb2-f0ba402f73ec service nova] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] No waiting events found dispatching network-vif-unplugged-1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:12:06 user nova-compute[95467]: WARNING nova.compute.manager [req-9f3a4dc7-6563-49f4-84a3-6202a8f98a6d req-fb62ae67-5ddd-4746-9bb2-f0ba402f73ec service nova] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Received unexpected event network-vif-unplugged-1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2 for instance with vm_state active and task_state rebuilding.
Nov 15 08:12:06 user nova-compute[95467]: DEBUG nova.compute.manager [req-9f3a4dc7-6563-49f4-84a3-6202a8f98a6d req-fb62ae67-5ddd-4746-9bb2-f0ba402f73ec service nova] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Received event network-vif-plugged-1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-9f3a4dc7-6563-49f4-84a3-6202a8f98a6d req-fb62ae67-5ddd-4746-9bb2-f0ba402f73ec service nova] Acquiring lock "7e53d93e-1222-4b1a-9745-d512da0f7925-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-9f3a4dc7-6563-49f4-84a3-6202a8f98a6d req-fb62ae67-5ddd-4746-9bb2-f0ba402f73ec service nova] Lock "7e53d93e-1222-4b1a-9745-d512da0f7925-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-9f3a4dc7-6563-49f4-84a3-6202a8f98a6d req-fb62ae67-5ddd-4746-9bb2-f0ba402f73ec service nova] Lock "7e53d93e-1222-4b1a-9745-d512da0f7925-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG nova.compute.manager [req-9f3a4dc7-6563-49f4-84a3-6202a8f98a6d req-fb62ae67-5ddd-4746-9bb2-f0ba402f73ec service nova] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] No waiting events found dispatching network-vif-plugged-1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:12:06 user nova-compute[95467]: WARNING nova.compute.manager [req-9f3a4dc7-6563-49f4-84a3-6202a8f98a6d req-fb62ae67-5ddd-4746-9bb2-f0ba402f73ec service nova] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Received unexpected event network-vif-plugged-1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2 for instance with vm_state active and task_state rebuilding.
Nov 15 08:12:06 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62c765b-92f6-435f-bf10-1207fc68d778]: (4, ('1', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] SCSI volumes sdb have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f')] {{(pid=95467) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c18e8c6b-d034-4135-b8ff-0cd39b2202c0]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f -p 172.16.0.220:3260 --logout {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[44fbf173-f2c9-429c-b3bb-a3470d69773b]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f, portal: 172.16.0.220,3260]
Nov 15 08:12:06 user nova-compute[95467]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f, portal: 172.16.0.220,3260] successful.
Nov 15 08:12:06 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f -p 172.16.0.220:3260 --op delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c2b091-f287-4cab-abef-5d0e38daedda]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] <== disconnect_volume: return (1119ms) None {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Disconnected iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 08:12:06 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Deleting instance files /opt/stack/data/nova/instances/7e53d93e-1222-4b1a-9745-d512da0f7925_del
Nov 15 08:12:06 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Deletion of /opt/stack/data/nova/instances/7e53d93e-1222-4b1a-9745-d512da0f7925_del complete
Nov 15 08:12:06 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-307f456a-cf34-46c9-8d0e-8c649e3d89d6 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-307f456a-cf34-46c9-8d0e-8c649e3d89d6 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] No BDM found with device name vdb, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-307f456a-cf34-46c9-8d0e-8c649e3d89d6 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] No VIF found with MAC fa:16:3e:82:8d:0f, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:06 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 7e53d93e-1222-4b1a-9745-d512da0f7925 could not be found.
Nov 15 08:12:06 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] calling os-brick to detach iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, {'target_iqn': 'iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mZKOEzLI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:12:06 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 08:12:06 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[2968330c-da7c-4b0c-bce9-a276c95410f6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 08:12:06 user nova-compute[95467]: No targets found.
Nov 15 08:12:06 user nova-compute[95467]: iSNS:
Nov 15 08:12:06 user nova-compute[95467]: No targets found.
Nov 15 08:12:06 user nova-compute[95467]: STATIC:
Nov 15 08:12:06 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8
Nov 15 08:12:06 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:12:06 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:12:06 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de
Nov 15 08:12:06 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:12:06 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:12:06 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05
Nov 15 08:12:06 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:12:06 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:12:06 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5
Nov 15 08:12:06 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:12:06 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:12:06 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff
Nov 15 08:12:06 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:12:06 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:12:06 user nova-compute[95467]: FIRMWARE:
Nov 15 08:12:06 user nova-compute[95467]: No targets found.
Nov 15 08:12:06 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 08:12:06 user nova-compute[95467]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 08:12:06 user nova-compute[95467]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=95467) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f', 0)] {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.045s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8539084d-037b-4b12-848d-109604b31730]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c6c7dd-7f51-4adf-b18e-6b7495eaa4d5]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)
Nov 15 08:12:06 user nova-compute[95467]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)
Nov 15 08:12:06 user nova-compute[95467]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 (non-flash)
Nov 15 08:12:06 user nova-compute[95467]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)
Nov 15 08:12:06 user nova-compute[95467]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff (non-flash)
Nov 15 08:12:06 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)
Nov 15 08:12:06 user nova-compute[95467]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)
Nov 15 08:12:06 user nova-compute[95467]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 (non-flash)
Nov 15 08:12:06 user nova-compute[95467]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)
Nov 15 08:12:06 user nova-compute[95467]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff (non-flash)
Nov 15 08:12:06 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efec86e7b50>, {}) {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Disconnecting from: [] {{(pid=95467) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.127s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] <== disconnect_volume: return (128ms) None {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Disconnected iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 08:12:06 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-307f456a-cf34-46c9-8d0e-8c649e3d89d6 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Lock "68264a44-5adf-4873-b380-26bcafe2ba04" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.742s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:12:07 user nova-compute[95467]: DEBUG nova.compute.manager [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Preparing to wait for external event volume-reimaged-01b18fa8-0d71-4fef-b5f2-44b7afba773f {{(pid=95467) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 15 08:12:07 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Acquiring lock "7e53d93e-1222-4b1a-9745-d512da0f7925-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:12:07 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Lock "7e53d93e-1222-4b1a-9745-d512da0f7925-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:12:07 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Lock "7e53d93e-1222-4b1a-9745-d512da0f7925-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:12:08 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1b868268-dc62-48a1-bbd0-189dd404f3e1 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Acquiring lock "68264a44-5adf-4873-b380-26bcafe2ba04" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:12:08 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1b868268-dc62-48a1-bbd0-189dd404f3e1 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Lock "68264a44-5adf-4873-b380-26bcafe2ba04" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:12:08 user nova-compute[95467]: INFO nova.compute.manager [None req-1b868268-dc62-48a1-bbd0-189dd404f3e1 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Detaching volume bc145840-7458-4ebe-aa31-f9350ac056ff
Nov 15 08:12:08 user nova-compute[95467]: INFO nova.virt.block_device [None req-1b868268-dc62-48a1-bbd0-189dd404f3e1 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Attempting to driver detach volume bc145840-7458-4ebe-aa31-f9350ac056ff from mountpoint /dev/vdb
Nov 15 08:12:08 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-1b868268-dc62-48a1-bbd0-189dd404f3e1 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Attempting to detach device vdb from instance 68264a44-5adf-4873-b380-26bcafe2ba04 from the persistent domain config. {{(pid=95467) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 08:12:08 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-1b868268-dc62-48a1-bbd0-189dd404f3e1 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 08:12:08 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:12:08 user nova-compute[95467]:   <source dev="/dev/sdg"/>
Nov 15 08:12:08 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:12:08 user nova-compute[95467]:   <serial>bc145840-7458-4ebe-aa31-f9350ac056ff</serial>
Nov 15 08:12:08 user nova-compute[95467]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 08:12:08 user nova-compute[95467]: </disk>
Nov 15 08:12:08 user nova-compute[95467]:  {{(pid=95467) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 08:12:08 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-1b868268-dc62-48a1-bbd0-189dd404f3e1 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Successfully detached device vdb from instance 68264a44-5adf-4873-b380-26bcafe2ba04 from the persistent domain config.
Nov 15 08:12:08 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-1b868268-dc62-48a1-bbd0-189dd404f3e1 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 68264a44-5adf-4873-b380-26bcafe2ba04 from the live domain config. {{(pid=95467) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 08:12:08 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-1b868268-dc62-48a1-bbd0-189dd404f3e1 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 08:12:08 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:12:08 user nova-compute[95467]:   <source dev="/dev/sdg"/>
Nov 15 08:12:08 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:12:08 user nova-compute[95467]:   <serial>bc145840-7458-4ebe-aa31-f9350ac056ff</serial>
Nov 15 08:12:08 user nova-compute[95467]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 08:12:08 user nova-compute[95467]: </disk>
Nov 15 08:12:08 user nova-compute[95467]:  {{(pid=95467) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 08:12:09 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-1b868268-dc62-48a1-bbd0-189dd404f3e1 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 68264a44-5adf-4873-b380-26bcafe2ba04 {{(pid=95467) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 08:12:10 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0bfa00b9-445a-4c99-b9db-8ebeb56cb317 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Calling os-brick to attach iSCSI Volume {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 08:12:10 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfa00b9-445a-4c99-b9db-8ebeb56cb317 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WKoHbtLV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:12:10 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-0bfa00b9-445a-4c99-b9db-8ebeb56cb317 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:12:10 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-0bfa00b9-445a-4c99-b9db-8ebeb56cb317 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:12:10 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-0bfa00b9-445a-4c99-b9db-8ebeb56cb317 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:12:10 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-0bfa00b9-445a-4c99-b9db-8ebeb56cb317 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:12:10 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-0bfa00b9-445a-4c99-b9db-8ebeb56cb317 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:12:10 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-0bfa00b9-445a-4c99-b9db-8ebeb56cb317 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:12:10 user nova-compute[95467]: INFO os_brick.initiator.connectors.iscsi [None req-0bfa00b9-445a-4c99-b9db-8ebeb56cb317 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 08:12:10 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 -p 172.16.0.220:3260 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:10 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:10 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25a9970-e44b-4c50-923c-074cb7ab9dce]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:10 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfa00b9-445a-4c99-b9db-8ebeb56cb317 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 08:12:10 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:10 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 -p 172.16.0.220:3260 --interface default --op new {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:10 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:10 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97c02b0-62a2-4ea9-ad11-c10cf2d9a1ff]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5] added\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:10 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfa00b9-445a-4c99-b9db-8ebeb56cb317 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5] added
Nov 15 08:12:10 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:10 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:10 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:10 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[756a4706-cc6d-489a-8852-41d305bc66f1]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:10 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfa00b9-445a-4c99-b9db-8ebeb56cb317 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:10 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:10 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:10 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86891c6-a0ac-4d09-a9e2-aa655d7e060a]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:10 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfa00b9-445a-4c99-b9db-8ebeb56cb317 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:10 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WKoHbtLV {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:10 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WKoHbtLV" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:10 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[054448d6-fa7e-45ca-8dd5-5487da5ad693]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:10 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfa00b9-445a-4c99-b9db-8ebeb56cb317 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WKoHbtLV'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:10 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:10 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:10 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:10 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[e481726c-158c-4f53-b1ba-93cab3016b48]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:10 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfa00b9-445a-4c99-b9db-8ebeb56cb317 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:10 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:10 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:10 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[9372420b-0143-40d8-8964-73c240a3b00a]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:10 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfa00b9-445a-4c99-b9db-8ebeb56cb317 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)
Nov 15 08:12:10 user nova-compute[95467]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)
Nov 15 08:12:10 user nova-compute[95467]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 (non-flash)
Nov 15 08:12:10 user nova-compute[95467]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)
Nov 15 08:12:10 user nova-compute[95467]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff (non-flash)
Nov 15 08:12:10 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:12:10 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfa00b9-445a-4c99-b9db-8ebeb56cb317 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)
Nov 15 08:12:10 user nova-compute[95467]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)
Nov 15 08:12:10 user nova-compute[95467]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 (non-flash)
Nov 15 08:12:10 user nova-compute[95467]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)
Nov 15 08:12:10 user nova-compute[95467]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff (non-flash)
Nov 15 08:12:10 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:12:10 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 -p 172.16.0.220:3260 --login {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:10 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:10 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20319e7-8711-4276-b637-375db7bf986f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:10 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfa00b9-445a-4c99-b9db-8ebeb56cb317 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5, portal: 172.16.0.220,3260]
Nov 15 08:12:10 user nova-compute[95467]: Login to [iface: default, target: iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5, portal: 172.16.0.220,3260] successful.
Nov 15 08:12:10 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:10 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:10 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:10 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b4dc66-93ab-40c4-984b-0dbc82e829f7]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:10 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfa00b9-445a-4c99-b9db-8ebeb56cb317 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:10 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:10 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:10 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[88fedfe2-0033-4cf4-b9b9-d67a33de3e09]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:10 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfa00b9-445a-4c99-b9db-8ebeb56cb317 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)
Nov 15 08:12:10 user nova-compute[95467]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)
Nov 15 08:12:10 user nova-compute[95467]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 (non-flash)
Nov 15 08:12:10 user nova-compute[95467]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)
Nov 15 08:12:10 user nova-compute[95467]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff (non-flash)
Nov 15 08:12:10 user nova-compute[95467]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 (non-flash)
Nov 15 08:12:10 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:12:10 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfa00b9-445a-4c99-b9db-8ebeb56cb317 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)
Nov 15 08:12:10 user nova-compute[95467]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)
Nov 15 08:12:10 user nova-compute[95467]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 (non-flash)
Nov 15 08:12:10 user nova-compute[95467]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)
Nov 15 08:12:10 user nova-compute[95467]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff (non-flash)
Nov 15 08:12:10 user nova-compute[95467]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 (non-flash)
Nov 15 08:12:10 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:12:10 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-0bfa00b9-445a-4c99-b9db-8ebeb56cb317 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:12:10 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfa00b9-445a-4c99-b9db-8ebeb56cb317 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Connected to 172.16.0.220:3260 {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 08:12:10 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-0bfa00b9-445a-4c99-b9db-8ebeb56cb317 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] HCTL ('33', '-', '-', 0) found on session 9 with lun 0 {{(pid=95467) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 08:12:10 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-0bfa00b9-445a-4c99-b9db-8ebeb56cb317 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=95467) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 08:12:10 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:10 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:10 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81d24b9-bc74-49c1-9af1-76928275ae76]: (4, ('- - 0', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:10 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-0bfa00b9-445a-4c99-b9db-8ebeb56cb317 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Searching for a device in session 9 and hctl ['33', '*', '*', 0] yield: None {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:12:11 user nova-compute[95467]: DEBUG nova.compute.manager [req-6910eb46-2da7-4b08-b47f-2c7206544000 req-ed47782b-64cf-4dc9-ae29-354a2adb301a service nova] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Received event network-changed-f6d25344-c8fc-4794-b302-a3665c62b78c {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:12:11 user nova-compute[95467]: DEBUG nova.compute.manager [req-6910eb46-2da7-4b08-b47f-2c7206544000 req-ed47782b-64cf-4dc9-ae29-354a2adb301a service nova] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Refreshing instance network info cache due to event network-changed-f6d25344-c8fc-4794-b302-a3665c62b78c. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:12:11 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-6910eb46-2da7-4b08-b47f-2c7206544000 req-ed47782b-64cf-4dc9-ae29-354a2adb301a service nova] Acquiring lock "refresh_cache-0917b083-2bbf-4baf-a0b8-d59ba3e2256b" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:12:11 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-6910eb46-2da7-4b08-b47f-2c7206544000 req-ed47782b-64cf-4dc9-ae29-354a2adb301a service nova] Acquired lock "refresh_cache-0917b083-2bbf-4baf-a0b8-d59ba3e2256b" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:12:11 user nova-compute[95467]: DEBUG nova.network.neutron [req-6910eb46-2da7-4b08-b47f-2c7206544000 req-ed47782b-64cf-4dc9-ae29-354a2adb301a service nova] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Refreshing network info cache for port f6d25344-c8fc-4794-b302-a3665c62b78c {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:12:11 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-0bfa00b9-445a-4c99-b9db-8ebeb56cb317 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Searching for a device in session 9 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:12:11 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfa00b9-445a-4c99-b9db-8ebeb56cb317 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WKoHbtLV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 08:12:11 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-0bfa00b9-445a-4c99-b9db-8ebeb56cb317 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:12:11 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfa00b9-445a-4c99-b9db-8ebeb56cb317 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '23562396364643333', 'path': '/dev/sdb'} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:12:11 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0bfa00b9-445a-4c99-b9db-8ebeb56cb317 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23562396364643333', 'path': '/dev/sdb'} {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 08:12:11 user nova-compute[95467]: DEBUG nova.objects.instance [None req-0bfa00b9-445a-4c99-b9db-8ebeb56cb317 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Lazy-loading 'flavor' on Instance uuid 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:12:11 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-0bfa00b9-445a-4c99-b9db-8ebeb56cb317 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 08:12:11 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:12:11 user nova-compute[95467]:   <source dev="/dev/sdb"/>
Nov 15 08:12:11 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:12:11 user nova-compute[95467]:   <serial>0b457e6b-86bf-4152-8f03-de5efd184fd5</serial>
Nov 15 08:12:11 user nova-compute[95467]: </disk>
Nov 15 08:12:11 user nova-compute[95467]:  {{(pid=95467) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 08:12:11 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:12 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-0bfa00b9-445a-4c99-b9db-8ebeb56cb317 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:12:12 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-0bfa00b9-445a-4c99-b9db-8ebeb56cb317 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] No BDM found with device name vdb, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:12:12 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-0bfa00b9-445a-4c99-b9db-8ebeb56cb317 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] No VIF found with MAC fa:16:3e:ff:f2:53, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:12:12 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-062a5a32-9ef2-445d-ba2a-c46e60c51cf0 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Acquiring lock "interface-0917b083-2bbf-4baf-a0b8-d59ba3e2256b-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:12:12 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-062a5a32-9ef2-445d-ba2a-c46e60c51cf0 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Lock "interface-0917b083-2bbf-4baf-a0b8-d59ba3e2256b-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:12:12 user nova-compute[95467]: DEBUG nova.objects.instance [None req-062a5a32-9ef2-445d-ba2a-c46e60c51cf0 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Lazy-loading 'flavor' on Instance uuid 0917b083-2bbf-4baf-a0b8-d59ba3e2256b {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:12:12 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0bfa00b9-445a-4c99-b9db-8ebeb56cb317 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Lock "1edf7591-3991-4df9-98c9-ebc4ca9e5a4a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.347s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:12:12 user nova-compute[95467]: DEBUG nova.network.neutron [req-6910eb46-2da7-4b08-b47f-2c7206544000 req-ed47782b-64cf-4dc9-ae29-354a2adb301a service nova] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Updated VIF entry in instance network info cache for port f6d25344-c8fc-4794-b302-a3665c62b78c. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:12:12 user nova-compute[95467]: DEBUG nova.network.neutron [req-6910eb46-2da7-4b08-b47f-2c7206544000 req-ed47782b-64cf-4dc9-ae29-354a2adb301a service nova] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Updating instance_info_cache with network_info: [{"id": "f6d25344-c8fc-4794-b302-a3665c62b78c", "address": "fa:16:3e:b4:72:56", "network": {"id": "76e3f53b-50a0-47d5-9e18-0bb9c42d5ba3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-182207081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18fe2aa7cd7c4943a8c848dd52b9697b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6d25344-c8", "ovs_interfaceid": "f6d25344-c8fc-4794-b302-a3665c62b78c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:12:12 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-6910eb46-2da7-4b08-b47f-2c7206544000 req-ed47782b-64cf-4dc9-ae29-354a2adb301a service nova] Releasing lock "refresh_cache-0917b083-2bbf-4baf-a0b8-d59ba3e2256b" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:12:12 user nova-compute[95467]: DEBUG nova.objects.instance [None req-062a5a32-9ef2-445d-ba2a-c46e60c51cf0 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Lazy-loading 'pci_requests' on Instance uuid 0917b083-2bbf-4baf-a0b8-d59ba3e2256b {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:12:12 user nova-compute[95467]: DEBUG nova.objects.base [None req-062a5a32-9ef2-445d-ba2a-c46e60c51cf0 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Object Instance<0917b083-2bbf-4baf-a0b8-d59ba3e2256b> lazy-loaded attributes: flavor,pci_requests {{(pid=95467) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 08:12:12 user nova-compute[95467]: DEBUG nova.network.neutron [None req-062a5a32-9ef2-445d-ba2a-c46e60c51cf0 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] allocate_for_instance() {{(pid=95467) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 08:12:12 user nova-compute[95467]: DEBUG nova.policy [None req-062a5a32-9ef2-445d-ba2a-c46e60c51cf0 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5c29ac74b4e745a09af7ecedde0f5697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18fe2aa7cd7c4943a8c848dd52b9697b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95467) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 08:12:12 user nova-compute[95467]: DEBUG nova.network.neutron [None req-062a5a32-9ef2-445d-ba2a-c46e60c51cf0 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Successfully created port: c5401d35-e26c-4291-8a19-520a5ece891e {{(pid=95467) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 08:12:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e7d2aedb-b5e6-4885-8f78-bf677822fb84 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] Acquiring lock "a259558e-87ea-48c2-8b72-7443c0510d81" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:12:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e7d2aedb-b5e6-4885-8f78-bf677822fb84 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] Lock "a259558e-87ea-48c2-8b72-7443c0510d81" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:12:13 user nova-compute[95467]: DEBUG nova.objects.instance [None req-e7d2aedb-b5e6-4885-8f78-bf677822fb84 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] Lazy-loading 'flavor' on Instance uuid a259558e-87ea-48c2-8b72-7443c0510d81 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:12:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] Acquiring lock "1edf7591-3991-4df9-98c9-ebc4ca9e5a4a" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:12:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] Lock "1edf7591-3991-4df9-98c9-ebc4ca9e5a4a" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:12:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e7d2aedb-b5e6-4885-8f78-bf677822fb84 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] Lock "a259558e-87ea-48c2-8b72-7443c0510d81" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.103s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:12:13 user nova-compute[95467]: DEBUG os_brick.utils [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:12:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:13 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9963995-eac5-47aa-b074-cb5486d2c366]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:882ae90641f\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:13 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6666b54-6e99-4b6f-aba6-3f113ef15d75]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:13 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b476d1-7b0d-4df3-b9a2-7a73cb405c65]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:13 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[05000e11-7c9e-4ccb-8350-56968d8449f6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] Running cmd (subprocess): nvme version {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] 'nvme version' failed. Not Retrying. {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:12:13 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] nvme not present on system {{(pid=95467) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 08:12:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:12:13 user nova-compute[95467]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 08:12:13 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9923ae-2d9f-4894-bfca-f1848527c94e]: (4, '') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:13 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=95467) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 08:12:13 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 08:12:13 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] LIGHTOS: no hostnqn found. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 08:12:13 user nova-compute[95467]: DEBUG os_brick.utils [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:882ae90641f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:12:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e7d2aedb-b5e6-4885-8f78-bf677822fb84 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] Acquiring lock "a259558e-87ea-48c2-8b72-7443c0510d81" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:12:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e7d2aedb-b5e6-4885-8f78-bf677822fb84 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] Lock "a259558e-87ea-48c2-8b72-7443c0510d81" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:12:13 user nova-compute[95467]: INFO nova.compute.manager [None req-e7d2aedb-b5e6-4885-8f78-bf677822fb84 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Attaching volume ff9afdef-28d7-4ab9-ad35-8a12eeb41f07 to /dev/vdb
Nov 15 08:12:13 user nova-compute[95467]: DEBUG os_brick.utils [None req-e7d2aedb-b5e6-4885-8f78-bf677822fb84 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:12:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:13 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[96bd0cae-f3c8-497b-bab8-7475ffe447ae]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:882ae90641f\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:13 user nova-compute[95467]: INFO nova.compute.manager [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Swapping volume 0b457e6b-86bf-4152-8f03-de5efd184fd5 for 524e76af-4b7b-40a3-8e42-b26a7c731c4a
Nov 15 08:12:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:13 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[741226be-bbd9-4735-b5fa-92654483fc38]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:13 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b3adf6-1fdb-40b3-8512-3f1406ab1af9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:13 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[01cf0b17-c19b-4fde-a61e-c19f4c6c9723]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-e7d2aedb-b5e6-4885-8f78-bf677822fb84 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] Running cmd (subprocess): nvme version {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-e7d2aedb-b5e6-4885-8f78-bf677822fb84 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] 'nvme version' failed. Not Retrying. {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:12:13 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e7d2aedb-b5e6-4885-8f78-bf677822fb84 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] nvme not present on system {{(pid=95467) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 08:12:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:12:13 user nova-compute[95467]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 08:12:13 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e6f9570-29e7-47c8-b8f2-4dac242dc941]: (4, '') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:13 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-e7d2aedb-b5e6-4885-8f78-bf677822fb84 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=95467) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 08:12:13 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-e7d2aedb-b5e6-4885-8f78-bf677822fb84 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 08:12:13 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-e7d2aedb-b5e6-4885-8f78-bf677822fb84 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] LIGHTOS: no hostnqn found. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 08:12:13 user nova-compute[95467]: DEBUG os_brick.utils [None req-e7d2aedb-b5e6-4885-8f78-bf677822fb84 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:882ae90641f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:12:13 user nova-compute[95467]: DEBUG nova.virt.block_device [None req-e7d2aedb-b5e6-4885-8f78-bf677822fb84 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Updating existing volume attachment record: 0738fe9e-09fc-4111-a405-49226cc768dd {{(pid=95467) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 08:12:13 user nova-compute[95467]: DEBUG nova.network.neutron [None req-062a5a32-9ef2-445d-ba2a-c46e60c51cf0 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Successfully updated port: c5401d35-e26c-4291-8a19-520a5ece891e {{(pid=95467) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 08:12:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-062a5a32-9ef2-445d-ba2a-c46e60c51cf0 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Acquiring lock "refresh_cache-0917b083-2bbf-4baf-a0b8-d59ba3e2256b" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:12:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-062a5a32-9ef2-445d-ba2a-c46e60c51cf0 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Acquired lock "refresh_cache-0917b083-2bbf-4baf-a0b8-d59ba3e2256b" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:12:13 user nova-compute[95467]: DEBUG nova.network.neutron [None req-062a5a32-9ef2-445d-ba2a-c46e60c51cf0 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:12:13 user nova-compute[95467]: DEBUG nova.compute.manager [req-dac8bd2a-fe04-4c5c-a895-c173df25ec37 req-fa222b0d-4d99-414c-bef2-a31421d3d109 service nova] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Received event network-changed-6026878a-0f2b-467a-be5a-b500e3776ed6 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:12:13 user nova-compute[95467]: DEBUG nova.compute.manager [req-dac8bd2a-fe04-4c5c-a895-c173df25ec37 req-fa222b0d-4d99-414c-bef2-a31421d3d109 service nova] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Refreshing instance network info cache due to event network-changed-6026878a-0f2b-467a-be5a-b500e3776ed6. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:12:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-dac8bd2a-fe04-4c5c-a895-c173df25ec37 req-fa222b0d-4d99-414c-bef2-a31421d3d109 service nova] Acquiring lock "refresh_cache-a259558e-87ea-48c2-8b72-7443c0510d81" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:12:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-dac8bd2a-fe04-4c5c-a895-c173df25ec37 req-fa222b0d-4d99-414c-bef2-a31421d3d109 service nova] Acquired lock "refresh_cache-a259558e-87ea-48c2-8b72-7443c0510d81" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:12:13 user nova-compute[95467]: DEBUG nova.network.neutron [req-dac8bd2a-fe04-4c5c-a895-c173df25ec37 req-fa222b0d-4d99-414c-bef2-a31421d3d109 service nova] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Refreshing network info cache for port 6026878a-0f2b-467a-be5a-b500e3776ed6 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:12:13 user nova-compute[95467]: DEBUG nova.compute.manager [req-a01dd6a6-3be3-458b-bc9d-a023b170a06f req-9e1aa64b-aed9-4b4e-80cc-18b33e97bc7f service nova] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Received event network-changed-c5401d35-e26c-4291-8a19-520a5ece891e {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:12:13 user nova-compute[95467]: DEBUG nova.compute.manager [req-a01dd6a6-3be3-458b-bc9d-a023b170a06f req-9e1aa64b-aed9-4b4e-80cc-18b33e97bc7f service nova] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Refreshing instance network info cache due to event network-changed-c5401d35-e26c-4291-8a19-520a5ece891e. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:12:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-a01dd6a6-3be3-458b-bc9d-a023b170a06f req-9e1aa64b-aed9-4b4e-80cc-18b33e97bc7f service nova] Acquiring lock "refresh_cache-0917b083-2bbf-4baf-a0b8-d59ba3e2256b" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:12:14 user nova-compute[95467]: DEBUG nova.network.neutron [req-dac8bd2a-fe04-4c5c-a895-c173df25ec37 req-fa222b0d-4d99-414c-bef2-a31421d3d109 service nova] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Updated VIF entry in instance network info cache for port 6026878a-0f2b-467a-be5a-b500e3776ed6. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:12:14 user nova-compute[95467]: DEBUG nova.network.neutron [req-dac8bd2a-fe04-4c5c-a895-c173df25ec37 req-fa222b0d-4d99-414c-bef2-a31421d3d109 service nova] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Updating instance_info_cache with network_info: [{"id": "6026878a-0f2b-467a-be5a-b500e3776ed6", "address": "fa:16:3e:fc:81:b9", "network": {"id": "66c77f59-de52-498a-8294-ec7ac812074b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-943726914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd6ae375b97347d6b1b757bb74cd3c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6026878a-0f", "ovs_interfaceid": "6026878a-0f2b-467a-be5a-b500e3776ed6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:12:14 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-dac8bd2a-fe04-4c5c-a895-c173df25ec37 req-fa222b0d-4d99-414c-bef2-a31421d3d109 service nova] Releasing lock "refresh_cache-a259558e-87ea-48c2-8b72-7443c0510d81" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:12:14 user nova-compute[95467]: DEBUG nova.network.neutron [None req-062a5a32-9ef2-445d-ba2a-c46e60c51cf0 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Updating instance_info_cache with network_info: [{"id": "f6d25344-c8fc-4794-b302-a3665c62b78c", "address": "fa:16:3e:b4:72:56", "network": {"id": "76e3f53b-50a0-47d5-9e18-0bb9c42d5ba3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-182207081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18fe2aa7cd7c4943a8c848dd52b9697b", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6d25344-c8", "ovs_interfaceid": "f6d25344-c8fc-4794-b302-a3665c62b78c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c5401d35-e26c-4291-8a19-520a5ece891e", "address": "fa:16:3e:79:65:ad", "network": {"id": "43eed8c1-119b-4038-98a2-06248998df67", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-33201672", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "18fe2aa7cd7c4943a8c848dd52b9697b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5401d35-e2", "ovs_interfaceid": "c5401d35-e26c-4291-8a19-520a5ece891e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:12:14 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-062a5a32-9ef2-445d-ba2a-c46e60c51cf0 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Releasing lock "refresh_cache-0917b083-2bbf-4baf-a0b8-d59ba3e2256b" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:12:14 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-a01dd6a6-3be3-458b-bc9d-a023b170a06f req-9e1aa64b-aed9-4b4e-80cc-18b33e97bc7f service nova] Acquired lock "refresh_cache-0917b083-2bbf-4baf-a0b8-d59ba3e2256b" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:12:14 user nova-compute[95467]: DEBUG nova.network.neutron [req-a01dd6a6-3be3-458b-bc9d-a023b170a06f req-9e1aa64b-aed9-4b4e-80cc-18b33e97bc7f service nova] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Refreshing network info cache for port c5401d35-e26c-4291-8a19-520a5ece891e {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:12:14 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-062a5a32-9ef2-445d-ba2a-c46e60c51cf0 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T08:10:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-940506734',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-940506734',id=9,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOGNo6GmVxPWDErmWkQ6fepU8heeIoJyOQ4cdNTLpFz1E0Ctc05CX23OX/CDepMfdF3Ar0clX85i/1Lr4zTu3ZjElr//sRBIxLqJHKfdYZdCUYYo+kOnMpjx+ZoNdO+nnQ==',key_name='tempest-keypair-1459138786',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:10:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='18fe2aa7cd7c4943a8c848dd52b9697b',ramdisk_id='',reservation_id='r-edurmax0',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2023837645',owner_user_name='tempest-TaggedAttachmentsTest-2023837645-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:10:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c29ac74b4e745a09af7ecedde0f5697',uuid=0917b083-2bbf-4baf-a0b8-d59ba3e2256b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5401d35-e26c-4291-8a19-520a5ece891e", "address": "fa:16:3e:79:65:ad", "network": {"id": "43eed8c1-119b-4038-98a2-06248998df67", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-33201672", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "18fe2aa7cd7c4943a8c848dd52b9697b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5401d35-e2", "ovs_interfaceid": "c5401d35-e26c-4291-8a19-520a5ece891e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:12:14 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-062a5a32-9ef2-445d-ba2a-c46e60c51cf0 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Converting VIF {"id": "c5401d35-e26c-4291-8a19-520a5ece891e", "address": "fa:16:3e:79:65:ad", "network": {"id": "43eed8c1-119b-4038-98a2-06248998df67", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-33201672", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "18fe2aa7cd7c4943a8c848dd52b9697b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5401d35-e2", "ovs_interfaceid": "c5401d35-e26c-4291-8a19-520a5ece891e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:12:14 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-062a5a32-9ef2-445d-ba2a-c46e60c51cf0 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:65:ad,bridge_name='br-int',has_traffic_filtering=True,id=c5401d35-e26c-4291-8a19-520a5ece891e,network=Network(43eed8c1-119b-4038-98a2-06248998df67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5401d35-e2') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:12:14 user nova-compute[95467]: DEBUG os_vif [None req-062a5a32-9ef2-445d-ba2a-c46e60c51cf0 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:65:ad,bridge_name='br-int',has_traffic_filtering=True,id=c5401d35-e26c-4291-8a19-520a5ece891e,network=Network(43eed8c1-119b-4038-98a2-06248998df67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5401d35-e2') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:12:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:12:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:12:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '34bce880-24e7-594d-96f9-8d3f55b2490b', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:12:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc5401d35-e2, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:12:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc5401d35-e2, col_values=(('qos', UUID('bb02caba-9c72-4469-bff8-d58c481acc69')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:12:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc5401d35-e2, col_values=(('external_ids', {'iface-id': 'c5401d35-e26c-4291-8a19-520a5ece891e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:65:ad', 'vm-uuid': '0917b083-2bbf-4baf-a0b8-d59ba3e2256b'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:12:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:12:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:14 user nova-compute[95467]: INFO os_vif [None req-062a5a32-9ef2-445d-ba2a-c46e60c51cf0 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:65:ad,bridge_name='br-int',has_traffic_filtering=True,id=c5401d35-e26c-4291-8a19-520a5ece891e,network=Network(43eed8c1-119b-4038-98a2-06248998df67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5401d35-e2')
Nov 15 08:12:14 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-062a5a32-9ef2-445d-ba2a-c46e60c51cf0 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T08:10:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-940506734',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-940506734',id=9,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOGNo6GmVxPWDErmWkQ6fepU8heeIoJyOQ4cdNTLpFz1E0Ctc05CX23OX/CDepMfdF3Ar0clX85i/1Lr4zTu3ZjElr//sRBIxLqJHKfdYZdCUYYo+kOnMpjx+ZoNdO+nnQ==',key_name='tempest-keypair-1459138786',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:10:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='18fe2aa7cd7c4943a8c848dd52b9697b',ramdisk_id='',reservation_id='r-edurmax0',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2023837645',owner_user_name='tempest-TaggedAttachmentsTest-2023837645-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:10:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c29ac74b4e745a09af7ecedde0f5697',uuid=0917b083-2bbf-4baf-a0b8-d59ba3e2256b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5401d35-e26c-4291-8a19-520a5ece891e", "address": "fa:16:3e:79:65:ad", "network": {"id": "43eed8c1-119b-4038-98a2-06248998df67", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-33201672", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "18fe2aa7cd7c4943a8c848dd52b9697b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5401d35-e2", "ovs_interfaceid": "c5401d35-e26c-4291-8a19-520a5ece891e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:12:14 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-062a5a32-9ef2-445d-ba2a-c46e60c51cf0 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Converting VIF {"id": "c5401d35-e26c-4291-8a19-520a5ece891e", "address": "fa:16:3e:79:65:ad", "network": {"id": "43eed8c1-119b-4038-98a2-06248998df67", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-33201672", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "18fe2aa7cd7c4943a8c848dd52b9697b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5401d35-e2", "ovs_interfaceid": "c5401d35-e26c-4291-8a19-520a5ece891e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:12:14 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-062a5a32-9ef2-445d-ba2a-c46e60c51cf0 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:65:ad,bridge_name='br-int',has_traffic_filtering=True,id=c5401d35-e26c-4291-8a19-520a5ece891e,network=Network(43eed8c1-119b-4038-98a2-06248998df67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5401d35-e2') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:12:14 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-062a5a32-9ef2-445d-ba2a-c46e60c51cf0 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] attach device xml: <interface type="ethernet">
Nov 15 08:12:14 user nova-compute[95467]:   <mac address="fa:16:3e:79:65:ad"/>
Nov 15 08:12:14 user nova-compute[95467]:   <model type="virtio"/>
Nov 15 08:12:14 user nova-compute[95467]:   <mtu size="1442"/>
Nov 15 08:12:14 user nova-compute[95467]:   <target dev="tapc5401d35-e2"/>
Nov 15 08:12:14 user nova-compute[95467]: </interface>
Nov 15 08:12:14 user nova-compute[95467]:  {{(pid=95467) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 08:12:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:14 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-062a5a32-9ef2-445d-ba2a-c46e60c51cf0 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:12:14 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-062a5a32-9ef2-445d-ba2a-c46e60c51cf0 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] No BDM found with device name hda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:12:14 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-062a5a32-9ef2-445d-ba2a-c46e60c51cf0 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] No VIF found with MAC fa:16:3e:b4:72:56, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:12:14 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-062a5a32-9ef2-445d-ba2a-c46e60c51cf0 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:12:14 user nova-compute[95467]:   <nova:package version="0.0.0"/>
Nov 15 08:12:14 user nova-compute[95467]:   <nova:name>tempest-device-tagging-server-940506734</nova:name>
Nov 15 08:12:14 user nova-compute[95467]:   <nova:creationTime>2023-11-15 08:12:14</nova:creationTime>
Nov 15 08:12:14 user nova-compute[95467]:   <nova:flavor name="m1.tiny">
Nov 15 08:12:14 user nova-compute[95467]:     <nova:memory>512</nova:memory>
Nov 15 08:12:14 user nova-compute[95467]:     <nova:disk>1</nova:disk>
Nov 15 08:12:14 user nova-compute[95467]:     <nova:swap>0</nova:swap>
Nov 15 08:12:14 user nova-compute[95467]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:12:14 user nova-compute[95467]:     <nova:vcpus>1</nova:vcpus>
Nov 15 08:12:14 user nova-compute[95467]:   </nova:flavor>
Nov 15 08:12:14 user nova-compute[95467]:   <nova:owner>
Nov 15 08:12:14 user nova-compute[95467]:     <nova:user uuid="5c29ac74b4e745a09af7ecedde0f5697">tempest-TaggedAttachmentsTest-2023837645-project-member</nova:user>
Nov 15 08:12:14 user nova-compute[95467]:     <nova:project uuid="18fe2aa7cd7c4943a8c848dd52b9697b">tempest-TaggedAttachmentsTest-2023837645</nova:project>
Nov 15 08:12:14 user nova-compute[95467]:   </nova:owner>
Nov 15 08:12:14 user nova-compute[95467]:   <nova:root type="image" uuid="ed9c48aa-ce73-4b3b-9db1-235898be671b"/>
Nov 15 08:12:14 user nova-compute[95467]:   <nova:ports>
Nov 15 08:12:14 user nova-compute[95467]:     <nova:port uuid="f6d25344-c8fc-4794-b302-a3665c62b78c">
Nov 15 08:12:14 user nova-compute[95467]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 08:12:14 user nova-compute[95467]:     </nova:port>
Nov 15 08:12:14 user nova-compute[95467]:     <nova:port uuid="c5401d35-e26c-4291-8a19-520a5ece891e">
Nov 15 08:12:14 user nova-compute[95467]:       <nova:ip type="fixed" address="10.10.10.159" ipVersion="4"/>
Nov 15 08:12:14 user nova-compute[95467]:     </nova:port>
Nov 15 08:12:14 user nova-compute[95467]:   </nova:ports>
Nov 15 08:12:14 user nova-compute[95467]: </nova:instance>
Nov 15 08:12:14 user nova-compute[95467]:  {{(pid=95467) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 15 08:12:14 user nova-compute[95467]: DEBUG nova.network.neutron [req-a01dd6a6-3be3-458b-bc9d-a023b170a06f req-9e1aa64b-aed9-4b4e-80cc-18b33e97bc7f service nova] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Updated VIF entry in instance network info cache for port c5401d35-e26c-4291-8a19-520a5ece891e. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:12:14 user nova-compute[95467]: DEBUG nova.network.neutron [req-a01dd6a6-3be3-458b-bc9d-a023b170a06f req-9e1aa64b-aed9-4b4e-80cc-18b33e97bc7f service nova] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Updating instance_info_cache with network_info: [{"id": "f6d25344-c8fc-4794-b302-a3665c62b78c", "address": "fa:16:3e:b4:72:56", "network": {"id": "76e3f53b-50a0-47d5-9e18-0bb9c42d5ba3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-182207081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18fe2aa7cd7c4943a8c848dd52b9697b", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6d25344-c8", "ovs_interfaceid": "f6d25344-c8fc-4794-b302-a3665c62b78c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c5401d35-e26c-4291-8a19-520a5ece891e", "address": "fa:16:3e:79:65:ad", "network": {"id": "43eed8c1-119b-4038-98a2-06248998df67", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-33201672", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "18fe2aa7cd7c4943a8c848dd52b9697b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5401d35-e2", "ovs_interfaceid": "c5401d35-e26c-4291-8a19-520a5ece891e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:12:14 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-062a5a32-9ef2-445d-ba2a-c46e60c51cf0 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Lock "interface-0917b083-2bbf-4baf-a0b8-d59ba3e2256b-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 2.796s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:12:14 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-a01dd6a6-3be3-458b-bc9d-a023b170a06f req-9e1aa64b-aed9-4b4e-80cc-18b33e97bc7f service nova] Releasing lock "refresh_cache-0917b083-2bbf-4baf-a0b8-d59ba3e2256b" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:12:15 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:15 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:15 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:15 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:15 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-dfcc17c6-e168-407b-b3cc-6c1ed57b59ec tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Acquiring lock "0917b083-2bbf-4baf-a0b8-d59ba3e2256b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:12:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-dfcc17c6-e168-407b-b3cc-6c1ed57b59ec tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Lock "0917b083-2bbf-4baf-a0b8-d59ba3e2256b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:12:15 user nova-compute[95467]: DEBUG nova.objects.instance [None req-dfcc17c6-e168-407b-b3cc-6c1ed57b59ec tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Lazy-loading 'flavor' on Instance uuid 0917b083-2bbf-4baf-a0b8-d59ba3e2256b {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:12:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-dfcc17c6-e168-407b-b3cc-6c1ed57b59ec tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Lock "0917b083-2bbf-4baf-a0b8-d59ba3e2256b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:12:15 user nova-compute[95467]: DEBUG nova.compute.manager [req-68531d71-bcc5-4d59-a488-ce1ee10d8bbf req-d6524545-fb5b-4831-95a2-c265cdd62bd5 service nova] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Received event network-vif-plugged-c5401d35-e26c-4291-8a19-520a5ece891e {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:12:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-68531d71-bcc5-4d59-a488-ce1ee10d8bbf req-d6524545-fb5b-4831-95a2-c265cdd62bd5 service nova] Acquiring lock "0917b083-2bbf-4baf-a0b8-d59ba3e2256b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:12:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-68531d71-bcc5-4d59-a488-ce1ee10d8bbf req-d6524545-fb5b-4831-95a2-c265cdd62bd5 service nova] Lock "0917b083-2bbf-4baf-a0b8-d59ba3e2256b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:12:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-68531d71-bcc5-4d59-a488-ce1ee10d8bbf req-d6524545-fb5b-4831-95a2-c265cdd62bd5 service nova] Lock "0917b083-2bbf-4baf-a0b8-d59ba3e2256b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:12:15 user nova-compute[95467]: DEBUG nova.compute.manager [req-68531d71-bcc5-4d59-a488-ce1ee10d8bbf req-d6524545-fb5b-4831-95a2-c265cdd62bd5 service nova] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] No waiting events found dispatching network-vif-plugged-c5401d35-e26c-4291-8a19-520a5ece891e {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:12:15 user nova-compute[95467]: WARNING nova.compute.manager [req-68531d71-bcc5-4d59-a488-ce1ee10d8bbf req-d6524545-fb5b-4831-95a2-c265cdd62bd5 service nova] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Received unexpected event network-vif-plugged-c5401d35-e26c-4291-8a19-520a5ece891e for instance with vm_state active and task_state None.
Nov 15 08:12:15 user nova-compute[95467]: DEBUG nova.compute.manager [req-68531d71-bcc5-4d59-a488-ce1ee10d8bbf req-d6524545-fb5b-4831-95a2-c265cdd62bd5 service nova] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Received event network-vif-plugged-c5401d35-e26c-4291-8a19-520a5ece891e {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:12:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-68531d71-bcc5-4d59-a488-ce1ee10d8bbf req-d6524545-fb5b-4831-95a2-c265cdd62bd5 service nova] Acquiring lock "0917b083-2bbf-4baf-a0b8-d59ba3e2256b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:12:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-68531d71-bcc5-4d59-a488-ce1ee10d8bbf req-d6524545-fb5b-4831-95a2-c265cdd62bd5 service nova] Lock "0917b083-2bbf-4baf-a0b8-d59ba3e2256b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:12:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-68531d71-bcc5-4d59-a488-ce1ee10d8bbf req-d6524545-fb5b-4831-95a2-c265cdd62bd5 service nova] Lock "0917b083-2bbf-4baf-a0b8-d59ba3e2256b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:12:15 user nova-compute[95467]: DEBUG nova.compute.manager [req-68531d71-bcc5-4d59-a488-ce1ee10d8bbf req-d6524545-fb5b-4831-95a2-c265cdd62bd5 service nova] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] No waiting events found dispatching network-vif-plugged-c5401d35-e26c-4291-8a19-520a5ece891e {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:12:15 user nova-compute[95467]: WARNING nova.compute.manager [req-68531d71-bcc5-4d59-a488-ce1ee10d8bbf req-d6524545-fb5b-4831-95a2-c265cdd62bd5 service nova] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Received unexpected event network-vif-plugged-c5401d35-e26c-4291-8a19-520a5ece891e for instance with vm_state active and task_state None.
Nov 15 08:12:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-dfcc17c6-e168-407b-b3cc-6c1ed57b59ec tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Acquiring lock "0917b083-2bbf-4baf-a0b8-d59ba3e2256b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:12:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-dfcc17c6-e168-407b-b3cc-6c1ed57b59ec tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Lock "0917b083-2bbf-4baf-a0b8-d59ba3e2256b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:12:15 user nova-compute[95467]: INFO nova.compute.manager [None req-dfcc17c6-e168-407b-b3cc-6c1ed57b59ec tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Attaching volume 714a73ec-3d5a-4a77-9426-84d497ef3c56 to /dev/vdb
Nov 15 08:12:15 user nova-compute[95467]: DEBUG os_brick.utils [None req-dfcc17c6-e168-407b-b3cc-6c1ed57b59ec tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:12:15 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:15 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:15 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e809da2-cc8b-4d4b-97e8-e9b6d1b45ac7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:882ae90641f\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:15 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:15 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:15 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22f580e-4ce3-4617-bb66-3cd51aa6ee55]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:15 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:15 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:15 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d04d974-72b8-4d91-894f-78dbea03814a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:15 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e04adc8-672f-47d4-8eb5-9dbb821ab6da]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:15 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-dfcc17c6-e168-407b-b3cc-6c1ed57b59ec tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Running cmd (subprocess): nvme version {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:15 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-dfcc17c6-e168-407b-b3cc-6c1ed57b59ec tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] 'nvme version' failed. Not Retrying. {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:12:15 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dfcc17c6-e168-407b-b3cc-6c1ed57b59ec tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] nvme not present on system {{(pid=95467) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 08:12:15 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:15 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:12:15 user nova-compute[95467]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 08:12:15 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[753e2e09-42a0-4506-b5ed-7b600da3066a]: (4, '') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:15 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-dfcc17c6-e168-407b-b3cc-6c1ed57b59ec tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=95467) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 08:12:15 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-dfcc17c6-e168-407b-b3cc-6c1ed57b59ec tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 08:12:15 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-dfcc17c6-e168-407b-b3cc-6c1ed57b59ec tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] LIGHTOS: no hostnqn found. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 08:12:15 user nova-compute[95467]: DEBUG os_brick.utils [None req-dfcc17c6-e168-407b-b3cc-6c1ed57b59ec tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:882ae90641f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:12:15 user nova-compute[95467]: DEBUG nova.virt.block_device [None req-dfcc17c6-e168-407b-b3cc-6c1ed57b59ec tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Updating existing volume attachment record: d3331c3e-3963-4b1b-9b7f-56958ae339b4 {{(pid=95467) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 08:12:16 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:19 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:19 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7d2aedb-b5e6-4885-8f78-bf677822fb84 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Calling os-brick to attach iSCSI Volume {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 08:12:19 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d2aedb-b5e6-4885-8f78-bf677822fb84 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OmUrjZGB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:12:19 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-e7d2aedb-b5e6-4885-8f78-bf677822fb84 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:12:19 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-e7d2aedb-b5e6-4885-8f78-bf677822fb84 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:12:19 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-e7d2aedb-b5e6-4885-8f78-bf677822fb84 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:12:19 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-e7d2aedb-b5e6-4885-8f78-bf677822fb84 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:12:19 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-e7d2aedb-b5e6-4885-8f78-bf677822fb84 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:12:19 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-e7d2aedb-b5e6-4885-8f78-bf677822fb84 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:12:19 user nova-compute[95467]: INFO os_brick.initiator.connectors.iscsi [None req-e7d2aedb-b5e6-4885-8f78-bf677822fb84 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 08:12:19 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07 -p 172.16.0.220:3260 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:19 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:19 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b8f0d0-37fe-47c2-85cd-bc63ea79cafe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:19 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d2aedb-b5e6-4885-8f78-bf677822fb84 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 08:12:19 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:19 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07 -p 172.16.0.220:3260 --interface default --op new {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:19 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:19 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68f2d72-dcef-4f3e-ac69-d57327f2b7a0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07] added\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:19 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d2aedb-b5e6-4885-8f78-bf677822fb84 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07] added
Nov 15 08:12:19 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:19 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:19 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:19 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[702f2e3b-4464-4035-8ed4-7a1f1ad7c8e4]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:19 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d2aedb-b5e6-4885-8f78-bf677822fb84 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:19 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:19 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.043s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:19 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[96710707-bda6-442f-ac76-d01fc1ed24d1]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:19 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d2aedb-b5e6-4885-8f78-bf677822fb84 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:19 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OmUrjZGB {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:19 user nova-compute[95467]: DEBUG nova.compute.manager [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iXPZWHpK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1edf7591-3991-4df9-98c9-ebc4ca9e5a4a', 'attached_at': '', 'detached_at': '', 'volume_id': '524e76af-4b7b-40a3-8e42-b26a7c731c4a', 'serial': '524e76af-4b7b-40a3-8e42-b26a7c731c4a'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WKoHbtLV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '1edf7591-3991-4df9-98c9-ebc4ca9e5a4a', 'attached_at': '', 'detached_at': '', 'volume_id': '0b457e6b-86bf-4152-8f03-de5efd184fd5', 'serial'} {{(pid=95467) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 15 08:12:19 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Calling os-brick to attach iSCSI Volume {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 08:12:19 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iXPZWHpK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:12:19 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:12:19 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:12:19 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OmUrjZGB" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:19 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b2c670-2adf-4b90-8d1b-22e2bd6006a7]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:19 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d2aedb-b5e6-4885-8f78-bf677822fb84 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OmUrjZGB'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:19 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:19 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:19 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[70304a09-a3bd-429d-8fea-826a6ecc53f3]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:19 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d2aedb-b5e6-4885-8f78-bf677822fb84 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:19 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:19 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:19 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[016e88b1-2b86-4122-b8ab-fb3d8ba50296]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:19 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d2aedb-b5e6-4885-8f78-bf677822fb84 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)
Nov 15 08:12:19 user nova-compute[95467]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)
Nov 15 08:12:19 user nova-compute[95467]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)
Nov 15 08:12:19 user nova-compute[95467]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 (non-flash)
Nov 15 08:12:19 user nova-compute[95467]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)
Nov 15 08:12:19 user nova-compute[95467]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff (non-flash)
Nov 15 08:12:19 user nova-compute[95467]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 (non-flash)
Nov 15 08:12:19 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:12:19 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d2aedb-b5e6-4885-8f78-bf677822fb84 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)
Nov 15 08:12:19 user nova-compute[95467]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)
Nov 15 08:12:19 user nova-compute[95467]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)
Nov 15 08:12:19 user nova-compute[95467]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 (non-flash)
Nov 15 08:12:19 user nova-compute[95467]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)
Nov 15 08:12:19 user nova-compute[95467]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff (non-flash)
Nov 15 08:12:19 user nova-compute[95467]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 (non-flash)
Nov 15 08:12:19 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:12:19 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07 -p 172.16.0.220:3260 --login {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:19 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07 -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:19 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[245236e5-0b2a-4bda-8409-e9f105a508ec]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:19 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d2aedb-b5e6-4885-8f78-bf677822fb84 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07, portal: 172.16.0.220,3260]
Nov 15 08:12:19 user nova-compute[95467]: Login to [iface: default, target: iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07, portal: 172.16.0.220,3260] successful.
Nov 15 08:12:19 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:19 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:19 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:19 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[0120a275-4abb-4796-9ed0-a012634a4e24]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:19 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d2aedb-b5e6-4885-8f78-bf677822fb84 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:19 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:19 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:19 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d280c3f-fbc6-45a6-9076-31b275749e76]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:19 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d2aedb-b5e6-4885-8f78-bf677822fb84 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)
Nov 15 08:12:19 user nova-compute[95467]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07 (non-flash)
Nov 15 08:12:19 user nova-compute[95467]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)
Nov 15 08:12:19 user nova-compute[95467]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)
Nov 15 08:12:19 user nova-compute[95467]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 (non-flash)
Nov 15 08:12:19 user nova-compute[95467]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)
Nov 15 08:12:19 user nova-compute[95467]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff (non-flash)
Nov 15 08:12:19 user nova-compute[95467]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 (non-flash)
Nov 15 08:12:19 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:12:19 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d2aedb-b5e6-4885-8f78-bf677822fb84 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)
Nov 15 08:12:19 user nova-compute[95467]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07 (non-flash)
Nov 15 08:12:19 user nova-compute[95467]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)
Nov 15 08:12:19 user nova-compute[95467]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)
Nov 15 08:12:19 user nova-compute[95467]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 (non-flash)
Nov 15 08:12:19 user nova-compute[95467]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)
Nov 15 08:12:19 user nova-compute[95467]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff (non-flash)
Nov 15 08:12:19 user nova-compute[95467]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 (non-flash)
Nov 15 08:12:19 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:12:19 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-e7d2aedb-b5e6-4885-8f78-bf677822fb84 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:12:19 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d2aedb-b5e6-4885-8f78-bf677822fb84 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] Connected to 172.16.0.220:3260 {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 08:12:19 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-e7d2aedb-b5e6-4885-8f78-bf677822fb84 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] HCTL ('40', '-', '-', 0) found on session 11 with lun 0 {{(pid=95467) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 08:12:19 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-e7d2aedb-b5e6-4885-8f78-bf677822fb84 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=95467) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 08:12:19 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:20 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.156s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:20 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[054ea645-a1f9-4ae0-98dc-a97c9d23cdca]: (4, ('- - 0', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:20 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-e7d2aedb-b5e6-4885-8f78-bf677822fb84 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] Searching for a device in session 11 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:12:20 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d2aedb-b5e6-4885-8f78-bf677822fb84 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OmUrjZGB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 08:12:21 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-e7d2aedb-b5e6-4885-8f78-bf677822fb84 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.517s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:12:21 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d2aedb-b5e6-4885-8f78-bf677822fb84 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] <== connect_volume: return (1520ms) {'type': 'block', 'scsi_wwn': '26564383566373564', 'path': '/dev/sdi'} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:12:21 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7d2aedb-b5e6-4885-8f78-bf677822fb84 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564383566373564', 'path': '/dev/sdi'} {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 08:12:21 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.382s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:12:21 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:12:21 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:12:21 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:12:21 user nova-compute[95467]: INFO os_brick.initiator.connectors.iscsi [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 08:12:21 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a -p 172.16.0.220:3260 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:21 user nova-compute[95467]: DEBUG nova.objects.instance [None req-e7d2aedb-b5e6-4885-8f78-bf677822fb84 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] Lazy-loading 'flavor' on Instance uuid a259558e-87ea-48c2-8b72-7443c0510d81 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:12:21 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:21 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8927f619-5a8e-4c57-9bfd-4ac858c0a2ed]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:21 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 08:12:21 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:21 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a -p 172.16.0.220:3260 --interface default --op new {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:21 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-e7d2aedb-b5e6-4885-8f78-bf677822fb84 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] attach device xml: <disk type="block" device="disk">
Nov 15 08:12:21 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:12:21 user nova-compute[95467]:   <source dev="/dev/sdi"/>
Nov 15 08:12:21 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:12:21 user nova-compute[95467]:   <serial>ff9afdef-28d7-4ab9-ad35-8a12eeb41f07</serial>
Nov 15 08:12:21 user nova-compute[95467]: </disk>
Nov 15 08:12:21 user nova-compute[95467]:  {{(pid=95467) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 08:12:21 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:21 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ca9ee4-540b-4e55-ace8-de64f8995276]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a] added\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:21 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a] added
Nov 15 08:12:21 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:21 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:21 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:21 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d78c2f5-d23b-4462-96e9-5c6694f7aea6]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:21 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:21 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:21 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:21 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd72b51-66ad-4a89-9e57-1e6fe3367f18]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:21 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:21 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iXPZWHpK {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:21 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iXPZWHpK" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:21 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a98c26-2b59-4a51-81c7-087c2ed2ddd1]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:21 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iXPZWHpK'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:21 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:21 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:21 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d245fa1-d094-45e1-a686-e0ec7c7e90b4]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:21 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:21 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:21 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:21 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8ac29e-9d19-46cf-83c0-6fb5d0ef81aa]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:21 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)
Nov 15 08:12:21 user nova-compute[95467]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07 (non-flash)
Nov 15 08:12:21 user nova-compute[95467]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)
Nov 15 08:12:21 user nova-compute[95467]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)
Nov 15 08:12:21 user nova-compute[95467]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 (non-flash)
Nov 15 08:12:21 user nova-compute[95467]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)
Nov 15 08:12:21 user nova-compute[95467]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff (non-flash)
Nov 15 08:12:21 user nova-compute[95467]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 (non-flash)
Nov 15 08:12:21 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:12:21 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)
Nov 15 08:12:21 user nova-compute[95467]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07 (non-flash)
Nov 15 08:12:21 user nova-compute[95467]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)
Nov 15 08:12:21 user nova-compute[95467]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)
Nov 15 08:12:21 user nova-compute[95467]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 (non-flash)
Nov 15 08:12:21 user nova-compute[95467]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)
Nov 15 08:12:21 user nova-compute[95467]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff (non-flash)
Nov 15 08:12:21 user nova-compute[95467]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 (non-flash)
Nov 15 08:12:21 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:12:21 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a -p 172.16.0.220:3260 --login {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:21 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:21 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-e7d2aedb-b5e6-4885-8f78-bf677822fb84 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:12:21 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-e7d2aedb-b5e6-4885-8f78-bf677822fb84 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:12:21 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-e7d2aedb-b5e6-4885-8f78-bf677822fb84 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] No VIF found with MAC fa:16:3e:fc:81:b9, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:12:22 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e7d2aedb-b5e6-4885-8f78-bf677822fb84 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] Lock "a259558e-87ea-48c2-8b72-7443c0510d81" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.662s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:12:22 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfcc17c6-e168-407b-b3cc-6c1ed57b59ec tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Calling os-brick to attach iSCSI Volume {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 08:12:22 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfcc17c6-e168-407b-b3cc-6c1ed57b59ec tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xAMDjGIV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:12:22 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-dfcc17c6-e168-407b-b3cc-6c1ed57b59ec tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:12:22 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-dfcc17c6-e168-407b-b3cc-6c1ed57b59ec tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:12:22 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a -p 172.16.0.220:3260 --login" returned: 0 in 1.089s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:22 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71464fa-4482-442d-804d-6fc8bf759d93]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:22 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a, portal: 172.16.0.220,3260]
Nov 15 08:12:22 user nova-compute[95467]: Login to [iface: default, target: iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a, portal: 172.16.0.220,3260] successful.
Nov 15 08:12:22 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:22 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:22 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:22 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c939508-67cb-453f-b425-2d4d9562aba8]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:22 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:22 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:22 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:22 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc88f04-79f3-4905-9541-a08f5324454f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:22 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)
Nov 15 08:12:22 user nova-compute[95467]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07 (non-flash)
Nov 15 08:12:22 user nova-compute[95467]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a (non-flash)
Nov 15 08:12:22 user nova-compute[95467]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)
Nov 15 08:12:22 user nova-compute[95467]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)
Nov 15 08:12:22 user nova-compute[95467]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 (non-flash)
Nov 15 08:12:22 user nova-compute[95467]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)
Nov 15 08:12:22 user nova-compute[95467]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff (non-flash)
Nov 15 08:12:22 user nova-compute[95467]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 (non-flash)
Nov 15 08:12:22 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:12:22 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)
Nov 15 08:12:22 user nova-compute[95467]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07 (non-flash)
Nov 15 08:12:22 user nova-compute[95467]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a (non-flash)
Nov 15 08:12:22 user nova-compute[95467]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)
Nov 15 08:12:22 user nova-compute[95467]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)
Nov 15 08:12:22 user nova-compute[95467]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 (non-flash)
Nov 15 08:12:22 user nova-compute[95467]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)
Nov 15 08:12:22 user nova-compute[95467]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff (non-flash)
Nov 15 08:12:22 user nova-compute[95467]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 (non-flash)
Nov 15 08:12:22 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:12:22 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.320s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:12:22 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] Connected to 172.16.0.220:3260 {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 08:12:22 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] HCTL ('41', '-', '-', 0) found on session 12 with lun 0 {{(pid=95467) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 08:12:22 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] Scanning host 41 c: -, t: -, l: 0) {{(pid=95467) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 08:12:22 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:22 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.014s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:22 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a4e9c7-f935-4bce-8418-daa546374f63]: (4, ('- - 0', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:22 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] Searching for a device in session 12 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:12:22 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iXPZWHpK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 08:12:23 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-2edb25e1-96aa-4a8a-adfc-f3f7c7f7ea24 tempest-VolumesAssistedSnapshotsTest-1673116053 tempest-VolumesAssistedSnapshotsTest-1673116053-project] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] volume_snapshot_create: create_info: {'snapshot_id': '766643b2-a488-4c0e-8cba-e69a26e7e328', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=95467) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 15 08:12:23 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-2edb25e1-96aa-4a8a-adfc-f3f7c7f7ea24 tempest-VolumesAssistedSnapshotsTest-1673116053 tempest-VolumesAssistedSnapshotsTest-1673116053-project] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] snap xml: <domainsnapshot>
Nov 15 08:12:23 user nova-compute[95467]:   <disks>
Nov 15 08:12:23 user nova-compute[95467]:     <disk name="/dev/sdi" snapshot="external" type="file">
Nov 15 08:12:23 user nova-compute[95467]:       <source file="/dev/new_file"/>
Nov 15 08:12:23 user nova-compute[95467]:     </disk>
Nov 15 08:12:23 user nova-compute[95467]:     <disk name="vda" snapshot="no"/>
Nov 15 08:12:23 user nova-compute[95467]:   </disks>
Nov 15 08:12:23 user nova-compute[95467]: </domainsnapshot>
Nov 15 08:12:23 user nova-compute[95467]:  {{(pid=95467) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 15 08:12:23 user nova-compute[95467]: DEBUG nova.objects.instance [None req-2edb25e1-96aa-4a8a-adfc-f3f7c7f7ea24 tempest-VolumesAssistedSnapshotsTest-1673116053 tempest-VolumesAssistedSnapshotsTest-1673116053-project] Lazy-loading 'system_metadata' on Instance uuid a259558e-87ea-48c2-8b72-7443c0510d81 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:12:23 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-2edb25e1-96aa-4a8a-adfc-f3f7c7f7ea24 tempest-VolumesAssistedSnapshotsTest-1673116053 tempest-VolumesAssistedSnapshotsTest-1673116053-project] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver [None req-2edb25e1-96aa-4a8a-adfc-f3f7c7f7ea24 tempest-VolumesAssistedSnapshotsTest-1673116053 tempest-VolumesAssistedSnapshotsTest-1673116053-project] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Traceback (most recent call last):
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver [instance: a259558e-87ea-48c2-8b72-7443c0510d81]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver [instance: a259558e-87ea-48c2-8b72-7443c0510d81]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver [instance: a259558e-87ea-48c2-8b72-7443c0510d81]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver [instance: a259558e-87ea-48c2-8b72-7443c0510d81]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver [instance: a259558e-87ea-48c2-8b72-7443c0510d81]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver [instance: a259558e-87ea-48c2-8b72-7443c0510d81]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver [instance: a259558e-87ea-48c2-8b72-7443c0510d81]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver [instance: a259558e-87ea-48c2-8b72-7443c0510d81]     rv = execute(f, *args, **kwargs)
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver [instance: a259558e-87ea-48c2-8b72-7443c0510d81]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver [instance: a259558e-87ea-48c2-8b72-7443c0510d81]     six.reraise(c, e, tb)
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver [instance: a259558e-87ea-48c2-8b72-7443c0510d81]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver [instance: a259558e-87ea-48c2-8b72-7443c0510d81]     raise value
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver [instance: a259558e-87ea-48c2-8b72-7443c0510d81]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver [instance: a259558e-87ea-48c2-8b72-7443c0510d81]     rv = meth(*args, **kwargs)
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver [instance: a259558e-87ea-48c2-8b72-7443c0510d81]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver [instance: a259558e-87ea-48c2-8b72-7443c0510d81]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver [instance: a259558e-87ea-48c2-8b72-7443c0510d81] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver [instance: a259558e-87ea-48c2-8b72-7443c0510d81] 
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver [None req-2edb25e1-96aa-4a8a-adfc-f3f7c7f7ea24 tempest-VolumesAssistedSnapshotsTest-1673116053 tempest-VolumesAssistedSnapshotsTest-1673116053-project] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Traceback (most recent call last):
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver [instance: a259558e-87ea-48c2-8b72-7443c0510d81]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver [instance: a259558e-87ea-48c2-8b72-7443c0510d81]     self._volume_snapshot_create(context, instance, guest,
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver [instance: a259558e-87ea-48c2-8b72-7443c0510d81]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver [instance: a259558e-87ea-48c2-8b72-7443c0510d81]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver [instance: a259558e-87ea-48c2-8b72-7443c0510d81]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver [instance: a259558e-87ea-48c2-8b72-7443c0510d81]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver [instance: a259558e-87ea-48c2-8b72-7443c0510d81]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver [instance: a259558e-87ea-48c2-8b72-7443c0510d81]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver [instance: a259558e-87ea-48c2-8b72-7443c0510d81]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver [instance: a259558e-87ea-48c2-8b72-7443c0510d81]     rv = execute(f, *args, **kwargs)
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver [instance: a259558e-87ea-48c2-8b72-7443c0510d81]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver [instance: a259558e-87ea-48c2-8b72-7443c0510d81]     six.reraise(c, e, tb)
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver [instance: a259558e-87ea-48c2-8b72-7443c0510d81]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver [instance: a259558e-87ea-48c2-8b72-7443c0510d81]     raise value
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver [instance: a259558e-87ea-48c2-8b72-7443c0510d81]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver [instance: a259558e-87ea-48c2-8b72-7443c0510d81]     rv = meth(*args, **kwargs)
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver [instance: a259558e-87ea-48c2-8b72-7443c0510d81]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver [instance: a259558e-87ea-48c2-8b72-7443c0510d81]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver [instance: a259558e-87ea-48c2-8b72-7443c0510d81] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver [instance: a259558e-87ea-48c2-8b72-7443c0510d81] 
Nov 15 08:12:23 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-14bc6078-cfcf-4a08-af94-8fe3b7c6e2c3 tempest-VolumesAssistedSnapshotsTest-1673116053 tempest-VolumesAssistedSnapshotsTest-1673116053-project] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] volume_snapshot_delete: delete_info: {'volume_id': 'ff9afdef-28d7-4ab9-ad35-8a12eeb41f07'} {{(pid=95467) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver [None req-14bc6078-cfcf-4a08-af94-8fe3b7c6e2c3 tempest-VolumesAssistedSnapshotsTest-1673116053 tempest-VolumesAssistedSnapshotsTest-1673116053-project] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Traceback (most recent call last):
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver [instance: a259558e-87ea-48c2-8b72-7443c0510d81]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver [instance: a259558e-87ea-48c2-8b72-7443c0510d81]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver [instance: a259558e-87ea-48c2-8b72-7443c0510d81]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver [instance: a259558e-87ea-48c2-8b72-7443c0510d81]     if delete_info['type'] != 'qcow2':
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver [instance: a259558e-87ea-48c2-8b72-7443c0510d81] KeyError: 'type'
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver [instance: a259558e-87ea-48c2-8b72-7443c0510d81] 
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver [None req-2edb25e1-96aa-4a8a-adfc-f3f7c7f7ea24 tempest-VolumesAssistedSnapshotsTest-1673116053 tempest-VolumesAssistedSnapshotsTest-1673116053-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 766643b2-a488-4c0e-8cba-e69a26e7e328 could not be found.
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver     raise value
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver 
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver 
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 766643b2-a488-4c0e-8cba-e69a26e7e328 could not be found. (HTTP 404) (Request-ID: req-1dd716cb-9188-411e-9ce6-c5999c28446b)
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver 
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver 
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 766643b2-a488-4c0e-8cba-e69a26e7e328 could not be found.
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver 
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver [None req-14bc6078-cfcf-4a08-af94-8fe3b7c6e2c3 tempest-VolumesAssistedSnapshotsTest-1673116053 tempest-VolumesAssistedSnapshotsTest-1673116053-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver 
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver 
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-7025fade-1752-4fd3-922b-e77a433d43d6)
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver 
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver 
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 15 08:12:23 user nova-compute[95467]: ERROR nova.virt.libvirt.driver 
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server [None req-2edb25e1-96aa-4a8a-adfc-f3f7c7f7ea24 tempest-VolumesAssistedSnapshotsTest-1673116053 tempest-VolumesAssistedSnapshotsTest-1673116053-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server     raise value
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server 
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server [None req-14bc6078-cfcf-4a08-af94-8fe3b7c6e2c3 tempest-VolumesAssistedSnapshotsTest-1673116053 tempest-VolumesAssistedSnapshotsTest-1673116053-project] Exception during message handling: KeyError: 'type'
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 15 08:12:23 user nova-compute[95467]: ERROR oslo_messaging.rpc.server 
Nov 15 08:12:23 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.352s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:12:23 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] <== connect_volume: return (3734ms) {'type': 'block', 'scsi_wwn': '23534623237383463', 'path': '/dev/sdj'} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:12:23 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23534623237383463', 'path': '/dev/sdj'} {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 08:12:23 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-dfcc17c6-e168-407b-b3cc-6c1ed57b59ec tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.198s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:12:23 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-dfcc17c6-e168-407b-b3cc-6c1ed57b59ec tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:12:23 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-dfcc17c6-e168-407b-b3cc-6c1ed57b59ec tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:12:23 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-dfcc17c6-e168-407b-b3cc-6c1ed57b59ec tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:12:23 user nova-compute[95467]: INFO os_brick.initiator.connectors.iscsi [None req-dfcc17c6-e168-407b-b3cc-6c1ed57b59ec tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 08:12:23 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56 -p 172.16.0.220:3260 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:23 user nova-compute[95467]: DEBUG nova.objects.instance [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] Lazy-loading 'flavor' on Instance uuid 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:12:23 user nova-compute[95467]: DEBUG nova.compute.manager [req-e2f3e129-64d2-4d07-beaa-9651655631f4 req-b93f31e4-cd49-4fbf-9c37-efe3ed48595c service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Received event network-changed-89c9bfb4-6b7a-4635-ba8d-2b0370fafb8b {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:12:23 user nova-compute[95467]: DEBUG nova.compute.manager [req-e2f3e129-64d2-4d07-beaa-9651655631f4 req-b93f31e4-cd49-4fbf-9c37-efe3ed48595c service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Refreshing instance network info cache due to event network-changed-89c9bfb4-6b7a-4635-ba8d-2b0370fafb8b. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:12:23 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-e2f3e129-64d2-4d07-beaa-9651655631f4 req-b93f31e4-cd49-4fbf-9c37-efe3ed48595c service nova] Acquiring lock "refresh_cache-35e88686-253e-452a-9649-8aa2a04128ce" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:12:23 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-e2f3e129-64d2-4d07-beaa-9651655631f4 req-b93f31e4-cd49-4fbf-9c37-efe3ed48595c service nova] Acquired lock "refresh_cache-35e88686-253e-452a-9649-8aa2a04128ce" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:12:23 user nova-compute[95467]: DEBUG nova.network.neutron [req-e2f3e129-64d2-4d07-beaa-9651655631f4 req-b93f31e4-cd49-4fbf-9c37-efe3ed48595c service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Refreshing network info cache for port 89c9bfb4-6b7a-4635-ba8d-2b0370fafb8b {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:12:23 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:23 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a42dec-cdd8-40f0-8ac2-823ece7148c5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:23 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfcc17c6-e168-407b-b3cc-6c1ed57b59ec tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 08:12:23 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:23 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56 -p 172.16.0.220:3260 --interface default --op new {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:23 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:23 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b11965-6121-430b-adc7-967e94186bc4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56] added\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:23 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfcc17c6-e168-407b-b3cc-6c1ed57b59ec tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56] added
Nov 15 08:12:23 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:23 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:23 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:23 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0b2c15-657b-4e48-9133-6808056a8e0d]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:23 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfcc17c6-e168-407b-b3cc-6c1ed57b59ec tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:23 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:23 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:23 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1ac769-6009-490e-9589-ae1b66e970e8]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:23 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfcc17c6-e168-407b-b3cc-6c1ed57b59ec tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:23 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xAMDjGIV {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:23 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xAMDjGIV" returned: 0 in 0.030s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:23 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd764bf-44ea-4745-9753-b6f6d3cf0590]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:23 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfcc17c6-e168-407b-b3cc-6c1ed57b59ec tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xAMDjGIV'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:23 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:23 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-11d0a62f-4a76-481b-a154-4fd8ef9859e7 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] Acquiring lock "a259558e-87ea-48c2-8b72-7443c0510d81" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:12:23 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-11d0a62f-4a76-481b-a154-4fd8ef9859e7 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] Lock "a259558e-87ea-48c2-8b72-7443c0510d81" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:12:23 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:23 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc216f9-087f-4ba1-bfc8-560aae91c416]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:23 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfcc17c6-e168-407b-b3cc-6c1ed57b59ec tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:23 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:23 user nova-compute[95467]: INFO nova.compute.manager [None req-11d0a62f-4a76-481b-a154-4fd8ef9859e7 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Detaching volume ff9afdef-28d7-4ab9-ad35-8a12eeb41f07
Nov 15 08:12:23 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:23 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ccbadb-14d4-48df-91de-a9c83d80265b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:23 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfcc17c6-e168-407b-b3cc-6c1ed57b59ec tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)
Nov 15 08:12:23 user nova-compute[95467]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07 (non-flash)
Nov 15 08:12:23 user nova-compute[95467]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a (non-flash)
Nov 15 08:12:23 user nova-compute[95467]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)
Nov 15 08:12:23 user nova-compute[95467]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)
Nov 15 08:12:23 user nova-compute[95467]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 (non-flash)
Nov 15 08:12:23 user nova-compute[95467]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)
Nov 15 08:12:23 user nova-compute[95467]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff (non-flash)
Nov 15 08:12:23 user nova-compute[95467]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 (non-flash)
Nov 15 08:12:23 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:12:23 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfcc17c6-e168-407b-b3cc-6c1ed57b59ec tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)
Nov 15 08:12:23 user nova-compute[95467]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07 (non-flash)
Nov 15 08:12:23 user nova-compute[95467]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a (non-flash)
Nov 15 08:12:23 user nova-compute[95467]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)
Nov 15 08:12:23 user nova-compute[95467]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)
Nov 15 08:12:23 user nova-compute[95467]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 (non-flash)
Nov 15 08:12:23 user nova-compute[95467]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)
Nov 15 08:12:23 user nova-compute[95467]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff (non-flash)
Nov 15 08:12:23 user nova-compute[95467]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 (non-flash)
Nov 15 08:12:23 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:12:23 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56 -p 172.16.0.220:3260 --login {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:23 user nova-compute[95467]: INFO nova.virt.block_device [None req-11d0a62f-4a76-481b-a154-4fd8ef9859e7 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Attempting to driver detach volume ff9afdef-28d7-4ab9-ad35-8a12eeb41f07 from mountpoint /dev/vdb
Nov 15 08:12:23 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-11d0a62f-4a76-481b-a154-4fd8ef9859e7 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] Attempting to detach device vdb from instance a259558e-87ea-48c2-8b72-7443c0510d81 from the persistent domain config. {{(pid=95467) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 08:12:23 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-11d0a62f-4a76-481b-a154-4fd8ef9859e7 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] detach device xml: <disk type="block" device="disk">
Nov 15 08:12:23 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:12:23 user nova-compute[95467]:   <source dev="/dev/sdi"/>
Nov 15 08:12:23 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:12:23 user nova-compute[95467]:   <serial>ff9afdef-28d7-4ab9-ad35-8a12eeb41f07</serial>
Nov 15 08:12:23 user nova-compute[95467]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 08:12:23 user nova-compute[95467]: </disk>
Nov 15 08:12:23 user nova-compute[95467]:  {{(pid=95467) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 08:12:23 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56 -p 172.16.0.220:3260 --login" returned: 0 in 0.118s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:23 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[db068d20-f3b8-4435-9330-d19f56662ad7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:23 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfcc17c6-e168-407b-b3cc-6c1ed57b59ec tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56, portal: 172.16.0.220,3260]
Nov 15 08:12:23 user nova-compute[95467]: Login to [iface: default, target: iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56, portal: 172.16.0.220,3260] successful.
Nov 15 08:12:23 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:23 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:23 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-11d0a62f-4a76-481b-a154-4fd8ef9859e7 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] Successfully detached device vdb from instance a259558e-87ea-48c2-8b72-7443c0510d81 from the persistent domain config.
Nov 15 08:12:23 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-11d0a62f-4a76-481b-a154-4fd8ef9859e7 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a259558e-87ea-48c2-8b72-7443c0510d81 from the live domain config. {{(pid=95467) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 08:12:23 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-11d0a62f-4a76-481b-a154-4fd8ef9859e7 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] detach device xml: <disk type="block" device="disk">
Nov 15 08:12:23 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:12:23 user nova-compute[95467]:   <source dev="/dev/sdi"/>
Nov 15 08:12:23 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:12:23 user nova-compute[95467]:   <serial>ff9afdef-28d7-4ab9-ad35-8a12eeb41f07</serial>
Nov 15 08:12:23 user nova-compute[95467]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 08:12:23 user nova-compute[95467]: </disk>
Nov 15 08:12:23 user nova-compute[95467]:  {{(pid=95467) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 08:12:23 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:23 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ea9954-3bc5-4ea3-8d9f-2d92a92c9945]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:23 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfcc17c6-e168-407b-b3cc-6c1ed57b59ec tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:23 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:23 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:23 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fdf0eab-c1b1-465b-b681-f4cf7fddf448]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:23 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfcc17c6-e168-407b-b3cc-6c1ed57b59ec tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)
Nov 15 08:12:23 user nova-compute[95467]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07 (non-flash)
Nov 15 08:12:23 user nova-compute[95467]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a (non-flash)
Nov 15 08:12:23 user nova-compute[95467]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56 (non-flash)
Nov 15 08:12:23 user nova-compute[95467]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)
Nov 15 08:12:23 user nova-compute[95467]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)
Nov 15 08:12:23 user nova-compute[95467]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 (non-flash)
Nov 15 08:12:23 user nova-compute[95467]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)
Nov 15 08:12:23 user nova-compute[95467]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff (non-flash)
Nov 15 08:12:23 user nova-compute[95467]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 (non-flash)
Nov 15 08:12:23 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:12:23 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfcc17c6-e168-407b-b3cc-6c1ed57b59ec tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)
Nov 15 08:12:23 user nova-compute[95467]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07 (non-flash)
Nov 15 08:12:23 user nova-compute[95467]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a (non-flash)
Nov 15 08:12:23 user nova-compute[95467]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56 (non-flash)
Nov 15 08:12:23 user nova-compute[95467]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)
Nov 15 08:12:23 user nova-compute[95467]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)
Nov 15 08:12:23 user nova-compute[95467]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 (non-flash)
Nov 15 08:12:23 user nova-compute[95467]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)
Nov 15 08:12:23 user nova-compute[95467]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff (non-flash)
Nov 15 08:12:23 user nova-compute[95467]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 (non-flash)
Nov 15 08:12:23 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:12:23 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-dfcc17c6-e168-407b-b3cc-6c1ed57b59ec tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.416s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:12:23 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfcc17c6-e168-407b-b3cc-6c1ed57b59ec tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Connected to 172.16.0.220:3260 {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 08:12:23 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-dfcc17c6-e168-407b-b3cc-6c1ed57b59ec tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] HCTL ('42', '-', '-', 0) found on session 13 with lun 0 {{(pid=95467) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 08:12:23 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-dfcc17c6-e168-407b-b3cc-6c1ed57b59ec tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=95467) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 08:12:23 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:23 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:23 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2bc50fb-649a-485b-8e60-5a0cd74dddbe]: (4, ('- - 0', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:23 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-dfcc17c6-e168-407b-b3cc-6c1ed57b59ec tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Searching for a device in session 13 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:12:23 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfcc17c6-e168-407b-b3cc-6c1ed57b59ec tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xAMDjGIV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 08:12:23 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=95467) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 08:12:24 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-11d0a62f-4a76-481b-a154-4fd8ef9859e7 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a259558e-87ea-48c2-8b72-7443c0510d81 {{(pid=95467) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 08:12:24 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:24 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=95467) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 08:12:24 user nova-compute[95467]: DEBUG nova.network.neutron [req-e2f3e129-64d2-4d07-beaa-9651655631f4 req-b93f31e4-cd49-4fbf-9c37-efe3ed48595c service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Updated VIF entry in instance network info cache for port 89c9bfb4-6b7a-4635-ba8d-2b0370fafb8b. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:12:24 user nova-compute[95467]: DEBUG nova.network.neutron [req-e2f3e129-64d2-4d07-beaa-9651655631f4 req-b93f31e4-cd49-4fbf-9c37-efe3ed48595c service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Updating instance_info_cache with network_info: [{"id": "89c9bfb4-6b7a-4635-ba8d-2b0370fafb8b", "address": "fa:16:3e:51:c9:81", "network": {"id": "40744d2e-cc7c-4ca4-88b6-de3cb34a5da5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1986770176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89c9bfb4-6b", "ovs_interfaceid": "89c9bfb4-6b7a-4635-ba8d-2b0370fafb8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "92307630-ea94-407f-b852-ee250debc046", "address": "fa:16:3e:7f:f7:1a", "network": {"id": "22cdcc96-2021-437d-9fa1-bece0497025d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1206155458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92307630-ea", "ovs_interfaceid": "92307630-ea94-407f-b852-ee250debc046", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fae94c7c-6554-49a7-a221-43d18d1e95e0", "address": "fa:16:3e:d9:9d:86", "network": {"id": "22cdcc96-2021-437d-9fa1-bece0497025d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1206155458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfae94c7c-65", "ovs_interfaceid": "fae94c7c-6554-49a7-a221-43d18d1e95e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cdfe5e3f-2910-43a2-8d16-132d69d647d5", "address": "fa:16:3e:9e:d6:aa", "network": {"id": "22cdcc96-2021-437d-9fa1-bece0497025d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1206155458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdfe5e3f-29", "ovs_interfaceid": "cdfe5e3f-2910-43a2-8d16-132d69d647d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "aa13aa7e-d38c-487f-8c4f-0f1cd51a18eb", "address": "fa:16:3e:0f:9b:7a", "network": {"id": "22cdcc96-2021-437d-9fa1-bece0497025d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1206155458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa13aa7e-d3", "ovs_interfaceid": "aa13aa7e-d38c-487f-8c4f-0f1cd51a18eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "48912f9e-eeae-4f51-8123-8316a6fcc15e", "address": "fa:16:3e:92:f8:11", "network": {"id": "1e721803-a83d-4c10-ba12-7b70b3b0fa23", "bridge": "br-int", "label": "tempest-device-tagging-net2-1574523632", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48912f9e-ee", "ovs_interfaceid": "48912f9e-eeae-4f51-8123-8316a6fcc15e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0a35017f-b57c-4937-9479-22494bffb5b7", "address": "fa:16:3e:42:0c:b6", "network": {"id": "1e721803-a83d-4c10-ba12-7b70b3b0fa23", "bridge": "br-int", "label": "tempest-device-tagging-net2-1574523632", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a35017f-b5", "ovs_interfaceid": "0a35017f-b57c-4937-9479-22494bffb5b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:12:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-e2f3e129-64d2-4d07-beaa-9651655631f4 req-b93f31e4-cd49-4fbf-9c37-efe3ed48595c service nova] Releasing lock "refresh_cache-35e88686-253e-452a-9649-8aa2a04128ce" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:12:24 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-dfcc17c6-e168-407b-b3cc-6c1ed57b59ec tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.458s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:12:24 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfcc17c6-e168-407b-b3cc-6c1ed57b59ec tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] <== connect_volume: return (2655ms) {'type': 'block', 'scsi_wwn': '23733336364636237', 'path': '/dev/sdk'} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:12:24 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfcc17c6-e168-407b-b3cc-6c1ed57b59ec tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733336364636237', 'path': '/dev/sdk'} {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 08:12:24 user nova-compute[95467]: DEBUG nova.objects.instance [None req-dfcc17c6-e168-407b-b3cc-6c1ed57b59ec tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Lazy-loading 'flavor' on Instance uuid 0917b083-2bbf-4baf-a0b8-d59ba3e2256b {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:12:24 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] COPY block job progress, current cursor: 80740352 final cursor: 1073741824 {{(pid=95467) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 08:12:25 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-dfcc17c6-e168-407b-b3cc-6c1ed57b59ec tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 08:12:25 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:12:25 user nova-compute[95467]:   <source dev="/dev/sdk"/>
Nov 15 08:12:25 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:12:25 user nova-compute[95467]:   <serial>714a73ec-3d5a-4a77-9426-84d497ef3c56</serial>
Nov 15 08:12:25 user nova-compute[95467]: </disk>
Nov 15 08:12:25 user nova-compute[95467]:  {{(pid=95467) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 08:12:25 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] COPY block job progress, current cursor: 127926272 final cursor: 1073741824 {{(pid=95467) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 08:12:25 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-dfcc17c6-e168-407b-b3cc-6c1ed57b59ec tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:12:25 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-dfcc17c6-e168-407b-b3cc-6c1ed57b59ec tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] No BDM found with device name hda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:12:25 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-dfcc17c6-e168-407b-b3cc-6c1ed57b59ec tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] No VIF found with MAC fa:16:3e:b4:72:56, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:12:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-dfcc17c6-e168-407b-b3cc-6c1ed57b59ec tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Lock "0917b083-2bbf-4baf-a0b8-d59ba3e2256b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.031s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:12:26 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] COPY block job progress, current cursor: 291504128 final cursor: 1073741824 {{(pid=95467) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 08:12:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Acquiring lock "35e88686-253e-452a-9649-8aa2a04128ce" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:12:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Lock "35e88686-253e-452a-9649-8aa2a04128ce" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:12:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Acquiring lock "35e88686-253e-452a-9649-8aa2a04128ce-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:12:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Lock "35e88686-253e-452a-9649-8aa2a04128ce-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:12:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Lock "35e88686-253e-452a-9649-8aa2a04128ce-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:12:26 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] COPY block job progress, current cursor: 452984832 final cursor: 1073741824 {{(pid=95467) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 08:12:26 user nova-compute[95467]: INFO nova.compute.manager [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Terminating instance
Nov 15 08:12:26 user nova-compute[95467]: DEBUG nova.compute.manager [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Start destroying the instance on the hypervisor. {{(pid=95467) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 08:12:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:26 user nova-compute[95467]: DEBUG nova.compute.manager [req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b req-5bb35528-c6fb-45e3-97e7-d124d5111fca service nova] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Received event volume-reimaged-01b18fa8-0d71-4fef-b5f2-44b7afba773f {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:12:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b req-5bb35528-c6fb-45e3-97e7-d124d5111fca service nova] Acquiring lock "7e53d93e-1222-4b1a-9745-d512da0f7925-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:12:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b req-5bb35528-c6fb-45e3-97e7-d124d5111fca service nova] Lock "7e53d93e-1222-4b1a-9745-d512da0f7925-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:12:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b req-5bb35528-c6fb-45e3-97e7-d124d5111fca service nova] Lock "7e53d93e-1222-4b1a-9745-d512da0f7925-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:12:26 user nova-compute[95467]: DEBUG nova.compute.manager [req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b req-5bb35528-c6fb-45e3-97e7-d124d5111fca service nova] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Processing event volume-reimaged-01b18fa8-0d71-4fef-b5f2-44b7afba773f {{(pid=95467) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 15 08:12:26 user nova-compute[95467]: DEBUG nova.compute.manager [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Instance event wait completed in 18 seconds for volume-reimaged {{(pid=95467) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 08:12:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:26 user nova-compute[95467]: INFO nova.virt.block_device [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Booting with volume 01b18fa8-0d71-4fef-b5f2-44b7afba773f at /dev/vda
Nov 15 08:12:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:26 user nova-compute[95467]: DEBUG os_brick.utils [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:12:26 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:26 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:26 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c31232-df85-45a2-953a-933840a52dc7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:882ae90641f\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:26 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:26 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:26 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f32e700-e605-4f63-8259-db4305f16f77]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:26 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:26 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:26 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ef1299-7b05-40f7-ade4-d602aef0009c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:26 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[956eac6a-bde9-4ce6-bba1-64fb64c807c8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:26 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Running cmd (subprocess): nvme version {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:27 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] 'nvme version' failed. Not Retrying. {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:12:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:27 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] nvme not present on system {{(pid=95467) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 08:12:27 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:27 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] COPY block job progress, current cursor: 577765376 final cursor: 1073741824 {{(pid=95467) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 08:12:27 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:12:27 user nova-compute[95467]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 08:12:27 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3566586-2ef5-46b0-ac08-1668ac8eb637]: (4, '') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:27 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=95467) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 08:12:27 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 08:12:27 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] LIGHTOS: no hostnqn found. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 08:12:27 user nova-compute[95467]: DEBUG os_brick.utils [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] <== get_connector_properties: return (215ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:882ae90641f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:12:27 user nova-compute[95467]: DEBUG nova.virt.block_device [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Updating existing volume attachment record: a8a245e9-3327-4101-a098-24c6921cda79 {{(pid=95467) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 08:12:27 user nova-compute[95467]: DEBUG nova.compute.manager [req-b9ff2e9c-617c-4d52-92b5-b94b3d2d7454 req-c8cdb6d6-30b8-40b5-ad30-12d5ad6ce09a service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Received event network-vif-unplugged-89c9bfb4-6b7a-4635-ba8d-2b0370fafb8b {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:12:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b9ff2e9c-617c-4d52-92b5-b94b3d2d7454 req-c8cdb6d6-30b8-40b5-ad30-12d5ad6ce09a service nova] Acquiring lock "35e88686-253e-452a-9649-8aa2a04128ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:12:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b9ff2e9c-617c-4d52-92b5-b94b3d2d7454 req-c8cdb6d6-30b8-40b5-ad30-12d5ad6ce09a service nova] Lock "35e88686-253e-452a-9649-8aa2a04128ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:12:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b9ff2e9c-617c-4d52-92b5-b94b3d2d7454 req-c8cdb6d6-30b8-40b5-ad30-12d5ad6ce09a service nova] Lock "35e88686-253e-452a-9649-8aa2a04128ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:12:27 user nova-compute[95467]: DEBUG nova.compute.manager [req-b9ff2e9c-617c-4d52-92b5-b94b3d2d7454 req-c8cdb6d6-30b8-40b5-ad30-12d5ad6ce09a service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] No waiting events found dispatching network-vif-unplugged-89c9bfb4-6b7a-4635-ba8d-2b0370fafb8b {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:12:27 user nova-compute[95467]: DEBUG nova.compute.manager [req-b9ff2e9c-617c-4d52-92b5-b94b3d2d7454 req-c8cdb6d6-30b8-40b5-ad30-12d5ad6ce09a service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Received event network-vif-unplugged-89c9bfb4-6b7a-4635-ba8d-2b0370fafb8b for instance with task_state deleting. {{(pid=95467) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 08:12:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:27 user nova-compute[95467]: DEBUG nova.compute.manager [req-f521c712-248c-4f0a-b57b-bf61fb897f2c req-5337165c-8a4b-465b-ac8b-2b47d84937e7 service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Received event network-vif-unplugged-92307630-ea94-407f-b852-ee250debc046 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:12:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-f521c712-248c-4f0a-b57b-bf61fb897f2c req-5337165c-8a4b-465b-ac8b-2b47d84937e7 service nova] Acquiring lock "35e88686-253e-452a-9649-8aa2a04128ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:12:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-f521c712-248c-4f0a-b57b-bf61fb897f2c req-5337165c-8a4b-465b-ac8b-2b47d84937e7 service nova] Lock "35e88686-253e-452a-9649-8aa2a04128ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:12:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-f521c712-248c-4f0a-b57b-bf61fb897f2c req-5337165c-8a4b-465b-ac8b-2b47d84937e7 service nova] Lock "35e88686-253e-452a-9649-8aa2a04128ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:12:27 user nova-compute[95467]: DEBUG nova.compute.manager [req-f521c712-248c-4f0a-b57b-bf61fb897f2c req-5337165c-8a4b-465b-ac8b-2b47d84937e7 service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] No waiting events found dispatching network-vif-unplugged-92307630-ea94-407f-b852-ee250debc046 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:12:27 user nova-compute[95467]: DEBUG nova.compute.manager [req-f521c712-248c-4f0a-b57b-bf61fb897f2c req-5337165c-8a4b-465b-ac8b-2b47d84937e7 service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Received event network-vif-unplugged-92307630-ea94-407f-b852-ee250debc046 for instance with task_state deleting. {{(pid=95467) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 08:12:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:27 user nova-compute[95467]: DEBUG nova.compute.manager [req-54b76527-063d-436f-9149-0070ec7bb28d req-d0fc0cf7-8537-4553-9cd0-60105a70ec0b service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Received event network-vif-unplugged-cdfe5e3f-2910-43a2-8d16-132d69d647d5 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:12:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-54b76527-063d-436f-9149-0070ec7bb28d req-d0fc0cf7-8537-4553-9cd0-60105a70ec0b service nova] Acquiring lock "35e88686-253e-452a-9649-8aa2a04128ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:12:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-54b76527-063d-436f-9149-0070ec7bb28d req-d0fc0cf7-8537-4553-9cd0-60105a70ec0b service nova] Lock "35e88686-253e-452a-9649-8aa2a04128ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:12:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-54b76527-063d-436f-9149-0070ec7bb28d req-d0fc0cf7-8537-4553-9cd0-60105a70ec0b service nova] Lock "35e88686-253e-452a-9649-8aa2a04128ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:12:27 user nova-compute[95467]: DEBUG nova.compute.manager [req-54b76527-063d-436f-9149-0070ec7bb28d req-d0fc0cf7-8537-4553-9cd0-60105a70ec0b service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] No waiting events found dispatching network-vif-unplugged-cdfe5e3f-2910-43a2-8d16-132d69d647d5 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:12:27 user nova-compute[95467]: DEBUG nova.compute.manager [req-54b76527-063d-436f-9149-0070ec7bb28d req-d0fc0cf7-8537-4553-9cd0-60105a70ec0b service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Received event network-vif-unplugged-cdfe5e3f-2910-43a2-8d16-132d69d647d5 for instance with task_state deleting. {{(pid=95467) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 08:12:27 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] COPY block job progress, current cursor: 711983104 final cursor: 1073741824 {{(pid=95467) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 08:12:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-2f700d37-5d71-4cec-9de2-64d3ee456dc3 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Acquiring lock "0917b083-2bbf-4baf-a0b8-d59ba3e2256b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:12:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-2f700d37-5d71-4cec-9de2-64d3ee456dc3 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Lock "0917b083-2bbf-4baf-a0b8-d59ba3e2256b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:12:27 user nova-compute[95467]: INFO nova.compute.manager [None req-2f700d37-5d71-4cec-9de2-64d3ee456dc3 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Detaching volume 714a73ec-3d5a-4a77-9426-84d497ef3c56
Nov 15 08:12:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:27 user nova-compute[95467]: INFO nova.virt.block_device [None req-2f700d37-5d71-4cec-9de2-64d3ee456dc3 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Attempting to driver detach volume 714a73ec-3d5a-4a77-9426-84d497ef3c56 from mountpoint /dev/vdb
Nov 15 08:12:27 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-2f700d37-5d71-4cec-9de2-64d3ee456dc3 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Attempting to detach device vdb from instance 0917b083-2bbf-4baf-a0b8-d59ba3e2256b from the persistent domain config. {{(pid=95467) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 08:12:27 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-2f700d37-5d71-4cec-9de2-64d3ee456dc3 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 08:12:27 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:12:27 user nova-compute[95467]:   <source dev="/dev/sdk"/>
Nov 15 08:12:27 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:12:27 user nova-compute[95467]:   <serial>714a73ec-3d5a-4a77-9426-84d497ef3c56</serial>
Nov 15 08:12:27 user nova-compute[95467]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 08:12:27 user nova-compute[95467]: </disk>
Nov 15 08:12:27 user nova-compute[95467]:  {{(pid=95467) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 08:12:27 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-2f700d37-5d71-4cec-9de2-64d3ee456dc3 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Successfully detached device vdb from instance 0917b083-2bbf-4baf-a0b8-d59ba3e2256b from the persistent domain config.
Nov 15 08:12:27 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-2f700d37-5d71-4cec-9de2-64d3ee456dc3 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0917b083-2bbf-4baf-a0b8-d59ba3e2256b from the live domain config. {{(pid=95467) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 08:12:27 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-2f700d37-5d71-4cec-9de2-64d3ee456dc3 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 08:12:27 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:12:27 user nova-compute[95467]:   <source dev="/dev/sdk"/>
Nov 15 08:12:27 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:12:27 user nova-compute[95467]:   <serial>714a73ec-3d5a-4a77-9426-84d497ef3c56</serial>
Nov 15 08:12:27 user nova-compute[95467]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 08:12:27 user nova-compute[95467]: </disk>
Nov 15 08:12:27 user nova-compute[95467]:  {{(pid=95467) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 08:12:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:28 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] COPY block job progress, current cursor: 838860800 final cursor: 1073741824 {{(pid=95467) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 08:12:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:28 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] COPY block job progress, current cursor: 969932800 final cursor: 1073741824 {{(pid=95467) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 08:12:28 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-2f700d37-5d71-4cec-9de2-64d3ee456dc3 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0917b083-2bbf-4baf-a0b8-d59ba3e2256b {{(pid=95467) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 08:12:28 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Instance destroyed successfully.
Nov 15 08:12:28 user nova-compute[95467]: DEBUG nova.objects.instance [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Lazy-loading 'resources' on Instance uuid 35e88686-253e-452a-9649-8aa2a04128ce {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:12:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:28 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T08:10:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-758967957',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-758967957',id=11,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbZVUH/X9/g3qhx/QO8l72lfDEt+C9X9Z6weUibGQiHc28yEhmZMMQoZFFfhUqXnOPDCGgwnjkX76jUoX2h70Sx75kIWvX0KaOE6PQPo0AMGmDacZo4ev1tywwnYEkgNg==',key_name='tempest-keypair-786167401',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:11:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e2ffe5715db4f6ebcd4237eaa12305a',ramdisk_id='',reservation_id='r-wkd8jere',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1329538542',owner_user_name='tempest-TaggedBootDevicesTest_v242-1329538542-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:11:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30338a0bc0734be2beb2cb994fdb85d7',uuid=35e88686-253e-452a-9649-8aa2a04128ce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "89c9bfb4-6b7a-4635-ba8d-2b0370fafb8b", "address": "fa:16:3e:51:c9:81", "network": {"id": "40744d2e-cc7c-4ca4-88b6-de3cb34a5da5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1986770176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89c9bfb4-6b", "ovs_interfaceid": "89c9bfb4-6b7a-4635-ba8d-2b0370fafb8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:12:28 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Converting VIF {"id": "89c9bfb4-6b7a-4635-ba8d-2b0370fafb8b", "address": "fa:16:3e:51:c9:81", "network": {"id": "40744d2e-cc7c-4ca4-88b6-de3cb34a5da5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1986770176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89c9bfb4-6b", "ovs_interfaceid": "89c9bfb4-6b7a-4635-ba8d-2b0370fafb8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:12:28 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:51:c9:81,bridge_name='br-int',has_traffic_filtering=True,id=89c9bfb4-6b7a-4635-ba8d-2b0370fafb8b,network=Network(40744d2e-cc7c-4ca4-88b6-de3cb34a5da5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89c9bfb4-6b') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:12:28 user nova-compute[95467]: DEBUG os_vif [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:c9:81,bridge_name='br-int',has_traffic_filtering=True,id=89c9bfb4-6b7a-4635-ba8d-2b0370fafb8b,network=Network(40744d2e-cc7c-4ca4-88b6-de3cb34a5da5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89c9bfb4-6b') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:12:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap89c9bfb4-6b, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:12:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d5484bd9-2e89-4ba0-a011-5e831825a976) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=95467) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:29 user nova-compute[95467]: INFO os_vif [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:c9:81,bridge_name='br-int',has_traffic_filtering=True,id=89c9bfb4-6b7a-4635-ba8d-2b0370fafb8b,network=Network(40744d2e-cc7c-4ca4-88b6-de3cb34a5da5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89c9bfb4-6b')
Nov 15 08:12:29 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T08:10:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-758967957',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-758967957',id=11,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbZVUH/X9/g3qhx/QO8l72lfDEt+C9X9Z6weUibGQiHc28yEhmZMMQoZFFfhUqXnOPDCGgwnjkX76jUoX2h70Sx75kIWvX0KaOE6PQPo0AMGmDacZo4ev1tywwnYEkgNg==',key_name='tempest-keypair-786167401',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:11:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e2ffe5715db4f6ebcd4237eaa12305a',ramdisk_id='',reservation_id='r-wkd8jere',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1329538542',owner_user_name='tempest-TaggedBootDevicesTest_v242-1329538542-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:11:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30338a0bc0734be2beb2cb994fdb85d7',uuid=35e88686-253e-452a-9649-8aa2a04128ce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "92307630-ea94-407f-b852-ee250debc046", "address": "fa:16:3e:7f:f7:1a", "network": {"id": "22cdcc96-2021-437d-9fa1-bece0497025d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1206155458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92307630-ea", "ovs_interfaceid": "92307630-ea94-407f-b852-ee250debc046", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Converting VIF {"id": "92307630-ea94-407f-b852-ee250debc046", "address": "fa:16:3e:7f:f7:1a", "network": {"id": "22cdcc96-2021-437d-9fa1-bece0497025d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1206155458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92307630-ea", "ovs_interfaceid": "92307630-ea94-407f-b852-ee250debc046", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:f7:1a,bridge_name='br-int',has_traffic_filtering=True,id=92307630-ea94-407f-b852-ee250debc046,network=Network(22cdcc96-2021-437d-9fa1-bece0497025d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap92307630-ea') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG os_vif [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:f7:1a,bridge_name='br-int',has_traffic_filtering=True,id=92307630-ea94-407f-b852-ee250debc046,network=Network(22cdcc96-2021-437d-9fa1-bece0497025d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap92307630-ea') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap92307630-ea, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG nova.compute.manager [req-c3c520ba-1c8a-4a90-b31c-5fea4a66f6bb req-c5c73b1f-516a-4ea2-87a4-a8248888e84f service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Received event network-vif-plugged-89c9bfb4-6b7a-4635-ba8d-2b0370fafb8b {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-c3c520ba-1c8a-4a90-b31c-5fea4a66f6bb req-c5c73b1f-516a-4ea2-87a4-a8248888e84f service nova] Acquiring lock "35e88686-253e-452a-9649-8aa2a04128ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-c3c520ba-1c8a-4a90-b31c-5fea4a66f6bb req-c5c73b1f-516a-4ea2-87a4-a8248888e84f service nova] Lock "35e88686-253e-452a-9649-8aa2a04128ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-c3c520ba-1c8a-4a90-b31c-5fea4a66f6bb req-c5c73b1f-516a-4ea2-87a4-a8248888e84f service nova] Lock "35e88686-253e-452a-9649-8aa2a04128ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG nova.compute.manager [req-c3c520ba-1c8a-4a90-b31c-5fea4a66f6bb req-c5c73b1f-516a-4ea2-87a4-a8248888e84f service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] No waiting events found dispatching network-vif-plugged-89c9bfb4-6b7a-4635-ba8d-2b0370fafb8b {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:12:29 user nova-compute[95467]: WARNING nova.compute.manager [req-c3c520ba-1c8a-4a90-b31c-5fea4a66f6bb req-c5c73b1f-516a-4ea2-87a4-a8248888e84f service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Received unexpected event network-vif-plugged-89c9bfb4-6b7a-4635-ba8d-2b0370fafb8b for instance with vm_state active and task_state deleting.
Nov 15 08:12:29 user nova-compute[95467]: DEBUG nova.compute.manager [req-c3c520ba-1c8a-4a90-b31c-5fea4a66f6bb req-c5c73b1f-516a-4ea2-87a4-a8248888e84f service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Received event network-vif-unplugged-48912f9e-eeae-4f51-8123-8316a6fcc15e {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-c3c520ba-1c8a-4a90-b31c-5fea4a66f6bb req-c5c73b1f-516a-4ea2-87a4-a8248888e84f service nova] Acquiring lock "35e88686-253e-452a-9649-8aa2a04128ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-c3c520ba-1c8a-4a90-b31c-5fea4a66f6bb req-c5c73b1f-516a-4ea2-87a4-a8248888e84f service nova] Lock "35e88686-253e-452a-9649-8aa2a04128ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-c3c520ba-1c8a-4a90-b31c-5fea4a66f6bb req-c5c73b1f-516a-4ea2-87a4-a8248888e84f service nova] Lock "35e88686-253e-452a-9649-8aa2a04128ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG nova.compute.manager [req-c3c520ba-1c8a-4a90-b31c-5fea4a66f6bb req-c5c73b1f-516a-4ea2-87a4-a8248888e84f service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] No waiting events found dispatching network-vif-unplugged-48912f9e-eeae-4f51-8123-8316a6fcc15e {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG nova.compute.manager [req-c3c520ba-1c8a-4a90-b31c-5fea4a66f6bb req-c5c73b1f-516a-4ea2-87a4-a8248888e84f service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Received event network-vif-unplugged-48912f9e-eeae-4f51-8123-8316a6fcc15e for instance with task_state deleting. {{(pid=95467) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG nova.compute.manager [req-c3c520ba-1c8a-4a90-b31c-5fea4a66f6bb req-c5c73b1f-516a-4ea2-87a4-a8248888e84f service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Received event network-vif-plugged-48912f9e-eeae-4f51-8123-8316a6fcc15e {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-c3c520ba-1c8a-4a90-b31c-5fea4a66f6bb req-c5c73b1f-516a-4ea2-87a4-a8248888e84f service nova] Acquiring lock "35e88686-253e-452a-9649-8aa2a04128ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-c3c520ba-1c8a-4a90-b31c-5fea4a66f6bb req-c5c73b1f-516a-4ea2-87a4-a8248888e84f service nova] Lock "35e88686-253e-452a-9649-8aa2a04128ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-c3c520ba-1c8a-4a90-b31c-5fea4a66f6bb req-c5c73b1f-516a-4ea2-87a4-a8248888e84f service nova] Lock "35e88686-253e-452a-9649-8aa2a04128ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG nova.compute.manager [req-c3c520ba-1c8a-4a90-b31c-5fea4a66f6bb req-c5c73b1f-516a-4ea2-87a4-a8248888e84f service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] No waiting events found dispatching network-vif-plugged-48912f9e-eeae-4f51-8123-8316a6fcc15e {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:12:29 user nova-compute[95467]: WARNING nova.compute.manager [req-c3c520ba-1c8a-4a90-b31c-5fea4a66f6bb req-c5c73b1f-516a-4ea2-87a4-a8248888e84f service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Received unexpected event network-vif-plugged-48912f9e-eeae-4f51-8123-8316a6fcc15e for instance with vm_state active and task_state deleting.
Nov 15 08:12:29 user nova-compute[95467]: DEBUG nova.compute.manager [req-c3c520ba-1c8a-4a90-b31c-5fea4a66f6bb req-c5c73b1f-516a-4ea2-87a4-a8248888e84f service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Received event network-vif-unplugged-0a35017f-b57c-4937-9479-22494bffb5b7 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-c3c520ba-1c8a-4a90-b31c-5fea4a66f6bb req-c5c73b1f-516a-4ea2-87a4-a8248888e84f service nova] Acquiring lock "35e88686-253e-452a-9649-8aa2a04128ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-c3c520ba-1c8a-4a90-b31c-5fea4a66f6bb req-c5c73b1f-516a-4ea2-87a4-a8248888e84f service nova] Lock "35e88686-253e-452a-9649-8aa2a04128ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-c3c520ba-1c8a-4a90-b31c-5fea4a66f6bb req-c5c73b1f-516a-4ea2-87a4-a8248888e84f service nova] Lock "35e88686-253e-452a-9649-8aa2a04128ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG nova.compute.manager [req-c3c520ba-1c8a-4a90-b31c-5fea4a66f6bb req-c5c73b1f-516a-4ea2-87a4-a8248888e84f service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] No waiting events found dispatching network-vif-unplugged-0a35017f-b57c-4937-9479-22494bffb5b7 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG nova.compute.manager [req-c3c520ba-1c8a-4a90-b31c-5fea4a66f6bb req-c5c73b1f-516a-4ea2-87a4-a8248888e84f service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Received event network-vif-unplugged-0a35017f-b57c-4937-9479-22494bffb5b7 for instance with task_state deleting. {{(pid=95467) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG nova.compute.manager [req-c3c520ba-1c8a-4a90-b31c-5fea4a66f6bb req-c5c73b1f-516a-4ea2-87a4-a8248888e84f service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Received event network-vif-plugged-0a35017f-b57c-4937-9479-22494bffb5b7 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-c3c520ba-1c8a-4a90-b31c-5fea4a66f6bb req-c5c73b1f-516a-4ea2-87a4-a8248888e84f service nova] Acquiring lock "35e88686-253e-452a-9649-8aa2a04128ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-c3c520ba-1c8a-4a90-b31c-5fea4a66f6bb req-c5c73b1f-516a-4ea2-87a4-a8248888e84f service nova] Lock "35e88686-253e-452a-9649-8aa2a04128ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-c3c520ba-1c8a-4a90-b31c-5fea4a66f6bb req-c5c73b1f-516a-4ea2-87a4-a8248888e84f service nova] Lock "35e88686-253e-452a-9649-8aa2a04128ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG nova.compute.manager [req-c3c520ba-1c8a-4a90-b31c-5fea4a66f6bb req-c5c73b1f-516a-4ea2-87a4-a8248888e84f service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] No waiting events found dispatching network-vif-plugged-0a35017f-b57c-4937-9479-22494bffb5b7 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:12:29 user nova-compute[95467]: WARNING nova.compute.manager [req-c3c520ba-1c8a-4a90-b31c-5fea4a66f6bb req-c5c73b1f-516a-4ea2-87a4-a8248888e84f service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Received unexpected event network-vif-plugged-0a35017f-b57c-4937-9479-22494bffb5b7 for instance with vm_state active and task_state deleting.
Nov 15 08:12:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1b8f6a36-9ef4-4697-bdd3-0242a182a667) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] calling os-brick to detach iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, {'target_iqn': 'iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WKoHbtLV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:12:29 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:12:29 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47910ef-1ea2-4bb7-8760-df58680ce426]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 08:12:29 user nova-compute[95467]: No targets found.
Nov 15 08:12:29 user nova-compute[95467]: iSNS:
Nov 15 08:12:29 user nova-compute[95467]: No targets found.
Nov 15 08:12:29 user nova-compute[95467]: STATIC:
Nov 15 08:12:29 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8
Nov 15 08:12:29 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:12:29 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:12:29 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5
Nov 15 08:12:29 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:12:29 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:12:29 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a
Nov 15 08:12:29 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:12:29 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:12:29 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07
Nov 15 08:12:29 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:12:29 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:12:29 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de
Nov 15 08:12:29 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:12:29 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:12:29 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05
Nov 15 08:12:29 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:12:29 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:12:29 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5
Nov 15 08:12:29 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:12:29 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:12:29 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56
Nov 15 08:12:29 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:12:29 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:12:29 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff
Nov 15 08:12:29 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:12:29 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:12:29 user nova-compute[95467]: FIRMWARE:
Nov 15 08:12:29 user nova-compute[95467]: No targets found.
Nov 15 08:12:29 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 08:12:29 user nova-compute[95467]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 08:12:29 user nova-compute[95467]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=95467) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5', 0)] {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:29 user nova-compute[95467]: INFO os_vif [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:f7:1a,bridge_name='br-int',has_traffic_filtering=True,id=92307630-ea94-407f-b852-ee250debc046,network=Network(22cdcc96-2021-437d-9fa1-bece0497025d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap92307630-ea')
Nov 15 08:12:29 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T08:10:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-758967957',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-758967957',id=11,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbZVUH/X9/g3qhx/QO8l72lfDEt+C9X9Z6weUibGQiHc28yEhmZMMQoZFFfhUqXnOPDCGgwnjkX76jUoX2h70Sx75kIWvX0KaOE6PQPo0AMGmDacZo4ev1tywwnYEkgNg==',key_name='tempest-keypair-786167401',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:11:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e2ffe5715db4f6ebcd4237eaa12305a',ramdisk_id='',reservation_id='r-wkd8jere',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1329538542',owner_user_name='tempest-TaggedBootDevicesTest_v242-1329538542-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:11:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30338a0bc0734be2beb2cb994fdb85d7',uuid=35e88686-253e-452a-9649-8aa2a04128ce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fae94c7c-6554-49a7-a221-43d18d1e95e0", "address": "fa:16:3e:d9:9d:86", "network": {"id": "22cdcc96-2021-437d-9fa1-bece0497025d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1206155458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfae94c7c-65", "ovs_interfaceid": "fae94c7c-6554-49a7-a221-43d18d1e95e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Converting VIF {"id": "fae94c7c-6554-49a7-a221-43d18d1e95e0", "address": "fa:16:3e:d9:9d:86", "network": {"id": "22cdcc96-2021-437d-9fa1-bece0497025d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1206155458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfae94c7c-65", "ovs_interfaceid": "fae94c7c-6554-49a7-a221-43d18d1e95e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:9d:86,bridge_name='br-int',has_traffic_filtering=True,id=fae94c7c-6554-49a7-a221-43d18d1e95e0,network=Network(22cdcc96-2021-437d-9fa1-bece0497025d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfae94c7c-65') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG os_vif [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:9d:86,bridge_name='br-int',has_traffic_filtering=True,id=fae94c7c-6554-49a7-a221-43d18d1e95e0,network=Network(22cdcc96-2021-437d-9fa1-bece0497025d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfae94c7c-65') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfae94c7c-65, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ff3fd9-6b8d-488f-896d-39663e2ab2a8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG nova.compute.manager [req-78f4b778-58c9-4f2f-9137-01aaceb16416 req-2c14048a-a0dd-458c-b9ff-1f6793ac64ff service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Received event network-vif-plugged-92307630-ea94-407f-b852-ee250debc046 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-78f4b778-58c9-4f2f-9137-01aaceb16416 req-2c14048a-a0dd-458c-b9ff-1f6793ac64ff service nova] Acquiring lock "35e88686-253e-452a-9649-8aa2a04128ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-78f4b778-58c9-4f2f-9137-01aaceb16416 req-2c14048a-a0dd-458c-b9ff-1f6793ac64ff service nova] Lock "35e88686-253e-452a-9649-8aa2a04128ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-78f4b778-58c9-4f2f-9137-01aaceb16416 req-2c14048a-a0dd-458c-b9ff-1f6793ac64ff service nova] Lock "35e88686-253e-452a-9649-8aa2a04128ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG nova.compute.manager [req-78f4b778-58c9-4f2f-9137-01aaceb16416 req-2c14048a-a0dd-458c-b9ff-1f6793ac64ff service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] No waiting events found dispatching network-vif-plugged-92307630-ea94-407f-b852-ee250debc046 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:12:29 user nova-compute[95467]: WARNING nova.compute.manager [req-78f4b778-58c9-4f2f-9137-01aaceb16416 req-2c14048a-a0dd-458c-b9ff-1f6793ac64ff service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Received unexpected event network-vif-plugged-92307630-ea94-407f-b852-ee250debc046 for instance with vm_state active and task_state deleting.
Nov 15 08:12:29 user nova-compute[95467]: DEBUG nova.compute.manager [req-78f4b778-58c9-4f2f-9137-01aaceb16416 req-2c14048a-a0dd-458c-b9ff-1f6793ac64ff service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Received event network-vif-unplugged-aa13aa7e-d38c-487f-8c4f-0f1cd51a18eb {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-78f4b778-58c9-4f2f-9137-01aaceb16416 req-2c14048a-a0dd-458c-b9ff-1f6793ac64ff service nova] Acquiring lock "35e88686-253e-452a-9649-8aa2a04128ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-78f4b778-58c9-4f2f-9137-01aaceb16416 req-2c14048a-a0dd-458c-b9ff-1f6793ac64ff service nova] Lock "35e88686-253e-452a-9649-8aa2a04128ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-78f4b778-58c9-4f2f-9137-01aaceb16416 req-2c14048a-a0dd-458c-b9ff-1f6793ac64ff service nova] Lock "35e88686-253e-452a-9649-8aa2a04128ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG nova.compute.manager [req-78f4b778-58c9-4f2f-9137-01aaceb16416 req-2c14048a-a0dd-458c-b9ff-1f6793ac64ff service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] No waiting events found dispatching network-vif-unplugged-aa13aa7e-d38c-487f-8c4f-0f1cd51a18eb {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG nova.compute.manager [req-78f4b778-58c9-4f2f-9137-01aaceb16416 req-2c14048a-a0dd-458c-b9ff-1f6793ac64ff service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Received event network-vif-unplugged-aa13aa7e-d38c-487f-8c4f-0f1cd51a18eb for instance with task_state deleting. {{(pid=95467) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG nova.compute.manager [req-78f4b778-58c9-4f2f-9137-01aaceb16416 req-2c14048a-a0dd-458c-b9ff-1f6793ac64ff service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Received event network-vif-plugged-aa13aa7e-d38c-487f-8c4f-0f1cd51a18eb {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-78f4b778-58c9-4f2f-9137-01aaceb16416 req-2c14048a-a0dd-458c-b9ff-1f6793ac64ff service nova] Acquiring lock "35e88686-253e-452a-9649-8aa2a04128ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-78f4b778-58c9-4f2f-9137-01aaceb16416 req-2c14048a-a0dd-458c-b9ff-1f6793ac64ff service nova] Lock "35e88686-253e-452a-9649-8aa2a04128ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-78f4b778-58c9-4f2f-9137-01aaceb16416 req-2c14048a-a0dd-458c-b9ff-1f6793ac64ff service nova] Lock "35e88686-253e-452a-9649-8aa2a04128ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG nova.compute.manager [req-78f4b778-58c9-4f2f-9137-01aaceb16416 req-2c14048a-a0dd-458c-b9ff-1f6793ac64ff service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] No waiting events found dispatching network-vif-plugged-aa13aa7e-d38c-487f-8c4f-0f1cd51a18eb {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:12:29 user nova-compute[95467]: WARNING nova.compute.manager [req-78f4b778-58c9-4f2f-9137-01aaceb16416 req-2c14048a-a0dd-458c-b9ff-1f6793ac64ff service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Received unexpected event network-vif-plugged-aa13aa7e-d38c-487f-8c4f-0f1cd51a18eb for instance with vm_state active and task_state deleting.
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[430ff3d5-e27e-4081-bbac-fce40aa9fc53]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07 (non-flash)
Nov 15 08:12:29 user nova-compute[95467]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a (non-flash)
Nov 15 08:12:29 user nova-compute[95467]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56 (non-flash)
Nov 15 08:12:29 user nova-compute[95467]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)
Nov 15 08:12:29 user nova-compute[95467]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)
Nov 15 08:12:29 user nova-compute[95467]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 (non-flash)
Nov 15 08:12:29 user nova-compute[95467]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)
Nov 15 08:12:29 user nova-compute[95467]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff (non-flash)
Nov 15 08:12:29 user nova-compute[95467]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 (non-flash)
Nov 15 08:12:29 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07 (non-flash)
Nov 15 08:12:29 user nova-compute[95467]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a (non-flash)
Nov 15 08:12:29 user nova-compute[95467]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56 (non-flash)
Nov 15 08:12:29 user nova-compute[95467]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)
Nov 15 08:12:29 user nova-compute[95467]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)
Nov 15 08:12:29 user nova-compute[95467]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 (non-flash)
Nov 15 08:12:29 user nova-compute[95467]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)
Nov 15 08:12:29 user nova-compute[95467]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff (non-flash)
Nov 15 08:12:29 user nova-compute[95467]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 (non-flash)
Nov 15 08:12:29 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efed857a170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5'): ({'sdb'}, set())}) {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] Removing single pathed devices sdb {{(pid=95467) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1428496d-2394-49bd-87e2-7669fc466a8e) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[4203089f-c4d6-40ce-90d2-237aeb6c86e5]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[df242883-ea16-48b7-af17-62d2fb607260]: (4, ('ok\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] Flushing IO for device /dev/sdb {{(pid=95467) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:29 user nova-compute[95467]: INFO os_vif [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:9d:86,bridge_name='br-int',has_traffic_filtering=True,id=fae94c7c-6554-49a7-a221-43d18d1e95e0,network=Network(22cdcc96-2021-437d-9fa1-bece0497025d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfae94c7c-65')
Nov 15 08:12:29 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T08:10:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-758967957',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-758967957',id=11,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbZVUH/X9/g3qhx/QO8l72lfDEt+C9X9Z6weUibGQiHc28yEhmZMMQoZFFfhUqXnOPDCGgwnjkX76jUoX2h70Sx75kIWvX0KaOE6PQPo0AMGmDacZo4ev1tywwnYEkgNg==',key_name='tempest-keypair-786167401',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:11:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e2ffe5715db4f6ebcd4237eaa12305a',ramdisk_id='',reservation_id='r-wkd8jere',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1329538542',owner_user_name='tempest-TaggedBootDevicesTest_v242-1329538542-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:11:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30338a0bc0734be2beb2cb994fdb85d7',uuid=35e88686-253e-452a-9649-8aa2a04128ce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cdfe5e3f-2910-43a2-8d16-132d69d647d5", "address": "fa:16:3e:9e:d6:aa", "network": {"id": "22cdcc96-2021-437d-9fa1-bece0497025d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1206155458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdfe5e3f-29", "ovs_interfaceid": "cdfe5e3f-2910-43a2-8d16-132d69d647d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Converting VIF {"id": "cdfe5e3f-2910-43a2-8d16-132d69d647d5", "address": "fa:16:3e:9e:d6:aa", "network": {"id": "22cdcc96-2021-437d-9fa1-bece0497025d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1206155458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdfe5e3f-29", "ovs_interfaceid": "cdfe5e3f-2910-43a2-8d16-132d69d647d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:d6:aa,bridge_name='br-int',has_traffic_filtering=True,id=cdfe5e3f-2910-43a2-8d16-132d69d647d5,network=Network(22cdcc96-2021-437d-9fa1-bece0497025d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdfe5e3f-29') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG os_vif [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:d6:aa,bridge_name='br-int',has_traffic_filtering=True,id=cdfe5e3f-2910-43a2-8d16-132d69d647d5,network=Network(22cdcc96-2021-437d-9fa1-bece0497025d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdfe5e3f-29') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcdfe5e3f-29, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f710cf11-2e18-4cbd-82e3-b4c8c61a82fd]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=95467) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:29 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-1b868268-dc62-48a1-bbd0-189dd404f3e1 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 68264a44-5adf-4873-b380-26bcafe2ba04 is timed out.
Nov 15 08:12:29 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-1b868268-dc62-48a1-bbd0-189dd404f3e1 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Successfully detached device vdb from instance 68264a44-5adf-4873-b380-26bcafe2ba04 from the live domain config.
Nov 15 08:12:29 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b868268-dc62-48a1-bbd0-189dd404f3e1 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] calling os-brick to detach iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b868268-dc62-48a1-bbd0-189dd404f3e1 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, {'target_iqn': 'iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mQSRvXoK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:12:29 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-1b868268-dc62-48a1-bbd0-189dd404f3e1 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:12:29 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-1b868268-dc62-48a1-bbd0-189dd404f3e1 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7c6bd6c5-8030-4b42-b204-6fdf75f7e68d) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e3206c-645c-47be-a940-08d5bcc08705]: (4, ('1', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] SCSI volumes sdb have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5')] {{(pid=95467) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:29 user nova-compute[95467]: INFO os_vif [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:d6:aa,bridge_name='br-int',has_traffic_filtering=True,id=cdfe5e3f-2910-43a2-8d16-132d69d647d5,network=Network(22cdcc96-2021-437d-9fa1-bece0497025d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdfe5e3f-29')
Nov 15 08:12:29 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T08:10:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-758967957',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-758967957',id=11,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbZVUH/X9/g3qhx/QO8l72lfDEt+C9X9Z6weUibGQiHc28yEhmZMMQoZFFfhUqXnOPDCGgwnjkX76jUoX2h70Sx75kIWvX0KaOE6PQPo0AMGmDacZo4ev1tywwnYEkgNg==',key_name='tempest-keypair-786167401',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:11:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e2ffe5715db4f6ebcd4237eaa12305a',ramdisk_id='',reservation_id='r-wkd8jere',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1329538542',owner_user_name='tempest-TaggedBootDevicesTest_v242-1329538542-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:11:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30338a0bc0734be2beb2cb994fdb85d7',uuid=35e88686-253e-452a-9649-8aa2a04128ce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aa13aa7e-d38c-487f-8c4f-0f1cd51a18eb", "address": "fa:16:3e:0f:9b:7a", "network": {"id": "22cdcc96-2021-437d-9fa1-bece0497025d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1206155458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa13aa7e-d3", "ovs_interfaceid": "aa13aa7e-d38c-487f-8c4f-0f1cd51a18eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Converting VIF {"id": "aa13aa7e-d38c-487f-8c4f-0f1cd51a18eb", "address": "fa:16:3e:0f:9b:7a", "network": {"id": "22cdcc96-2021-437d-9fa1-bece0497025d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1206155458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa13aa7e-d3", "ovs_interfaceid": "aa13aa7e-d38c-487f-8c4f-0f1cd51a18eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:9b:7a,bridge_name='br-int',has_traffic_filtering=True,id=aa13aa7e-d38c-487f-8c4f-0f1cd51a18eb,network=Network(22cdcc96-2021-437d-9fa1-bece0497025d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa13aa7e-d3') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG os_vif [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:9b:7a,bridge_name='br-int',has_traffic_filtering=True,id=aa13aa7e-d38c-487f-8c4f-0f1cd51a18eb,network=Network(22cdcc96-2021-437d-9fa1-bece0497025d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa13aa7e-d3') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb32cb95-fc05-4e13-8718-e2e859edb9b3]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaa13aa7e-d3, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 -p 172.16.0.220:3260 --logout {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=902eedcd-54e5-4354-a1e6-42bdb11c1d3a) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:29 user nova-compute[95467]: INFO os_vif [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:9b:7a,bridge_name='br-int',has_traffic_filtering=True,id=aa13aa7e-d38c-487f-8c4f-0f1cd51a18eb,network=Network(22cdcc96-2021-437d-9fa1-bece0497025d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa13aa7e-d3')
Nov 15 08:12:29 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T08:10:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-758967957',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-758967957',id=11,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbZVUH/X9/g3qhx/QO8l72lfDEt+C9X9Z6weUibGQiHc28yEhmZMMQoZFFfhUqXnOPDCGgwnjkX76jUoX2h70Sx75kIWvX0KaOE6PQPo0AMGmDacZo4ev1tywwnYEkgNg==',key_name='tempest-keypair-786167401',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:11:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e2ffe5715db4f6ebcd4237eaa12305a',ramdisk_id='',reservation_id='r-wkd8jere',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1329538542',owner_user_name='tempest-TaggedBootDevicesTest_v242-1329538542-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:11:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30338a0bc0734be2beb2cb994fdb85d7',uuid=35e88686-253e-452a-9649-8aa2a04128ce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "48912f9e-eeae-4f51-8123-8316a6fcc15e", "address": "fa:16:3e:92:f8:11", "network": {"id": "1e721803-a83d-4c10-ba12-7b70b3b0fa23", "bridge": "br-int", "label": "tempest-device-tagging-net2-1574523632", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48912f9e-ee", "ovs_interfaceid": "48912f9e-eeae-4f51-8123-8316a6fcc15e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Converting VIF {"id": "48912f9e-eeae-4f51-8123-8316a6fcc15e", "address": "fa:16:3e:92:f8:11", "network": {"id": "1e721803-a83d-4c10-ba12-7b70b3b0fa23", "bridge": "br-int", "label": "tempest-device-tagging-net2-1574523632", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48912f9e-ee", "ovs_interfaceid": "48912f9e-eeae-4f51-8123-8316a6fcc15e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:f8:11,bridge_name='br-int',has_traffic_filtering=True,id=48912f9e-eeae-4f51-8123-8316a6fcc15e,network=Network(1e721803-a83d-4c10-ba12-7b70b3b0fa23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48912f9e-ee') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG os_vif [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:f8:11,bridge_name='br-int',has_traffic_filtering=True,id=48912f9e-eeae-4f51-8123-8316a6fcc15e,network=Network(1e721803-a83d-4c10-ba12-7b70b3b0fa23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48912f9e-ee') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap48912f9e-ee, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4249ad38-0432-43ec-8d64-457a81d634e9) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.090s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29ba6cf-5e10-404c-91dd-af15ebd3ea39]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5, portal: 172.16.0.220,3260]
Nov 15 08:12:29 user nova-compute[95467]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5, portal: 172.16.0.220,3260] successful.
Nov 15 08:12:29 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 -p 172.16.0.220:3260 --op delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:29 user nova-compute[95467]: INFO os_vif [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:f8:11,bridge_name='br-int',has_traffic_filtering=True,id=48912f9e-eeae-4f51-8123-8316a6fcc15e,network=Network(1e721803-a83d-4c10-ba12-7b70b3b0fa23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48912f9e-ee')
Nov 15 08:12:29 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T08:10:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-758967957',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-758967957',id=11,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbZVUH/X9/g3qhx/QO8l72lfDEt+C9X9Z6weUibGQiHc28yEhmZMMQoZFFfhUqXnOPDCGgwnjkX76jUoX2h70Sx75kIWvX0KaOE6PQPo0AMGmDacZo4ev1tywwnYEkgNg==',key_name='tempest-keypair-786167401',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:11:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e2ffe5715db4f6ebcd4237eaa12305a',ramdisk_id='',reservation_id='r-wkd8jere',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1329538542',owner_user_name='tempest-TaggedBootDevicesTest_v242-1329538542-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:11:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30338a0bc0734be2beb2cb994fdb85d7',uuid=35e88686-253e-452a-9649-8aa2a04128ce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0a35017f-b57c-4937-9479-22494bffb5b7", "address": "fa:16:3e:42:0c:b6", "network": {"id": "1e721803-a83d-4c10-ba12-7b70b3b0fa23", "bridge": "br-int", "label": "tempest-device-tagging-net2-1574523632", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a35017f-b5", "ovs_interfaceid": "0a35017f-b57c-4937-9479-22494bffb5b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Converting VIF {"id": "0a35017f-b57c-4937-9479-22494bffb5b7", "address": "fa:16:3e:42:0c:b6", "network": {"id": "1e721803-a83d-4c10-ba12-7b70b3b0fa23", "bridge": "br-int", "label": "tempest-device-tagging-net2-1574523632", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a35017f-b5", "ovs_interfaceid": "0a35017f-b57c-4937-9479-22494bffb5b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:0c:b6,bridge_name='br-int',has_traffic_filtering=True,id=0a35017f-b57c-4937-9479-22494bffb5b7,network=Network(1e721803-a83d-4c10-ba12-7b70b3b0fa23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a35017f-b5') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG os_vif [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:0c:b6,bridge_name='br-int',has_traffic_filtering=True,id=0a35017f-b57c-4937-9479-22494bffb5b7,network=Network(1e721803-a83d-4c10-ba12-7b70b3b0fa23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a35017f-b5') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0a35017f-b5, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=421aefdd-e5b3-41a8-b680-36be60b0911c) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:29 user nova-compute[95467]: INFO os_vif [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:0c:b6,bridge_name='br-int',has_traffic_filtering=True,id=0a35017f-b57c-4937-9479-22494bffb5b7,network=Network(1e721803-a83d-4c10-ba12-7b70b3b0fa23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a35017f-b5')
Nov 15 08:12:29 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] calling os-brick to detach iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, {'target_iqn': 'iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RpxtXbBF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:12:29 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:12:29 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG nova.compute.manager [req-e139f59f-455e-443c-ab77-7d4d5a179a8f req-3492eea7-031b-4744-be78-d1a5e8682b23 service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Received event network-vif-plugged-cdfe5e3f-2910-43a2-8d16-132d69d647d5 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-e139f59f-455e-443c-ab77-7d4d5a179a8f req-3492eea7-031b-4744-be78-d1a5e8682b23 service nova] Acquiring lock "35e88686-253e-452a-9649-8aa2a04128ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-e139f59f-455e-443c-ab77-7d4d5a179a8f req-3492eea7-031b-4744-be78-d1a5e8682b23 service nova] Lock "35e88686-253e-452a-9649-8aa2a04128ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-e139f59f-455e-443c-ab77-7d4d5a179a8f req-3492eea7-031b-4744-be78-d1a5e8682b23 service nova] Lock "35e88686-253e-452a-9649-8aa2a04128ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG nova.compute.manager [req-e139f59f-455e-443c-ab77-7d4d5a179a8f req-3492eea7-031b-4744-be78-d1a5e8682b23 service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] No waiting events found dispatching network-vif-plugged-cdfe5e3f-2910-43a2-8d16-132d69d647d5 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:12:29 user nova-compute[95467]: WARNING nova.compute.manager [req-e139f59f-455e-443c-ab77-7d4d5a179a8f req-3492eea7-031b-4744-be78-d1a5e8682b23 service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Received unexpected event network-vif-plugged-cdfe5e3f-2910-43a2-8d16-132d69d647d5 for instance with vm_state active and task_state deleting.
Nov 15 08:12:29 user nova-compute[95467]: DEBUG nova.compute.manager [req-e139f59f-455e-443c-ab77-7d4d5a179a8f req-3492eea7-031b-4744-be78-d1a5e8682b23 service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Received event network-vif-unplugged-fae94c7c-6554-49a7-a221-43d18d1e95e0 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-e139f59f-455e-443c-ab77-7d4d5a179a8f req-3492eea7-031b-4744-be78-d1a5e8682b23 service nova] Acquiring lock "35e88686-253e-452a-9649-8aa2a04128ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-e139f59f-455e-443c-ab77-7d4d5a179a8f req-3492eea7-031b-4744-be78-d1a5e8682b23 service nova] Lock "35e88686-253e-452a-9649-8aa2a04128ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-e139f59f-455e-443c-ab77-7d4d5a179a8f req-3492eea7-031b-4744-be78-d1a5e8682b23 service nova] Lock "35e88686-253e-452a-9649-8aa2a04128ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG nova.compute.manager [req-e139f59f-455e-443c-ab77-7d4d5a179a8f req-3492eea7-031b-4744-be78-d1a5e8682b23 service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] No waiting events found dispatching network-vif-unplugged-fae94c7c-6554-49a7-a221-43d18d1e95e0 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG nova.compute.manager [req-e139f59f-455e-443c-ab77-7d4d5a179a8f req-3492eea7-031b-4744-be78-d1a5e8682b23 service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Received event network-vif-unplugged-fae94c7c-6554-49a7-a221-43d18d1e95e0 for instance with task_state deleting. {{(pid=95467) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG nova.compute.manager [req-e139f59f-455e-443c-ab77-7d4d5a179a8f req-3492eea7-031b-4744-be78-d1a5e8682b23 service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Received event network-vif-plugged-fae94c7c-6554-49a7-a221-43d18d1e95e0 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-e139f59f-455e-443c-ab77-7d4d5a179a8f req-3492eea7-031b-4744-be78-d1a5e8682b23 service nova] Acquiring lock "35e88686-253e-452a-9649-8aa2a04128ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-e139f59f-455e-443c-ab77-7d4d5a179a8f req-3492eea7-031b-4744-be78-d1a5e8682b23 service nova] Lock "35e88686-253e-452a-9649-8aa2a04128ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-e139f59f-455e-443c-ab77-7d4d5a179a8f req-3492eea7-031b-4744-be78-d1a5e8682b23 service nova] Lock "35e88686-253e-452a-9649-8aa2a04128ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG nova.compute.manager [req-e139f59f-455e-443c-ab77-7d4d5a179a8f req-3492eea7-031b-4744-be78-d1a5e8682b23 service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] No waiting events found dispatching network-vif-plugged-fae94c7c-6554-49a7-a221-43d18d1e95e0 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:12:29 user nova-compute[95467]: WARNING nova.compute.manager [req-e139f59f-455e-443c-ab77-7d4d5a179a8f req-3492eea7-031b-4744-be78-d1a5e8682b23 service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Received unexpected event network-vif-plugged-fae94c7c-6554-49a7-a221-43d18d1e95e0 for instance with vm_state active and task_state deleting.
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[2119191c-d4a8-48d4-8588-2d6c9a3db862]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] <== disconnect_volume: return (368ms) None {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Disconnected iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-1b868268-dc62-48a1-bbd0-189dd404f3e1 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.194s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b713ca79-dc37-4885-9923-11e027eb00cf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b868268-dc62-48a1-bbd0-189dd404f3e1 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 08:12:29 user nova-compute[95467]: No targets found.
Nov 15 08:12:29 user nova-compute[95467]: iSNS:
Nov 15 08:12:29 user nova-compute[95467]: No targets found.
Nov 15 08:12:29 user nova-compute[95467]: STATIC:
Nov 15 08:12:29 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8
Nov 15 08:12:29 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:12:29 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:12:29 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a
Nov 15 08:12:29 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:12:29 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:12:29 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07
Nov 15 08:12:29 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:12:29 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:12:29 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de
Nov 15 08:12:29 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:12:29 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:12:29 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05
Nov 15 08:12:29 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:12:29 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:12:29 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5
Nov 15 08:12:29 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:12:29 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:12:29 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56
Nov 15 08:12:29 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:12:29 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:12:29 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff
Nov 15 08:12:29 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:12:29 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:12:29 user nova-compute[95467]: FIRMWARE:
Nov 15 08:12:29 user nova-compute[95467]: No targets found.
Nov 15 08:12:29 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b868268-dc62-48a1-bbd0-189dd404f3e1 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 08:12:29 user nova-compute[95467]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 08:12:29 user nova-compute[95467]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=95467) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b868268-dc62-48a1-bbd0-189dd404f3e1 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff', 0)] {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[592a1794-69b7-460f-ba28-0b5238a6150d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG nova.compute.manager [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iXPZWHpK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': '1edf7591-3991-4df9-98c9-ebc4ca9e5a4a', 'attached_at': '', 'detached_at': '', 'volume_id': '524e76af-4b7b-40a3-8e42-b26a7c731c4a', 'serial'} {{(pid=95467) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG nova.compute.manager [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] swap_volume: removing Cinder connection for volume 0b457e6b-86bf-4152-8f03-de5efd184fd5 {{(pid=95467) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f74a44-9bf9-4f49-bf00-b601ba0b0138]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b868268-dc62-48a1-bbd0-189dd404f3e1 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07 (non-flash)
Nov 15 08:12:29 user nova-compute[95467]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a (non-flash)
Nov 15 08:12:29 user nova-compute[95467]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56 (non-flash)
Nov 15 08:12:29 user nova-compute[95467]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)
Nov 15 08:12:29 user nova-compute[95467]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)
Nov 15 08:12:29 user nova-compute[95467]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 (non-flash)
Nov 15 08:12:29 user nova-compute[95467]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)
Nov 15 08:12:29 user nova-compute[95467]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff (non-flash)
Nov 15 08:12:29 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b868268-dc62-48a1-bbd0-189dd404f3e1 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07 (non-flash)
Nov 15 08:12:29 user nova-compute[95467]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a (non-flash)
Nov 15 08:12:29 user nova-compute[95467]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56 (non-flash)
Nov 15 08:12:29 user nova-compute[95467]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)
Nov 15 08:12:29 user nova-compute[95467]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)
Nov 15 08:12:29 user nova-compute[95467]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 (non-flash)
Nov 15 08:12:29 user nova-compute[95467]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)
Nov 15 08:12:29 user nova-compute[95467]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff (non-flash)
Nov 15 08:12:29 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b868268-dc62-48a1-bbd0-189dd404f3e1 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efed868b0a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff'): ({'sdg'}, set())}) {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-1b868268-dc62-48a1-bbd0-189dd404f3e1 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Removing single pathed devices sdg {{(pid=95467) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae30c59-273c-4bc2-818e-0fa4fa44a3b8]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6db60fd-3599-441b-9f64-0f031da2a7ab]: (4, ('ok\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-1b868268-dc62-48a1-bbd0-189dd404f3e1 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Flushing IO for device /dev/sdg {{(pid=95467) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7001d3a-abac-49aa-929e-a60f6e6d66ae]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-1b868268-dc62-48a1-bbd0-189dd404f3e1 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=95467) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.041s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b739a1c-49ee-4697-91ac-a8590f172379]: (4, ('1', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-1b868268-dc62-48a1-bbd0-189dd404f3e1 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-1b868268-dc62-48a1-bbd0-189dd404f3e1 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] SCSI volumes sdg have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b868268-dc62-48a1-bbd0-189dd404f3e1 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff')] {{(pid=95467) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ddd4d23-7bca-4ef8-a617-eaef2b68f88f]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b868268-dc62-48a1-bbd0-189dd404f3e1 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff -p 172.16.0.220:3260 --logout {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6e929b-b7e0-4467-98bd-0950ecdde80a]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b868268-dc62-48a1-bbd0-189dd404f3e1 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff, portal: 172.16.0.220,3260]
Nov 15 08:12:29 user nova-compute[95467]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff, portal: 172.16.0.220,3260] successful.
Nov 15 08:12:29 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff -p 172.16.0.220:3260 --op delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc145840-7458-4ebe-aa31-f9350ac056ff -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd2c6d9-d3bc-48c8-843e-70a4263bb029]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b868268-dc62-48a1-bbd0-189dd404f3e1 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-1b868268-dc62-48a1-bbd0-189dd404f3e1 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b868268-dc62-48a1-bbd0-189dd404f3e1 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] <== disconnect_volume: return (551ms) None {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b868268-dc62-48a1-bbd0-189dd404f3e1 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Disconnected iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.385s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd0b178-ad73-44bb-98d3-de93010beea1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 08:12:30 user nova-compute[95467]: No targets found.
Nov 15 08:12:30 user nova-compute[95467]: iSNS:
Nov 15 08:12:30 user nova-compute[95467]: No targets found.
Nov 15 08:12:30 user nova-compute[95467]: STATIC:
Nov 15 08:12:30 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8
Nov 15 08:12:30 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:12:30 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:12:30 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a
Nov 15 08:12:30 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:12:30 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:12:30 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07
Nov 15 08:12:30 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:12:30 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:12:30 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de
Nov 15 08:12:30 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:12:30 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:12:30 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05
Nov 15 08:12:30 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:12:30 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:12:30 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5
Nov 15 08:12:30 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:12:30 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:12:30 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56
Nov 15 08:12:30 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:12:30 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:12:30 user nova-compute[95467]: FIRMWARE:
Nov 15 08:12:30 user nova-compute[95467]: No targets found.
Nov 15 08:12:30 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 08:12:30 user nova-compute[95467]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 08:12:30 user nova-compute[95467]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=95467) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8', 0)] {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92dae9e-05db-4d38-9538-8b1ac7f49a17]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f2ec3d-0a55-4aa4-a7f4-316ab2c93e1b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07 (non-flash)
Nov 15 08:12:30 user nova-compute[95467]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a (non-flash)
Nov 15 08:12:30 user nova-compute[95467]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56 (non-flash)
Nov 15 08:12:30 user nova-compute[95467]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)
Nov 15 08:12:30 user nova-compute[95467]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)
Nov 15 08:12:30 user nova-compute[95467]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 (non-flash)
Nov 15 08:12:30 user nova-compute[95467]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)
Nov 15 08:12:30 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07 (non-flash)
Nov 15 08:12:30 user nova-compute[95467]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a (non-flash)
Nov 15 08:12:30 user nova-compute[95467]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56 (non-flash)
Nov 15 08:12:30 user nova-compute[95467]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 (non-flash)
Nov 15 08:12:30 user nova-compute[95467]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)
Nov 15 08:12:30 user nova-compute[95467]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 (non-flash)
Nov 15 08:12:30 user nova-compute[95467]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)
Nov 15 08:12:30 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efed85f93f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8'): ({'sdc'}, set())}) {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Removing single pathed devices sdc {{(pid=95467) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4052fc71-7f58-49c9-b863-d34db0c3d5b7 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Acquiring lock "fa82104f-d822-49fa-a06b-643733e27b06" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4052fc71-7f58-49c9-b863-d34db0c3d5b7 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Lock "fa82104f-d822-49fa-a06b-643733e27b06" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4052fc71-7f58-49c9-b863-d34db0c3d5b7 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Acquiring lock "fa82104f-d822-49fa-a06b-643733e27b06-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4052fc71-7f58-49c9-b863-d34db0c3d5b7 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Lock "fa82104f-d822-49fa-a06b-643733e27b06-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4052fc71-7f58-49c9-b863-d34db0c3d5b7 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Lock "fa82104f-d822-49fa-a06b-643733e27b06-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:12:30 user nova-compute[95467]: INFO nova.compute.manager [None req-4052fc71-7f58-49c9-b863-d34db0c3d5b7 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] [instance: fa82104f-d822-49fa-a06b-643733e27b06] Terminating instance
Nov 15 08:12:30 user nova-compute[95467]: DEBUG nova.compute.manager [None req-4052fc71-7f58-49c9-b863-d34db0c3d5b7 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] [instance: fa82104f-d822-49fa-a06b-643733e27b06] Start destroying the instance on the hypervisor. {{(pid=95467) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f22b99-23e8-4408-9ed0-43e3397c623b]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[214ca233-2f67-4d9f-931c-fb2646157b22]: (4, ('ok\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Flushing IO for device /dev/sdc {{(pid=95467) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb90dac-e2a8-4fab-9030-2a1a4687f374]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=95467) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.055s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[148b93c2-6467-45a6-a514-59adfe104d44]: (4, ('1', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] SCSI volumes sdc have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8')] {{(pid=95467) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f729d801-3347-418e-abe0-450d05a0e54e]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 -p 172.16.0.220:3260 --logout {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea2b3aa-82a7-45de-8d6b-132b5a9b0a3d]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8, portal: 172.16.0.220,3260]
Nov 15 08:12:30 user nova-compute[95467]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8, portal: 172.16.0.220,3260] successful.
Nov 15 08:12:30 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 -p 172.16.0.220:3260 --op delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d4b7008-9243-4206-a1e7-bddc82e2d5c8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[4537663d-eacf-4122-a8f4-f4151a6dcef1]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] <== disconnect_volume: return (760ms) None {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Disconnected iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] calling os-brick to detach iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, {'target_iqn': 'iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VDMlFcgO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:12:30 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:12:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[35dba9b2-325d-4fec-bc93-1c6e2a30b5c5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 08:12:30 user nova-compute[95467]: No targets found.
Nov 15 08:12:30 user nova-compute[95467]: iSNS:
Nov 15 08:12:30 user nova-compute[95467]: No targets found.
Nov 15 08:12:30 user nova-compute[95467]: STATIC:
Nov 15 08:12:30 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a
Nov 15 08:12:30 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:12:30 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:12:30 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07
Nov 15 08:12:30 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:12:30 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:12:30 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de
Nov 15 08:12:30 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:12:30 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:12:30 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05
Nov 15 08:12:30 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:12:30 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:12:30 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5
Nov 15 08:12:30 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:12:30 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:12:30 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56
Nov 15 08:12:30 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:12:30 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:12:30 user nova-compute[95467]: FIRMWARE:
Nov 15 08:12:30 user nova-compute[95467]: No targets found.
Nov 15 08:12:30 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 08:12:30 user nova-compute[95467]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 08:12:30 user nova-compute[95467]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=95467) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05', 0)] {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6827ef3-e875-4e08-9fe0-889da0f6492f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9ed756-7979-46aa-8bb0-1ef0739a4655]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07 (non-flash)
Nov 15 08:12:30 user nova-compute[95467]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a (non-flash)
Nov 15 08:12:30 user nova-compute[95467]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56 (non-flash)
Nov 15 08:12:30 user nova-compute[95467]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)
Nov 15 08:12:30 user nova-compute[95467]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 (non-flash)
Nov 15 08:12:30 user nova-compute[95467]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)
Nov 15 08:12:30 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07 (non-flash)
Nov 15 08:12:30 user nova-compute[95467]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a (non-flash)
Nov 15 08:12:30 user nova-compute[95467]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56 (non-flash)
Nov 15 08:12:30 user nova-compute[95467]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 (non-flash)
Nov 15 08:12:30 user nova-compute[95467]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 (non-flash)
Nov 15 08:12:30 user nova-compute[95467]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)
Nov 15 08:12:30 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efed85f93f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05'): ({'sdd'}, set())}) {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Removing single pathed devices sdd {{(pid=95467) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93b749d-2beb-4b8f-9df4-ef890dce490a]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba8c997-90af-40b1-8404-53dc6323acad]: (4, ('ok\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Flushing IO for device /dev/sdd {{(pid=95467) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb2bc9a-5c39-44a8-86a5-aba7674d4b28]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=95467) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.073s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[3853cb0b-6229-40af-929e-a2765a0c175f]: (4, ('1', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] SCSI volumes sdd have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05')] {{(pid=95467) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d70839e-eaa6-4c9e-b676-f61d2d457ea9]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 -p 172.16.0.220:3260 --logout {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:30 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: fa82104f-d822-49fa-a06b-643733e27b06] Instance destroyed successfully.
Nov 15 08:12:30 user nova-compute[95467]: DEBUG nova.objects.instance [None req-4052fc71-7f58-49c9-b863-d34db0c3d5b7 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Lazy-loading 'resources' on Instance uuid fa82104f-d822-49fa-a06b-643733e27b06 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 -p 172.16.0.220:3260 --logout" returned: 0 in 0.225s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[5060f889-fb73-4338-81d4-68bceffeef80]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05, portal: 172.16.0.220,3260]
Nov 15 08:12:30 user nova-compute[95467]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05, portal: 172.16.0.220,3260] successful.
Nov 15 08:12:30 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 -p 172.16.0.220:3260 --op delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-4052fc71-7f58-49c9-b863-d34db0c3d5b7 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:10:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-84573768',display_name='tempest-VolumesNegativeTest-instance-84573768',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-84573768',id=12,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:10:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5bbfad19c5ef40fa9fedc7990c81d433',ramdisk_id='',reservation_id='r-54in150e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-961110799',owner_user_name='tempest-VolumesNegativeTest-961110799-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:10:49Z,user_data=None,user_id='566c5d2645e64505837fe9897bbac064',uuid=fa82104f-d822-49fa-a06b-643733e27b06,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21218f5a-82fe-4212-9f29-38468f27afb3", "address": "fa:16:3e:c6:32:45", "network": {"id": "59688126-3d6d-4bbd-89e7-dfc59e199581", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d7a38b3c02f7432780351fffae6b27d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21218f5a-82", "ovs_interfaceid": "21218f5a-82fe-4212-9f29-38468f27afb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-4052fc71-7f58-49c9-b863-d34db0c3d5b7 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Converting VIF {"id": "21218f5a-82fe-4212-9f29-38468f27afb3", "address": "fa:16:3e:c6:32:45", "network": {"id": "59688126-3d6d-4bbd-89e7-dfc59e199581", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d7a38b3c02f7432780351fffae6b27d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21218f5a-82", "ovs_interfaceid": "21218f5a-82fe-4212-9f29-38468f27afb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-4052fc71-7f58-49c9-b863-d34db0c3d5b7 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:32:45,bridge_name='br-int',has_traffic_filtering=True,id=21218f5a-82fe-4212-9f29-38468f27afb3,network=Network(59688126-3d6d-4bbd-89e7-dfc59e199581),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21218f5a-82') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG os_vif [None req-4052fc71-7f58-49c9-b863-d34db0c3d5b7 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:32:45,bridge_name='br-int',has_traffic_filtering=True,id=21218f5a-82fe-4212-9f29-38468f27afb3,network=Network(59688126-3d6d-4bbd-89e7-dfc59e199581),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21218f5a-82') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap21218f5a-82, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5bb2e099-f045-4ffe-a241-228a5a5ec815) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:12:30 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:31 user nova-compute[95467]: INFO os_vif [None req-4052fc71-7f58-49c9-b863-d34db0c3d5b7 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:32:45,bridge_name='br-int',has_traffic_filtering=True,id=21218f5a-82fe-4212-9f29-38468f27afb3,network=Network(59688126-3d6d-4bbd-89e7-dfc59e199581),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21218f5a-82')
Nov 15 08:12:31 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-4052fc71-7f58-49c9-b863-d34db0c3d5b7 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] [instance: fa82104f-d822-49fa-a06b-643733e27b06] Deleting instance files /opt/stack/data/nova/instances/fa82104f-d822-49fa-a06b-643733e27b06_del
Nov 15 08:12:31 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-4052fc71-7f58-49c9-b863-d34db0c3d5b7 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] [instance: fa82104f-d822-49fa-a06b-643733e27b06] Deletion of /opt/stack/data/nova/instances/fa82104f-d822-49fa-a06b-643733e27b06_del complete
Nov 15 08:12:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aee0d1b6-eb0f-452e-90e9-fcabb9014c05 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.093s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb4b4a0-663e-4326-a2f4-aba0652b8c0f]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.603s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] <== disconnect_volume: return (604ms) None {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Disconnected iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] calling os-brick to detach iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, {'target_iqn': 'iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gNTcCWOs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:12:31 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:12:31 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb535f1a-6b17-4e1c-9448-ea5015702d62]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 08:12:31 user nova-compute[95467]: No targets found.
Nov 15 08:12:31 user nova-compute[95467]: iSNS:
Nov 15 08:12:31 user nova-compute[95467]: No targets found.
Nov 15 08:12:31 user nova-compute[95467]: STATIC:
Nov 15 08:12:31 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a
Nov 15 08:12:31 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:12:31 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:12:31 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07
Nov 15 08:12:31 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:12:31 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:12:31 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de
Nov 15 08:12:31 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:12:31 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:12:31 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5
Nov 15 08:12:31 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:12:31 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:12:31 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56
Nov 15 08:12:31 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:12:31 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:12:31 user nova-compute[95467]: FIRMWARE:
Nov 15 08:12:31 user nova-compute[95467]: No targets found.
Nov 15 08:12:31 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 08:12:31 user nova-compute[95467]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 08:12:31 user nova-compute[95467]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=95467) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5', 0)] {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[566ee670-bcb7-4ea2-811b-1d3ca5c5a715]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[349a82cb-66c6-4307-86f4-66ececdcbf5d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07 (non-flash)
Nov 15 08:12:31 user nova-compute[95467]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a (non-flash)
Nov 15 08:12:31 user nova-compute[95467]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56 (non-flash)
Nov 15 08:12:31 user nova-compute[95467]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 (non-flash)
Nov 15 08:12:31 user nova-compute[95467]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)
Nov 15 08:12:31 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07 (non-flash)
Nov 15 08:12:31 user nova-compute[95467]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a (non-flash)
Nov 15 08:12:31 user nova-compute[95467]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56 (non-flash)
Nov 15 08:12:31 user nova-compute[95467]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 (non-flash)
Nov 15 08:12:31 user nova-compute[95467]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)
Nov 15 08:12:31 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efed85f93f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5'): ({'sde'}, set())}) {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Removing single pathed devices sde {{(pid=95467) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b069e2a-ac53-48cf-a355-9ca382bdd3df]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74ea532-f668-4dbe-abf7-c1e8b2f41436]: (4, ('ok\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Flushing IO for device /dev/sde {{(pid=95467) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e20aed5-656e-427a-ac68-31e2827734d3]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=95467) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:31 user nova-compute[95467]: INFO nova.compute.manager [None req-4052fc71-7f58-49c9-b863-d34db0c3d5b7 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] [instance: fa82104f-d822-49fa-a06b-643733e27b06] Took 1.05 seconds to destroy the instance on the hypervisor.
Nov 15 08:12:31 user nova-compute[95467]: DEBUG oslo.service.loopingcall [None req-4052fc71-7f58-49c9-b863-d34db0c3d5b7 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=95467) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG nova.compute.manager [-] [instance: fa82104f-d822-49fa-a06b-643733e27b06] Deallocating network for instance {{(pid=95467) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: fa82104f-d822-49fa-a06b-643733e27b06] deallocate_for_instance() {{(pid=95467) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.101s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a1c48a-c038-487a-abb3-bd11311b5fef]: (4, ('1', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] SCSI volumes sde have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5')] {{(pid=95467) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1302f1-d948-4d54-b30b-b770db019d09]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 -p 172.16.0.220:3260 --logout {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG nova.compute.manager [req-e9b4b068-8aa3-4d47-a24a-840d5a2a43a4 req-71f4a137-dc11-4916-928d-af4431bc21f2 service nova] [instance: fa82104f-d822-49fa-a06b-643733e27b06] Received event network-vif-unplugged-21218f5a-82fe-4212-9f29-38468f27afb3 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-e9b4b068-8aa3-4d47-a24a-840d5a2a43a4 req-71f4a137-dc11-4916-928d-af4431bc21f2 service nova] Acquiring lock "fa82104f-d822-49fa-a06b-643733e27b06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-e9b4b068-8aa3-4d47-a24a-840d5a2a43a4 req-71f4a137-dc11-4916-928d-af4431bc21f2 service nova] Lock "fa82104f-d822-49fa-a06b-643733e27b06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-e9b4b068-8aa3-4d47-a24a-840d5a2a43a4 req-71f4a137-dc11-4916-928d-af4431bc21f2 service nova] Lock "fa82104f-d822-49fa-a06b-643733e27b06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG nova.compute.manager [req-e9b4b068-8aa3-4d47-a24a-840d5a2a43a4 req-71f4a137-dc11-4916-928d-af4431bc21f2 service nova] [instance: fa82104f-d822-49fa-a06b-643733e27b06] No waiting events found dispatching network-vif-unplugged-21218f5a-82fe-4212-9f29-38468f27afb3 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG nova.compute.manager [req-e9b4b068-8aa3-4d47-a24a-840d5a2a43a4 req-71f4a137-dc11-4916-928d-af4431bc21f2 service nova] [instance: fa82104f-d822-49fa-a06b-643733e27b06] Received event network-vif-unplugged-21218f5a-82fe-4212-9f29-38468f27afb3 for instance with task_state deleting. {{(pid=95467) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG nova.compute.manager [req-e9b4b068-8aa3-4d47-a24a-840d5a2a43a4 req-71f4a137-dc11-4916-928d-af4431bc21f2 service nova] [instance: fa82104f-d822-49fa-a06b-643733e27b06] Received event network-vif-plugged-21218f5a-82fe-4212-9f29-38468f27afb3 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-e9b4b068-8aa3-4d47-a24a-840d5a2a43a4 req-71f4a137-dc11-4916-928d-af4431bc21f2 service nova] Acquiring lock "fa82104f-d822-49fa-a06b-643733e27b06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-e9b4b068-8aa3-4d47-a24a-840d5a2a43a4 req-71f4a137-dc11-4916-928d-af4431bc21f2 service nova] Lock "fa82104f-d822-49fa-a06b-643733e27b06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-e9b4b068-8aa3-4d47-a24a-840d5a2a43a4 req-71f4a137-dc11-4916-928d-af4431bc21f2 service nova] Lock "fa82104f-d822-49fa-a06b-643733e27b06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG nova.compute.manager [req-e9b4b068-8aa3-4d47-a24a-840d5a2a43a4 req-71f4a137-dc11-4916-928d-af4431bc21f2 service nova] [instance: fa82104f-d822-49fa-a06b-643733e27b06] No waiting events found dispatching network-vif-plugged-21218f5a-82fe-4212-9f29-38468f27afb3 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:12:31 user nova-compute[95467]: WARNING nova.compute.manager [req-e9b4b068-8aa3-4d47-a24a-840d5a2a43a4 req-71f4a137-dc11-4916-928d-af4431bc21f2 service nova] [instance: fa82104f-d822-49fa-a06b-643733e27b06] Received unexpected event network-vif-plugged-21218f5a-82fe-4212-9f29-38468f27afb3 for instance with vm_state active and task_state deleting.
Nov 15 08:12:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.144s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[18426963-ac5d-4d06-ba5f-1b174042361d]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5, portal: 172.16.0.220,3260]
Nov 15 08:12:31 user nova-compute[95467]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5, portal: 172.16.0.220,3260] successful.
Nov 15 08:12:31 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 -p 172.16.0.220:3260 --op delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ddf1d31-d702-4b54-b8f7-4014ce0d9ca5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9548d04-9105-4a4d-a682-e461768fcc23]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.460s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] <== disconnect_volume: return (461ms) None {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Disconnected iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 08:12:31 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Deleting instance files /opt/stack/data/nova/instances/35e88686-253e-452a-9649-8aa2a04128ce_del
Nov 15 08:12:31 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Deletion of /opt/stack/data/nova/instances/35e88686-253e-452a-9649-8aa2a04128ce_del complete
Nov 15 08:12:31 user nova-compute[95467]: INFO nova.compute.manager [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Took 5.03 seconds to destroy the instance on the hypervisor.
Nov 15 08:12:31 user nova-compute[95467]: DEBUG oslo.service.loopingcall [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=95467) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG nova.compute.manager [-] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Deallocating network for instance {{(pid=95467) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] deallocate_for_instance() {{(pid=95467) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG nova.objects.instance [None req-1b868268-dc62-48a1-bbd0-189dd404f3e1 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Lazy-loading 'flavor' on Instance uuid 68264a44-5adf-4873-b380-26bcafe2ba04 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1b868268-dc62-48a1-bbd0-189dd404f3e1 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Lock "68264a44-5adf-4873-b380-26bcafe2ba04" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.765s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: fa82104f-d822-49fa-a06b-643733e27b06] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG nova.compute.manager [req-23cea499-0527-4180-ac74-9eb1bc97bbb9 req-8ac0c862-8665-4b5c-9571-307c65e45864 service nova] [instance: fa82104f-d822-49fa-a06b-643733e27b06] Received event network-vif-deleted-21218f5a-82fe-4212-9f29-38468f27afb3 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:12:31 user nova-compute[95467]: INFO nova.compute.manager [req-23cea499-0527-4180-ac74-9eb1bc97bbb9 req-8ac0c862-8665-4b5c-9571-307c65e45864 service nova] [instance: fa82104f-d822-49fa-a06b-643733e27b06] Neutron deleted interface 21218f5a-82fe-4212-9f29-38468f27afb3; detaching it from the instance and deleting it from the info cache
Nov 15 08:12:31 user nova-compute[95467]: DEBUG nova.network.neutron [req-23cea499-0527-4180-ac74-9eb1bc97bbb9 req-8ac0c862-8665-4b5c-9571-307c65e45864 service nova] [instance: fa82104f-d822-49fa-a06b-643733e27b06] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:12:31 user nova-compute[95467]: INFO nova.compute.manager [-] [instance: fa82104f-d822-49fa-a06b-643733e27b06] Took 0.62 seconds to deallocate network for instance.
Nov 15 08:12:31 user nova-compute[95467]: DEBUG nova.compute.manager [req-23cea499-0527-4180-ac74-9eb1bc97bbb9 req-8ac0c862-8665-4b5c-9571-307c65e45864 service nova] [instance: fa82104f-d822-49fa-a06b-643733e27b06] Detach interface failed, port_id=21218f5a-82fe-4212-9f29-38468f27afb3, reason: Instance fa82104f-d822-49fa-a06b-643733e27b06 could not be found. {{(pid=95467) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4052fc71-7f58-49c9-b863-d34db0c3d5b7 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:12:31 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4052fc71-7f58-49c9-b863-d34db0c3d5b7 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:12:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:32 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-4052fc71-7f58-49c9-b863-d34db0c3d5b7 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:12:32 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-4052fc71-7f58-49c9-b863-d34db0c3d5b7 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:12:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4052fc71-7f58-49c9-b863-d34db0c3d5b7 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.428s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:12:32 user nova-compute[95467]: INFO nova.scheduler.client.report [None req-4052fc71-7f58-49c9-b863-d34db0c3d5b7 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Deleted allocations for instance fa82104f-d822-49fa-a06b-643733e27b06
Nov 15 08:12:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4052fc71-7f58-49c9-b863-d34db0c3d5b7 tempest-VolumesNegativeTest-961110799 tempest-VolumesNegativeTest-961110799-project-member] Lock "fa82104f-d822-49fa-a06b-643733e27b06" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.317s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:12:33 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:12:33 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=95467) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 08:12:33 user nova-compute[95467]: DEBUG nova.compute.manager [req-8f1d6759-c97b-4275-ba8a-7cc933b129ed req-087d5365-7bf5-412b-98dd-537701143c24 service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Received event network-vif-deleted-89c9bfb4-6b7a-4635-ba8d-2b0370fafb8b {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:12:33 user nova-compute[95467]: INFO nova.compute.manager [req-8f1d6759-c97b-4275-ba8a-7cc933b129ed req-087d5365-7bf5-412b-98dd-537701143c24 service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Neutron deleted interface 89c9bfb4-6b7a-4635-ba8d-2b0370fafb8b; detaching it from the instance and deleting it from the info cache
Nov 15 08:12:33 user nova-compute[95467]: DEBUG nova.network.neutron [req-8f1d6759-c97b-4275-ba8a-7cc933b129ed req-087d5365-7bf5-412b-98dd-537701143c24 service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Updating instance_info_cache with network_info: [{"id": "92307630-ea94-407f-b852-ee250debc046", "address": "fa:16:3e:7f:f7:1a", "network": {"id": "22cdcc96-2021-437d-9fa1-bece0497025d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1206155458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92307630-ea", "ovs_interfaceid": "92307630-ea94-407f-b852-ee250debc046", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fae94c7c-6554-49a7-a221-43d18d1e95e0", "address": "fa:16:3e:d9:9d:86", "network": {"id": "22cdcc96-2021-437d-9fa1-bece0497025d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1206155458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfae94c7c-65", "ovs_interfaceid": "fae94c7c-6554-49a7-a221-43d18d1e95e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cdfe5e3f-2910-43a2-8d16-132d69d647d5", "address": "fa:16:3e:9e:d6:aa", "network": {"id": "22cdcc96-2021-437d-9fa1-bece0497025d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1206155458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdfe5e3f-29", "ovs_interfaceid": "cdfe5e3f-2910-43a2-8d16-132d69d647d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "aa13aa7e-d38c-487f-8c4f-0f1cd51a18eb", "address": "fa:16:3e:0f:9b:7a", "network": {"id": "22cdcc96-2021-437d-9fa1-bece0497025d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1206155458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa13aa7e-d3", "ovs_interfaceid": "aa13aa7e-d38c-487f-8c4f-0f1cd51a18eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "48912f9e-eeae-4f51-8123-8316a6fcc15e", "address": "fa:16:3e:92:f8:11", "network": {"id": "1e721803-a83d-4c10-ba12-7b70b3b0fa23", "bridge": "br-int", "label": "tempest-device-tagging-net2-1574523632", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48912f9e-ee", "ovs_interfaceid": "48912f9e-eeae-4f51-8123-8316a6fcc15e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0a35017f-b57c-4937-9479-22494bffb5b7", "address": "fa:16:3e:42:0c:b6", "network": {"id": "1e721803-a83d-4c10-ba12-7b70b3b0fa23", "bridge": "br-int", "label": "tempest-device-tagging-net2-1574523632", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e2ffe5715db4f6ebcd4237eaa12305a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a35017f-b5", "ovs_interfaceid": "0a35017f-b57c-4937-9479-22494bffb5b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:12:33 user nova-compute[95467]: DEBUG nova.compute.manager [req-8f1d6759-c97b-4275-ba8a-7cc933b129ed req-087d5365-7bf5-412b-98dd-537701143c24 service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Detach interface failed, port_id=89c9bfb4-6b7a-4635-ba8d-2b0370fafb8b, reason: Instance 35e88686-253e-452a-9649-8aa2a04128ce could not be found. {{(pid=95467) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 08:12:34 user nova-compute[95467]: DEBUG nova.compute.manager [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] swap_volume: Updating volume 0b457e6b-86bf-4152-8f03-de5efd184fd5 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "iXPZWHpK", "auth_password": "kjnatKiI8LVM7A", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdj", "volume_id": "524e76af-4b7b-40a3-8e42-b26a7c731c4a"}, "status": "reserved", "instance": "1edf7591-3991-4df9-98c9-ebc4ca9e5a4a", "attached_at": "", "detached_at": "", "volume_id": "524e76af-4b7b-40a3-8e42-b26a7c731c4a", "serial": "524e76af-4b7b-40a3-8e42-b26a7c731c4a"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '524e76af-4b7b-40a3-8e42-b26a7c731c4a', 'no_device': None, 'attachment_id': '6df15bd9-cd93-4744-b0e3-bb2ce653d07d'} {{(pid=95467) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 15 08:12:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0aaa7280-1513-4d53-8005-ebbbbb926f10 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] Lock "1edf7591-3991-4df9-98c9-ebc4ca9e5a4a" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 20.944s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:12:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Creating instance directory {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 08:12:34 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Creating image(s)
Nov 15 08:12:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Did not create local disks {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 08:12:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Ensure instance console log exists: /opt/stack/data/nova/instances/7e53d93e-1222-4b1a-9745-d512da0f7925/console.log {{(pid=95467) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 08:12:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:12:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:12:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:12:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Start _get_guest_xml network_info=[{"id": "1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2", "address": "fa:16:3e:b1:d4:80", "network": {"id": "d8daee94-e2d9-42cf-9675-8c06e7292d36", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-765825262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81b11067a2d84bba8e6929713034b422", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d8e0cf8-c3", "ovs_interfaceid": "1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'a8a245e9-3327-4101-a098-24c6921cda79', 'delete_on_termination': True, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mZKOEzLI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7e53d93e-1222-4b1a-9745-d512da0f7925', 'attached_at': '', 'detached_at': '', 'volume_id': '01b18fa8-0d71-4fef-b5f2-44b7afba773f', 'serial': '01b18fa8-0d71-4fef-b5f2-44b7afba773f'}, 'volume_type': None} {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:12:34 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 15 08:12:34 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 15 08:12:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:12:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:12:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:12:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:12:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:12:34 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:12:34 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:12:34 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:12:34 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:12:34 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:12:34 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:12:34 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:12:34 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:12:34 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:12:34 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:12:34 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:12:34 user nova-compute[95467]: DEBUG nova.objects.instance [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7e53d93e-1222-4b1a-9745-d512da0f7925 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:12:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Calling os-brick to attach iSCSI Volume {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 08:12:34 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mZKOEzLI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:12:34 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 08:12:34 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:12:34 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:12:34 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 08:12:34 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:12:34 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:12:34 user nova-compute[95467]: INFO os_brick.initiator.connectors.iscsi [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 08:12:34 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f -p 172.16.0.220:3260 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:34 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:34 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50218cb-25bb-4020-a44c-e3d3c41d186d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:34 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 08:12:34 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:34 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f -p 172.16.0.220:3260 --interface default --op new {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:34 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:34 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a64085-295f-466c-9e65-c3f80158aa5f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f] added\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:34 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f] added
Nov 15 08:12:34 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:34 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:34 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:34 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b213ad8f-37f4-4f7e-b08e-79da24913a59]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:34 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:34 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:34 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:34 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4bbe4a-38f5-45ad-879c-36f9d3bcd23b]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:34 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:34 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mZKOEzLI {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:34 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mZKOEzLI" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:34 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[53cfdb75-9e97-4757-9ee3-e4139f61cb14]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:34 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mZKOEzLI'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:34 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:34 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:34 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[2936a42a-cc32-41be-9fbf-a0b282e1fadb]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:34 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:34 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:34 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:34 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[9056f612-f20d-42cb-95ad-b8caaa363aea]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:34 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07 (non-flash)
Nov 15 08:12:34 user nova-compute[95467]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a (non-flash)
Nov 15 08:12:34 user nova-compute[95467]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56 (non-flash)
Nov 15 08:12:34 user nova-compute[95467]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)
Nov 15 08:12:34 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:12:34 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07 (non-flash)
Nov 15 08:12:34 user nova-compute[95467]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a (non-flash)
Nov 15 08:12:34 user nova-compute[95467]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56 (non-flash)
Nov 15 08:12:34 user nova-compute[95467]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)
Nov 15 08:12:34 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:12:34 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f -p 172.16.0.220:3260 --login {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:34 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f -p 172.16.0.220:3260 --login" returned: 0 in 0.131s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:34 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8263fae0-d0ad-4aba-b25c-3be3c046709b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:34 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f, portal: 172.16.0.220,3260]
Nov 15 08:12:34 user nova-compute[95467]: Login to [iface: default, target: iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f, portal: 172.16.0.220,3260] successful.
Nov 15 08:12:34 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:34 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:34 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:12:34 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.039s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:34 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a791fda-9ae1-4ccc-972c-8e4a0f431f05]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:34 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:34 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:35 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39ea88b-67e8-473a-bb87-9c41cc4f4872]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07 (non-flash)
Nov 15 08:12:35 user nova-compute[95467]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a (non-flash)
Nov 15 08:12:35 user nova-compute[95467]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56 (non-flash)
Nov 15 08:12:35 user nova-compute[95467]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)
Nov 15 08:12:35 user nova-compute[95467]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)
Nov 15 08:12:35 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:12:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07 (non-flash)
Nov 15 08:12:35 user nova-compute[95467]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a (non-flash)
Nov 15 08:12:35 user nova-compute[95467]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56 (non-flash)
Nov 15 08:12:35 user nova-compute[95467]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)
Nov 15 08:12:35 user nova-compute[95467]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)
Nov 15 08:12:35 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:12:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.385s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:12:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Connected to 172.16.0.220:3260 {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 08:12:35 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=95467) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 08:12:35 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=95467) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 08:12:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:35 user nova-compute[95467]: INFO nova.compute.manager [-] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Took 3.47 seconds to deallocate network for instance.
Nov 15 08:12:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:35 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef5e18b-6a1f-4ceb-b10c-23a2410e560e]: (4, ('- - 0', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:35 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:12:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mZKOEzLI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 08:12:35 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] Acquiring lock "1edf7591-3991-4df9-98c9-ebc4ca9e5a4a" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:12:35 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] Lock "1edf7591-3991-4df9-98c9-ebc4ca9e5a4a" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:12:35 user nova-compute[95467]: DEBUG os_brick.utils [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:12:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:35 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d460b095-ca89-48d5-9c93-445ca08d6452]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:882ae90641f\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:35 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[3129a094-f30e-431a-bf92-f3e2df2da2c0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:35 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dcf3c20-7dc6-40d9-a664-11c845fd5558]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:35 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d004b57-d1e8-4484-8140-6b13935a7abb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] Running cmd (subprocess): nvme version {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] 'nvme version' failed. Not Retrying. {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:12:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] nvme not present on system {{(pid=95467) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 08:12:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:12:35 user nova-compute[95467]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 08:12:35 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f5142c-5076-4ca7-8790-1f7dc023f7c1]: (4, '') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=95467) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 08:12:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 08:12:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] LIGHTOS: no hostnqn found. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 08:12:35 user nova-compute[95467]: DEBUG os_brick.utils [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:882ae90641f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:12:35 user nova-compute[95467]: INFO nova.compute.manager [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Swapping volume 524e76af-4b7b-40a3-8e42-b26a7c731c4a for 0b457e6b-86bf-4152-8f03-de5efd184fd5
Nov 15 08:12:35 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:12:35 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:12:35 user nova-compute[95467]: DEBUG nova.compute.manager [req-b5380105-6862-489f-a12a-83541b5f89f4 req-dcc07a5a-26d1-4da3-9ab1-ea5371299de8 service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Received event network-vif-deleted-0a35017f-b57c-4937-9479-22494bffb5b7 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:12:35 user nova-compute[95467]: DEBUG nova.compute.manager [req-b5380105-6862-489f-a12a-83541b5f89f4 req-dcc07a5a-26d1-4da3-9ab1-ea5371299de8 service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Received event network-vif-deleted-aa13aa7e-d38c-487f-8c4f-0f1cd51a18eb {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:12:35 user nova-compute[95467]: DEBUG nova.compute.manager [req-b5380105-6862-489f-a12a-83541b5f89f4 req-dcc07a5a-26d1-4da3-9ab1-ea5371299de8 service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Received event network-vif-deleted-48912f9e-eeae-4f51-8123-8316a6fcc15e {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:12:35 user nova-compute[95467]: DEBUG nova.compute.manager [req-b5380105-6862-489f-a12a-83541b5f89f4 req-dcc07a5a-26d1-4da3-9ab1-ea5371299de8 service nova] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Received event network-vif-deleted-cdfe5e3f-2910-43a2-8d16-132d69d647d5 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:12:36 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:36 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.431s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:12:36 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] <== connect_volume: return (1432ms) {'type': 'block', 'scsi_wwn': '23466333731396463', 'path': '/dev/sdb'} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:12:36 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23466333731396463', 'path': '/dev/sdb'} {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 08:12:36 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T08:10:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1930677760',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-123252793',id=7,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAC1BuAs3ejJ+aRw6D/CB1xzKj78ip7ytDqvO2vvfGnTsB6+r8q33E0IAISM3h9/kVw6ZoQQmHwLT2P/3YuBA4w/px39kz5Vj5TaIA4bkzJYmqXkT5MBbT73nDHHxYjkVA==',key_name='tempest-keypair-986720723',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:10:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='81b11067a2d84bba8e6929713034b422',ramdisk_id='',reservation_id='r-pdz8drr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1288833049',owner_user_name='tempest-ServerActionsV293TestJSON-1288833049-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:12:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='54bfe816a1bf4ee485e055604f0b7609',uuid=7e53d93e-1222-4b1a-9745-d512da0f7925,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2", "address": "fa:16:3e:b1:d4:80", "network": {"id": "d8daee94-e2d9-42cf-9675-8c06e7292d36", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-765825262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81b11067a2d84bba8e6929713034b422", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d8e0cf8-c3", "ovs_interfaceid": "1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:12:36 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Converting VIF {"id": "1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2", "address": "fa:16:3e:b1:d4:80", "network": {"id": "d8daee94-e2d9-42cf-9675-8c06e7292d36", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-765825262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81b11067a2d84bba8e6929713034b422", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d8e0cf8-c3", "ovs_interfaceid": "1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:12:36 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:d4:80,bridge_name='br-int',has_traffic_filtering=True,id=1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2,network=Network(d8daee94-e2d9-42cf-9675-8c06e7292d36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d8e0cf8-c3') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:12:36 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:12:36 user nova-compute[95467]:   <uuid>7e53d93e-1222-4b1a-9745-d512da0f7925</uuid>
Nov 15 08:12:36 user nova-compute[95467]:   <name>instance-00000007</name>
Nov 15 08:12:36 user nova-compute[95467]:   <memory>524288</memory>
Nov 15 08:12:36 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:12:36 user nova-compute[95467]:   <metadata>
Nov 15 08:12:36 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:12:36 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:12:36 user nova-compute[95467]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1930677760</nova:name>
Nov 15 08:12:36 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:12:34</nova:creationTime>
Nov 15 08:12:36 user nova-compute[95467]:       <nova:flavor name="m1.tiny">
Nov 15 08:12:36 user nova-compute[95467]:         <nova:memory>512</nova:memory>
Nov 15 08:12:36 user nova-compute[95467]:         <nova:disk>1</nova:disk>
Nov 15 08:12:36 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:12:36 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:12:36 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:12:36 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:12:36 user nova-compute[95467]:       <nova:owner>
Nov 15 08:12:36 user nova-compute[95467]:         <nova:user uuid="54bfe816a1bf4ee485e055604f0b7609">tempest-ServerActionsV293TestJSON-1288833049-project-member</nova:user>
Nov 15 08:12:36 user nova-compute[95467]:         <nova:project uuid="81b11067a2d84bba8e6929713034b422">tempest-ServerActionsV293TestJSON-1288833049</nova:project>
Nov 15 08:12:36 user nova-compute[95467]:       </nova:owner>
Nov 15 08:12:36 user nova-compute[95467]:       <nova:ports>
Nov 15 08:12:36 user nova-compute[95467]:         <nova:port uuid="1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2">
Nov 15 08:12:36 user nova-compute[95467]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 08:12:36 user nova-compute[95467]:         </nova:port>
Nov 15 08:12:36 user nova-compute[95467]:       </nova:ports>
Nov 15 08:12:36 user nova-compute[95467]:     </nova:instance>
Nov 15 08:12:36 user nova-compute[95467]:   </metadata>
Nov 15 08:12:36 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:12:36 user nova-compute[95467]:     <system>
Nov 15 08:12:36 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:12:36 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:12:36 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:12:36 user nova-compute[95467]:       <entry name="serial">7e53d93e-1222-4b1a-9745-d512da0f7925</entry>
Nov 15 08:12:36 user nova-compute[95467]:       <entry name="uuid">7e53d93e-1222-4b1a-9745-d512da0f7925</entry>
Nov 15 08:12:36 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:12:36 user nova-compute[95467]:     </system>
Nov 15 08:12:36 user nova-compute[95467]:   </sysinfo>
Nov 15 08:12:36 user nova-compute[95467]:   <os>
Nov 15 08:12:36 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:12:36 user nova-compute[95467]:     <boot dev="hd"/>
Nov 15 08:12:36 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:12:36 user nova-compute[95467]:   </os>
Nov 15 08:12:36 user nova-compute[95467]:   <features>
Nov 15 08:12:36 user nova-compute[95467]:     <acpi/>
Nov 15 08:12:36 user nova-compute[95467]:     <apic/>
Nov 15 08:12:36 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:12:36 user nova-compute[95467]:   </features>
Nov 15 08:12:36 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:12:36 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:12:36 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:12:36 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:12:36 user nova-compute[95467]:   </clock>
Nov 15 08:12:36 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:12:36 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:12:36 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:12:36 user nova-compute[95467]:   </cpu>
Nov 15 08:12:36 user nova-compute[95467]:   <devices>
Nov 15 08:12:36 user nova-compute[95467]:     <disk type="block" device="disk">
Nov 15 08:12:36 user nova-compute[95467]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:12:36 user nova-compute[95467]:       <source dev="/dev/sdb"/>
Nov 15 08:12:36 user nova-compute[95467]:       <target dev="vda" bus="virtio"/>
Nov 15 08:12:36 user nova-compute[95467]:       <serial>01b18fa8-0d71-4fef-b5f2-44b7afba773f</serial>
Nov 15 08:12:36 user nova-compute[95467]:     </disk>
Nov 15 08:12:36 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:12:36 user nova-compute[95467]:       <mac address="fa:16:3e:b1:d4:80"/>
Nov 15 08:12:36 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:12:36 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:12:36 user nova-compute[95467]:       <target dev="tap1d8e0cf8-c3"/>
Nov 15 08:12:36 user nova-compute[95467]:     </interface>
Nov 15 08:12:36 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:12:36 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/7e53d93e-1222-4b1a-9745-d512da0f7925/console.log" append="off"/>
Nov 15 08:12:36 user nova-compute[95467]:     </serial>
Nov 15 08:12:36 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:12:36 user nova-compute[95467]:     <video>
Nov 15 08:12:36 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:12:36 user nova-compute[95467]:     </video>
Nov 15 08:12:36 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:12:36 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:12:36 user nova-compute[95467]:     </rng>
Nov 15 08:12:36 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:12:36 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:12:36 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:12:36 user nova-compute[95467]:     </memballoon>
Nov 15 08:12:36 user nova-compute[95467]:   </devices>
Nov 15 08:12:36 user nova-compute[95467]: </domain>
Nov 15 08:12:36 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:12:36 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T08:10:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1930677760',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-123252793',id=7,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAC1BuAs3ejJ+aRw6D/CB1xzKj78ip7ytDqvO2vvfGnTsB6+r8q33E0IAISM3h9/kVw6ZoQQmHwLT2P/3YuBA4w/px39kz5Vj5TaIA4bkzJYmqXkT5MBbT73nDHHxYjkVA==',key_name='tempest-keypair-986720723',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:10:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='81b11067a2d84bba8e6929713034b422',ramdisk_id='',reservation_id='r-pdz8drr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1288833049',owner_user_name='tempest-ServerActionsV293TestJSON-1288833049-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:12:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='54bfe816a1bf4ee485e055604f0b7609',uuid=7e53d93e-1222-4b1a-9745-d512da0f7925,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2", "address": "fa:16:3e:b1:d4:80", "network": {"id": "d8daee94-e2d9-42cf-9675-8c06e7292d36", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-765825262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81b11067a2d84bba8e6929713034b422", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d8e0cf8-c3", "ovs_interfaceid": "1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:12:36 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Converting VIF {"id": "1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2", "address": "fa:16:3e:b1:d4:80", "network": {"id": "d8daee94-e2d9-42cf-9675-8c06e7292d36", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-765825262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81b11067a2d84bba8e6929713034b422", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d8e0cf8-c3", "ovs_interfaceid": "1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:12:36 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:d4:80,bridge_name='br-int',has_traffic_filtering=True,id=1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2,network=Network(d8daee94-e2d9-42cf-9675-8c06e7292d36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d8e0cf8-c3') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:12:36 user nova-compute[95467]: DEBUG os_vif [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:d4:80,bridge_name='br-int',has_traffic_filtering=True,id=1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2,network=Network(d8daee94-e2d9-42cf-9675-8c06e7292d36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d8e0cf8-c3') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:12:36 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:36 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:12:36 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:12:36 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:36 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5b1cccca-2ae6-5b26-bf7b-8c6efd97bf97', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:12:36 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:36 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:36 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:36 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1d8e0cf8-c3, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:12:36 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1d8e0cf8-c3, col_values=(('qos', UUID('e669cc0b-341a-4e3e-bd1d-f796efc8933b')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:12:36 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1d8e0cf8-c3, col_values=(('external_ids', {'iface-id': '1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:d4:80', 'vm-uuid': '7e53d93e-1222-4b1a-9745-d512da0f7925'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:12:36 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:12:36 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:36 user nova-compute[95467]: INFO os_vif [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:d4:80,bridge_name='br-int',has_traffic_filtering=True,id=1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2,network=Network(d8daee94-e2d9-42cf-9675-8c06e7292d36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d8e0cf8-c3')
Nov 15 08:12:36 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:12:36 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] No VIF found with MAC fa:16:3e:b1:d4:80, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:12:36 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager.update_available_resource {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:12:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:12:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:12:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:12:36 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Auditing locally available compute resources for user (node: user) {{(pid=95467) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 08:12:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:37 user nova-compute[95467]: DEBUG nova.compute.manager [req-39ae11f7-9db2-4a39-88d0-9efb40f84761 req-eb32c979-7008-49ce-8f67-471559f6495e service nova] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Received event network-vif-plugged-1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:12:37 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-39ae11f7-9db2-4a39-88d0-9efb40f84761 req-eb32c979-7008-49ce-8f67-471559f6495e service nova] Acquiring lock "7e53d93e-1222-4b1a-9745-d512da0f7925-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:12:37 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-39ae11f7-9db2-4a39-88d0-9efb40f84761 req-eb32c979-7008-49ce-8f67-471559f6495e service nova] Lock "7e53d93e-1222-4b1a-9745-d512da0f7925-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:12:37 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-39ae11f7-9db2-4a39-88d0-9efb40f84761 req-eb32c979-7008-49ce-8f67-471559f6495e service nova] Lock "7e53d93e-1222-4b1a-9745-d512da0f7925-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:12:37 user nova-compute[95467]: DEBUG nova.compute.manager [req-39ae11f7-9db2-4a39-88d0-9efb40f84761 req-eb32c979-7008-49ce-8f67-471559f6495e service nova] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] No waiting events found dispatching network-vif-plugged-1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:12:37 user nova-compute[95467]: WARNING nova.compute.manager [req-39ae11f7-9db2-4a39-88d0-9efb40f84761 req-eb32c979-7008-49ce-8f67-471559f6495e service nova] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Received unexpected event network-vif-plugged-1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2 for instance with vm_state active and task_state rebuild_spawning.
Nov 15 08:12:37 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68264a44-5adf-4873-b380-26bcafe2ba04/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68264a44-5adf-4873-b380-26bcafe2ba04/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68264a44-5adf-4873-b380-26bcafe2ba04/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68264a44-5adf-4873-b380-26bcafe2ba04/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5748cf5d-9c57-4477-8952-ec39d0d18f55/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5748cf5d-9c57-4477-8952-ec39d0d18f55/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5748cf5d-9c57-4477-8952-ec39d0d18f55/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:39 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5748cf5d-9c57-4477-8952-ec39d0d18f55/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:39 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:12:39 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1edf7591-3991-4df9-98c9-ebc4ca9e5a4a/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:39 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1edf7591-3991-4df9-98c9-ebc4ca9e5a4a/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:39 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1edf7591-3991-4df9-98c9-ebc4ca9e5a4a/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:39 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1edf7591-3991-4df9-98c9-ebc4ca9e5a4a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:39 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:12:39 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:12:39 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a259558e-87ea-48c2-8b72-7443c0510d81/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:39 user nova-compute[95467]: DEBUG nova.compute.manager [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Instance event wait completed in 0 seconds for  {{(pid=95467) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 08:12:39 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Guest created on hypervisor {{(pid=95467) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 08:12:39 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Instance spawned successfully.
Nov 15 08:12:39 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 08:12:39 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Found default for hw_cdrom_bus of ide {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:12:39 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Found default for hw_disk_bus of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:12:39 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Found default for hw_input_bus of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:12:39 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Found default for hw_pointer_model of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:12:39 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Found default for hw_video_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:12:39 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Found default for hw_vif_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:12:39 user nova-compute[95467]: DEBUG nova.compute.manager [req-cee2927c-3a41-4647-afb1-884f7b04d8d8 req-23a8fa85-1eb1-4e02-9e44-903c24bfd5fd service nova] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Received event network-vif-plugged-1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:12:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-cee2927c-3a41-4647-afb1-884f7b04d8d8 req-23a8fa85-1eb1-4e02-9e44-903c24bfd5fd service nova] Acquiring lock "7e53d93e-1222-4b1a-9745-d512da0f7925-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:12:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-cee2927c-3a41-4647-afb1-884f7b04d8d8 req-23a8fa85-1eb1-4e02-9e44-903c24bfd5fd service nova] Lock "7e53d93e-1222-4b1a-9745-d512da0f7925-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:12:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-cee2927c-3a41-4647-afb1-884f7b04d8d8 req-23a8fa85-1eb1-4e02-9e44-903c24bfd5fd service nova] Lock "7e53d93e-1222-4b1a-9745-d512da0f7925-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:12:39 user nova-compute[95467]: DEBUG nova.compute.manager [req-cee2927c-3a41-4647-afb1-884f7b04d8d8 req-23a8fa85-1eb1-4e02-9e44-903c24bfd5fd service nova] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] No waiting events found dispatching network-vif-plugged-1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:12:39 user nova-compute[95467]: WARNING nova.compute.manager [req-cee2927c-3a41-4647-afb1-884f7b04d8d8 req-23a8fa85-1eb1-4e02-9e44-903c24bfd5fd service nova] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Received unexpected event network-vif-plugged-1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2 for instance with vm_state active and task_state rebuild_spawning.
Nov 15 08:12:39 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a259558e-87ea-48c2-8b72-7443c0510d81/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:39 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a259558e-87ea-48c2-8b72-7443c0510d81/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:39 user nova-compute[95467]: DEBUG nova.compute.manager [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:12:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:12:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:12:39 user nova-compute[95467]: DEBUG nova.objects.instance [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Trying to apply a migration context that does not seem to be set for this instance {{(pid=95467) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 15 08:12:39 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a259558e-87ea-48c2-8b72-7443c0510d81/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:39 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60e20e77-6091-4abc-bbad-b5f21a2071c3/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1efe2418-0fb7-49cb-8a9a-1dbe9a4f186b tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.111s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:12:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60e20e77-6091-4abc-bbad-b5f21a2071c3/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60e20e77-6091-4abc-bbad-b5f21a2071c3/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60e20e77-6091-4abc-bbad-b5f21a2071c3/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0917b083-2bbf-4baf-a0b8-d59ba3e2256b/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0917b083-2bbf-4baf-a0b8-d59ba3e2256b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0917b083-2bbf-4baf-a0b8-d59ba3e2256b/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0917b083-2bbf-4baf-a0b8-d59ba3e2256b/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2aa477-6786-483a-b088-d8ec204fe6aa/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2aa477-6786-483a-b088-d8ec204fe6aa/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2aa477-6786-483a-b088-d8ec204fe6aa/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2aa477-6786-483a-b088-d8ec204fe6aa/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43f602f1-89c4-40b4-92f4-f054b980ce8a/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43f602f1-89c4-40b4-92f4-f054b980ce8a/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43f602f1-89c4-40b4-92f4-f054b980ce8a/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43f602f1-89c4-40b4-92f4-f054b980ce8a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:42 user nova-compute[95467]: INFO nova.compute.manager [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] [instance: 35e88686-253e-452a-9649-8aa2a04128ce] Took 7.41 seconds to detach 3 volumes for instance.
Nov 15 08:12:42 user nova-compute[95467]: DEBUG nova.compute.manager [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WKoHbtLV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1edf7591-3991-4df9-98c9-ebc4ca9e5a4a', 'attached_at': '', 'detached_at': '', 'volume_id': '0b457e6b-86bf-4152-8f03-de5efd184fd5', 'serial': '0b457e6b-86bf-4152-8f03-de5efd184fd5'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iXPZWHpK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'volume_id': '524e76af-4b7b-40a3-8e42-b26a7c731c4a'}, 'status': 'reserved', 'instance': '1edf7591-3991-4df9-98c9-ebc4ca9e5a4a', 'attached_at': '', 'detached_at': '', 'volume_id': '524e76af-4b7b-40a3-8e42-b26a7c731c4a', 'serial'} {{(pid=95467) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 15 08:12:42 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:12:42 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:12:42 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Hypervisor/Node resource view: name=user free_ram=7168MB free_disk=25.52477264404297GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=95467) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Calling os-brick to attach iSCSI Volume {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WKoHbtLV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:12:42 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:12:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:12:42 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:12:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:12:42 user nova-compute[95467]: INFO os_brick.initiator.connectors.iscsi [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 08:12:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 -p 172.16.0.220:3260 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dbce0ec-72d1-4d96-9821-936e4e75e012]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 08:12:42 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 -p 172.16.0.220:3260 --interface default --op new {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7aed8c-2fa6-4027-acaa-a75370298446]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5] added\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5] added
Nov 15 08:12:42 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b169817-9ce1-4e24-ad2e-869ccab10726]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ee1384-114d-48c2-9e2a-824576bdc7d6]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WKoHbtLV {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WKoHbtLV" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d639b5a-58f1-4ab4-9343-aeeacdd6dfbd]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WKoHbtLV'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[171582e2-0f3c-488c-ab5f-8c0742aa1f3d]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0acea89-9615-40eb-998c-e772c2b3eaba]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07 (non-flash)
Nov 15 08:12:42 user nova-compute[95467]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a (non-flash)
Nov 15 08:12:42 user nova-compute[95467]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56 (non-flash)
Nov 15 08:12:42 user nova-compute[95467]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)
Nov 15 08:12:42 user nova-compute[95467]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)
Nov 15 08:12:42 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07 (non-flash)
Nov 15 08:12:42 user nova-compute[95467]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a (non-flash)
Nov 15 08:12:42 user nova-compute[95467]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56 (non-flash)
Nov 15 08:12:42 user nova-compute[95467]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)
Nov 15 08:12:42 user nova-compute[95467]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)
Nov 15 08:12:42 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance ee2aa477-6786-483a-b088-d8ec204fe6aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 5748cf5d-9c57-4477-8952-ec39d0d18f55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 73fe8852-c47a-47ab-a56f-6864c8ed5479 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 68264a44-5adf-4873-b380-26bcafe2ba04 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 7e53d93e-1222-4b1a-9745-d512da0f7925 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 0917b083-2bbf-4baf-a0b8-d59ba3e2256b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance a259558e-87ea-48c2-8b72-7443c0510d81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 35e88686-253e-452a-9649-8aa2a04128ce actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 43f602f1-89c4-40b4-92f4-f054b980ce8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 60e20e77-6091-4abc-bbad-b5f21a2071c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 -p 172.16.0.220:3260 --login {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[017a5bb6-39fb-470d-ae37-453b69ea7a4b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5, portal: 172.16.0.220,3260]
Nov 15 08:12:42 user nova-compute[95467]: Login to [iface: default, target: iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5, portal: 172.16.0.220,3260] successful.
Nov 15 08:12:42 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb693477-01ea-494b-a6e4-72eabfcef080]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a13dae-b410-4ffd-a648-55e2326e18dd]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07 (non-flash)
Nov 15 08:12:42 user nova-compute[95467]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a (non-flash)
Nov 15 08:12:42 user nova-compute[95467]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56 (non-flash)
Nov 15 08:12:42 user nova-compute[95467]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)
Nov 15 08:12:42 user nova-compute[95467]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 (non-flash)
Nov 15 08:12:42 user nova-compute[95467]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)
Nov 15 08:12:42 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07 (non-flash)
Nov 15 08:12:42 user nova-compute[95467]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a (non-flash)
Nov 15 08:12:42 user nova-compute[95467]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56 (non-flash)
Nov 15 08:12:42 user nova-compute[95467]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)
Nov 15 08:12:42 user nova-compute[95467]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 (non-flash)
Nov 15 08:12:42 user nova-compute[95467]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)
Nov 15 08:12:42 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] Connected to 172.16.0.220:3260 {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] HCTL ('34', '-', '-', 0) found on session 15 with lun 0 {{(pid=95467) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] Scanning host 34 c: -, t: -, l: 0) {{(pid=95467) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f813d126-b6f6-453e-8d53-30b1ba059c6b]: (4, ('- - 0', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:12:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WKoHbtLV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 08:12:43 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:12:43 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:12:43 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Compute_service record updated for user:user {{(pid=95467) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 08:12:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.589s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:12:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.544s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:12:43 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:12:43 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:12:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.349s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:12:43 user nova-compute[95467]: INFO nova.scheduler.client.report [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Deleted allocations for instance 35e88686-253e-452a-9649-8aa2a04128ce
Nov 15 08:12:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-298c99fc-a118-4c5d-b097-38797c0054d5 tempest-TaggedBootDevicesTest_v242-1329538542 tempest-TaggedBootDevicesTest_v242-1329538542-project-member] Lock "35e88686-253e-452a-9649-8aa2a04128ce" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 17.050s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:12:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:12:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '23562396364643333', 'path': '/dev/sdc'} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:12:43 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23562396364643333', 'path': '/dev/sdc'} {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 08:12:43 user nova-compute[95467]: DEBUG nova.objects.instance [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] Lazy-loading 'flavor' on Instance uuid 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:12:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:44 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:12:44 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:12:44 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Starting heal instance info cache {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 08:12:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "refresh_cache-5748cf5d-9c57-4477-8952-ec39d0d18f55" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:12:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquired lock "refresh_cache-5748cf5d-9c57-4477-8952-ec39d0d18f55" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:12:44 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] Forcefully refreshing network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 08:12:44 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=95467) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 08:12:44 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-11d0a62f-4a76-481b-a154-4fd8ef9859e7 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a259558e-87ea-48c2-8b72-7443c0510d81 is timed out.
Nov 15 08:12:44 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-11d0a62f-4a76-481b-a154-4fd8ef9859e7 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] Successfully detached device vdb from instance a259558e-87ea-48c2-8b72-7443c0510d81 from the live domain config.
Nov 15 08:12:44 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11d0a62f-4a76-481b-a154-4fd8ef9859e7 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] calling os-brick to detach iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 08:12:44 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d0a62f-4a76-481b-a154-4fd8ef9859e7 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, {'target_iqn': 'iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OmUrjZGB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:12:44 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-11d0a62f-4a76-481b-a154-4fd8ef9859e7 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:12:44 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-11d0a62f-4a76-481b-a154-4fd8ef9859e7 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:12:44 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-11d0a62f-4a76-481b-a154-4fd8ef9859e7 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:12:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:44 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03b93d2-b3a7-47f5-8c76-36242a882311]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:44 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d0a62f-4a76-481b-a154-4fd8ef9859e7 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 08:12:44 user nova-compute[95467]: No targets found.
Nov 15 08:12:44 user nova-compute[95467]: iSNS:
Nov 15 08:12:44 user nova-compute[95467]: No targets found.
Nov 15 08:12:44 user nova-compute[95467]: STATIC:
Nov 15 08:12:44 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f
Nov 15 08:12:44 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:12:44 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:12:44 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5
Nov 15 08:12:44 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:12:44 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:12:44 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a
Nov 15 08:12:44 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:12:44 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:12:44 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07
Nov 15 08:12:44 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:12:44 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:12:44 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de
Nov 15 08:12:44 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:12:44 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:12:44 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56
Nov 15 08:12:44 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:12:44 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:12:44 user nova-compute[95467]: FIRMWARE:
Nov 15 08:12:44 user nova-compute[95467]: No targets found.
Nov 15 08:12:44 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:12:44 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d0a62f-4a76-481b-a154-4fd8ef9859e7 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 08:12:44 user nova-compute[95467]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 08:12:44 user nova-compute[95467]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=95467) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 08:12:44 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d0a62f-4a76-481b-a154-4fd8ef9859e7 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07', 0)] {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 08:12:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:44 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a53de0-dd30-4fae-99c0-f1d3d6da7ed3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.053s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:44 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1ae0dc-5547-4851-a291-24dc8ddf6548]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:44 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d0a62f-4a76-481b-a154-4fd8ef9859e7 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07 (non-flash)
Nov 15 08:12:44 user nova-compute[95467]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a (non-flash)
Nov 15 08:12:44 user nova-compute[95467]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56 (non-flash)
Nov 15 08:12:44 user nova-compute[95467]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)
Nov 15 08:12:44 user nova-compute[95467]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 (non-flash)
Nov 15 08:12:44 user nova-compute[95467]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)
Nov 15 08:12:44 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:12:44 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d0a62f-4a76-481b-a154-4fd8ef9859e7 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07 (non-flash)
Nov 15 08:12:44 user nova-compute[95467]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a (non-flash)
Nov 15 08:12:44 user nova-compute[95467]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56 (non-flash)
Nov 15 08:12:44 user nova-compute[95467]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)
Nov 15 08:12:44 user nova-compute[95467]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 (non-flash)
Nov 15 08:12:44 user nova-compute[95467]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)
Nov 15 08:12:44 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:12:44 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d0a62f-4a76-481b-a154-4fd8ef9859e7 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efec8442200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07'): ({'sdi'}, set())}) {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 08:12:44 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-11d0a62f-4a76-481b-a154-4fd8ef9859e7 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] Removing single pathed devices sdi {{(pid=95467) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 08:12:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.033s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:44 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e0d18f-83fa-4413-80fb-c0893acb7a7b]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.032s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:44 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f86cd7b-1f69-4e7b-9903-40fca0ee2113]: (4, ('ok\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:44 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-11d0a62f-4a76-481b-a154-4fd8ef9859e7 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] Flushing IO for device /dev/sdi {{(pid=95467) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 08:12:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.024s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:44 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[109d277d-812d-4721-b658-53a52a5f4199]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:44 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-11d0a62f-4a76-481b-a154-4fd8ef9859e7 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=95467) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 08:12:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.066s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:44 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab6d3263-a269-4a54-b105-4c79298dbf1c]: (4, ('1', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:44 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-11d0a62f-4a76-481b-a154-4fd8ef9859e7 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 08:12:44 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-11d0a62f-4a76-481b-a154-4fd8ef9859e7 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] SCSI volumes sdi have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 08:12:44 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d0a62f-4a76-481b-a154-4fd8ef9859e7 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07')] {{(pid=95467) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 08:12:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:44 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[043953ea-b9da-4811-b274-2c704a4946ac]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:44 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d0a62f-4a76-481b-a154-4fd8ef9859e7 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07 -p 172.16.0.220:3260 --logout {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:44 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] COPY block job progress, current cursor: 126877696 final cursor: 1073741824 {{(pid=95467) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 08:12:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07 -p 172.16.0.220:3260 --logout" returned: 0 in 0.107s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:44 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b1567e-8121-4e97-a40d-4c19cbe63364]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:44 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d0a62f-4a76-481b-a154-4fd8ef9859e7 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07, portal: 172.16.0.220,3260]
Nov 15 08:12:44 user nova-compute[95467]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07, portal: 172.16.0.220,3260] successful.
Nov 15 08:12:44 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07 -p 172.16.0.220:3260 --op delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff9afdef-28d7-4ab9-ad35-8a12eeb41f07 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.049s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:44 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f88e0c-f434-435c-8a97-e7a8b82a066c]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:44 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d0a62f-4a76-481b-a154-4fd8ef9859e7 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:44 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-11d0a62f-4a76-481b-a154-4fd8ef9859e7 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.516s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:12:44 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d0a62f-4a76-481b-a154-4fd8ef9859e7 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] <== disconnect_volume: return (517ms) None {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:12:44 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11d0a62f-4a76-481b-a154-4fd8ef9859e7 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Disconnected iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 08:12:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:45 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] COPY block job progress, current cursor: 272629760 final cursor: 1073741824 {{(pid=95467) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 08:12:45 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] Updating instance_info_cache with network_info: [{"id": "015c421f-8bfc-4576-a9cc-bf990e3803ab", "address": "fa:16:3e:e1:8a:d4", "network": {"id": "27fd2b0f-65bd-4ae4-b5c8-dfca91668078", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1310727750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50e2fec6a90a41a5a586c6da227caacc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap015c421f-8b", "ovs_interfaceid": "015c421f-8bfc-4576-a9cc-bf990e3803ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:12:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Releasing lock "refresh_cache-5748cf5d-9c57-4477-8952-ec39d0d18f55" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:12:45 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] Updated the network info_cache for instance {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 08:12:45 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:12:45 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:12:45 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:12:45 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] COPY block job progress, current cursor: 411041792 final cursor: 1073741824 {{(pid=95467) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 08:12:46 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:46 user nova-compute[95467]: DEBUG nova.objects.instance [None req-11d0a62f-4a76-481b-a154-4fd8ef9859e7 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] Lazy-loading 'flavor' on Instance uuid a259558e-87ea-48c2-8b72-7443c0510d81 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:12:46 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] COPY block job progress, current cursor: 507510784 final cursor: 1073741824 {{(pid=95467) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 08:12:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-11d0a62f-4a76-481b-a154-4fd8ef9859e7 tempest-VolumesAssistedSnapshotsTest-138338061 tempest-VolumesAssistedSnapshotsTest-138338061-project-admin] Lock "a259558e-87ea-48c2-8b72-7443c0510d81" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.660s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:12:46 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] COPY block job progress, current cursor: 649068544 final cursor: 1073741824 {{(pid=95467) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 08:12:47 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:47 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] COPY block job progress, current cursor: 836763648 final cursor: 1073741824 {{(pid=95467) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 08:12:47 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] COPY block job progress, current cursor: 968884224 final cursor: 1073741824 {{(pid=95467) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=95467) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] calling os-brick to detach iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, {'target_iqn': 'iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iXPZWHpK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'volume_id': '524e76af-4b7b-40a3-8e42-b26a7c731c4a'}, None), 'kwargs': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:12:48 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:12:48 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[e78bec34-c2be-4d9c-b38e-9e8161211b2a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 08:12:48 user nova-compute[95467]: No targets found.
Nov 15 08:12:48 user nova-compute[95467]: iSNS:
Nov 15 08:12:48 user nova-compute[95467]: No targets found.
Nov 15 08:12:48 user nova-compute[95467]: STATIC:
Nov 15 08:12:48 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f
Nov 15 08:12:48 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:12:48 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:12:48 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5
Nov 15 08:12:48 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:12:48 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:12:48 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a
Nov 15 08:12:48 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:12:48 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:12:48 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de
Nov 15 08:12:48 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:12:48 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:12:48 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56
Nov 15 08:12:48 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:12:48 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:12:48 user nova-compute[95467]: FIRMWARE:
Nov 15 08:12:48 user nova-compute[95467]: No targets found.
Nov 15 08:12:48 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 08:12:48 user nova-compute[95467]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 08:12:48 user nova-compute[95467]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=95467) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a', 0)] {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[25572b03-533f-40b9-a14c-133ba339c1b5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[18aa59c5-5a8b-4cb0-8993-eea9113dd195]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a (non-flash)
Nov 15 08:12:48 user nova-compute[95467]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56 (non-flash)
Nov 15 08:12:48 user nova-compute[95467]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)
Nov 15 08:12:48 user nova-compute[95467]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 (non-flash)
Nov 15 08:12:48 user nova-compute[95467]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)
Nov 15 08:12:48 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a (non-flash)
Nov 15 08:12:48 user nova-compute[95467]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56 (non-flash)
Nov 15 08:12:48 user nova-compute[95467]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)
Nov 15 08:12:48 user nova-compute[95467]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 (non-flash)
Nov 15 08:12:48 user nova-compute[95467]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)
Nov 15 08:12:48 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efed86fd510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a'): ({'sdj'}, set())}) {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] Removing single pathed devices sdj {{(pid=95467) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[947b1d60-b2b8-4d78-9aaa-69aa59163bf8]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.036s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[000a24c7-1da4-4acc-a35a-2b50116713cc]: (4, ('ok\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] Flushing IO for device /dev/sdj {{(pid=95467) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c877968-4db2-4bd8-91c8-fc2ed06da862]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=95467) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.032s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee26f8a5-8eff-4020-ae7e-10b85b1c2ef0]: (4, ('1', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] SCSI volumes sdj have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a')] {{(pid=95467) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f410029-cdd6-4a78-8106-ab0e66006e0d]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a -p 172.16.0.220:3260 --logout {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[df61a81c-39f9-4966-9fdd-6e00bfc30a7c]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a, portal: 172.16.0.220,3260]
Nov 15 08:12:48 user nova-compute[95467]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a, portal: 172.16.0.220,3260] successful.
Nov 15 08:12:48 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a -p 172.16.0.220:3260 --op delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:524e76af-4b7b-40a3-8e42-b26a7c731c4a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d667d37-cb5f-4613-8b8d-120c9127def5]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] <== disconnect_volume: return (325ms) None {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Disconnected iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG nova.compute.manager [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WKoHbtLV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '1edf7591-3991-4df9-98c9-ebc4ca9e5a4a', 'attached_at': '', 'detached_at': '', 'volume_id': '0b457e6b-86bf-4152-8f03-de5efd184fd5', 'serial'} {{(pid=95467) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG nova.compute.manager [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] swap_volume: removing Cinder connection for volume 524e76af-4b7b-40a3-8e42-b26a7c731c4a {{(pid=95467) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 15 08:12:48 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-2f700d37-5d71-4cec-9de2-64d3ee456dc3 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0917b083-2bbf-4baf-a0b8-d59ba3e2256b is timed out.
Nov 15 08:12:48 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-2f700d37-5d71-4cec-9de2-64d3ee456dc3 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Successfully detached device vdb from instance 0917b083-2bbf-4baf-a0b8-d59ba3e2256b from the live domain config.
Nov 15 08:12:48 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f700d37-5d71-4cec-9de2-64d3ee456dc3 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] calling os-brick to detach iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f700d37-5d71-4cec-9de2-64d3ee456dc3 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, {'target_iqn': 'iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xAMDjGIV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:12:48 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-2f700d37-5d71-4cec-9de2-64d3ee456dc3 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:12:48 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-2f700d37-5d71-4cec-9de2-64d3ee456dc3 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-2f700d37-5d71-4cec-9de2-64d3ee456dc3 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2601a6a-ac59-4c0c-96b7-7f89c4892096]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f700d37-5d71-4cec-9de2-64d3ee456dc3 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 08:12:48 user nova-compute[95467]: No targets found.
Nov 15 08:12:48 user nova-compute[95467]: iSNS:
Nov 15 08:12:48 user nova-compute[95467]: No targets found.
Nov 15 08:12:48 user nova-compute[95467]: STATIC:
Nov 15 08:12:48 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f
Nov 15 08:12:48 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:12:48 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:12:48 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5
Nov 15 08:12:48 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:12:48 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:12:48 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de
Nov 15 08:12:48 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:12:48 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:12:48 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56
Nov 15 08:12:48 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:12:48 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:12:48 user nova-compute[95467]: FIRMWARE:
Nov 15 08:12:48 user nova-compute[95467]: No targets found.
Nov 15 08:12:48 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f700d37-5d71-4cec-9de2-64d3ee456dc3 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 08:12:48 user nova-compute[95467]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 08:12:48 user nova-compute[95467]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=95467) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f700d37-5d71-4cec-9de2-64d3ee456dc3 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56', 0)] {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c8938c-1671-4420-8497-940db3918924]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[045bc5ec-f53a-42ba-93e6-6ddc39783021]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f700d37-5d71-4cec-9de2-64d3ee456dc3 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56 (non-flash)
Nov 15 08:12:48 user nova-compute[95467]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)
Nov 15 08:12:48 user nova-compute[95467]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 (non-flash)
Nov 15 08:12:48 user nova-compute[95467]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)
Nov 15 08:12:48 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f700d37-5d71-4cec-9de2-64d3ee456dc3 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56 (non-flash)
Nov 15 08:12:48 user nova-compute[95467]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)
Nov 15 08:12:48 user nova-compute[95467]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 (non-flash)
Nov 15 08:12:48 user nova-compute[95467]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)
Nov 15 08:12:48 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f700d37-5d71-4cec-9de2-64d3ee456dc3 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efec858d870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56'): ({'sdk'}, set())}) {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-2f700d37-5d71-4cec-9de2-64d3ee456dc3 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Removing single pathed devices sdk {{(pid=95467) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[441078d9-baee-442a-9d5d-cb8ccb09a4a4]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.022s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3f840a-1555-4600-a5e2-a9a0fdd49e43]: (4, ('ok\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-2f700d37-5d71-4cec-9de2-64d3ee456dc3 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Flushing IO for device /dev/sdk {{(pid=95467) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 08:12:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.015s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:49 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[6312c8dd-a861-4845-a1af-c08f2667dd9b]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:49 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-2f700d37-5d71-4cec-9de2-64d3ee456dc3 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=95467) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 08:12:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.033s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:49 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e031139-2376-4fb0-9075-e2c87d9afc56]: (4, ('1', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:49 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-2f700d37-5d71-4cec-9de2-64d3ee456dc3 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 08:12:49 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-2f700d37-5d71-4cec-9de2-64d3ee456dc3 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] SCSI volumes sdk have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 08:12:49 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f700d37-5d71-4cec-9de2-64d3ee456dc3 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56')] {{(pid=95467) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 08:12:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:49 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef1eeea-9c19-49e5-8b36-c9a5b5ef1b6f]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:49 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f700d37-5d71-4cec-9de2-64d3ee456dc3 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56 -p 172.16.0.220:3260 --logout {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:49 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4310284-871d-4ef9-bba1-b0783e34afd7]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:49 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f700d37-5d71-4cec-9de2-64d3ee456dc3 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56, portal: 172.16.0.220,3260]
Nov 15 08:12:49 user nova-compute[95467]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56, portal: 172.16.0.220,3260] successful.
Nov 15 08:12:49 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56 -p 172.16.0.220:3260 --op delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:714a73ec-3d5a-4a77-9426-84d497ef3c56 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:49 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce819aeb-98b7-4610-85c2-6426aaa00bf0]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:12:49 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f700d37-5d71-4cec-9de2-64d3ee456dc3 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:12:49 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-2f700d37-5d71-4cec-9de2-64d3ee456dc3 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:12:49 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f700d37-5d71-4cec-9de2-64d3ee456dc3 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] <== disconnect_volume: return (307ms) None {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:12:49 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f700d37-5d71-4cec-9de2-64d3ee456dc3 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Disconnected iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 08:12:49 user nova-compute[95467]: DEBUG nova.compute.manager [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] swap_volume: Updating volume 524e76af-4b7b-40a3-8e42-b26a7c731c4a BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "WKoHbtLV", "auth_password": "9l3SKDm8UcOgCE", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdc", "volume_id": "0b457e6b-86bf-4152-8f03-de5efd184fd5"}, "status": "reserved", "instance": "1edf7591-3991-4df9-98c9-ebc4ca9e5a4a", "attached_at": "", "detached_at": "", "volume_id": "0b457e6b-86bf-4152-8f03-de5efd184fd5", "serial": "0b457e6b-86bf-4152-8f03-de5efd184fd5"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '0b457e6b-86bf-4152-8f03-de5efd184fd5', 'no_device': None, 'attachment_id': 'c0ba78ca-44cc-469a-8456-83488bfb60e0'} {{(pid=95467) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 15 08:12:49 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e890a368-13b1-49ba-b2f9-64036d1a67e2 tempest-TestVolumeSwap-1911463340 tempest-TestVolumeSwap-1911463340-project-admin] Lock "1edf7591-3991-4df9-98c9-ebc4ca9e5a4a" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 14.352s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:12:50 user nova-compute[95467]: DEBUG nova.objects.instance [None req-2f700d37-5d71-4cec-9de2-64d3ee456dc3 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Lazy-loading 'flavor' on Instance uuid 0917b083-2bbf-4baf-a0b8-d59ba3e2256b {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:12:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-2f700d37-5d71-4cec-9de2-64d3ee456dc3 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Lock "0917b083-2bbf-4baf-a0b8-d59ba3e2256b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.533s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:12:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-37f4bd6b-f8fd-477a-a87d-82dabe6ec074 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Acquiring lock "1edf7591-3991-4df9-98c9-ebc4ca9e5a4a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:12:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-37f4bd6b-f8fd-477a-a87d-82dabe6ec074 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Lock "1edf7591-3991-4df9-98c9-ebc4ca9e5a4a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:12:51 user nova-compute[95467]: INFO nova.compute.manager [None req-37f4bd6b-f8fd-477a-a87d-82dabe6ec074 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Detaching volume 0b457e6b-86bf-4152-8f03-de5efd184fd5
Nov 15 08:12:51 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:51 user nova-compute[95467]: INFO nova.virt.block_device [None req-37f4bd6b-f8fd-477a-a87d-82dabe6ec074 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Attempting to driver detach volume 0b457e6b-86bf-4152-8f03-de5efd184fd5 from mountpoint /dev/vdb
Nov 15 08:12:51 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-37f4bd6b-f8fd-477a-a87d-82dabe6ec074 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Attempting to detach device vdb from instance 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a from the persistent domain config. {{(pid=95467) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 08:12:51 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-37f4bd6b-f8fd-477a-a87d-82dabe6ec074 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 08:12:51 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:12:51 user nova-compute[95467]:   <source dev="/dev/sdc"/>
Nov 15 08:12:51 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:12:51 user nova-compute[95467]:   <serial>0b457e6b-86bf-4152-8f03-de5efd184fd5</serial>
Nov 15 08:12:51 user nova-compute[95467]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 08:12:51 user nova-compute[95467]: </disk>
Nov 15 08:12:51 user nova-compute[95467]:  {{(pid=95467) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 08:12:51 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-37f4bd6b-f8fd-477a-a87d-82dabe6ec074 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Successfully detached device vdb from instance 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a from the persistent domain config.
Nov 15 08:12:51 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-37f4bd6b-f8fd-477a-a87d-82dabe6ec074 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a from the live domain config. {{(pid=95467) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 08:12:51 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-37f4bd6b-f8fd-477a-a87d-82dabe6ec074 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 08:12:51 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:12:51 user nova-compute[95467]:   <source dev="/dev/sdc"/>
Nov 15 08:12:51 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:12:51 user nova-compute[95467]:   <serial>0b457e6b-86bf-4152-8f03-de5efd184fd5</serial>
Nov 15 08:12:51 user nova-compute[95467]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 08:12:51 user nova-compute[95467]: </disk>
Nov 15 08:12:51 user nova-compute[95467]:  {{(pid=95467) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 08:12:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-96d7cc5d-4226-460b-8182-0c3a169aebb7 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Acquiring lock "interface-0917b083-2bbf-4baf-a0b8-d59ba3e2256b-c5401d35-e26c-4291-8a19-520a5ece891e" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:12:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-96d7cc5d-4226-460b-8182-0c3a169aebb7 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Lock "interface-0917b083-2bbf-4baf-a0b8-d59ba3e2256b-c5401d35-e26c-4291-8a19-520a5ece891e" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:12:51 user nova-compute[95467]: DEBUG nova.objects.instance [None req-96d7cc5d-4226-460b-8182-0c3a169aebb7 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Lazy-loading 'flavor' on Instance uuid 0917b083-2bbf-4baf-a0b8-d59ba3e2256b {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:12:51 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-96d7cc5d-4226-460b-8182-0c3a169aebb7 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T08:10:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-940506734',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-940506734',id=9,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOGNo6GmVxPWDErmWkQ6fepU8heeIoJyOQ4cdNTLpFz1E0Ctc05CX23OX/CDepMfdF3Ar0clX85i/1Lr4zTu3ZjElr//sRBIxLqJHKfdYZdCUYYo+kOnMpjx+ZoNdO+nnQ==',key_name='tempest-keypair-1459138786',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:10:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='18fe2aa7cd7c4943a8c848dd52b9697b',ramdisk_id='',reservation_id='r-edurmax0',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2023837645',owner_user_name='tempest-TaggedAttachmentsTest-2023837645-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:10:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c29ac74b4e745a09af7ecedde0f5697',uuid=0917b083-2bbf-4baf-a0b8-d59ba3e2256b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5401d35-e26c-4291-8a19-520a5ece891e", "address": "fa:16:3e:79:65:ad", "network": {"id": "43eed8c1-119b-4038-98a2-06248998df67", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-33201672", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "18fe2aa7cd7c4943a8c848dd52b9697b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5401d35-e2", "ovs_interfaceid": "c5401d35-e26c-4291-8a19-520a5ece891e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:12:51 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-96d7cc5d-4226-460b-8182-0c3a169aebb7 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Converting VIF {"id": "c5401d35-e26c-4291-8a19-520a5ece891e", "address": "fa:16:3e:79:65:ad", "network": {"id": "43eed8c1-119b-4038-98a2-06248998df67", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-33201672", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "18fe2aa7cd7c4943a8c848dd52b9697b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5401d35-e2", "ovs_interfaceid": "c5401d35-e26c-4291-8a19-520a5ece891e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:12:51 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-96d7cc5d-4226-460b-8182-0c3a169aebb7 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:65:ad,bridge_name='br-int',has_traffic_filtering=True,id=c5401d35-e26c-4291-8a19-520a5ece891e,network=Network(43eed8c1-119b-4038-98a2-06248998df67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5401d35-e2') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:12:51 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-96d7cc5d-4226-460b-8182-0c3a169aebb7 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:79:65:ad"/><model type="virtio"/><mtu size="1442"/><target dev="tapc5401d35-e2"/></interface> {{(pid=95467) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 08:12:51 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-96d7cc5d-4226-460b-8182-0c3a169aebb7 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:79:65:ad"/><model type="virtio"/><mtu size="1442"/><target dev="tapc5401d35-e2"/></interface> {{(pid=95467) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 08:12:51 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-96d7cc5d-4226-460b-8182-0c3a169aebb7 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Attempting to detach device tapc5401d35-e2 from instance 0917b083-2bbf-4baf-a0b8-d59ba3e2256b from the persistent domain config. {{(pid=95467) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 08:12:51 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-96d7cc5d-4226-460b-8182-0c3a169aebb7 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] detach device xml: <interface type="ethernet">
Nov 15 08:12:51 user nova-compute[95467]:   <mac address="fa:16:3e:79:65:ad"/>
Nov 15 08:12:51 user nova-compute[95467]:   <model type="virtio"/>
Nov 15 08:12:51 user nova-compute[95467]:   <mtu size="1442"/>
Nov 15 08:12:51 user nova-compute[95467]:   <target dev="tapc5401d35-e2"/>
Nov 15 08:12:51 user nova-compute[95467]: </interface>
Nov 15 08:12:51 user nova-compute[95467]:  {{(pid=95467) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 08:12:51 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-96d7cc5d-4226-460b-8182-0c3a169aebb7 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:79:65:ad"/><model type="virtio"/><mtu size="1442"/><target dev="tapc5401d35-e2"/></interface> {{(pid=95467) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 08:12:51 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-96d7cc5d-4226-460b-8182-0c3a169aebb7 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:79:65:ad"/><model type="virtio"/><mtu size="1442"/><target dev="tapc5401d35-e2"/></interface>not found in domain: <domain type='kvm' id='9'>
Nov 15 08:12:51 user nova-compute[95467]:   <name>instance-00000009</name>
Nov 15 08:12:51 user nova-compute[95467]:   <uuid>0917b083-2bbf-4baf-a0b8-d59ba3e2256b</uuid>
Nov 15 08:12:51 user nova-compute[95467]:   <metadata>
Nov 15 08:12:51 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:12:51 user nova-compute[95467]:   <nova:package version="0.0.0"/>
Nov 15 08:12:51 user nova-compute[95467]:   <nova:name>tempest-device-tagging-server-940506734</nova:name>
Nov 15 08:12:51 user nova-compute[95467]:   <nova:creationTime>2023-11-15 08:12:14</nova:creationTime>
Nov 15 08:12:51 user nova-compute[95467]:   <nova:flavor name="m1.tiny">
Nov 15 08:12:51 user nova-compute[95467]:     <nova:memory>512</nova:memory>
Nov 15 08:12:51 user nova-compute[95467]:     <nova:disk>1</nova:disk>
Nov 15 08:12:51 user nova-compute[95467]:     <nova:swap>0</nova:swap>
Nov 15 08:12:51 user nova-compute[95467]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:12:51 user nova-compute[95467]:     <nova:vcpus>1</nova:vcpus>
Nov 15 08:12:51 user nova-compute[95467]:   </nova:flavor>
Nov 15 08:12:51 user nova-compute[95467]:   <nova:owner>
Nov 15 08:12:51 user nova-compute[95467]:     <nova:user uuid="5c29ac74b4e745a09af7ecedde0f5697">tempest-TaggedAttachmentsTest-2023837645-project-member</nova:user>
Nov 15 08:12:51 user nova-compute[95467]:     <nova:project uuid="18fe2aa7cd7c4943a8c848dd52b9697b">tempest-TaggedAttachmentsTest-2023837645</nova:project>
Nov 15 08:12:51 user nova-compute[95467]:   </nova:owner>
Nov 15 08:12:51 user nova-compute[95467]:   <nova:root type="image" uuid="ed9c48aa-ce73-4b3b-9db1-235898be671b"/>
Nov 15 08:12:51 user nova-compute[95467]:   <nova:ports>
Nov 15 08:12:51 user nova-compute[95467]:     <nova:port uuid="f6d25344-c8fc-4794-b302-a3665c62b78c">
Nov 15 08:12:51 user nova-compute[95467]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 08:12:51 user nova-compute[95467]:     </nova:port>
Nov 15 08:12:51 user nova-compute[95467]:     <nova:port uuid="c5401d35-e26c-4291-8a19-520a5ece891e">
Nov 15 08:12:51 user nova-compute[95467]:       <nova:ip type="fixed" address="10.10.10.159" ipVersion="4"/>
Nov 15 08:12:51 user nova-compute[95467]:     </nova:port>
Nov 15 08:12:51 user nova-compute[95467]:   </nova:ports>
Nov 15 08:12:51 user nova-compute[95467]: </nova:instance>
Nov 15 08:12:51 user nova-compute[95467]:   </metadata>
Nov 15 08:12:51 user nova-compute[95467]:   <memory unit='KiB'>524288</memory>
Nov 15 08:12:51 user nova-compute[95467]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 15 08:12:51 user nova-compute[95467]:   <vcpu placement='static'>1</vcpu>
Nov 15 08:12:51 user nova-compute[95467]:   <resource>
Nov 15 08:12:51 user nova-compute[95467]:     <partition>/machine</partition>
Nov 15 08:12:51 user nova-compute[95467]:   </resource>
Nov 15 08:12:51 user nova-compute[95467]:   <sysinfo type='smbios'>
Nov 15 08:12:51 user nova-compute[95467]:     <system>
Nov 15 08:12:51 user nova-compute[95467]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 15 08:12:51 user nova-compute[95467]:       <entry name='product'>OpenStack Nova</entry>
Nov 15 08:12:51 user nova-compute[95467]:       <entry name='version'>0.0.0</entry>
Nov 15 08:12:51 user nova-compute[95467]:       <entry name='serial'>0917b083-2bbf-4baf-a0b8-d59ba3e2256b</entry>
Nov 15 08:12:51 user nova-compute[95467]:       <entry name='uuid'>0917b083-2bbf-4baf-a0b8-d59ba3e2256b</entry>
Nov 15 08:12:51 user nova-compute[95467]:       <entry name='family'>Virtual Machine</entry>
Nov 15 08:12:51 user nova-compute[95467]:     </system>
Nov 15 08:12:51 user nova-compute[95467]:   </sysinfo>
Nov 15 08:12:51 user nova-compute[95467]:   <os>
Nov 15 08:12:51 user nova-compute[95467]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 15 08:12:51 user nova-compute[95467]:     <boot dev='hd'/>
Nov 15 08:12:51 user nova-compute[95467]:     <smbios mode='sysinfo'/>
Nov 15 08:12:51 user nova-compute[95467]:   </os>
Nov 15 08:12:51 user nova-compute[95467]:   <features>
Nov 15 08:12:51 user nova-compute[95467]:     <acpi/>
Nov 15 08:12:51 user nova-compute[95467]:     <apic/>
Nov 15 08:12:51 user nova-compute[95467]:     <vmcoreinfo state='on'/>
Nov 15 08:12:51 user nova-compute[95467]:   </features>
Nov 15 08:12:51 user nova-compute[95467]:   <cpu mode='custom' match='exact' check='full'>
Nov 15 08:12:51 user nova-compute[95467]:     <model fallback='forbid'>Nehalem</model>
Nov 15 08:12:51 user nova-compute[95467]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 15 08:12:51 user nova-compute[95467]:     <feature policy='require' name='vme'/>
Nov 15 08:12:51 user nova-compute[95467]:     <feature policy='require' name='x2apic'/>
Nov 15 08:12:51 user nova-compute[95467]:     <feature policy='require' name='hypervisor'/>
Nov 15 08:12:51 user nova-compute[95467]:   </cpu>
Nov 15 08:12:51 user nova-compute[95467]:   <clock offset='utc'>
Nov 15 08:12:51 user nova-compute[95467]:     <timer name='pit' tickpolicy='delay'/>
Nov 15 08:12:51 user nova-compute[95467]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 15 08:12:51 user nova-compute[95467]:     <timer name='hpet' present='no'/>
Nov 15 08:12:51 user nova-compute[95467]:   </clock>
Nov 15 08:12:51 user nova-compute[95467]:   <on_poweroff>destroy</on_poweroff>
Nov 15 08:12:51 user nova-compute[95467]:   <on_reboot>restart</on_reboot>
Nov 15 08:12:51 user nova-compute[95467]:   <on_crash>destroy</on_crash>
Nov 15 08:12:51 user nova-compute[95467]:   <devices>
Nov 15 08:12:51 user nova-compute[95467]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 15 08:12:51 user nova-compute[95467]:     <disk type='file' device='disk'>
Nov 15 08:12:51 user nova-compute[95467]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 15 08:12:51 user nova-compute[95467]:       <source file='/opt/stack/data/nova/instances/0917b083-2bbf-4baf-a0b8-d59ba3e2256b/disk' index='2'/>
Nov 15 08:12:51 user nova-compute[95467]:       <backingStore type='file' index='3'>
Nov 15 08:12:51 user nova-compute[95467]:         <format type='raw'/>
Nov 15 08:12:51 user nova-compute[95467]:         <source file='/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc'/>
Nov 15 08:12:51 user nova-compute[95467]:         <backingStore/>
Nov 15 08:12:51 user nova-compute[95467]:       </backingStore>
Nov 15 08:12:51 user nova-compute[95467]:       <target dev='vda' bus='virtio'/>
Nov 15 08:12:51 user nova-compute[95467]:       <alias name='virtio-disk0'/>
Nov 15 08:12:51 user nova-compute[95467]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 15 08:12:51 user nova-compute[95467]:     </disk>
Nov 15 08:12:51 user nova-compute[95467]:     <disk type='file' device='cdrom'>
Nov 15 08:12:51 user nova-compute[95467]:       <driver name='qemu' type='raw' cache='none'/>
Nov 15 08:12:51 user nova-compute[95467]:       <source file='/opt/stack/data/nova/instances/0917b083-2bbf-4baf-a0b8-d59ba3e2256b/disk.config' index='1'/>
Nov 15 08:12:51 user nova-compute[95467]:       <backingStore/>
Nov 15 08:12:51 user nova-compute[95467]:       <target dev='hda' bus='ide'/>
Nov 15 08:12:51 user nova-compute[95467]:       <readonly/>
Nov 15 08:12:51 user nova-compute[95467]:       <alias name='ide0-0-0'/>
Nov 15 08:12:51 user nova-compute[95467]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 15 08:12:51 user nova-compute[95467]:     </disk>
Nov 15 08:12:51 user nova-compute[95467]:     <controller type='usb' index='0' model='none'>
Nov 15 08:12:51 user nova-compute[95467]:       <alias name='usb'/>
Nov 15 08:12:51 user nova-compute[95467]:     </controller>
Nov 15 08:12:51 user nova-compute[95467]:     <controller type='pci' index='0' model='pci-root'>
Nov 15 08:12:51 user nova-compute[95467]:       <alias name='pci.0'/>
Nov 15 08:12:51 user nova-compute[95467]:     </controller>
Nov 15 08:12:51 user nova-compute[95467]:     <controller type='ide' index='0'>
Nov 15 08:12:51 user nova-compute[95467]:       <alias name='ide'/>
Nov 15 08:12:51 user nova-compute[95467]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 15 08:12:51 user nova-compute[95467]:     </controller>
Nov 15 08:12:51 user nova-compute[95467]:     <interface type='ethernet'>
Nov 15 08:12:51 user nova-compute[95467]:       <mac address='fa:16:3e:b4:72:56'/>
Nov 15 08:12:51 user nova-compute[95467]:       <target dev='tapf6d25344-c8'/>
Nov 15 08:12:51 user nova-compute[95467]:       <model type='virtio'/>
Nov 15 08:12:51 user nova-compute[95467]:       <mtu size='1442'/>
Nov 15 08:12:51 user nova-compute[95467]:       <alias name='net0'/>
Nov 15 08:12:51 user nova-compute[95467]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 15 08:12:51 user nova-compute[95467]:     </interface>
Nov 15 08:12:51 user nova-compute[95467]:     <interface type='ethernet'>
Nov 15 08:12:51 user nova-compute[95467]:       <mac address='fa:16:3e:79:65:ad'/>
Nov 15 08:12:51 user nova-compute[95467]:       <target dev='tapc5401d35-e2'/>
Nov 15 08:12:51 user nova-compute[95467]:       <model type='virtio'/>
Nov 15 08:12:51 user nova-compute[95467]:       <mtu size='1442'/>
Nov 15 08:12:51 user nova-compute[95467]:       <alias name='net1'/>
Nov 15 08:12:51 user nova-compute[95467]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 15 08:12:51 user nova-compute[95467]:     </interface>
Nov 15 08:12:51 user nova-compute[95467]:     <serial type='pty'>
Nov 15 08:12:51 user nova-compute[95467]:       <source path='/dev/pts/8'/>
Nov 15 08:12:51 user nova-compute[95467]:       <log file='/opt/stack/data/nova/instances/0917b083-2bbf-4baf-a0b8-d59ba3e2256b/console.log' append='off'/>
Nov 15 08:12:51 user nova-compute[95467]:       <target type='isa-serial' port='0'>
Nov 15 08:12:51 user nova-compute[95467]:         <model name='isa-serial'/>
Nov 15 08:12:51 user nova-compute[95467]:       </target>
Nov 15 08:12:51 user nova-compute[95467]:       <alias name='serial0'/>
Nov 15 08:12:51 user nova-compute[95467]:     </serial>
Nov 15 08:12:51 user nova-compute[95467]:     <console type='pty' tty='/dev/pts/8'>
Nov 15 08:12:51 user nova-compute[95467]:       <source path='/dev/pts/8'/>
Nov 15 08:12:51 user nova-compute[95467]:       <log file='/opt/stack/data/nova/instances/0917b083-2bbf-4baf-a0b8-d59ba3e2256b/console.log' append='off'/>
Nov 15 08:12:51 user nova-compute[95467]:       <target type='serial' port='0'/>
Nov 15 08:12:51 user nova-compute[95467]:       <alias name='serial0'/>
Nov 15 08:12:51 user nova-compute[95467]:     </console>
Nov 15 08:12:51 user nova-compute[95467]:     <input type='mouse' bus='ps2'>
Nov 15 08:12:51 user nova-compute[95467]:       <alias name='input0'/>
Nov 15 08:12:51 user nova-compute[95467]:     </input>
Nov 15 08:12:51 user nova-compute[95467]:     <input type='keyboard' bus='ps2'>
Nov 15 08:12:51 user nova-compute[95467]:       <alias name='input1'/>
Nov 15 08:12:51 user nova-compute[95467]:     </input>
Nov 15 08:12:51 user nova-compute[95467]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Nov 15 08:12:51 user nova-compute[95467]:       <listen type='address' address='0.0.0.0'/>
Nov 15 08:12:51 user nova-compute[95467]:     </graphics>
Nov 15 08:12:51 user nova-compute[95467]:     <audio id='1' type='none'/>
Nov 15 08:12:51 user nova-compute[95467]:     <video>
Nov 15 08:12:51 user nova-compute[95467]:       <model type='virtio' heads='1' primary='yes'/>
Nov 15 08:12:51 user nova-compute[95467]:       <alias name='video0'/>
Nov 15 08:12:51 user nova-compute[95467]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 15 08:12:51 user nova-compute[95467]:     </video>
Nov 15 08:12:51 user nova-compute[95467]:     <memballoon model='virtio'>
Nov 15 08:12:51 user nova-compute[95467]:       <stats period='10'/>
Nov 15 08:12:51 user nova-compute[95467]:       <alias name='balloon0'/>
Nov 15 08:12:51 user nova-compute[95467]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 15 08:12:51 user nova-compute[95467]:     </memballoon>
Nov 15 08:12:51 user nova-compute[95467]:     <rng model='virtio'>
Nov 15 08:12:51 user nova-compute[95467]:       <backend model='random'>/dev/urandom</backend>
Nov 15 08:12:51 user nova-compute[95467]:       <alias name='rng0'/>
Nov 15 08:12:51 user nova-compute[95467]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 15 08:12:51 user nova-compute[95467]:     </rng>
Nov 15 08:12:51 user nova-compute[95467]:   </devices>
Nov 15 08:12:51 user nova-compute[95467]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 15 08:12:51 user nova-compute[95467]:     <label>libvirt-0917b083-2bbf-4baf-a0b8-d59ba3e2256b</label>
Nov 15 08:12:51 user nova-compute[95467]:     <imagelabel>libvirt-0917b083-2bbf-4baf-a0b8-d59ba3e2256b</imagelabel>
Nov 15 08:12:51 user nova-compute[95467]:   </seclabel>
Nov 15 08:12:51 user nova-compute[95467]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 15 08:12:51 user nova-compute[95467]:     <label>+64055:+108</label>
Nov 15 08:12:51 user nova-compute[95467]:     <imagelabel>+64055:+108</imagelabel>
Nov 15 08:12:51 user nova-compute[95467]:   </seclabel>
Nov 15 08:12:51 user nova-compute[95467]: </domain>
Nov 15 08:12:51 user nova-compute[95467]:  {{(pid=95467) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 15 08:12:51 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-96d7cc5d-4226-460b-8182-0c3a169aebb7 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Successfully detached device tapc5401d35-e2 from instance 0917b083-2bbf-4baf-a0b8-d59ba3e2256b from the persistent domain config.
Nov 15 08:12:51 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-96d7cc5d-4226-460b-8182-0c3a169aebb7 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] (1/8): Attempting to detach device tapc5401d35-e2 with device alias net1 from instance 0917b083-2bbf-4baf-a0b8-d59ba3e2256b from the live domain config. {{(pid=95467) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 08:12:51 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-96d7cc5d-4226-460b-8182-0c3a169aebb7 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] detach device xml: <interface type="ethernet">
Nov 15 08:12:51 user nova-compute[95467]:   <mac address="fa:16:3e:79:65:ad"/>
Nov 15 08:12:51 user nova-compute[95467]:   <model type="virtio"/>
Nov 15 08:12:51 user nova-compute[95467]:   <mtu size="1442"/>
Nov 15 08:12:51 user nova-compute[95467]:   <target dev="tapc5401d35-e2"/>
Nov 15 08:12:51 user nova-compute[95467]: </interface>
Nov 15 08:12:51 user nova-compute[95467]:  {{(pid=95467) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 08:12:51 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-96d7cc5d-4226-460b-8182-0c3a169aebb7 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Start waiting for the detach event from libvirt for device tapc5401d35-e2 with device alias net1 for instance 0917b083-2bbf-4baf-a0b8-d59ba3e2256b {{(pid=95467) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 08:12:51 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:51 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-37f4bd6b-f8fd-477a-a87d-82dabe6ec074 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a {{(pid=95467) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 08:12:51 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:51 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:51 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:51 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:51 user nova-compute[95467]: DEBUG nova.compute.manager [req-d75227d2-0fc5-41d2-8464-6bd7331bb03a req-fa350bf7-aba1-4966-b914-6c23e4293dac service nova] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Received event network-vif-unplugged-c5401d35-e26c-4291-8a19-520a5ece891e {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:12:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-d75227d2-0fc5-41d2-8464-6bd7331bb03a req-fa350bf7-aba1-4966-b914-6c23e4293dac service nova] Acquiring lock "0917b083-2bbf-4baf-a0b8-d59ba3e2256b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:12:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-d75227d2-0fc5-41d2-8464-6bd7331bb03a req-fa350bf7-aba1-4966-b914-6c23e4293dac service nova] Lock "0917b083-2bbf-4baf-a0b8-d59ba3e2256b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:12:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-d75227d2-0fc5-41d2-8464-6bd7331bb03a req-fa350bf7-aba1-4966-b914-6c23e4293dac service nova] Lock "0917b083-2bbf-4baf-a0b8-d59ba3e2256b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:12:51 user nova-compute[95467]: DEBUG nova.compute.manager [req-d75227d2-0fc5-41d2-8464-6bd7331bb03a req-fa350bf7-aba1-4966-b914-6c23e4293dac service nova] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] No waiting events found dispatching network-vif-unplugged-c5401d35-e26c-4291-8a19-520a5ece891e {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:12:51 user nova-compute[95467]: WARNING nova.compute.manager [req-d75227d2-0fc5-41d2-8464-6bd7331bb03a req-fa350bf7-aba1-4966-b914-6c23e4293dac service nova] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Received unexpected event network-vif-unplugged-c5401d35-e26c-4291-8a19-520a5ece891e for instance with vm_state active and task_state None.
Nov 15 08:12:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:53 user nova-compute[95467]: DEBUG nova.compute.manager [req-fb06c957-faa8-417b-8c6e-2fc236694604 req-a4895fbe-0fd3-46d8-9be6-c23dcfeb9cea service nova] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Received event network-vif-plugged-c5401d35-e26c-4291-8a19-520a5ece891e {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:12:53 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-fb06c957-faa8-417b-8c6e-2fc236694604 req-a4895fbe-0fd3-46d8-9be6-c23dcfeb9cea service nova] Acquiring lock "0917b083-2bbf-4baf-a0b8-d59ba3e2256b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:12:53 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-fb06c957-faa8-417b-8c6e-2fc236694604 req-a4895fbe-0fd3-46d8-9be6-c23dcfeb9cea service nova] Lock "0917b083-2bbf-4baf-a0b8-d59ba3e2256b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:12:53 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-fb06c957-faa8-417b-8c6e-2fc236694604 req-a4895fbe-0fd3-46d8-9be6-c23dcfeb9cea service nova] Lock "0917b083-2bbf-4baf-a0b8-d59ba3e2256b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:12:53 user nova-compute[95467]: DEBUG nova.compute.manager [req-fb06c957-faa8-417b-8c6e-2fc236694604 req-a4895fbe-0fd3-46d8-9be6-c23dcfeb9cea service nova] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] No waiting events found dispatching network-vif-plugged-c5401d35-e26c-4291-8a19-520a5ece891e {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:12:53 user nova-compute[95467]: WARNING nova.compute.manager [req-fb06c957-faa8-417b-8c6e-2fc236694604 req-a4895fbe-0fd3-46d8-9be6-c23dcfeb9cea service nova] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Received unexpected event network-vif-plugged-c5401d35-e26c-4291-8a19-520a5ece891e for instance with vm_state active and task_state None.
Nov 15 08:12:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Acquiring lock "21cf2ada-b15c-490d-ac37-96e9c87e9056" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:12:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "21cf2ada-b15c-490d-ac37-96e9c87e9056" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:12:54 user nova-compute[95467]: DEBUG nova.compute.manager [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Starting instance... {{(pid=95467) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 08:12:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:12:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:12:54 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=95467) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 08:12:54 user nova-compute[95467]: INFO nova.compute.claims [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Claim successful on node user
Nov 15 08:12:55 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:12:55 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:12:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.479s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:12:55 user nova-compute[95467]: DEBUG nova.compute.manager [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Start building networks asynchronously for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 08:12:55 user nova-compute[95467]: DEBUG nova.compute.manager [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Allocating IP information in the background. {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 08:12:55 user nova-compute[95467]: DEBUG nova.network.neutron [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] allocate_for_instance() {{(pid=95467) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 08:12:55 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 08:12:55 user nova-compute[95467]: DEBUG nova.compute.manager [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Start building block device mappings for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 08:12:55 user nova-compute[95467]: DEBUG nova.policy [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6971581ab2604353aeb0c45c5252b4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c34d65a8000347feb2b3966b7ce0d785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95467) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 08:12:55 user nova-compute[95467]: DEBUG nova.compute.manager [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Start spawning the instance on the hypervisor. {{(pid=95467) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 08:12:55 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Creating instance directory {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 08:12:55 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Creating image(s)
Nov 15 08:12:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Acquiring lock "/opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:12:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "/opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:12:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "/opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:12:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.176s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Acquiring lock "a3fcf60225fcefd310404971cd18ab9851c548dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:12:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:12:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.173s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk 1073741824 {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk 1073741824" returned: 0 in 0.056s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:12:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:55 user nova-compute[95467]: DEBUG nova.network.neutron [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Successfully created port: 1e52d31b-a56a-41e1-8a39-b79dacfe70b9 {{(pid=95467) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 08:12:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.181s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:55 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Checking if we can resize image /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk. size=1073741824 {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 08:12:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:12:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:12:56 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Cannot resize image /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk to a smaller size. {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 08:12:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Created local disks {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 08:12:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Ensure instance console log exists: /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/console.log {{(pid=95467) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 08:12:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:12:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:12:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:12:56 user nova-compute[95467]: DEBUG nova.network.neutron [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Successfully updated port: 1e52d31b-a56a-41e1-8a39-b79dacfe70b9 {{(pid=95467) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 08:12:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Acquiring lock "refresh_cache-21cf2ada-b15c-490d-ac37-96e9c87e9056" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:12:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Acquired lock "refresh_cache-21cf2ada-b15c-490d-ac37-96e9c87e9056" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:12:56 user nova-compute[95467]: DEBUG nova.network.neutron [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:12:56 user nova-compute[95467]: DEBUG nova.compute.manager [req-6cb78378-e82f-4c00-be05-4cab4cf3ad69 req-ef1a7df9-98d4-4a49-9c1e-924f17ae8bb1 service nova] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Received event network-changed-1e52d31b-a56a-41e1-8a39-b79dacfe70b9 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:12:56 user nova-compute[95467]: DEBUG nova.compute.manager [req-6cb78378-e82f-4c00-be05-4cab4cf3ad69 req-ef1a7df9-98d4-4a49-9c1e-924f17ae8bb1 service nova] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Refreshing instance network info cache due to event network-changed-1e52d31b-a56a-41e1-8a39-b79dacfe70b9. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:12:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-6cb78378-e82f-4c00-be05-4cab4cf3ad69 req-ef1a7df9-98d4-4a49-9c1e-924f17ae8bb1 service nova] Acquiring lock "refresh_cache-21cf2ada-b15c-490d-ac37-96e9c87e9056" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:12:56 user nova-compute[95467]: DEBUG nova.network.neutron [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Instance cache missing network info. {{(pid=95467) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 08:12:56 user nova-compute[95467]: DEBUG nova.network.neutron [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Updating instance_info_cache with network_info: [{"id": "1e52d31b-a56a-41e1-8a39-b79dacfe70b9", "address": "fa:16:3e:7f:8e:61", "network": {"id": "ac9a381d-25fe-4419-b151-f03333413813", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1183680999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34d65a8000347feb2b3966b7ce0d785", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e52d31b-a5", "ovs_interfaceid": "1e52d31b-a56a-41e1-8a39-b79dacfe70b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:12:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Releasing lock "refresh_cache-21cf2ada-b15c-490d-ac37-96e9c87e9056" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:12:56 user nova-compute[95467]: DEBUG nova.compute.manager [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Instance network_info: |[{"id": "1e52d31b-a56a-41e1-8a39-b79dacfe70b9", "address": "fa:16:3e:7f:8e:61", "network": {"id": "ac9a381d-25fe-4419-b151-f03333413813", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1183680999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34d65a8000347feb2b3966b7ce0d785", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e52d31b-a5", "ovs_interfaceid": "1e52d31b-a56a-41e1-8a39-b79dacfe70b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 08:12:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-6cb78378-e82f-4c00-be05-4cab4cf3ad69 req-ef1a7df9-98d4-4a49-9c1e-924f17ae8bb1 service nova] Acquired lock "refresh_cache-21cf2ada-b15c-490d-ac37-96e9c87e9056" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:12:56 user nova-compute[95467]: DEBUG nova.network.neutron [req-6cb78378-e82f-4c00-be05-4cab4cf3ad69 req-ef1a7df9-98d4-4a49-9c1e-924f17ae8bb1 service nova] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Refreshing network info cache for port 1e52d31b-a56a-41e1-8a39-b79dacfe70b9 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:12:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Start _get_guest_xml network_info=[{"id": "1e52d31b-a56a-41e1-8a39-b79dacfe70b9", "address": "fa:16:3e:7f:8e:61", "network": {"id": "ac9a381d-25fe-4419-b151-f03333413813", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1183680999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34d65a8000347feb2b3966b7ce0d785", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e52d31b-a5", "ovs_interfaceid": "1e52d31b-a56a-41e1-8a39-b79dacfe70b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'ed9c48aa-ce73-4b3b-9db1-235898be671b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:12:56 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:12:56 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:12:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:12:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:12:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:12:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:12:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:12:56 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:12:56 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:12:56 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:12:56 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:12:56 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:12:56 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:12:56 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:12:56 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:12:56 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:12:56 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:12:56 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:12:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:12:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1521441653',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1521441653',id=15,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c34d65a8000347feb2b3966b7ce0d785',ramdisk_id='',reservation_id='r-mu80gu5r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1903830225',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:12:55Z,user_data=None,user_id='6971581ab2604353aeb0c45c5252b4fb',uuid=21cf2ada-b15c-490d-ac37-96e9c87e9056,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e52d31b-a56a-41e1-8a39-b79dacfe70b9", "address": "fa:16:3e:7f:8e:61", "network": {"id": "ac9a381d-25fe-4419-b151-f03333413813", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1183680999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34d65a8000347feb2b3966b7ce0d785", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e52d31b-a5", "ovs_interfaceid": "1e52d31b-a56a-41e1-8a39-b79dacfe70b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:12:56 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Converting VIF {"id": "1e52d31b-a56a-41e1-8a39-b79dacfe70b9", "address": "fa:16:3e:7f:8e:61", "network": {"id": "ac9a381d-25fe-4419-b151-f03333413813", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1183680999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34d65a8000347feb2b3966b7ce0d785", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e52d31b-a5", "ovs_interfaceid": "1e52d31b-a56a-41e1-8a39-b79dacfe70b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:12:56 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:8e:61,bridge_name='br-int',has_traffic_filtering=True,id=1e52d31b-a56a-41e1-8a39-b79dacfe70b9,network=Network(ac9a381d-25fe-4419-b151-f03333413813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e52d31b-a5') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:12:56 user nova-compute[95467]: DEBUG nova.objects.instance [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lazy-loading 'pci_devices' on Instance uuid 21cf2ada-b15c-490d-ac37-96e9c87e9056 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:12:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:12:56 user nova-compute[95467]:   <uuid>21cf2ada-b15c-490d-ac37-96e9c87e9056</uuid>
Nov 15 08:12:56 user nova-compute[95467]:   <name>instance-0000000f</name>
Nov 15 08:12:56 user nova-compute[95467]:   <memory>524288</memory>
Nov 15 08:12:56 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:12:56 user nova-compute[95467]:   <metadata>
Nov 15 08:12:56 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:12:56 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:12:56 user nova-compute[95467]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1521441653</nova:name>
Nov 15 08:12:56 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:12:56</nova:creationTime>
Nov 15 08:12:56 user nova-compute[95467]:       <nova:flavor name="m1.tiny">
Nov 15 08:12:56 user nova-compute[95467]:         <nova:memory>512</nova:memory>
Nov 15 08:12:56 user nova-compute[95467]:         <nova:disk>1</nova:disk>
Nov 15 08:12:56 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:12:56 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:12:56 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:12:56 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:12:56 user nova-compute[95467]:       <nova:owner>
Nov 15 08:12:56 user nova-compute[95467]:         <nova:user uuid="6971581ab2604353aeb0c45c5252b4fb">tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member</nova:user>
Nov 15 08:12:56 user nova-compute[95467]:         <nova:project uuid="c34d65a8000347feb2b3966b7ce0d785">tempest-ServerBootFromVolumeStableRescueTest-1903830225</nova:project>
Nov 15 08:12:56 user nova-compute[95467]:       </nova:owner>
Nov 15 08:12:56 user nova-compute[95467]:       <nova:root type="image" uuid="ed9c48aa-ce73-4b3b-9db1-235898be671b"/>
Nov 15 08:12:56 user nova-compute[95467]:       <nova:ports>
Nov 15 08:12:56 user nova-compute[95467]:         <nova:port uuid="1e52d31b-a56a-41e1-8a39-b79dacfe70b9">
Nov 15 08:12:56 user nova-compute[95467]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 08:12:56 user nova-compute[95467]:         </nova:port>
Nov 15 08:12:56 user nova-compute[95467]:       </nova:ports>
Nov 15 08:12:56 user nova-compute[95467]:     </nova:instance>
Nov 15 08:12:56 user nova-compute[95467]:   </metadata>
Nov 15 08:12:56 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:12:56 user nova-compute[95467]:     <system>
Nov 15 08:12:56 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:12:56 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:12:56 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:12:56 user nova-compute[95467]:       <entry name="serial">21cf2ada-b15c-490d-ac37-96e9c87e9056</entry>
Nov 15 08:12:56 user nova-compute[95467]:       <entry name="uuid">21cf2ada-b15c-490d-ac37-96e9c87e9056</entry>
Nov 15 08:12:56 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:12:56 user nova-compute[95467]:     </system>
Nov 15 08:12:56 user nova-compute[95467]:   </sysinfo>
Nov 15 08:12:56 user nova-compute[95467]:   <os>
Nov 15 08:12:56 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:12:56 user nova-compute[95467]:     <boot dev="hd"/>
Nov 15 08:12:56 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:12:56 user nova-compute[95467]:   </os>
Nov 15 08:12:56 user nova-compute[95467]:   <features>
Nov 15 08:12:56 user nova-compute[95467]:     <acpi/>
Nov 15 08:12:56 user nova-compute[95467]:     <apic/>
Nov 15 08:12:56 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:12:56 user nova-compute[95467]:   </features>
Nov 15 08:12:56 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:12:56 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:12:56 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:12:56 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:12:56 user nova-compute[95467]:   </clock>
Nov 15 08:12:56 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:12:56 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:12:56 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:12:56 user nova-compute[95467]:   </cpu>
Nov 15 08:12:56 user nova-compute[95467]:   <devices>
Nov 15 08:12:56 user nova-compute[95467]:     <disk type="file" device="disk">
Nov 15 08:12:56 user nova-compute[95467]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 08:12:56 user nova-compute[95467]:       <source file="/opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk"/>
Nov 15 08:12:56 user nova-compute[95467]:       <target dev="vda" bus="virtio"/>
Nov 15 08:12:56 user nova-compute[95467]:     </disk>
Nov 15 08:12:56 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:12:56 user nova-compute[95467]:       <mac address="fa:16:3e:7f:8e:61"/>
Nov 15 08:12:56 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:12:56 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:12:56 user nova-compute[95467]:       <target dev="tap1e52d31b-a5"/>
Nov 15 08:12:56 user nova-compute[95467]:     </interface>
Nov 15 08:12:56 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:12:56 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/console.log" append="off"/>
Nov 15 08:12:56 user nova-compute[95467]:     </serial>
Nov 15 08:12:56 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:12:56 user nova-compute[95467]:     <video>
Nov 15 08:12:56 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:12:56 user nova-compute[95467]:     </video>
Nov 15 08:12:56 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:12:56 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:12:56 user nova-compute[95467]:     </rng>
Nov 15 08:12:56 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:12:56 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:12:56 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:12:56 user nova-compute[95467]:     </memballoon>
Nov 15 08:12:56 user nova-compute[95467]:   </devices>
Nov 15 08:12:56 user nova-compute[95467]: </domain>
Nov 15 08:12:56 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:12:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:12:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1521441653',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1521441653',id=15,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c34d65a8000347feb2b3966b7ce0d785',ramdisk_id='',reservation_id='r-mu80gu5r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1903830225',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:12:55Z,user_data=None,user_id='6971581ab2604353aeb0c45c5252b4fb',uuid=21cf2ada-b15c-490d-ac37-96e9c87e9056,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e52d31b-a56a-41e1-8a39-b79dacfe70b9", "address": "fa:16:3e:7f:8e:61", "network": {"id": "ac9a381d-25fe-4419-b151-f03333413813", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1183680999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34d65a8000347feb2b3966b7ce0d785", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e52d31b-a5", "ovs_interfaceid": "1e52d31b-a56a-41e1-8a39-b79dacfe70b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:12:56 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Converting VIF {"id": "1e52d31b-a56a-41e1-8a39-b79dacfe70b9", "address": "fa:16:3e:7f:8e:61", "network": {"id": "ac9a381d-25fe-4419-b151-f03333413813", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1183680999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34d65a8000347feb2b3966b7ce0d785", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e52d31b-a5", "ovs_interfaceid": "1e52d31b-a56a-41e1-8a39-b79dacfe70b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:12:56 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:8e:61,bridge_name='br-int',has_traffic_filtering=True,id=1e52d31b-a56a-41e1-8a39-b79dacfe70b9,network=Network(ac9a381d-25fe-4419-b151-f03333413813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e52d31b-a5') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:12:56 user nova-compute[95467]: DEBUG os_vif [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:8e:61,bridge_name='br-int',has_traffic_filtering=True,id=1e52d31b-a56a-41e1-8a39-b79dacfe70b9,network=Network(ac9a381d-25fe-4419-b151-f03333413813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e52d31b-a5') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:12:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:12:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:12:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '45157711-d69d-56e4-bb00-af5daf7b5c49', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:12:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:12:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1e52d31b-a5, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:12:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1e52d31b-a5, col_values=(('qos', UUID('23e60d41-5986-4068-a585-b19b59fa70e2')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:12:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1e52d31b-a5, col_values=(('external_ids', {'iface-id': '1e52d31b-a56a-41e1-8a39-b79dacfe70b9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:8e:61', 'vm-uuid': '21cf2ada-b15c-490d-ac37-96e9c87e9056'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:12:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:12:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:56 user nova-compute[95467]: INFO os_vif [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:8e:61,bridge_name='br-int',has_traffic_filtering=True,id=1e52d31b-a56a-41e1-8a39-b79dacfe70b9,network=Network(ac9a381d-25fe-4419-b151-f03333413813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e52d31b-a5')
Nov 15 08:12:57 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:12:57 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] No VIF found with MAC fa:16:3e:7f:8e:61, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:12:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:57 user nova-compute[95467]: DEBUG nova.network.neutron [req-6cb78378-e82f-4c00-be05-4cab4cf3ad69 req-ef1a7df9-98d4-4a49-9c1e-924f17ae8bb1 service nova] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Updated VIF entry in instance network info cache for port 1e52d31b-a56a-41e1-8a39-b79dacfe70b9. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:12:57 user nova-compute[95467]: DEBUG nova.network.neutron [req-6cb78378-e82f-4c00-be05-4cab4cf3ad69 req-ef1a7df9-98d4-4a49-9c1e-924f17ae8bb1 service nova] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Updating instance_info_cache with network_info: [{"id": "1e52d31b-a56a-41e1-8a39-b79dacfe70b9", "address": "fa:16:3e:7f:8e:61", "network": {"id": "ac9a381d-25fe-4419-b151-f03333413813", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1183680999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34d65a8000347feb2b3966b7ce0d785", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e52d31b-a5", "ovs_interfaceid": "1e52d31b-a56a-41e1-8a39-b79dacfe70b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:12:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-6cb78378-e82f-4c00-be05-4cab4cf3ad69 req-ef1a7df9-98d4-4a49-9c1e-924f17ae8bb1 service nova] Releasing lock "refresh_cache-21cf2ada-b15c-490d-ac37-96e9c87e9056" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:12:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:12:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:00 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Acquiring lock "35bbed35-d10e-4637-b673-754a85f9d2ff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:13:00 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Lock "35bbed35-d10e-4637-b673-754a85f9d2ff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:13:00 user nova-compute[95467]: DEBUG nova.compute.manager [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 35bbed35-d10e-4637-b673-754a85f9d2ff] Starting instance... {{(pid=95467) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 08:13:00 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:13:00 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:13:00 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=95467) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 08:13:00 user nova-compute[95467]: INFO nova.compute.claims [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 35bbed35-d10e-4637-b673-754a85f9d2ff] Claim successful on node user
Nov 15 08:13:00 user nova-compute[95467]: DEBUG nova.compute.manager [req-1e5ac8d8-527a-4e5a-80e7-d24dd56b2849 req-26259341-a415-49f5-9b31-51fb1d1fefa6 service nova] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Received event network-vif-plugged-1e52d31b-a56a-41e1-8a39-b79dacfe70b9 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:13:00 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-1e5ac8d8-527a-4e5a-80e7-d24dd56b2849 req-26259341-a415-49f5-9b31-51fb1d1fefa6 service nova] Acquiring lock "21cf2ada-b15c-490d-ac37-96e9c87e9056-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:13:00 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-1e5ac8d8-527a-4e5a-80e7-d24dd56b2849 req-26259341-a415-49f5-9b31-51fb1d1fefa6 service nova] Lock "21cf2ada-b15c-490d-ac37-96e9c87e9056-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:13:00 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-1e5ac8d8-527a-4e5a-80e7-d24dd56b2849 req-26259341-a415-49f5-9b31-51fb1d1fefa6 service nova] Lock "21cf2ada-b15c-490d-ac37-96e9c87e9056-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:13:00 user nova-compute[95467]: DEBUG nova.compute.manager [req-1e5ac8d8-527a-4e5a-80e7-d24dd56b2849 req-26259341-a415-49f5-9b31-51fb1d1fefa6 service nova] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] No waiting events found dispatching network-vif-plugged-1e52d31b-a56a-41e1-8a39-b79dacfe70b9 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:13:00 user nova-compute[95467]: WARNING nova.compute.manager [req-1e5ac8d8-527a-4e5a-80e7-d24dd56b2849 req-26259341-a415-49f5-9b31-51fb1d1fefa6 service nova] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Received unexpected event network-vif-plugged-1e52d31b-a56a-41e1-8a39-b79dacfe70b9 for instance with vm_state building and task_state spawning.
Nov 15 08:13:00 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:13:00 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:13:00 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.525s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:13:00 user nova-compute[95467]: DEBUG nova.compute.manager [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 35bbed35-d10e-4637-b673-754a85f9d2ff] Start building networks asynchronously for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 08:13:00 user nova-compute[95467]: DEBUG nova.compute.manager [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 35bbed35-d10e-4637-b673-754a85f9d2ff] Allocating IP information in the background. {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 08:13:00 user nova-compute[95467]: DEBUG nova.network.neutron [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 35bbed35-d10e-4637-b673-754a85f9d2ff] allocate_for_instance() {{(pid=95467) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 08:13:00 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 35bbed35-d10e-4637-b673-754a85f9d2ff] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 08:13:00 user nova-compute[95467]: DEBUG nova.compute.manager [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 35bbed35-d10e-4637-b673-754a85f9d2ff] Start building block device mappings for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 08:13:00 user nova-compute[95467]: DEBUG nova.compute.manager [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Instance event wait completed in 0 seconds for  {{(pid=95467) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 08:13:00 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Guest created on hypervisor {{(pid=95467) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 08:13:00 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Instance spawned successfully.
Nov 15 08:13:00 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 08:13:00 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Found default for hw_cdrom_bus of ide {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:13:00 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Found default for hw_disk_bus of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:13:00 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Found default for hw_input_bus of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:13:00 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Found default for hw_pointer_model of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:13:00 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Found default for hw_video_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:13:00 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Found default for hw_vif_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:13:00 user nova-compute[95467]: DEBUG nova.policy [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '331b706f494247759f827dbb1efcb663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f1d989dd2242bfad9c3a5d7380c887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95467) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 08:13:01 user nova-compute[95467]: INFO nova.compute.manager [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Took 5.67 seconds to spawn the instance on the hypervisor.
Nov 15 08:13:01 user nova-compute[95467]: DEBUG nova.compute.manager [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:13:01 user nova-compute[95467]: DEBUG nova.compute.manager [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 35bbed35-d10e-4637-b673-754a85f9d2ff] Start spawning the instance on the hypervisor. {{(pid=95467) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 08:13:01 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 35bbed35-d10e-4637-b673-754a85f9d2ff] Creating instance directory {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 08:13:01 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 35bbed35-d10e-4637-b673-754a85f9d2ff] Creating image(s)
Nov 15 08:13:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Acquiring lock "/opt/stack/data/nova/instances/35bbed35-d10e-4637-b673-754a85f9d2ff/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:13:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Lock "/opt/stack/data/nova/instances/35bbed35-d10e-4637-b673-754a85f9d2ff/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:13:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Lock "/opt/stack/data/nova/instances/35bbed35-d10e-4637-b673-754a85f9d2ff/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:13:01 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:01 user nova-compute[95467]: INFO nova.compute.manager [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Took 6.46 seconds to build instance.
Nov 15 08:13:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-340a2324-b01d-4c7e-aaf3-93625d8fb8fd tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "21cf2ada-b15c-490d-ac37-96e9c87e9056" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.639s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:13:01 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.167s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:13:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Acquiring lock "a3fcf60225fcefd310404971cd18ab9851c548dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:13:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:13:01 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:01 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.185s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:13:01 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/35bbed35-d10e-4637-b673-754a85f9d2ff/disk 1073741824 {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:01 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/35bbed35-d10e-4637-b673-754a85f9d2ff/disk 1073741824" returned: 0 in 0.048s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:13:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:13:01 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:01 user nova-compute[95467]: DEBUG nova.network.neutron [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 35bbed35-d10e-4637-b673-754a85f9d2ff] Successfully created port: df2a067b-ea66-44ff-9b4c-c1a738e193b0 {{(pid=95467) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 08:13:01 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.179s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:13:01 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Checking if we can resize image /opt/stack/data/nova/instances/35bbed35-d10e-4637-b673-754a85f9d2ff/disk. size=1073741824 {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 08:13:01 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35bbed35-d10e-4637-b673-754a85f9d2ff/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:01 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35bbed35-d10e-4637-b673-754a85f9d2ff/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:13:01 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Cannot resize image /opt/stack/data/nova/instances/35bbed35-d10e-4637-b673-754a85f9d2ff/disk to a smaller size. {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 08:13:01 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 35bbed35-d10e-4637-b673-754a85f9d2ff] Created local disks {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 08:13:01 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 35bbed35-d10e-4637-b673-754a85f9d2ff] Ensure instance console log exists: /opt/stack/data/nova/instances/35bbed35-d10e-4637-b673-754a85f9d2ff/console.log {{(pid=95467) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 08:13:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:13:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:13:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:13:01 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:02 user nova-compute[95467]: DEBUG nova.network.neutron [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 35bbed35-d10e-4637-b673-754a85f9d2ff] Successfully updated port: df2a067b-ea66-44ff-9b4c-c1a738e193b0 {{(pid=95467) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 08:13:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Acquiring lock "refresh_cache-35bbed35-d10e-4637-b673-754a85f9d2ff" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:13:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Acquired lock "refresh_cache-35bbed35-d10e-4637-b673-754a85f9d2ff" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:13:02 user nova-compute[95467]: DEBUG nova.network.neutron [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 35bbed35-d10e-4637-b673-754a85f9d2ff] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:13:02 user nova-compute[95467]: DEBUG nova.network.neutron [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 35bbed35-d10e-4637-b673-754a85f9d2ff] Instance cache missing network info. {{(pid=95467) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 08:13:02 user nova-compute[95467]: DEBUG nova.compute.manager [req-83adad8c-2c02-46be-ba3c-935f78fe4ca2 req-8367ba54-30aa-44fe-b9c8-16d89e778748 service nova] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Received event network-vif-plugged-1e52d31b-a56a-41e1-8a39-b79dacfe70b9 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:13:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-83adad8c-2c02-46be-ba3c-935f78fe4ca2 req-8367ba54-30aa-44fe-b9c8-16d89e778748 service nova] Acquiring lock "21cf2ada-b15c-490d-ac37-96e9c87e9056-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:13:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-83adad8c-2c02-46be-ba3c-935f78fe4ca2 req-8367ba54-30aa-44fe-b9c8-16d89e778748 service nova] Lock "21cf2ada-b15c-490d-ac37-96e9c87e9056-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:13:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-83adad8c-2c02-46be-ba3c-935f78fe4ca2 req-8367ba54-30aa-44fe-b9c8-16d89e778748 service nova] Lock "21cf2ada-b15c-490d-ac37-96e9c87e9056-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:13:02 user nova-compute[95467]: DEBUG nova.compute.manager [req-83adad8c-2c02-46be-ba3c-935f78fe4ca2 req-8367ba54-30aa-44fe-b9c8-16d89e778748 service nova] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] No waiting events found dispatching network-vif-plugged-1e52d31b-a56a-41e1-8a39-b79dacfe70b9 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:13:02 user nova-compute[95467]: WARNING nova.compute.manager [req-83adad8c-2c02-46be-ba3c-935f78fe4ca2 req-8367ba54-30aa-44fe-b9c8-16d89e778748 service nova] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Received unexpected event network-vif-plugged-1e52d31b-a56a-41e1-8a39-b79dacfe70b9 for instance with vm_state active and task_state None.
Nov 15 08:13:02 user nova-compute[95467]: DEBUG nova.compute.manager [req-83adad8c-2c02-46be-ba3c-935f78fe4ca2 req-8367ba54-30aa-44fe-b9c8-16d89e778748 service nova] [instance: 35bbed35-d10e-4637-b673-754a85f9d2ff] Received event network-changed-df2a067b-ea66-44ff-9b4c-c1a738e193b0 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:13:02 user nova-compute[95467]: DEBUG nova.compute.manager [req-83adad8c-2c02-46be-ba3c-935f78fe4ca2 req-8367ba54-30aa-44fe-b9c8-16d89e778748 service nova] [instance: 35bbed35-d10e-4637-b673-754a85f9d2ff] Refreshing instance network info cache due to event network-changed-df2a067b-ea66-44ff-9b4c-c1a738e193b0. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:13:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-83adad8c-2c02-46be-ba3c-935f78fe4ca2 req-8367ba54-30aa-44fe-b9c8-16d89e778748 service nova] Acquiring lock "refresh_cache-35bbed35-d10e-4637-b673-754a85f9d2ff" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:13:02 user nova-compute[95467]: DEBUG nova.network.neutron [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 35bbed35-d10e-4637-b673-754a85f9d2ff] Updating instance_info_cache with network_info: [{"id": "df2a067b-ea66-44ff-9b4c-c1a738e193b0", "address": "fa:16:3e:67:3f:73", "network": {"id": "4e5f387a-ee4d-4e5b-bbb3-0d3af738de45", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-839692973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6f1d989dd2242bfad9c3a5d7380c887", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf2a067b-ea", "ovs_interfaceid": "df2a067b-ea66-44ff-9b4c-c1a738e193b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:13:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Releasing lock "refresh_cache-35bbed35-d10e-4637-b673-754a85f9d2ff" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:13:02 user nova-compute[95467]: DEBUG nova.compute.manager [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 35bbed35-d10e-4637-b673-754a85f9d2ff] Instance network_info: |[{"id": "df2a067b-ea66-44ff-9b4c-c1a738e193b0", "address": "fa:16:3e:67:3f:73", "network": {"id": "4e5f387a-ee4d-4e5b-bbb3-0d3af738de45", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-839692973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6f1d989dd2242bfad9c3a5d7380c887", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf2a067b-ea", "ovs_interfaceid": "df2a067b-ea66-44ff-9b4c-c1a738e193b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 08:13:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-83adad8c-2c02-46be-ba3c-935f78fe4ca2 req-8367ba54-30aa-44fe-b9c8-16d89e778748 service nova] Acquired lock "refresh_cache-35bbed35-d10e-4637-b673-754a85f9d2ff" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:13:02 user nova-compute[95467]: DEBUG nova.network.neutron [req-83adad8c-2c02-46be-ba3c-935f78fe4ca2 req-8367ba54-30aa-44fe-b9c8-16d89e778748 service nova] [instance: 35bbed35-d10e-4637-b673-754a85f9d2ff] Refreshing network info cache for port df2a067b-ea66-44ff-9b4c-c1a738e193b0 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:13:02 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 35bbed35-d10e-4637-b673-754a85f9d2ff] Start _get_guest_xml network_info=[{"id": "df2a067b-ea66-44ff-9b4c-c1a738e193b0", "address": "fa:16:3e:67:3f:73", "network": {"id": "4e5f387a-ee4d-4e5b-bbb3-0d3af738de45", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-839692973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6f1d989dd2242bfad9c3a5d7380c887", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf2a067b-ea", "ovs_interfaceid": "df2a067b-ea66-44ff-9b4c-c1a738e193b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'ed9c48aa-ce73-4b3b-9db1-235898be671b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:13:02 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:13:02 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:13:02 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:13:02 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:13:02 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:13:02 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:13:02 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:13:02 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:13:02 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:13:02 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:13:02 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:13:02 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:13:02 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:13:02 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:13:02 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:13:02 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:13:02 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:13:02 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:13:02 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:12:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1120244885',display_name='tempest-VolumesAdminNegativeTest-server-1120244885',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1120244885',id=16,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6f1d989dd2242bfad9c3a5d7380c887',ramdisk_id='',reservation_id='r-q6v13chn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1724237472',owner_user_name='tempest-VolumesAdminNegativeTest-1724237472-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:13:01Z,user_data=None,user_id='331b706f494247759f827dbb1efcb663',uuid=35bbed35-d10e-4637-b673-754a85f9d2ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df2a067b-ea66-44ff-9b4c-c1a738e193b0", "address": "fa:16:3e:67:3f:73", "network": {"id": "4e5f387a-ee4d-4e5b-bbb3-0d3af738de45", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-839692973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6f1d989dd2242bfad9c3a5d7380c887", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf2a067b-ea", "ovs_interfaceid": "df2a067b-ea66-44ff-9b4c-c1a738e193b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:13:02 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Converting VIF {"id": "df2a067b-ea66-44ff-9b4c-c1a738e193b0", "address": "fa:16:3e:67:3f:73", "network": {"id": "4e5f387a-ee4d-4e5b-bbb3-0d3af738de45", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-839692973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6f1d989dd2242bfad9c3a5d7380c887", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf2a067b-ea", "ovs_interfaceid": "df2a067b-ea66-44ff-9b4c-c1a738e193b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:13:02 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:3f:73,bridge_name='br-int',has_traffic_filtering=True,id=df2a067b-ea66-44ff-9b4c-c1a738e193b0,network=Network(4e5f387a-ee4d-4e5b-bbb3-0d3af738de45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf2a067b-ea') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:13:02 user nova-compute[95467]: DEBUG nova.objects.instance [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Lazy-loading 'pci_devices' on Instance uuid 35bbed35-d10e-4637-b673-754a85f9d2ff {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:13:02 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 35bbed35-d10e-4637-b673-754a85f9d2ff] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:13:02 user nova-compute[95467]:   <uuid>35bbed35-d10e-4637-b673-754a85f9d2ff</uuid>
Nov 15 08:13:02 user nova-compute[95467]:   <name>instance-00000010</name>
Nov 15 08:13:02 user nova-compute[95467]:   <memory>524288</memory>
Nov 15 08:13:02 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:13:02 user nova-compute[95467]:   <metadata>
Nov 15 08:13:02 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:13:02 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:13:02 user nova-compute[95467]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1120244885</nova:name>
Nov 15 08:13:02 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:13:02</nova:creationTime>
Nov 15 08:13:02 user nova-compute[95467]:       <nova:flavor name="m1.tiny">
Nov 15 08:13:02 user nova-compute[95467]:         <nova:memory>512</nova:memory>
Nov 15 08:13:02 user nova-compute[95467]:         <nova:disk>1</nova:disk>
Nov 15 08:13:02 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:13:02 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:13:02 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:13:02 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:13:02 user nova-compute[95467]:       <nova:owner>
Nov 15 08:13:02 user nova-compute[95467]:         <nova:user uuid="331b706f494247759f827dbb1efcb663">tempest-VolumesAdminNegativeTest-1724237472-project-member</nova:user>
Nov 15 08:13:02 user nova-compute[95467]:         <nova:project uuid="d6f1d989dd2242bfad9c3a5d7380c887">tempest-VolumesAdminNegativeTest-1724237472</nova:project>
Nov 15 08:13:02 user nova-compute[95467]:       </nova:owner>
Nov 15 08:13:02 user nova-compute[95467]:       <nova:root type="image" uuid="ed9c48aa-ce73-4b3b-9db1-235898be671b"/>
Nov 15 08:13:02 user nova-compute[95467]:       <nova:ports>
Nov 15 08:13:02 user nova-compute[95467]:         <nova:port uuid="df2a067b-ea66-44ff-9b4c-c1a738e193b0">
Nov 15 08:13:02 user nova-compute[95467]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 08:13:02 user nova-compute[95467]:         </nova:port>
Nov 15 08:13:02 user nova-compute[95467]:       </nova:ports>
Nov 15 08:13:02 user nova-compute[95467]:     </nova:instance>
Nov 15 08:13:02 user nova-compute[95467]:   </metadata>
Nov 15 08:13:02 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:13:02 user nova-compute[95467]:     <system>
Nov 15 08:13:02 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:13:02 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:13:02 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:13:02 user nova-compute[95467]:       <entry name="serial">35bbed35-d10e-4637-b673-754a85f9d2ff</entry>
Nov 15 08:13:02 user nova-compute[95467]:       <entry name="uuid">35bbed35-d10e-4637-b673-754a85f9d2ff</entry>
Nov 15 08:13:02 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:13:02 user nova-compute[95467]:     </system>
Nov 15 08:13:02 user nova-compute[95467]:   </sysinfo>
Nov 15 08:13:02 user nova-compute[95467]:   <os>
Nov 15 08:13:02 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:13:02 user nova-compute[95467]:     <boot dev="hd"/>
Nov 15 08:13:02 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:13:02 user nova-compute[95467]:   </os>
Nov 15 08:13:02 user nova-compute[95467]:   <features>
Nov 15 08:13:02 user nova-compute[95467]:     <acpi/>
Nov 15 08:13:02 user nova-compute[95467]:     <apic/>
Nov 15 08:13:02 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:13:02 user nova-compute[95467]:   </features>
Nov 15 08:13:02 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:13:02 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:13:02 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:13:02 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:13:02 user nova-compute[95467]:   </clock>
Nov 15 08:13:02 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:13:02 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:13:02 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:13:02 user nova-compute[95467]:   </cpu>
Nov 15 08:13:02 user nova-compute[95467]:   <devices>
Nov 15 08:13:02 user nova-compute[95467]:     <disk type="file" device="disk">
Nov 15 08:13:02 user nova-compute[95467]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 08:13:02 user nova-compute[95467]:       <source file="/opt/stack/data/nova/instances/35bbed35-d10e-4637-b673-754a85f9d2ff/disk"/>
Nov 15 08:13:02 user nova-compute[95467]:       <target dev="vda" bus="virtio"/>
Nov 15 08:13:02 user nova-compute[95467]:     </disk>
Nov 15 08:13:02 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:13:02 user nova-compute[95467]:       <mac address="fa:16:3e:67:3f:73"/>
Nov 15 08:13:02 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:13:02 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:13:02 user nova-compute[95467]:       <target dev="tapdf2a067b-ea"/>
Nov 15 08:13:02 user nova-compute[95467]:     </interface>
Nov 15 08:13:02 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:13:02 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/35bbed35-d10e-4637-b673-754a85f9d2ff/console.log" append="off"/>
Nov 15 08:13:02 user nova-compute[95467]:     </serial>
Nov 15 08:13:02 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:13:02 user nova-compute[95467]:     <video>
Nov 15 08:13:02 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:13:02 user nova-compute[95467]:     </video>
Nov 15 08:13:02 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:13:02 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:13:02 user nova-compute[95467]:     </rng>
Nov 15 08:13:02 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:13:02 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:13:02 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:13:02 user nova-compute[95467]:     </memballoon>
Nov 15 08:13:02 user nova-compute[95467]:   </devices>
Nov 15 08:13:02 user nova-compute[95467]: </domain>
Nov 15 08:13:02 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:13:02 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:12:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1120244885',display_name='tempest-VolumesAdminNegativeTest-server-1120244885',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1120244885',id=16,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6f1d989dd2242bfad9c3a5d7380c887',ramdisk_id='',reservation_id='r-q6v13chn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1724237472',owner_user_name='tempest-VolumesAdminNegativeTest-1724237472-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:13:01Z,user_data=None,user_id='331b706f494247759f827dbb1efcb663',uuid=35bbed35-d10e-4637-b673-754a85f9d2ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df2a067b-ea66-44ff-9b4c-c1a738e193b0", "address": "fa:16:3e:67:3f:73", "network": {"id": "4e5f387a-ee4d-4e5b-bbb3-0d3af738de45", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-839692973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6f1d989dd2242bfad9c3a5d7380c887", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf2a067b-ea", "ovs_interfaceid": "df2a067b-ea66-44ff-9b4c-c1a738e193b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:13:02 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Converting VIF {"id": "df2a067b-ea66-44ff-9b4c-c1a738e193b0", "address": "fa:16:3e:67:3f:73", "network": {"id": "4e5f387a-ee4d-4e5b-bbb3-0d3af738de45", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-839692973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6f1d989dd2242bfad9c3a5d7380c887", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf2a067b-ea", "ovs_interfaceid": "df2a067b-ea66-44ff-9b4c-c1a738e193b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:13:02 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:3f:73,bridge_name='br-int',has_traffic_filtering=True,id=df2a067b-ea66-44ff-9b4c-c1a738e193b0,network=Network(4e5f387a-ee4d-4e5b-bbb3-0d3af738de45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf2a067b-ea') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:13:02 user nova-compute[95467]: DEBUG os_vif [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:3f:73,bridge_name='br-int',has_traffic_filtering=True,id=df2a067b-ea66-44ff-9b4c-c1a738e193b0,network=Network(4e5f387a-ee4d-4e5b-bbb3-0d3af738de45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf2a067b-ea') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:13:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:13:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:13:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '34a4eee8-0322-58a7-bf20-95951d6b4458', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:13:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:13:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdf2a067b-ea, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:13:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdf2a067b-ea, col_values=(('qos', UUID('71611802-16dd-4704-892b-d448433dc6a4')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:13:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdf2a067b-ea, col_values=(('external_ids', {'iface-id': 'df2a067b-ea66-44ff-9b4c-c1a738e193b0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:3f:73', 'vm-uuid': '35bbed35-d10e-4637-b673-754a85f9d2ff'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:13:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:13:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:02 user nova-compute[95467]: INFO os_vif [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:3f:73,bridge_name='br-int',has_traffic_filtering=True,id=df2a067b-ea66-44ff-9b4c-c1a738e193b0,network=Network(4e5f387a-ee4d-4e5b-bbb3-0d3af738de45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf2a067b-ea')
Nov 15 08:13:02 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:13:02 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] No VIF found with MAC fa:16:3e:67:3f:73, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:13:02 user nova-compute[95467]: DEBUG nova.network.neutron [req-83adad8c-2c02-46be-ba3c-935f78fe4ca2 req-8367ba54-30aa-44fe-b9c8-16d89e778748 service nova] [instance: 35bbed35-d10e-4637-b673-754a85f9d2ff] Updated VIF entry in instance network info cache for port df2a067b-ea66-44ff-9b4c-c1a738e193b0. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:13:02 user nova-compute[95467]: DEBUG nova.network.neutron [req-83adad8c-2c02-46be-ba3c-935f78fe4ca2 req-8367ba54-30aa-44fe-b9c8-16d89e778748 service nova] [instance: 35bbed35-d10e-4637-b673-754a85f9d2ff] Updating instance_info_cache with network_info: [{"id": "df2a067b-ea66-44ff-9b4c-c1a738e193b0", "address": "fa:16:3e:67:3f:73", "network": {"id": "4e5f387a-ee4d-4e5b-bbb3-0d3af738de45", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-839692973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6f1d989dd2242bfad9c3a5d7380c887", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf2a067b-ea", "ovs_interfaceid": "df2a067b-ea66-44ff-9b4c-c1a738e193b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:13:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-83adad8c-2c02-46be-ba3c-935f78fe4ca2 req-8367ba54-30aa-44fe-b9c8-16d89e778748 service nova] Releasing lock "refresh_cache-35bbed35-d10e-4637-b673-754a85f9d2ff" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:13:04 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:04 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:04 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:04 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:04 user nova-compute[95467]: DEBUG nova.compute.manager [req-fbf3590c-0677-4b2d-ac00-5d48e4eb92ed req-27985b57-a97e-4080-8397-df06639da903 service nova] [instance: 35bbed35-d10e-4637-b673-754a85f9d2ff] Received event network-vif-plugged-df2a067b-ea66-44ff-9b4c-c1a738e193b0 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:13:04 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-fbf3590c-0677-4b2d-ac00-5d48e4eb92ed req-27985b57-a97e-4080-8397-df06639da903 service nova] Acquiring lock "35bbed35-d10e-4637-b673-754a85f9d2ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:13:04 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-fbf3590c-0677-4b2d-ac00-5d48e4eb92ed req-27985b57-a97e-4080-8397-df06639da903 service nova] Lock "35bbed35-d10e-4637-b673-754a85f9d2ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:13:04 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-fbf3590c-0677-4b2d-ac00-5d48e4eb92ed req-27985b57-a97e-4080-8397-df06639da903 service nova] Lock "35bbed35-d10e-4637-b673-754a85f9d2ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:13:04 user nova-compute[95467]: DEBUG nova.compute.manager [req-fbf3590c-0677-4b2d-ac00-5d48e4eb92ed req-27985b57-a97e-4080-8397-df06639da903 service nova] [instance: 35bbed35-d10e-4637-b673-754a85f9d2ff] No waiting events found dispatching network-vif-plugged-df2a067b-ea66-44ff-9b4c-c1a738e193b0 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:13:04 user nova-compute[95467]: WARNING nova.compute.manager [req-fbf3590c-0677-4b2d-ac00-5d48e4eb92ed req-27985b57-a97e-4080-8397-df06639da903 service nova] [instance: 35bbed35-d10e-4637-b673-754a85f9d2ff] Received unexpected event network-vif-plugged-df2a067b-ea66-44ff-9b4c-c1a738e193b0 for instance with vm_state building and task_state spawning.
Nov 15 08:13:04 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:04 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:06 user nova-compute[95467]: DEBUG nova.compute.manager [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 35bbed35-d10e-4637-b673-754a85f9d2ff] Instance event wait completed in 0 seconds for  {{(pid=95467) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 08:13:06 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 35bbed35-d10e-4637-b673-754a85f9d2ff] Guest created on hypervisor {{(pid=95467) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 08:13:06 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 35bbed35-d10e-4637-b673-754a85f9d2ff] Instance spawned successfully.
Nov 15 08:13:06 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 35bbed35-d10e-4637-b673-754a85f9d2ff] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 08:13:06 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 35bbed35-d10e-4637-b673-754a85f9d2ff] Found default for hw_cdrom_bus of ide {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:13:06 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 35bbed35-d10e-4637-b673-754a85f9d2ff] Found default for hw_disk_bus of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:13:06 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 35bbed35-d10e-4637-b673-754a85f9d2ff] Found default for hw_input_bus of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:13:06 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 35bbed35-d10e-4637-b673-754a85f9d2ff] Found default for hw_pointer_model of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:13:06 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 35bbed35-d10e-4637-b673-754a85f9d2ff] Found default for hw_video_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:13:06 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 35bbed35-d10e-4637-b673-754a85f9d2ff] Found default for hw_vif_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:13:06 user nova-compute[95467]: INFO nova.compute.manager [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 35bbed35-d10e-4637-b673-754a85f9d2ff] Took 5.59 seconds to spawn the instance on the hypervisor.
Nov 15 08:13:06 user nova-compute[95467]: DEBUG nova.compute.manager [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 35bbed35-d10e-4637-b673-754a85f9d2ff] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:13:06 user nova-compute[95467]: DEBUG nova.compute.manager [req-e1d49dd6-e7f6-4671-8996-79eefd4722b2 req-977bf56b-673b-4135-8fec-0781a60506eb service nova] [instance: 35bbed35-d10e-4637-b673-754a85f9d2ff] Received event network-vif-plugged-df2a067b-ea66-44ff-9b4c-c1a738e193b0 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:13:06 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-e1d49dd6-e7f6-4671-8996-79eefd4722b2 req-977bf56b-673b-4135-8fec-0781a60506eb service nova] Acquiring lock "35bbed35-d10e-4637-b673-754a85f9d2ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:13:06 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-e1d49dd6-e7f6-4671-8996-79eefd4722b2 req-977bf56b-673b-4135-8fec-0781a60506eb service nova] Lock "35bbed35-d10e-4637-b673-754a85f9d2ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:13:06 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-e1d49dd6-e7f6-4671-8996-79eefd4722b2 req-977bf56b-673b-4135-8fec-0781a60506eb service nova] Lock "35bbed35-d10e-4637-b673-754a85f9d2ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:13:06 user nova-compute[95467]: DEBUG nova.compute.manager [req-e1d49dd6-e7f6-4671-8996-79eefd4722b2 req-977bf56b-673b-4135-8fec-0781a60506eb service nova] [instance: 35bbed35-d10e-4637-b673-754a85f9d2ff] No waiting events found dispatching network-vif-plugged-df2a067b-ea66-44ff-9b4c-c1a738e193b0 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:13:06 user nova-compute[95467]: WARNING nova.compute.manager [req-e1d49dd6-e7f6-4671-8996-79eefd4722b2 req-977bf56b-673b-4135-8fec-0781a60506eb service nova] [instance: 35bbed35-d10e-4637-b673-754a85f9d2ff] Received unexpected event network-vif-plugged-df2a067b-ea66-44ff-9b4c-c1a738e193b0 for instance with vm_state building and task_state spawning.
Nov 15 08:13:06 user nova-compute[95467]: INFO nova.compute.manager [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 35bbed35-d10e-4637-b673-754a85f9d2ff] Took 6.58 seconds to build instance.
Nov 15 08:13:06 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7b96ee4d-5931-46b2-94e8-540e19fb6676 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Lock "35bbed35-d10e-4637-b673-754a85f9d2ff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.703s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:13:07 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:07 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:11 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-96d7cc5d-4226-460b-8182-0c3a169aebb7 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Waiting for libvirt event about the detach of device tapc5401d35-e2 with device alias net1 from instance 0917b083-2bbf-4baf-a0b8-d59ba3e2256b is timed out.
Nov 15 08:13:11 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-96d7cc5d-4226-460b-8182-0c3a169aebb7 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:79:65:ad"/><model type="virtio"/><mtu size="1442"/><target dev="tapc5401d35-e2"/></interface> {{(pid=95467) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 08:13:11 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-96d7cc5d-4226-460b-8182-0c3a169aebb7 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:79:65:ad"/><model type="virtio"/><mtu size="1442"/><target dev="tapc5401d35-e2"/></interface>not found in domain: <domain type='kvm' id='9'>
Nov 15 08:13:11 user nova-compute[95467]:   <name>instance-00000009</name>
Nov 15 08:13:11 user nova-compute[95467]:   <uuid>0917b083-2bbf-4baf-a0b8-d59ba3e2256b</uuid>
Nov 15 08:13:11 user nova-compute[95467]:   <metadata>
Nov 15 08:13:11 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:13:11 user nova-compute[95467]:   <nova:package version="0.0.0"/>
Nov 15 08:13:11 user nova-compute[95467]:   <nova:name>tempest-device-tagging-server-940506734</nova:name>
Nov 15 08:13:11 user nova-compute[95467]:   <nova:creationTime>2023-11-15 08:12:14</nova:creationTime>
Nov 15 08:13:11 user nova-compute[95467]:   <nova:flavor name="m1.tiny">
Nov 15 08:13:11 user nova-compute[95467]:     <nova:memory>512</nova:memory>
Nov 15 08:13:11 user nova-compute[95467]:     <nova:disk>1</nova:disk>
Nov 15 08:13:11 user nova-compute[95467]:     <nova:swap>0</nova:swap>
Nov 15 08:13:11 user nova-compute[95467]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:13:11 user nova-compute[95467]:     <nova:vcpus>1</nova:vcpus>
Nov 15 08:13:11 user nova-compute[95467]:   </nova:flavor>
Nov 15 08:13:11 user nova-compute[95467]:   <nova:owner>
Nov 15 08:13:11 user nova-compute[95467]:     <nova:user uuid="5c29ac74b4e745a09af7ecedde0f5697">tempest-TaggedAttachmentsTest-2023837645-project-member</nova:user>
Nov 15 08:13:11 user nova-compute[95467]:     <nova:project uuid="18fe2aa7cd7c4943a8c848dd52b9697b">tempest-TaggedAttachmentsTest-2023837645</nova:project>
Nov 15 08:13:11 user nova-compute[95467]:   </nova:owner>
Nov 15 08:13:11 user nova-compute[95467]:   <nova:root type="image" uuid="ed9c48aa-ce73-4b3b-9db1-235898be671b"/>
Nov 15 08:13:11 user nova-compute[95467]:   <nova:ports>
Nov 15 08:13:11 user nova-compute[95467]:     <nova:port uuid="f6d25344-c8fc-4794-b302-a3665c62b78c">
Nov 15 08:13:11 user nova-compute[95467]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 08:13:11 user nova-compute[95467]:     </nova:port>
Nov 15 08:13:11 user nova-compute[95467]:     <nova:port uuid="c5401d35-e26c-4291-8a19-520a5ece891e">
Nov 15 08:13:11 user nova-compute[95467]:       <nova:ip type="fixed" address="10.10.10.159" ipVersion="4"/>
Nov 15 08:13:11 user nova-compute[95467]:     </nova:port>
Nov 15 08:13:11 user nova-compute[95467]:   </nova:ports>
Nov 15 08:13:11 user nova-compute[95467]: </nova:instance>
Nov 15 08:13:11 user nova-compute[95467]:   </metadata>
Nov 15 08:13:11 user nova-compute[95467]:   <memory unit='KiB'>524288</memory>
Nov 15 08:13:11 user nova-compute[95467]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 15 08:13:11 user nova-compute[95467]:   <vcpu placement='static'>1</vcpu>
Nov 15 08:13:11 user nova-compute[95467]:   <resource>
Nov 15 08:13:11 user nova-compute[95467]:     <partition>/machine</partition>
Nov 15 08:13:11 user nova-compute[95467]:   </resource>
Nov 15 08:13:11 user nova-compute[95467]:   <sysinfo type='smbios'>
Nov 15 08:13:11 user nova-compute[95467]:     <system>
Nov 15 08:13:11 user nova-compute[95467]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 15 08:13:11 user nova-compute[95467]:       <entry name='product'>OpenStack Nova</entry>
Nov 15 08:13:11 user nova-compute[95467]:       <entry name='version'>0.0.0</entry>
Nov 15 08:13:11 user nova-compute[95467]:       <entry name='serial'>0917b083-2bbf-4baf-a0b8-d59ba3e2256b</entry>
Nov 15 08:13:11 user nova-compute[95467]:       <entry name='uuid'>0917b083-2bbf-4baf-a0b8-d59ba3e2256b</entry>
Nov 15 08:13:11 user nova-compute[95467]:       <entry name='family'>Virtual Machine</entry>
Nov 15 08:13:11 user nova-compute[95467]:     </system>
Nov 15 08:13:11 user nova-compute[95467]:   </sysinfo>
Nov 15 08:13:11 user nova-compute[95467]:   <os>
Nov 15 08:13:11 user nova-compute[95467]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 15 08:13:11 user nova-compute[95467]:     <boot dev='hd'/>
Nov 15 08:13:11 user nova-compute[95467]:     <smbios mode='sysinfo'/>
Nov 15 08:13:11 user nova-compute[95467]:   </os>
Nov 15 08:13:11 user nova-compute[95467]:   <features>
Nov 15 08:13:11 user nova-compute[95467]:     <acpi/>
Nov 15 08:13:11 user nova-compute[95467]:     <apic/>
Nov 15 08:13:11 user nova-compute[95467]:     <vmcoreinfo state='on'/>
Nov 15 08:13:11 user nova-compute[95467]:   </features>
Nov 15 08:13:11 user nova-compute[95467]:   <cpu mode='custom' match='exact' check='full'>
Nov 15 08:13:11 user nova-compute[95467]:     <model fallback='forbid'>Nehalem</model>
Nov 15 08:13:11 user nova-compute[95467]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 15 08:13:11 user nova-compute[95467]:     <feature policy='require' name='vme'/>
Nov 15 08:13:11 user nova-compute[95467]:     <feature policy='require' name='x2apic'/>
Nov 15 08:13:11 user nova-compute[95467]:     <feature policy='require' name='hypervisor'/>
Nov 15 08:13:11 user nova-compute[95467]:   </cpu>
Nov 15 08:13:11 user nova-compute[95467]:   <clock offset='utc'>
Nov 15 08:13:11 user nova-compute[95467]:     <timer name='pit' tickpolicy='delay'/>
Nov 15 08:13:11 user nova-compute[95467]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 15 08:13:11 user nova-compute[95467]:     <timer name='hpet' present='no'/>
Nov 15 08:13:11 user nova-compute[95467]:   </clock>
Nov 15 08:13:11 user nova-compute[95467]:   <on_poweroff>destroy</on_poweroff>
Nov 15 08:13:11 user nova-compute[95467]:   <on_reboot>restart</on_reboot>
Nov 15 08:13:11 user nova-compute[95467]:   <on_crash>destroy</on_crash>
Nov 15 08:13:11 user nova-compute[95467]:   <devices>
Nov 15 08:13:11 user nova-compute[95467]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 15 08:13:11 user nova-compute[95467]:     <disk type='file' device='disk'>
Nov 15 08:13:11 user nova-compute[95467]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 15 08:13:11 user nova-compute[95467]:       <source file='/opt/stack/data/nova/instances/0917b083-2bbf-4baf-a0b8-d59ba3e2256b/disk' index='2'/>
Nov 15 08:13:11 user nova-compute[95467]:       <backingStore type='file' index='3'>
Nov 15 08:13:11 user nova-compute[95467]:         <format type='raw'/>
Nov 15 08:13:11 user nova-compute[95467]:         <source file='/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc'/>
Nov 15 08:13:11 user nova-compute[95467]:         <backingStore/>
Nov 15 08:13:11 user nova-compute[95467]:       </backingStore>
Nov 15 08:13:11 user nova-compute[95467]:       <target dev='vda' bus='virtio'/>
Nov 15 08:13:11 user nova-compute[95467]:       <alias name='virtio-disk0'/>
Nov 15 08:13:11 user nova-compute[95467]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 15 08:13:11 user nova-compute[95467]:     </disk>
Nov 15 08:13:11 user nova-compute[95467]:     <disk type='file' device='cdrom'>
Nov 15 08:13:11 user nova-compute[95467]:       <driver name='qemu' type='raw' cache='none'/>
Nov 15 08:13:11 user nova-compute[95467]:       <source file='/opt/stack/data/nova/instances/0917b083-2bbf-4baf-a0b8-d59ba3e2256b/disk.config' index='1'/>
Nov 15 08:13:11 user nova-compute[95467]:       <backingStore/>
Nov 15 08:13:11 user nova-compute[95467]:       <target dev='hda' bus='ide'/>
Nov 15 08:13:11 user nova-compute[95467]:       <readonly/>
Nov 15 08:13:11 user nova-compute[95467]:       <alias name='ide0-0-0'/>
Nov 15 08:13:11 user nova-compute[95467]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 15 08:13:11 user nova-compute[95467]:     </disk>
Nov 15 08:13:11 user nova-compute[95467]:     <controller type='usb' index='0' model='none'>
Nov 15 08:13:11 user nova-compute[95467]:       <alias name='usb'/>
Nov 15 08:13:11 user nova-compute[95467]:     </controller>
Nov 15 08:13:11 user nova-compute[95467]:     <controller type='pci' index='0' model='pci-root'>
Nov 15 08:13:11 user nova-compute[95467]:       <alias name='pci.0'/>
Nov 15 08:13:11 user nova-compute[95467]:     </controller>
Nov 15 08:13:11 user nova-compute[95467]:     <controller type='ide' index='0'>
Nov 15 08:13:11 user nova-compute[95467]:       <alias name='ide'/>
Nov 15 08:13:11 user nova-compute[95467]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 15 08:13:11 user nova-compute[95467]:     </controller>
Nov 15 08:13:11 user nova-compute[95467]:     <interface type='ethernet'>
Nov 15 08:13:11 user nova-compute[95467]:       <mac address='fa:16:3e:b4:72:56'/>
Nov 15 08:13:11 user nova-compute[95467]:       <target dev='tapf6d25344-c8'/>
Nov 15 08:13:11 user nova-compute[95467]:       <model type='virtio'/>
Nov 15 08:13:11 user nova-compute[95467]:       <mtu size='1442'/>
Nov 15 08:13:11 user nova-compute[95467]:       <alias name='net0'/>
Nov 15 08:13:11 user nova-compute[95467]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 15 08:13:11 user nova-compute[95467]:     </interface>
Nov 15 08:13:11 user nova-compute[95467]:     <serial type='pty'>
Nov 15 08:13:11 user nova-compute[95467]:       <source path='/dev/pts/8'/>
Nov 15 08:13:11 user nova-compute[95467]:       <log file='/opt/stack/data/nova/instances/0917b083-2bbf-4baf-a0b8-d59ba3e2256b/console.log' append='off'/>
Nov 15 08:13:11 user nova-compute[95467]:       <target type='isa-serial' port='0'>
Nov 15 08:13:11 user nova-compute[95467]:         <model name='isa-serial'/>
Nov 15 08:13:11 user nova-compute[95467]:       </target>
Nov 15 08:13:11 user nova-compute[95467]:       <alias name='serial0'/>
Nov 15 08:13:11 user nova-compute[95467]:     </serial>
Nov 15 08:13:11 user nova-compute[95467]:     <console type='pty' tty='/dev/pts/8'>
Nov 15 08:13:11 user nova-compute[95467]:       <source path='/dev/pts/8'/>
Nov 15 08:13:11 user nova-compute[95467]:       <log file='/opt/stack/data/nova/instances/0917b083-2bbf-4baf-a0b8-d59ba3e2256b/console.log' append='off'/>
Nov 15 08:13:11 user nova-compute[95467]:       <target type='serial' port='0'/>
Nov 15 08:13:11 user nova-compute[95467]:       <alias name='serial0'/>
Nov 15 08:13:11 user nova-compute[95467]:     </console>
Nov 15 08:13:11 user nova-compute[95467]:     <input type='mouse' bus='ps2'>
Nov 15 08:13:11 user nova-compute[95467]:       <alias name='input0'/>
Nov 15 08:13:11 user nova-compute[95467]:     </input>
Nov 15 08:13:11 user nova-compute[95467]:     <input type='keyboard' bus='ps2'>
Nov 15 08:13:11 user nova-compute[95467]:       <alias name='input1'/>
Nov 15 08:13:11 user nova-compute[95467]:     </input>
Nov 15 08:13:11 user nova-compute[95467]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Nov 15 08:13:11 user nova-compute[95467]:       <listen type='address' address='0.0.0.0'/>
Nov 15 08:13:11 user nova-compute[95467]:     </graphics>
Nov 15 08:13:11 user nova-compute[95467]:     <audio id='1' type='none'/>
Nov 15 08:13:11 user nova-compute[95467]:     <video>
Nov 15 08:13:11 user nova-compute[95467]:       <model type='virtio' heads='1' primary='yes'/>
Nov 15 08:13:11 user nova-compute[95467]:       <alias name='video0'/>
Nov 15 08:13:11 user nova-compute[95467]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 15 08:13:11 user nova-compute[95467]:     </video>
Nov 15 08:13:11 user nova-compute[95467]:     <memballoon model='virtio'>
Nov 15 08:13:11 user nova-compute[95467]:       <stats period='10'/>
Nov 15 08:13:11 user nova-compute[95467]:       <alias name='balloon0'/>
Nov 15 08:13:11 user nova-compute[95467]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 15 08:13:11 user nova-compute[95467]:     </memballoon>
Nov 15 08:13:11 user nova-compute[95467]:     <rng model='virtio'>
Nov 15 08:13:11 user nova-compute[95467]:       <backend model='random'>/dev/urandom</backend>
Nov 15 08:13:11 user nova-compute[95467]:       <alias name='rng0'/>
Nov 15 08:13:11 user nova-compute[95467]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 15 08:13:11 user nova-compute[95467]:     </rng>
Nov 15 08:13:11 user nova-compute[95467]:   </devices>
Nov 15 08:13:11 user nova-compute[95467]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 15 08:13:11 user nova-compute[95467]:     <label>libvirt-0917b083-2bbf-4baf-a0b8-d59ba3e2256b</label>
Nov 15 08:13:11 user nova-compute[95467]:     <imagelabel>libvirt-0917b083-2bbf-4baf-a0b8-d59ba3e2256b</imagelabel>
Nov 15 08:13:11 user nova-compute[95467]:   </seclabel>
Nov 15 08:13:11 user nova-compute[95467]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 15 08:13:11 user nova-compute[95467]:     <label>+64055:+108</label>
Nov 15 08:13:11 user nova-compute[95467]:     <imagelabel>+64055:+108</imagelabel>
Nov 15 08:13:11 user nova-compute[95467]:   </seclabel>
Nov 15 08:13:11 user nova-compute[95467]: </domain>
Nov 15 08:13:11 user nova-compute[95467]:  {{(pid=95467) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 15 08:13:11 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-96d7cc5d-4226-460b-8182-0c3a169aebb7 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Successfully detached device tapc5401d35-e2 from instance 0917b083-2bbf-4baf-a0b8-d59ba3e2256b from the live domain config.
Nov 15 08:13:11 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-96d7cc5d-4226-460b-8182-0c3a169aebb7 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T08:10:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-940506734',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-940506734',id=9,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOGNo6GmVxPWDErmWkQ6fepU8heeIoJyOQ4cdNTLpFz1E0Ctc05CX23OX/CDepMfdF3Ar0clX85i/1Lr4zTu3ZjElr//sRBIxLqJHKfdYZdCUYYo+kOnMpjx+ZoNdO+nnQ==',key_name='tempest-keypair-1459138786',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:10:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='18fe2aa7cd7c4943a8c848dd52b9697b',ramdisk_id='',reservation_id='r-edurmax0',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2023837645',owner_user_name='tempest-TaggedAttachmentsTest-2023837645-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:10:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c29ac74b4e745a09af7ecedde0f5697',uuid=0917b083-2bbf-4baf-a0b8-d59ba3e2256b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5401d35-e26c-4291-8a19-520a5ece891e", "address": "fa:16:3e:79:65:ad", "network": {"id": "43eed8c1-119b-4038-98a2-06248998df67", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-33201672", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "18fe2aa7cd7c4943a8c848dd52b9697b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5401d35-e2", "ovs_interfaceid": "c5401d35-e26c-4291-8a19-520a5ece891e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:13:11 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-96d7cc5d-4226-460b-8182-0c3a169aebb7 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Converting VIF {"id": "c5401d35-e26c-4291-8a19-520a5ece891e", "address": "fa:16:3e:79:65:ad", "network": {"id": "43eed8c1-119b-4038-98a2-06248998df67", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-33201672", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "18fe2aa7cd7c4943a8c848dd52b9697b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5401d35-e2", "ovs_interfaceid": "c5401d35-e26c-4291-8a19-520a5ece891e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:13:11 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-96d7cc5d-4226-460b-8182-0c3a169aebb7 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:65:ad,bridge_name='br-int',has_traffic_filtering=True,id=c5401d35-e26c-4291-8a19-520a5ece891e,network=Network(43eed8c1-119b-4038-98a2-06248998df67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5401d35-e2') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:13:11 user nova-compute[95467]: DEBUG os_vif [None req-96d7cc5d-4226-460b-8182-0c3a169aebb7 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:65:ad,bridge_name='br-int',has_traffic_filtering=True,id=c5401d35-e26c-4291-8a19-520a5ece891e,network=Network(43eed8c1-119b-4038-98a2-06248998df67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5401d35-e2') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:13:11 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:11 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc5401d35-e2, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:13:11 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:11 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:13:11 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:11 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bb02caba-9c72-4469-bff8-d58c481acc69) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:13:11 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:11 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:13:11 user nova-compute[95467]: INFO os_vif [None req-96d7cc5d-4226-460b-8182-0c3a169aebb7 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:65:ad,bridge_name='br-int',has_traffic_filtering=True,id=c5401d35-e26c-4291-8a19-520a5ece891e,network=Network(43eed8c1-119b-4038-98a2-06248998df67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5401d35-e2')
Nov 15 08:13:11 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-96d7cc5d-4226-460b-8182-0c3a169aebb7 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:13:11 user nova-compute[95467]:   <nova:package version="0.0.0"/>
Nov 15 08:13:11 user nova-compute[95467]:   <nova:name>tempest-device-tagging-server-940506734</nova:name>
Nov 15 08:13:11 user nova-compute[95467]:   <nova:creationTime>2023-11-15 08:13:11</nova:creationTime>
Nov 15 08:13:11 user nova-compute[95467]:   <nova:flavor name="m1.tiny">
Nov 15 08:13:11 user nova-compute[95467]:     <nova:memory>512</nova:memory>
Nov 15 08:13:11 user nova-compute[95467]:     <nova:disk>1</nova:disk>
Nov 15 08:13:11 user nova-compute[95467]:     <nova:swap>0</nova:swap>
Nov 15 08:13:11 user nova-compute[95467]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:13:11 user nova-compute[95467]:     <nova:vcpus>1</nova:vcpus>
Nov 15 08:13:11 user nova-compute[95467]:   </nova:flavor>
Nov 15 08:13:11 user nova-compute[95467]:   <nova:owner>
Nov 15 08:13:11 user nova-compute[95467]:     <nova:user uuid="5c29ac74b4e745a09af7ecedde0f5697">tempest-TaggedAttachmentsTest-2023837645-project-member</nova:user>
Nov 15 08:13:11 user nova-compute[95467]:     <nova:project uuid="18fe2aa7cd7c4943a8c848dd52b9697b">tempest-TaggedAttachmentsTest-2023837645</nova:project>
Nov 15 08:13:11 user nova-compute[95467]:   </nova:owner>
Nov 15 08:13:11 user nova-compute[95467]:   <nova:root type="image" uuid="ed9c48aa-ce73-4b3b-9db1-235898be671b"/>
Nov 15 08:13:11 user nova-compute[95467]:   <nova:ports>
Nov 15 08:13:11 user nova-compute[95467]:     <nova:port uuid="f6d25344-c8fc-4794-b302-a3665c62b78c">
Nov 15 08:13:11 user nova-compute[95467]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 08:13:11 user nova-compute[95467]:     </nova:port>
Nov 15 08:13:11 user nova-compute[95467]:   </nova:ports>
Nov 15 08:13:11 user nova-compute[95467]: </nova:instance>
Nov 15 08:13:11 user nova-compute[95467]:  {{(pid=95467) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 15 08:13:11 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-37f4bd6b-f8fd-477a-a87d-82dabe6ec074 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a is timed out.
Nov 15 08:13:11 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-37f4bd6b-f8fd-477a-a87d-82dabe6ec074 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Successfully detached device vdb from instance 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a from the live domain config.
Nov 15 08:13:11 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37f4bd6b-f8fd-477a-a87d-82dabe6ec074 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] calling os-brick to detach iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 08:13:11 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f4bd6b-f8fd-477a-a87d-82dabe6ec074 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, {'target_iqn': 'iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WKoHbtLV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': '0b457e6b-86bf-4152-8f03-de5efd184fd5'}, None), 'kwargs': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:13:11 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-37f4bd6b-f8fd-477a-a87d-82dabe6ec074 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:13:11 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-37f4bd6b-f8fd-477a-a87d-82dabe6ec074 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:13:11 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-37f4bd6b-f8fd-477a-a87d-82dabe6ec074 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:13:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:13:11 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[98211dfa-5d81-4933-91b7-52cf17ba835c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:13:11 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f4bd6b-f8fd-477a-a87d-82dabe6ec074 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 08:13:11 user nova-compute[95467]: No targets found.
Nov 15 08:13:11 user nova-compute[95467]: iSNS:
Nov 15 08:13:11 user nova-compute[95467]: No targets found.
Nov 15 08:13:11 user nova-compute[95467]: STATIC:
Nov 15 08:13:11 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f
Nov 15 08:13:11 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:13:11 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:13:11 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5
Nov 15 08:13:11 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:13:11 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:13:11 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de
Nov 15 08:13:11 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:13:11 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:13:11 user nova-compute[95467]: FIRMWARE:
Nov 15 08:13:11 user nova-compute[95467]: No targets found.
Nov 15 08:13:11 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:13:11 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f4bd6b-f8fd-477a-a87d-82dabe6ec074 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 08:13:11 user nova-compute[95467]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 08:13:11 user nova-compute[95467]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=95467) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 08:13:11 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f4bd6b-f8fd-477a-a87d-82dabe6ec074 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5', 0)] {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 08:13:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:13:11 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f903d6-c21f-4d24-bbb9-be22efd5a427]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:13:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:13:11 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1d362a-5f3e-43f6-88b1-7283bd3c784d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:13:11 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f4bd6b-f8fd-477a-a87d-82dabe6ec074 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)
Nov 15 08:13:11 user nova-compute[95467]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 (non-flash)
Nov 15 08:13:11 user nova-compute[95467]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)
Nov 15 08:13:11 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:13:11 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f4bd6b-f8fd-477a-a87d-82dabe6ec074 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)
Nov 15 08:13:11 user nova-compute[95467]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 (non-flash)
Nov 15 08:13:11 user nova-compute[95467]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)
Nov 15 08:13:11 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:13:11 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f4bd6b-f8fd-477a-a87d-82dabe6ec074 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efec832f2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5'): ({'sdc'}, set())}) {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 08:13:11 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-37f4bd6b-f8fd-477a-a87d-82dabe6ec074 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Removing single pathed devices sdc {{(pid=95467) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 08:13:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:13:11 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d12d3eaf-014b-4302-94f3-b0f0eda7a760]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:13:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:13:11 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5fbc92c-0f4f-4865-a29d-356c595eea0b]: (4, ('ok\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:13:11 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-37f4bd6b-f8fd-477a-a87d-82dabe6ec074 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Flushing IO for device /dev/sdc {{(pid=95467) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 08:13:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:13:11 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a968aa61-a1d7-4f02-9495-2b4ef6f365ff]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:13:11 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-37f4bd6b-f8fd-477a-a87d-82dabe6ec074 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=95467) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 08:13:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:13:11 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0ebd30-6681-49cf-81a7-77a75d222d0b]: (4, ('1', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:13:11 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-37f4bd6b-f8fd-477a-a87d-82dabe6ec074 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 08:13:11 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-37f4bd6b-f8fd-477a-a87d-82dabe6ec074 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] SCSI volumes sdc have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 08:13:11 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f4bd6b-f8fd-477a-a87d-82dabe6ec074 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5')] {{(pid=95467) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 08:13:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:13:11 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33d0683-ea6e-4caa-8491-32004b250bb1]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:13:11 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f4bd6b-f8fd-477a-a87d-82dabe6ec074 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:13:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 -p 172.16.0.220:3260 --logout {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:13:11 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5ec1b6-9d26-4e67-a524-9edf64bd87ff]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:13:11 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f4bd6b-f8fd-477a-a87d-82dabe6ec074 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5, portal: 172.16.0.220,3260]
Nov 15 08:13:11 user nova-compute[95467]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5, portal: 172.16.0.220,3260] successful.
Nov 15 08:13:11 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:13:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 -p 172.16.0.220:3260 --op delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b457e6b-86bf-4152-8f03-de5efd184fd5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:13:11 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dadce5c-ef4a-4357-aa08-9e58fdd9f03b]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:13:11 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f4bd6b-f8fd-477a-a87d-82dabe6ec074 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:13:11 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-37f4bd6b-f8fd-477a-a87d-82dabe6ec074 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:13:11 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f4bd6b-f8fd-477a-a87d-82dabe6ec074 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] <== disconnect_volume: return (307ms) None {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:13:11 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37f4bd6b-f8fd-477a-a87d-82dabe6ec074 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Disconnected iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 08:13:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:12 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-96d7cc5d-4226-460b-8182-0c3a169aebb7 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Acquiring lock "refresh_cache-0917b083-2bbf-4baf-a0b8-d59ba3e2256b" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:13:12 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-96d7cc5d-4226-460b-8182-0c3a169aebb7 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Acquired lock "refresh_cache-0917b083-2bbf-4baf-a0b8-d59ba3e2256b" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:13:12 user nova-compute[95467]: DEBUG nova.network.neutron [None req-96d7cc5d-4226-460b-8182-0c3a169aebb7 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:13:12 user nova-compute[95467]: DEBUG nova.compute.manager [req-7544d9ff-a80d-4358-95a6-904e743ab394 req-e64a65fd-a02a-407e-abd2-ddcccde73806 service nova] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Received event network-vif-deleted-c5401d35-e26c-4291-8a19-520a5ece891e {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:13:12 user nova-compute[95467]: INFO nova.compute.manager [req-7544d9ff-a80d-4358-95a6-904e743ab394 req-e64a65fd-a02a-407e-abd2-ddcccde73806 service nova] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Neutron deleted interface c5401d35-e26c-4291-8a19-520a5ece891e; detaching it from the instance and deleting it from the info cache
Nov 15 08:13:12 user nova-compute[95467]: DEBUG nova.network.neutron [req-7544d9ff-a80d-4358-95a6-904e743ab394 req-e64a65fd-a02a-407e-abd2-ddcccde73806 service nova] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Updating instance_info_cache with network_info: [{"id": "f6d25344-c8fc-4794-b302-a3665c62b78c", "address": "fa:16:3e:b4:72:56", "network": {"id": "76e3f53b-50a0-47d5-9e18-0bb9c42d5ba3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-182207081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18fe2aa7cd7c4943a8c848dd52b9697b", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6d25344-c8", "ovs_interfaceid": "f6d25344-c8fc-4794-b302-a3665c62b78c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:13:12 user nova-compute[95467]: DEBUG nova.objects.instance [req-7544d9ff-a80d-4358-95a6-904e743ab394 req-e64a65fd-a02a-407e-abd2-ddcccde73806 service nova] Lazy-loading 'system_metadata' on Instance uuid 0917b083-2bbf-4baf-a0b8-d59ba3e2256b {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:13:12 user nova-compute[95467]: DEBUG nova.objects.instance [req-7544d9ff-a80d-4358-95a6-904e743ab394 req-e64a65fd-a02a-407e-abd2-ddcccde73806 service nova] Lazy-loading 'flavor' on Instance uuid 0917b083-2bbf-4baf-a0b8-d59ba3e2256b {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:13:12 user nova-compute[95467]: DEBUG nova.objects.base [req-7544d9ff-a80d-4358-95a6-904e743ab394 req-e64a65fd-a02a-407e-abd2-ddcccde73806 service nova] Object Instance<0917b083-2bbf-4baf-a0b8-d59ba3e2256b> lazy-loaded attributes: system_metadata,flavor {{(pid=95467) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 08:13:12 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [req-7544d9ff-a80d-4358-95a6-904e743ab394 req-e64a65fd-a02a-407e-abd2-ddcccde73806 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T08:10:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-940506734',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-940506734',id=9,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOGNo6GmVxPWDErmWkQ6fepU8heeIoJyOQ4cdNTLpFz1E0Ctc05CX23OX/CDepMfdF3Ar0clX85i/1Lr4zTu3ZjElr//sRBIxLqJHKfdYZdCUYYo+kOnMpjx+ZoNdO+nnQ==',key_name='tempest-keypair-1459138786',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:10:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='18fe2aa7cd7c4943a8c848dd52b9697b',ramdisk_id='',reservation_id='r-edurmax0',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2023837645',owner_user_name='tempest-TaggedAttachmentsTest-2023837645-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:10:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c29ac74b4e745a09af7ecedde0f5697',uuid=0917b083-2bbf-4baf-a0b8-d59ba3e2256b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5401d35-e26c-4291-8a19-520a5ece891e", "address": "fa:16:3e:79:65:ad", "network": {"id": "43eed8c1-119b-4038-98a2-06248998df67", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-33201672", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "18fe2aa7cd7c4943a8c848dd52b9697b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5401d35-e2", "ovs_interfaceid": "c5401d35-e26c-4291-8a19-520a5ece891e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:13:12 user nova-compute[95467]: DEBUG nova.network.os_vif_util [req-7544d9ff-a80d-4358-95a6-904e743ab394 req-e64a65fd-a02a-407e-abd2-ddcccde73806 service nova] Converting VIF {"id": "c5401d35-e26c-4291-8a19-520a5ece891e", "address": "fa:16:3e:79:65:ad", "network": {"id": "43eed8c1-119b-4038-98a2-06248998df67", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-33201672", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "18fe2aa7cd7c4943a8c848dd52b9697b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5401d35-e2", "ovs_interfaceid": "c5401d35-e26c-4291-8a19-520a5ece891e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:13:12 user nova-compute[95467]: DEBUG nova.network.os_vif_util [req-7544d9ff-a80d-4358-95a6-904e743ab394 req-e64a65fd-a02a-407e-abd2-ddcccde73806 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:65:ad,bridge_name='br-int',has_traffic_filtering=True,id=c5401d35-e26c-4291-8a19-520a5ece891e,network=Network(43eed8c1-119b-4038-98a2-06248998df67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5401d35-e2') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:13:12 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [req-7544d9ff-a80d-4358-95a6-904e743ab394 req-e64a65fd-a02a-407e-abd2-ddcccde73806 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:79:65:ad"/><model type="virtio"/><mtu size="1442"/><target dev="tapc5401d35-e2"/></interface> {{(pid=95467) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 08:13:12 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [req-7544d9ff-a80d-4358-95a6-904e743ab394 req-e64a65fd-a02a-407e-abd2-ddcccde73806 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:79:65:ad"/><model type="virtio"/><mtu size="1442"/><target dev="tapc5401d35-e2"/></interface>not found in domain: <domain type='kvm' id='9'>
Nov 15 08:13:12 user nova-compute[95467]:   <name>instance-00000009</name>
Nov 15 08:13:12 user nova-compute[95467]:   <uuid>0917b083-2bbf-4baf-a0b8-d59ba3e2256b</uuid>
Nov 15 08:13:12 user nova-compute[95467]:   <metadata>
Nov 15 08:13:12 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:13:12 user nova-compute[95467]:   <nova:package version="0.0.0"/>
Nov 15 08:13:12 user nova-compute[95467]:   <nova:name>tempest-device-tagging-server-940506734</nova:name>
Nov 15 08:13:12 user nova-compute[95467]:   <nova:creationTime>2023-11-15 08:13:11</nova:creationTime>
Nov 15 08:13:12 user nova-compute[95467]:   <nova:flavor name="m1.tiny">
Nov 15 08:13:12 user nova-compute[95467]:     <nova:memory>512</nova:memory>
Nov 15 08:13:12 user nova-compute[95467]:     <nova:disk>1</nova:disk>
Nov 15 08:13:12 user nova-compute[95467]:     <nova:swap>0</nova:swap>
Nov 15 08:13:12 user nova-compute[95467]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:13:12 user nova-compute[95467]:     <nova:vcpus>1</nova:vcpus>
Nov 15 08:13:12 user nova-compute[95467]:   </nova:flavor>
Nov 15 08:13:12 user nova-compute[95467]:   <nova:owner>
Nov 15 08:13:12 user nova-compute[95467]:     <nova:user uuid="5c29ac74b4e745a09af7ecedde0f5697">tempest-TaggedAttachmentsTest-2023837645-project-member</nova:user>
Nov 15 08:13:12 user nova-compute[95467]:     <nova:project uuid="18fe2aa7cd7c4943a8c848dd52b9697b">tempest-TaggedAttachmentsTest-2023837645</nova:project>
Nov 15 08:13:12 user nova-compute[95467]:   </nova:owner>
Nov 15 08:13:12 user nova-compute[95467]:   <nova:root type="image" uuid="ed9c48aa-ce73-4b3b-9db1-235898be671b"/>
Nov 15 08:13:12 user nova-compute[95467]:   <nova:ports>
Nov 15 08:13:12 user nova-compute[95467]:     <nova:port uuid="f6d25344-c8fc-4794-b302-a3665c62b78c">
Nov 15 08:13:12 user nova-compute[95467]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 08:13:12 user nova-compute[95467]:     </nova:port>
Nov 15 08:13:12 user nova-compute[95467]:   </nova:ports>
Nov 15 08:13:12 user nova-compute[95467]: </nova:instance>
Nov 15 08:13:12 user nova-compute[95467]:   </metadata>
Nov 15 08:13:12 user nova-compute[95467]:   <memory unit='KiB'>524288</memory>
Nov 15 08:13:12 user nova-compute[95467]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 15 08:13:12 user nova-compute[95467]:   <vcpu placement='static'>1</vcpu>
Nov 15 08:13:12 user nova-compute[95467]:   <resource>
Nov 15 08:13:12 user nova-compute[95467]:     <partition>/machine</partition>
Nov 15 08:13:12 user nova-compute[95467]:   </resource>
Nov 15 08:13:12 user nova-compute[95467]:   <sysinfo type='smbios'>
Nov 15 08:13:12 user nova-compute[95467]:     <system>
Nov 15 08:13:12 user nova-compute[95467]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 15 08:13:12 user nova-compute[95467]:       <entry name='product'>OpenStack Nova</entry>
Nov 15 08:13:12 user nova-compute[95467]:       <entry name='version'>0.0.0</entry>
Nov 15 08:13:12 user nova-compute[95467]:       <entry name='serial'>0917b083-2bbf-4baf-a0b8-d59ba3e2256b</entry>
Nov 15 08:13:12 user nova-compute[95467]:       <entry name='uuid'>0917b083-2bbf-4baf-a0b8-d59ba3e2256b</entry>
Nov 15 08:13:12 user nova-compute[95467]:       <entry name='family'>Virtual Machine</entry>
Nov 15 08:13:12 user nova-compute[95467]:     </system>
Nov 15 08:13:12 user nova-compute[95467]:   </sysinfo>
Nov 15 08:13:12 user nova-compute[95467]:   <os>
Nov 15 08:13:12 user nova-compute[95467]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 15 08:13:12 user nova-compute[95467]:     <boot dev='hd'/>
Nov 15 08:13:12 user nova-compute[95467]:     <smbios mode='sysinfo'/>
Nov 15 08:13:12 user nova-compute[95467]:   </os>
Nov 15 08:13:12 user nova-compute[95467]:   <features>
Nov 15 08:13:12 user nova-compute[95467]:     <acpi/>
Nov 15 08:13:12 user nova-compute[95467]:     <apic/>
Nov 15 08:13:12 user nova-compute[95467]:     <vmcoreinfo state='on'/>
Nov 15 08:13:12 user nova-compute[95467]:   </features>
Nov 15 08:13:12 user nova-compute[95467]:   <cpu mode='custom' match='exact' check='full'>
Nov 15 08:13:12 user nova-compute[95467]:     <model fallback='forbid'>Nehalem</model>
Nov 15 08:13:12 user nova-compute[95467]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 15 08:13:12 user nova-compute[95467]:     <feature policy='require' name='vme'/>
Nov 15 08:13:12 user nova-compute[95467]:     <feature policy='require' name='x2apic'/>
Nov 15 08:13:12 user nova-compute[95467]:     <feature policy='require' name='hypervisor'/>
Nov 15 08:13:12 user nova-compute[95467]:   </cpu>
Nov 15 08:13:12 user nova-compute[95467]:   <clock offset='utc'>
Nov 15 08:13:12 user nova-compute[95467]:     <timer name='pit' tickpolicy='delay'/>
Nov 15 08:13:12 user nova-compute[95467]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 15 08:13:12 user nova-compute[95467]:     <timer name='hpet' present='no'/>
Nov 15 08:13:12 user nova-compute[95467]:   </clock>
Nov 15 08:13:12 user nova-compute[95467]:   <on_poweroff>destroy</on_poweroff>
Nov 15 08:13:12 user nova-compute[95467]:   <on_reboot>restart</on_reboot>
Nov 15 08:13:12 user nova-compute[95467]:   <on_crash>destroy</on_crash>
Nov 15 08:13:12 user nova-compute[95467]:   <devices>
Nov 15 08:13:12 user nova-compute[95467]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 15 08:13:12 user nova-compute[95467]:     <disk type='file' device='disk'>
Nov 15 08:13:12 user nova-compute[95467]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 15 08:13:12 user nova-compute[95467]:       <source file='/opt/stack/data/nova/instances/0917b083-2bbf-4baf-a0b8-d59ba3e2256b/disk' index='2'/>
Nov 15 08:13:12 user nova-compute[95467]:       <backingStore type='file' index='3'>
Nov 15 08:13:12 user nova-compute[95467]:         <format type='raw'/>
Nov 15 08:13:12 user nova-compute[95467]:         <source file='/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc'/>
Nov 15 08:13:12 user nova-compute[95467]:         <backingStore/>
Nov 15 08:13:12 user nova-compute[95467]:       </backingStore>
Nov 15 08:13:12 user nova-compute[95467]:       <target dev='vda' bus='virtio'/>
Nov 15 08:13:12 user nova-compute[95467]:       <alias name='virtio-disk0'/>
Nov 15 08:13:12 user nova-compute[95467]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 15 08:13:12 user nova-compute[95467]:     </disk>
Nov 15 08:13:12 user nova-compute[95467]:     <disk type='file' device='cdrom'>
Nov 15 08:13:12 user nova-compute[95467]:       <driver name='qemu' type='raw' cache='none'/>
Nov 15 08:13:12 user nova-compute[95467]:       <source file='/opt/stack/data/nova/instances/0917b083-2bbf-4baf-a0b8-d59ba3e2256b/disk.config' index='1'/>
Nov 15 08:13:12 user nova-compute[95467]:       <backingStore/>
Nov 15 08:13:12 user nova-compute[95467]:       <target dev='hda' bus='ide'/>
Nov 15 08:13:12 user nova-compute[95467]:       <readonly/>
Nov 15 08:13:12 user nova-compute[95467]:       <alias name='ide0-0-0'/>
Nov 15 08:13:12 user nova-compute[95467]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 15 08:13:12 user nova-compute[95467]:     </disk>
Nov 15 08:13:12 user nova-compute[95467]:     <controller type='usb' index='0' model='none'>
Nov 15 08:13:12 user nova-compute[95467]:       <alias name='usb'/>
Nov 15 08:13:12 user nova-compute[95467]:     </controller>
Nov 15 08:13:12 user nova-compute[95467]:     <controller type='pci' index='0' model='pci-root'>
Nov 15 08:13:12 user nova-compute[95467]:       <alias name='pci.0'/>
Nov 15 08:13:12 user nova-compute[95467]:     </controller>
Nov 15 08:13:12 user nova-compute[95467]:     <controller type='ide' index='0'>
Nov 15 08:13:12 user nova-compute[95467]:       <alias name='ide'/>
Nov 15 08:13:12 user nova-compute[95467]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 15 08:13:12 user nova-compute[95467]:     </controller>
Nov 15 08:13:12 user nova-compute[95467]:     <interface type='ethernet'>
Nov 15 08:13:12 user nova-compute[95467]:       <mac address='fa:16:3e:b4:72:56'/>
Nov 15 08:13:12 user nova-compute[95467]:       <target dev='tapf6d25344-c8'/>
Nov 15 08:13:12 user nova-compute[95467]:       <model type='virtio'/>
Nov 15 08:13:12 user nova-compute[95467]:       <mtu size='1442'/>
Nov 15 08:13:12 user nova-compute[95467]:       <alias name='net0'/>
Nov 15 08:13:12 user nova-compute[95467]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 15 08:13:12 user nova-compute[95467]:     </interface>
Nov 15 08:13:12 user nova-compute[95467]:     <serial type='pty'>
Nov 15 08:13:12 user nova-compute[95467]:       <source path='/dev/pts/8'/>
Nov 15 08:13:12 user nova-compute[95467]:       <log file='/opt/stack/data/nova/instances/0917b083-2bbf-4baf-a0b8-d59ba3e2256b/console.log' append='off'/>
Nov 15 08:13:12 user nova-compute[95467]:       <target type='isa-serial' port='0'>
Nov 15 08:13:12 user nova-compute[95467]:         <model name='isa-serial'/>
Nov 15 08:13:12 user nova-compute[95467]:       </target>
Nov 15 08:13:12 user nova-compute[95467]:       <alias name='serial0'/>
Nov 15 08:13:12 user nova-compute[95467]:     </serial>
Nov 15 08:13:12 user nova-compute[95467]:     <console type='pty' tty='/dev/pts/8'>
Nov 15 08:13:12 user nova-compute[95467]:       <source path='/dev/pts/8'/>
Nov 15 08:13:12 user nova-compute[95467]:       <log file='/opt/stack/data/nova/instances/0917b083-2bbf-4baf-a0b8-d59ba3e2256b/console.log' append='off'/>
Nov 15 08:13:12 user nova-compute[95467]:       <target type='serial' port='0'/>
Nov 15 08:13:12 user nova-compute[95467]:       <alias name='serial0'/>
Nov 15 08:13:12 user nova-compute[95467]:     </console>
Nov 15 08:13:12 user nova-compute[95467]:     <input type='mouse' bus='ps2'>
Nov 15 08:13:12 user nova-compute[95467]:       <alias name='input0'/>
Nov 15 08:13:12 user nova-compute[95467]:     </input>
Nov 15 08:13:12 user nova-compute[95467]:     <input type='keyboard' bus='ps2'>
Nov 15 08:13:12 user nova-compute[95467]:       <alias name='input1'/>
Nov 15 08:13:12 user nova-compute[95467]:     </input>
Nov 15 08:13:12 user nova-compute[95467]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Nov 15 08:13:12 user nova-compute[95467]:       <listen type='address' address='0.0.0.0'/>
Nov 15 08:13:12 user nova-compute[95467]:     </graphics>
Nov 15 08:13:12 user nova-compute[95467]:     <audio id='1' type='none'/>
Nov 15 08:13:12 user nova-compute[95467]:     <video>
Nov 15 08:13:12 user nova-compute[95467]:       <model type='virtio' heads='1' primary='yes'/>
Nov 15 08:13:12 user nova-compute[95467]:       <alias name='video0'/>
Nov 15 08:13:12 user nova-compute[95467]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 15 08:13:12 user nova-compute[95467]:     </video>
Nov 15 08:13:12 user nova-compute[95467]:     <memballoon model='virtio'>
Nov 15 08:13:12 user nova-compute[95467]:       <stats period='10'/>
Nov 15 08:13:12 user nova-compute[95467]:       <alias name='balloon0'/>
Nov 15 08:13:12 user nova-compute[95467]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 15 08:13:12 user nova-compute[95467]:     </memballoon>
Nov 15 08:13:12 user nova-compute[95467]:     <rng model='virtio'>
Nov 15 08:13:12 user nova-compute[95467]:       <backend model='random'>/dev/urandom</backend>
Nov 15 08:13:12 user nova-compute[95467]:       <alias name='rng0'/>
Nov 15 08:13:12 user nova-compute[95467]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 15 08:13:12 user nova-compute[95467]:     </rng>
Nov 15 08:13:12 user nova-compute[95467]:   </devices>
Nov 15 08:13:12 user nova-compute[95467]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 15 08:13:12 user nova-compute[95467]:     <label>libvirt-0917b083-2bbf-4baf-a0b8-d59ba3e2256b</label>
Nov 15 08:13:12 user nova-compute[95467]:     <imagelabel>libvirt-0917b083-2bbf-4baf-a0b8-d59ba3e2256b</imagelabel>
Nov 15 08:13:12 user nova-compute[95467]:   </seclabel>
Nov 15 08:13:12 user nova-compute[95467]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 15 08:13:12 user nova-compute[95467]:     <label>+64055:+108</label>
Nov 15 08:13:12 user nova-compute[95467]:     <imagelabel>+64055:+108</imagelabel>
Nov 15 08:13:12 user nova-compute[95467]:   </seclabel>
Nov 15 08:13:12 user nova-compute[95467]: </domain>
Nov 15 08:13:12 user nova-compute[95467]:  {{(pid=95467) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 15 08:13:12 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [req-7544d9ff-a80d-4358-95a6-904e743ab394 req-e64a65fd-a02a-407e-abd2-ddcccde73806 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:79:65:ad"/><model type="virtio"/><mtu size="1442"/><target dev="tapc5401d35-e2"/></interface> {{(pid=95467) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 08:13:12 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [req-7544d9ff-a80d-4358-95a6-904e743ab394 req-e64a65fd-a02a-407e-abd2-ddcccde73806 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:79:65:ad"/><model type="virtio"/><mtu size="1442"/><target dev="tapc5401d35-e2"/></interface>not found in domain: <domain type='kvm' id='9'>
Nov 15 08:13:12 user nova-compute[95467]:   <name>instance-00000009</name>
Nov 15 08:13:12 user nova-compute[95467]:   <uuid>0917b083-2bbf-4baf-a0b8-d59ba3e2256b</uuid>
Nov 15 08:13:12 user nova-compute[95467]:   <metadata>
Nov 15 08:13:12 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:13:12 user nova-compute[95467]:   <nova:package version="0.0.0"/>
Nov 15 08:13:12 user nova-compute[95467]:   <nova:name>tempest-device-tagging-server-940506734</nova:name>
Nov 15 08:13:12 user nova-compute[95467]:   <nova:creationTime>2023-11-15 08:13:11</nova:creationTime>
Nov 15 08:13:12 user nova-compute[95467]:   <nova:flavor name="m1.tiny">
Nov 15 08:13:12 user nova-compute[95467]:     <nova:memory>512</nova:memory>
Nov 15 08:13:12 user nova-compute[95467]:     <nova:disk>1</nova:disk>
Nov 15 08:13:12 user nova-compute[95467]:     <nova:swap>0</nova:swap>
Nov 15 08:13:12 user nova-compute[95467]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:13:12 user nova-compute[95467]:     <nova:vcpus>1</nova:vcpus>
Nov 15 08:13:12 user nova-compute[95467]:   </nova:flavor>
Nov 15 08:13:12 user nova-compute[95467]:   <nova:owner>
Nov 15 08:13:12 user nova-compute[95467]:     <nova:user uuid="5c29ac74b4e745a09af7ecedde0f5697">tempest-TaggedAttachmentsTest-2023837645-project-member</nova:user>
Nov 15 08:13:12 user nova-compute[95467]:     <nova:project uuid="18fe2aa7cd7c4943a8c848dd52b9697b">tempest-TaggedAttachmentsTest-2023837645</nova:project>
Nov 15 08:13:12 user nova-compute[95467]:   </nova:owner>
Nov 15 08:13:12 user nova-compute[95467]:   <nova:root type="image" uuid="ed9c48aa-ce73-4b3b-9db1-235898be671b"/>
Nov 15 08:13:12 user nova-compute[95467]:   <nova:ports>
Nov 15 08:13:12 user nova-compute[95467]:     <nova:port uuid="f6d25344-c8fc-4794-b302-a3665c62b78c">
Nov 15 08:13:12 user nova-compute[95467]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 08:13:12 user nova-compute[95467]:     </nova:port>
Nov 15 08:13:12 user nova-compute[95467]:   </nova:ports>
Nov 15 08:13:12 user nova-compute[95467]: </nova:instance>
Nov 15 08:13:12 user nova-compute[95467]:   </metadata>
Nov 15 08:13:12 user nova-compute[95467]:   <memory unit='KiB'>524288</memory>
Nov 15 08:13:12 user nova-compute[95467]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 15 08:13:12 user nova-compute[95467]:   <vcpu placement='static'>1</vcpu>
Nov 15 08:13:12 user nova-compute[95467]:   <resource>
Nov 15 08:13:12 user nova-compute[95467]:     <partition>/machine</partition>
Nov 15 08:13:12 user nova-compute[95467]:   </resource>
Nov 15 08:13:12 user nova-compute[95467]:   <sysinfo type='smbios'>
Nov 15 08:13:12 user nova-compute[95467]:     <system>
Nov 15 08:13:12 user nova-compute[95467]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 15 08:13:12 user nova-compute[95467]:       <entry name='product'>OpenStack Nova</entry>
Nov 15 08:13:12 user nova-compute[95467]:       <entry name='version'>0.0.0</entry>
Nov 15 08:13:12 user nova-compute[95467]:       <entry name='serial'>0917b083-2bbf-4baf-a0b8-d59ba3e2256b</entry>
Nov 15 08:13:12 user nova-compute[95467]:       <entry name='uuid'>0917b083-2bbf-4baf-a0b8-d59ba3e2256b</entry>
Nov 15 08:13:12 user nova-compute[95467]:       <entry name='family'>Virtual Machine</entry>
Nov 15 08:13:12 user nova-compute[95467]:     </system>
Nov 15 08:13:12 user nova-compute[95467]:   </sysinfo>
Nov 15 08:13:12 user nova-compute[95467]:   <os>
Nov 15 08:13:12 user nova-compute[95467]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 15 08:13:12 user nova-compute[95467]:     <boot dev='hd'/>
Nov 15 08:13:12 user nova-compute[95467]:     <smbios mode='sysinfo'/>
Nov 15 08:13:12 user nova-compute[95467]:   </os>
Nov 15 08:13:12 user nova-compute[95467]:   <features>
Nov 15 08:13:12 user nova-compute[95467]:     <acpi/>
Nov 15 08:13:12 user nova-compute[95467]:     <apic/>
Nov 15 08:13:12 user nova-compute[95467]:     <vmcoreinfo state='on'/>
Nov 15 08:13:12 user nova-compute[95467]:   </features>
Nov 15 08:13:12 user nova-compute[95467]:   <cpu mode='custom' match='exact' check='full'>
Nov 15 08:13:12 user nova-compute[95467]:     <model fallback='forbid'>Nehalem</model>
Nov 15 08:13:12 user nova-compute[95467]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 15 08:13:12 user nova-compute[95467]:     <feature policy='require' name='vme'/>
Nov 15 08:13:12 user nova-compute[95467]:     <feature policy='require' name='x2apic'/>
Nov 15 08:13:12 user nova-compute[95467]:     <feature policy='require' name='hypervisor'/>
Nov 15 08:13:12 user nova-compute[95467]:   </cpu>
Nov 15 08:13:12 user nova-compute[95467]:   <clock offset='utc'>
Nov 15 08:13:12 user nova-compute[95467]:     <timer name='pit' tickpolicy='delay'/>
Nov 15 08:13:12 user nova-compute[95467]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 15 08:13:12 user nova-compute[95467]:     <timer name='hpet' present='no'/>
Nov 15 08:13:12 user nova-compute[95467]:   </clock>
Nov 15 08:13:12 user nova-compute[95467]:   <on_poweroff>destroy</on_poweroff>
Nov 15 08:13:12 user nova-compute[95467]:   <on_reboot>restart</on_reboot>
Nov 15 08:13:12 user nova-compute[95467]:   <on_crash>destroy</on_crash>
Nov 15 08:13:12 user nova-compute[95467]:   <devices>
Nov 15 08:13:12 user nova-compute[95467]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 15 08:13:12 user nova-compute[95467]:     <disk type='file' device='disk'>
Nov 15 08:13:12 user nova-compute[95467]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 15 08:13:12 user nova-compute[95467]:       <source file='/opt/stack/data/nova/instances/0917b083-2bbf-4baf-a0b8-d59ba3e2256b/disk' index='2'/>
Nov 15 08:13:12 user nova-compute[95467]:       <backingStore type='file' index='3'>
Nov 15 08:13:12 user nova-compute[95467]:         <format type='raw'/>
Nov 15 08:13:12 user nova-compute[95467]:         <source file='/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc'/>
Nov 15 08:13:12 user nova-compute[95467]:         <backingStore/>
Nov 15 08:13:12 user nova-compute[95467]:       </backingStore>
Nov 15 08:13:12 user nova-compute[95467]:       <target dev='vda' bus='virtio'/>
Nov 15 08:13:12 user nova-compute[95467]:       <alias name='virtio-disk0'/>
Nov 15 08:13:12 user nova-compute[95467]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 15 08:13:12 user nova-compute[95467]:     </disk>
Nov 15 08:13:12 user nova-compute[95467]:     <disk type='file' device='cdrom'>
Nov 15 08:13:12 user nova-compute[95467]:       <driver name='qemu' type='raw' cache='none'/>
Nov 15 08:13:12 user nova-compute[95467]:       <source file='/opt/stack/data/nova/instances/0917b083-2bbf-4baf-a0b8-d59ba3e2256b/disk.config' index='1'/>
Nov 15 08:13:12 user nova-compute[95467]:       <backingStore/>
Nov 15 08:13:12 user nova-compute[95467]:       <target dev='hda' bus='ide'/>
Nov 15 08:13:12 user nova-compute[95467]:       <readonly/>
Nov 15 08:13:12 user nova-compute[95467]:       <alias name='ide0-0-0'/>
Nov 15 08:13:12 user nova-compute[95467]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 15 08:13:12 user nova-compute[95467]:     </disk>
Nov 15 08:13:12 user nova-compute[95467]:     <controller type='usb' index='0' model='none'>
Nov 15 08:13:12 user nova-compute[95467]:       <alias name='usb'/>
Nov 15 08:13:12 user nova-compute[95467]:     </controller>
Nov 15 08:13:12 user nova-compute[95467]:     <controller type='pci' index='0' model='pci-root'>
Nov 15 08:13:12 user nova-compute[95467]:       <alias name='pci.0'/>
Nov 15 08:13:12 user nova-compute[95467]:     </controller>
Nov 15 08:13:12 user nova-compute[95467]:     <controller type='ide' index='0'>
Nov 15 08:13:12 user nova-compute[95467]:       <alias name='ide'/>
Nov 15 08:13:12 user nova-compute[95467]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 15 08:13:12 user nova-compute[95467]:     </controller>
Nov 15 08:13:12 user nova-compute[95467]:     <interface type='ethernet'>
Nov 15 08:13:12 user nova-compute[95467]:       <mac address='fa:16:3e:b4:72:56'/>
Nov 15 08:13:12 user nova-compute[95467]:       <target dev='tapf6d25344-c8'/>
Nov 15 08:13:12 user nova-compute[95467]:       <model type='virtio'/>
Nov 15 08:13:12 user nova-compute[95467]:       <mtu size='1442'/>
Nov 15 08:13:12 user nova-compute[95467]:       <alias name='net0'/>
Nov 15 08:13:12 user nova-compute[95467]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 15 08:13:12 user nova-compute[95467]:     </interface>
Nov 15 08:13:12 user nova-compute[95467]:     <serial type='pty'>
Nov 15 08:13:12 user nova-compute[95467]:       <source path='/dev/pts/8'/>
Nov 15 08:13:12 user nova-compute[95467]:       <log file='/opt/stack/data/nova/instances/0917b083-2bbf-4baf-a0b8-d59ba3e2256b/console.log' append='off'/>
Nov 15 08:13:12 user nova-compute[95467]:       <target type='isa-serial' port='0'>
Nov 15 08:13:12 user nova-compute[95467]:         <model name='isa-serial'/>
Nov 15 08:13:12 user nova-compute[95467]:       </target>
Nov 15 08:13:12 user nova-compute[95467]:       <alias name='serial0'/>
Nov 15 08:13:12 user nova-compute[95467]:     </serial>
Nov 15 08:13:12 user nova-compute[95467]:     <console type='pty' tty='/dev/pts/8'>
Nov 15 08:13:12 user nova-compute[95467]:       <source path='/dev/pts/8'/>
Nov 15 08:13:12 user nova-compute[95467]:       <log file='/opt/stack/data/nova/instances/0917b083-2bbf-4baf-a0b8-d59ba3e2256b/console.log' append='off'/>
Nov 15 08:13:12 user nova-compute[95467]:       <target type='serial' port='0'/>
Nov 15 08:13:12 user nova-compute[95467]:       <alias name='serial0'/>
Nov 15 08:13:12 user nova-compute[95467]:     </console>
Nov 15 08:13:12 user nova-compute[95467]:     <input type='mouse' bus='ps2'>
Nov 15 08:13:12 user nova-compute[95467]:       <alias name='input0'/>
Nov 15 08:13:12 user nova-compute[95467]:     </input>
Nov 15 08:13:12 user nova-compute[95467]:     <input type='keyboard' bus='ps2'>
Nov 15 08:13:12 user nova-compute[95467]:       <alias name='input1'/>
Nov 15 08:13:12 user nova-compute[95467]:     </input>
Nov 15 08:13:12 user nova-compute[95467]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Nov 15 08:13:12 user nova-compute[95467]:       <listen type='address' address='0.0.0.0'/>
Nov 15 08:13:12 user nova-compute[95467]:     </graphics>
Nov 15 08:13:12 user nova-compute[95467]:     <audio id='1' type='none'/>
Nov 15 08:13:12 user nova-compute[95467]:     <video>
Nov 15 08:13:12 user nova-compute[95467]:       <model type='virtio' heads='1' primary='yes'/>
Nov 15 08:13:12 user nova-compute[95467]:       <alias name='video0'/>
Nov 15 08:13:12 user nova-compute[95467]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 15 08:13:12 user nova-compute[95467]:     </video>
Nov 15 08:13:12 user nova-compute[95467]:     <memballoon model='virtio'>
Nov 15 08:13:12 user nova-compute[95467]:       <stats period='10'/>
Nov 15 08:13:12 user nova-compute[95467]:       <alias name='balloon0'/>
Nov 15 08:13:12 user nova-compute[95467]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 15 08:13:12 user nova-compute[95467]:     </memballoon>
Nov 15 08:13:12 user nova-compute[95467]:     <rng model='virtio'>
Nov 15 08:13:12 user nova-compute[95467]:       <backend model='random'>/dev/urandom</backend>
Nov 15 08:13:12 user nova-compute[95467]:       <alias name='rng0'/>
Nov 15 08:13:12 user nova-compute[95467]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 15 08:13:12 user nova-compute[95467]:     </rng>
Nov 15 08:13:12 user nova-compute[95467]:   </devices>
Nov 15 08:13:12 user nova-compute[95467]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 15 08:13:12 user nova-compute[95467]:     <label>libvirt-0917b083-2bbf-4baf-a0b8-d59ba3e2256b</label>
Nov 15 08:13:12 user nova-compute[95467]:     <imagelabel>libvirt-0917b083-2bbf-4baf-a0b8-d59ba3e2256b</imagelabel>
Nov 15 08:13:12 user nova-compute[95467]:   </seclabel>
Nov 15 08:13:12 user nova-compute[95467]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 15 08:13:12 user nova-compute[95467]:     <label>+64055:+108</label>
Nov 15 08:13:12 user nova-compute[95467]:     <imagelabel>+64055:+108</imagelabel>
Nov 15 08:13:12 user nova-compute[95467]:   </seclabel>
Nov 15 08:13:12 user nova-compute[95467]: </domain>
Nov 15 08:13:12 user nova-compute[95467]:  {{(pid=95467) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 15 08:13:12 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [req-7544d9ff-a80d-4358-95a6-904e743ab394 req-e64a65fd-a02a-407e-abd2-ddcccde73806 service nova] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Detaching interface fa:16:3e:79:65:ad failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapc5401d35-e2' not found.
Nov 15 08:13:12 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [req-7544d9ff-a80d-4358-95a6-904e743ab394 req-e64a65fd-a02a-407e-abd2-ddcccde73806 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T08:10:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-940506734',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-940506734',id=9,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOGNo6GmVxPWDErmWkQ6fepU8heeIoJyOQ4cdNTLpFz1E0Ctc05CX23OX/CDepMfdF3Ar0clX85i/1Lr4zTu3ZjElr//sRBIxLqJHKfdYZdCUYYo+kOnMpjx+ZoNdO+nnQ==',key_name='tempest-keypair-1459138786',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:10:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='18fe2aa7cd7c4943a8c848dd52b9697b',ramdisk_id='',reservation_id='r-edurmax0',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2023837645',owner_user_name='tempest-TaggedAttachmentsTest-2023837645-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:10:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c29ac74b4e745a09af7ecedde0f5697',uuid=0917b083-2bbf-4baf-a0b8-d59ba3e2256b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5401d35-e26c-4291-8a19-520a5ece891e", "address": "fa:16:3e:79:65:ad", "network": {"id": "43eed8c1-119b-4038-98a2-06248998df67", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-33201672", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "18fe2aa7cd7c4943a8c848dd52b9697b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5401d35-e2", "ovs_interfaceid": "c5401d35-e26c-4291-8a19-520a5ece891e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:13:12 user nova-compute[95467]: DEBUG nova.network.os_vif_util [req-7544d9ff-a80d-4358-95a6-904e743ab394 req-e64a65fd-a02a-407e-abd2-ddcccde73806 service nova] Converting VIF {"id": "c5401d35-e26c-4291-8a19-520a5ece891e", "address": "fa:16:3e:79:65:ad", "network": {"id": "43eed8c1-119b-4038-98a2-06248998df67", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-33201672", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "18fe2aa7cd7c4943a8c848dd52b9697b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5401d35-e2", "ovs_interfaceid": "c5401d35-e26c-4291-8a19-520a5ece891e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:13:12 user nova-compute[95467]: DEBUG nova.network.os_vif_util [req-7544d9ff-a80d-4358-95a6-904e743ab394 req-e64a65fd-a02a-407e-abd2-ddcccde73806 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:65:ad,bridge_name='br-int',has_traffic_filtering=True,id=c5401d35-e26c-4291-8a19-520a5ece891e,network=Network(43eed8c1-119b-4038-98a2-06248998df67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5401d35-e2') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:13:12 user nova-compute[95467]: DEBUG os_vif [req-7544d9ff-a80d-4358-95a6-904e743ab394 req-e64a65fd-a02a-407e-abd2-ddcccde73806 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:65:ad,bridge_name='br-int',has_traffic_filtering=True,id=c5401d35-e26c-4291-8a19-520a5ece891e,network=Network(43eed8c1-119b-4038-98a2-06248998df67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5401d35-e2') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:13:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc5401d35-e2, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:13:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:13:12 user nova-compute[95467]: INFO os_vif [req-7544d9ff-a80d-4358-95a6-904e743ab394 req-e64a65fd-a02a-407e-abd2-ddcccde73806 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:65:ad,bridge_name='br-int',has_traffic_filtering=True,id=c5401d35-e26c-4291-8a19-520a5ece891e,network=Network(43eed8c1-119b-4038-98a2-06248998df67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5401d35-e2')
Nov 15 08:13:12 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [req-7544d9ff-a80d-4358-95a6-904e743ab394 req-e64a65fd-a02a-407e-abd2-ddcccde73806 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:13:12 user nova-compute[95467]:   <nova:package version="0.0.0"/>
Nov 15 08:13:12 user nova-compute[95467]:   <nova:name>tempest-device-tagging-server-940506734</nova:name>
Nov 15 08:13:12 user nova-compute[95467]:   <nova:creationTime>2023-11-15 08:13:12</nova:creationTime>
Nov 15 08:13:12 user nova-compute[95467]:   <nova:flavor name="m1.tiny">
Nov 15 08:13:12 user nova-compute[95467]:     <nova:memory>512</nova:memory>
Nov 15 08:13:12 user nova-compute[95467]:     <nova:disk>1</nova:disk>
Nov 15 08:13:12 user nova-compute[95467]:     <nova:swap>0</nova:swap>
Nov 15 08:13:12 user nova-compute[95467]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:13:12 user nova-compute[95467]:     <nova:vcpus>1</nova:vcpus>
Nov 15 08:13:12 user nova-compute[95467]:   </nova:flavor>
Nov 15 08:13:12 user nova-compute[95467]:   <nova:owner>
Nov 15 08:13:12 user nova-compute[95467]:     <nova:user uuid="5c29ac74b4e745a09af7ecedde0f5697">tempest-TaggedAttachmentsTest-2023837645-project-member</nova:user>
Nov 15 08:13:12 user nova-compute[95467]:     <nova:project uuid="18fe2aa7cd7c4943a8c848dd52b9697b">tempest-TaggedAttachmentsTest-2023837645</nova:project>
Nov 15 08:13:12 user nova-compute[95467]:   </nova:owner>
Nov 15 08:13:12 user nova-compute[95467]:   <nova:root type="image" uuid="ed9c48aa-ce73-4b3b-9db1-235898be671b"/>
Nov 15 08:13:12 user nova-compute[95467]:   <nova:ports>
Nov 15 08:13:12 user nova-compute[95467]:     <nova:port uuid="f6d25344-c8fc-4794-b302-a3665c62b78c">
Nov 15 08:13:12 user nova-compute[95467]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 08:13:12 user nova-compute[95467]:     </nova:port>
Nov 15 08:13:12 user nova-compute[95467]:   </nova:ports>
Nov 15 08:13:12 user nova-compute[95467]: </nova:instance>
Nov 15 08:13:12 user nova-compute[95467]:  {{(pid=95467) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 15 08:13:12 user nova-compute[95467]: INFO nova.network.neutron [None req-96d7cc5d-4226-460b-8182-0c3a169aebb7 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Port c5401d35-e26c-4291-8a19-520a5ece891e from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Nov 15 08:13:12 user nova-compute[95467]: DEBUG nova.network.neutron [None req-96d7cc5d-4226-460b-8182-0c3a169aebb7 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Updating instance_info_cache with network_info: [{"id": "f6d25344-c8fc-4794-b302-a3665c62b78c", "address": "fa:16:3e:b4:72:56", "network": {"id": "76e3f53b-50a0-47d5-9e18-0bb9c42d5ba3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-182207081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18fe2aa7cd7c4943a8c848dd52b9697b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6d25344-c8", "ovs_interfaceid": "f6d25344-c8fc-4794-b302-a3665c62b78c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:13:12 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-96d7cc5d-4226-460b-8182-0c3a169aebb7 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Releasing lock "refresh_cache-0917b083-2bbf-4baf-a0b8-d59ba3e2256b" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:13:12 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-96d7cc5d-4226-460b-8182-0c3a169aebb7 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Lock "interface-0917b083-2bbf-4baf-a0b8-d59ba3e2256b-c5401d35-e26c-4291-8a19-520a5ece891e" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.418s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:13:12 user nova-compute[95467]: DEBUG nova.objects.instance [None req-37f4bd6b-f8fd-477a-a87d-82dabe6ec074 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Lazy-loading 'flavor' on Instance uuid 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:13:12 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-37f4bd6b-f8fd-477a-a87d-82dabe6ec074 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Lock "1edf7591-3991-4df9-98c9-ebc4ca9e5a4a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.875s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:13:16 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-35f77557-b073-4e48-a419-45ee01ec2060 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] Acquiring lock "a259558e-87ea-48c2-8b72-7443c0510d81" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:13:16 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-35f77557-b073-4e48-a419-45ee01ec2060 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] Lock "a259558e-87ea-48c2-8b72-7443c0510d81" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:13:16 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-35f77557-b073-4e48-a419-45ee01ec2060 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] Acquiring lock "a259558e-87ea-48c2-8b72-7443c0510d81-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:13:16 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-35f77557-b073-4e48-a419-45ee01ec2060 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] Lock "a259558e-87ea-48c2-8b72-7443c0510d81-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:13:16 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-35f77557-b073-4e48-a419-45ee01ec2060 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] Lock "a259558e-87ea-48c2-8b72-7443c0510d81-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:13:16 user nova-compute[95467]: INFO nova.compute.manager [None req-35f77557-b073-4e48-a419-45ee01ec2060 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Terminating instance
Nov 15 08:13:16 user nova-compute[95467]: DEBUG nova.compute.manager [None req-35f77557-b073-4e48-a419-45ee01ec2060 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Start destroying the instance on the hypervisor. {{(pid=95467) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 08:13:16 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:16 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:16 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:16 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:16 user nova-compute[95467]: DEBUG nova.compute.manager [req-f215826a-c6d3-4691-9ae3-862c570e2bd8 req-70094aae-c99a-448e-ac97-b160d53988a4 service nova] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Received event network-vif-unplugged-6026878a-0f2b-467a-be5a-b500e3776ed6 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:13:16 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-f215826a-c6d3-4691-9ae3-862c570e2bd8 req-70094aae-c99a-448e-ac97-b160d53988a4 service nova] Acquiring lock "a259558e-87ea-48c2-8b72-7443c0510d81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:13:16 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-f215826a-c6d3-4691-9ae3-862c570e2bd8 req-70094aae-c99a-448e-ac97-b160d53988a4 service nova] Lock "a259558e-87ea-48c2-8b72-7443c0510d81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:13:16 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-f215826a-c6d3-4691-9ae3-862c570e2bd8 req-70094aae-c99a-448e-ac97-b160d53988a4 service nova] Lock "a259558e-87ea-48c2-8b72-7443c0510d81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:13:16 user nova-compute[95467]: DEBUG nova.compute.manager [req-f215826a-c6d3-4691-9ae3-862c570e2bd8 req-70094aae-c99a-448e-ac97-b160d53988a4 service nova] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] No waiting events found dispatching network-vif-unplugged-6026878a-0f2b-467a-be5a-b500e3776ed6 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:13:16 user nova-compute[95467]: DEBUG nova.compute.manager [req-f215826a-c6d3-4691-9ae3-862c570e2bd8 req-70094aae-c99a-448e-ac97-b160d53988a4 service nova] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Received event network-vif-unplugged-6026878a-0f2b-467a-be5a-b500e3776ed6 for instance with task_state deleting. {{(pid=95467) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 08:13:16 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:17 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Instance destroyed successfully.
Nov 15 08:13:17 user nova-compute[95467]: DEBUG nova.objects.instance [None req-35f77557-b073-4e48-a419-45ee01ec2060 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] Lazy-loading 'resources' on Instance uuid a259558e-87ea-48c2-8b72-7443c0510d81 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:13:17 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-35f77557-b073-4e48-a419-45ee01ec2060 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:10:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-928383486',display_name='tempest-VolumesAssistedSnapshotsTest-server-928383486',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-928383486',id=10,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEYCs5SdFlFaD1XhVN4K3XS66xNGhwMkVPDb0+LtFoq6bFwIvN0FYHLyNJVkcr+3Vfl1gTXWrYQcTSlhFZlz5N5XpBKSHX1ez4NflzskasVetjH6WyOLnnKv8115SrrxZA==',key_name='tempest-keypair-854904367',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:10:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bd6ae375b97347d6b1b757bb74cd3c50',ramdisk_id='',reservation_id='r-6jaq6n69',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1565892016',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1565892016-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:10:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21401887c3f04e238f5399da20d7be71',uuid=a259558e-87ea-48c2-8b72-7443c0510d81,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6026878a-0f2b-467a-be5a-b500e3776ed6", "address": "fa:16:3e:fc:81:b9", "network": {"id": "66c77f59-de52-498a-8294-ec7ac812074b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-943726914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd6ae375b97347d6b1b757bb74cd3c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6026878a-0f", "ovs_interfaceid": "6026878a-0f2b-467a-be5a-b500e3776ed6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:13:17 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-35f77557-b073-4e48-a419-45ee01ec2060 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] Converting VIF {"id": "6026878a-0f2b-467a-be5a-b500e3776ed6", "address": "fa:16:3e:fc:81:b9", "network": {"id": "66c77f59-de52-498a-8294-ec7ac812074b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-943726914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd6ae375b97347d6b1b757bb74cd3c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6026878a-0f", "ovs_interfaceid": "6026878a-0f2b-467a-be5a-b500e3776ed6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:13:17 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-35f77557-b073-4e48-a419-45ee01ec2060 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:81:b9,bridge_name='br-int',has_traffic_filtering=True,id=6026878a-0f2b-467a-be5a-b500e3776ed6,network=Network(66c77f59-de52-498a-8294-ec7ac812074b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6026878a-0f') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:13:17 user nova-compute[95467]: DEBUG os_vif [None req-35f77557-b073-4e48-a419-45ee01ec2060 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:81:b9,bridge_name='br-int',has_traffic_filtering=True,id=6026878a-0f2b-467a-be5a-b500e3776ed6,network=Network(66c77f59-de52-498a-8294-ec7ac812074b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6026878a-0f') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:13:17 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:17 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6026878a-0f, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:13:17 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:17 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:13:17 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:17 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d5e14cf1-47f1-42df-b824-835e4ce8205d) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:13:17 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:17 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:17 user nova-compute[95467]: INFO os_vif [None req-35f77557-b073-4e48-a419-45ee01ec2060 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:81:b9,bridge_name='br-int',has_traffic_filtering=True,id=6026878a-0f2b-467a-be5a-b500e3776ed6,network=Network(66c77f59-de52-498a-8294-ec7ac812074b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6026878a-0f')
Nov 15 08:13:17 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-35f77557-b073-4e48-a419-45ee01ec2060 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Deleting instance files /opt/stack/data/nova/instances/a259558e-87ea-48c2-8b72-7443c0510d81_del
Nov 15 08:13:17 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-35f77557-b073-4e48-a419-45ee01ec2060 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Deletion of /opt/stack/data/nova/instances/a259558e-87ea-48c2-8b72-7443c0510d81_del complete
Nov 15 08:13:17 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:17 user nova-compute[95467]: INFO nova.compute.manager [None req-35f77557-b073-4e48-a419-45ee01ec2060 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 15 08:13:17 user nova-compute[95467]: DEBUG oslo.service.loopingcall [None req-35f77557-b073-4e48-a419-45ee01ec2060 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=95467) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 08:13:17 user nova-compute[95467]: DEBUG nova.compute.manager [-] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Deallocating network for instance {{(pid=95467) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 08:13:17 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] deallocate_for_instance() {{(pid=95467) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 08:13:17 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:13:18 user nova-compute[95467]: INFO nova.compute.manager [-] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Took 0.92 seconds to deallocate network for instance.
Nov 15 08:13:18 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-35f77557-b073-4e48-a419-45ee01ec2060 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:13:18 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-35f77557-b073-4e48-a419-45ee01ec2060 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:13:18 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-35f77557-b073-4e48-a419-45ee01ec2060 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:13:18 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-35f77557-b073-4e48-a419-45ee01ec2060 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:13:18 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-35f77557-b073-4e48-a419-45ee01ec2060 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.335s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:13:18 user nova-compute[95467]: INFO nova.scheduler.client.report [None req-35f77557-b073-4e48-a419-45ee01ec2060 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] Deleted allocations for instance a259558e-87ea-48c2-8b72-7443c0510d81
Nov 15 08:13:18 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-35f77557-b073-4e48-a419-45ee01ec2060 tempest-VolumesAssistedSnapshotsTest-1565892016 tempest-VolumesAssistedSnapshotsTest-1565892016-project-member] Lock "a259558e-87ea-48c2-8b72-7443c0510d81" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.295s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:13:18 user nova-compute[95467]: DEBUG nova.compute.manager [req-549c6ede-ddc5-4d00-aa8f-cf521c20f1b3 req-745babda-5637-4590-aa1d-31e418e7ac83 service nova] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Received event network-vif-plugged-6026878a-0f2b-467a-be5a-b500e3776ed6 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:13:18 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-549c6ede-ddc5-4d00-aa8f-cf521c20f1b3 req-745babda-5637-4590-aa1d-31e418e7ac83 service nova] Acquiring lock "a259558e-87ea-48c2-8b72-7443c0510d81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:13:18 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-549c6ede-ddc5-4d00-aa8f-cf521c20f1b3 req-745babda-5637-4590-aa1d-31e418e7ac83 service nova] Lock "a259558e-87ea-48c2-8b72-7443c0510d81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:13:18 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-549c6ede-ddc5-4d00-aa8f-cf521c20f1b3 req-745babda-5637-4590-aa1d-31e418e7ac83 service nova] Lock "a259558e-87ea-48c2-8b72-7443c0510d81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:13:18 user nova-compute[95467]: DEBUG nova.compute.manager [req-549c6ede-ddc5-4d00-aa8f-cf521c20f1b3 req-745babda-5637-4590-aa1d-31e418e7ac83 service nova] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] No waiting events found dispatching network-vif-plugged-6026878a-0f2b-467a-be5a-b500e3776ed6 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:13:18 user nova-compute[95467]: WARNING nova.compute.manager [req-549c6ede-ddc5-4d00-aa8f-cf521c20f1b3 req-745babda-5637-4590-aa1d-31e418e7ac83 service nova] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Received unexpected event network-vif-plugged-6026878a-0f2b-467a-be5a-b500e3776ed6 for instance with vm_state deleted and task_state None.
Nov 15 08:13:18 user nova-compute[95467]: DEBUG nova.compute.manager [req-549c6ede-ddc5-4d00-aa8f-cf521c20f1b3 req-745babda-5637-4590-aa1d-31e418e7ac83 service nova] [instance: a259558e-87ea-48c2-8b72-7443c0510d81] Received event network-vif-deleted-6026878a-0f2b-467a-be5a-b500e3776ed6 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:13:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-17e4886c-d335-4085-9b0f-bb8733718155 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Acquiring lock "43f602f1-89c4-40b4-92f4-f054b980ce8a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:13:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-17e4886c-d335-4085-9b0f-bb8733718155 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Lock "43f602f1-89c4-40b4-92f4-f054b980ce8a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:13:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-17e4886c-d335-4085-9b0f-bb8733718155 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Acquiring lock "43f602f1-89c4-40b4-92f4-f054b980ce8a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:13:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-17e4886c-d335-4085-9b0f-bb8733718155 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Lock "43f602f1-89c4-40b4-92f4-f054b980ce8a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:13:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-17e4886c-d335-4085-9b0f-bb8733718155 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Lock "43f602f1-89c4-40b4-92f4-f054b980ce8a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:13:25 user nova-compute[95467]: INFO nova.compute.manager [None req-17e4886c-d335-4085-9b0f-bb8733718155 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: 43f602f1-89c4-40b4-92f4-f054b980ce8a] Terminating instance
Nov 15 08:13:25 user nova-compute[95467]: DEBUG nova.compute.manager [None req-17e4886c-d335-4085-9b0f-bb8733718155 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: 43f602f1-89c4-40b4-92f4-f054b980ce8a] Start destroying the instance on the hypervisor. {{(pid=95467) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 08:13:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:26 user nova-compute[95467]: DEBUG nova.compute.manager [req-912d3174-38d7-47b1-b4d1-a534d4a9388e req-55616e1f-aaa3-46c9-b187-9a4b19cb4e48 service nova] [instance: 43f602f1-89c4-40b4-92f4-f054b980ce8a] Received event network-vif-unplugged-fe613d21-e0c1-49b3-8b93-0dd6b2926fc3 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:13:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-912d3174-38d7-47b1-b4d1-a534d4a9388e req-55616e1f-aaa3-46c9-b187-9a4b19cb4e48 service nova] Acquiring lock "43f602f1-89c4-40b4-92f4-f054b980ce8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:13:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-912d3174-38d7-47b1-b4d1-a534d4a9388e req-55616e1f-aaa3-46c9-b187-9a4b19cb4e48 service nova] Lock "43f602f1-89c4-40b4-92f4-f054b980ce8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:13:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-912d3174-38d7-47b1-b4d1-a534d4a9388e req-55616e1f-aaa3-46c9-b187-9a4b19cb4e48 service nova] Lock "43f602f1-89c4-40b4-92f4-f054b980ce8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:13:26 user nova-compute[95467]: DEBUG nova.compute.manager [req-912d3174-38d7-47b1-b4d1-a534d4a9388e req-55616e1f-aaa3-46c9-b187-9a4b19cb4e48 service nova] [instance: 43f602f1-89c4-40b4-92f4-f054b980ce8a] No waiting events found dispatching network-vif-unplugged-fe613d21-e0c1-49b3-8b93-0dd6b2926fc3 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:13:26 user nova-compute[95467]: DEBUG nova.compute.manager [req-912d3174-38d7-47b1-b4d1-a534d4a9388e req-55616e1f-aaa3-46c9-b187-9a4b19cb4e48 service nova] [instance: 43f602f1-89c4-40b4-92f4-f054b980ce8a] Received event network-vif-unplugged-fe613d21-e0c1-49b3-8b93-0dd6b2926fc3 for instance with task_state deleting. {{(pid=95467) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 08:13:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:26 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 43f602f1-89c4-40b4-92f4-f054b980ce8a] Instance destroyed successfully.
Nov 15 08:13:26 user nova-compute[95467]: DEBUG nova.objects.instance [None req-17e4886c-d335-4085-9b0f-bb8733718155 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Lazy-loading 'resources' on Instance uuid 43f602f1-89c4-40b4-92f4-f054b980ce8a {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:13:26 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-17e4886c-d335-4085-9b0f-bb8733718155 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:11:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1678114168',display_name='tempest-ServersNegativeTestJSON-server-1678114168',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1678114168',id=13,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:11:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1312e86f799549eb8adb4c846576262c',ramdisk_id='',reservation_id='r-z780zsyl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-146474397',owner_user_name='tempest-ServersNegativeTestJSON-146474397-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:11:42Z,user_data=None,user_id='1b2841a0788845f79ea0fccef74eda25',uuid=43f602f1-89c4-40b4-92f4-f054b980ce8a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe613d21-e0c1-49b3-8b93-0dd6b2926fc3", "address": "fa:16:3e:f5:bf:a5", "network": {"id": "9fc550b3-b517-4f14-93cd-f1c2866d1b29", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1976605572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1312e86f799549eb8adb4c846576262c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe613d21-e0", "ovs_interfaceid": "fe613d21-e0c1-49b3-8b93-0dd6b2926fc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:13:26 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-17e4886c-d335-4085-9b0f-bb8733718155 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Converting VIF {"id": "fe613d21-e0c1-49b3-8b93-0dd6b2926fc3", "address": "fa:16:3e:f5:bf:a5", "network": {"id": "9fc550b3-b517-4f14-93cd-f1c2866d1b29", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1976605572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1312e86f799549eb8adb4c846576262c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe613d21-e0", "ovs_interfaceid": "fe613d21-e0c1-49b3-8b93-0dd6b2926fc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:13:26 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-17e4886c-d335-4085-9b0f-bb8733718155 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:bf:a5,bridge_name='br-int',has_traffic_filtering=True,id=fe613d21-e0c1-49b3-8b93-0dd6b2926fc3,network=Network(9fc550b3-b517-4f14-93cd-f1c2866d1b29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe613d21-e0') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:13:26 user nova-compute[95467]: DEBUG os_vif [None req-17e4886c-d335-4085-9b0f-bb8733718155 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:bf:a5,bridge_name='br-int',has_traffic_filtering=True,id=fe613d21-e0c1-49b3-8b93-0dd6b2926fc3,network=Network(9fc550b3-b517-4f14-93cd-f1c2866d1b29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe613d21-e0') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:13:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe613d21-e0, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:13:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:13:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f1e7223b-8bd6-4182-8d36-eef2a3796565) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:13:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:26 user nova-compute[95467]: INFO os_vif [None req-17e4886c-d335-4085-9b0f-bb8733718155 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:bf:a5,bridge_name='br-int',has_traffic_filtering=True,id=fe613d21-e0c1-49b3-8b93-0dd6b2926fc3,network=Network(9fc550b3-b517-4f14-93cd-f1c2866d1b29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe613d21-e0')
Nov 15 08:13:26 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-17e4886c-d335-4085-9b0f-bb8733718155 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: 43f602f1-89c4-40b4-92f4-f054b980ce8a] Deleting instance files /opt/stack/data/nova/instances/43f602f1-89c4-40b4-92f4-f054b980ce8a_del
Nov 15 08:13:26 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-17e4886c-d335-4085-9b0f-bb8733718155 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: 43f602f1-89c4-40b4-92f4-f054b980ce8a] Deletion of /opt/stack/data/nova/instances/43f602f1-89c4-40b4-92f4-f054b980ce8a_del complete
Nov 15 08:13:26 user nova-compute[95467]: INFO nova.compute.manager [None req-17e4886c-d335-4085-9b0f-bb8733718155 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: 43f602f1-89c4-40b4-92f4-f054b980ce8a] Took 0.72 seconds to destroy the instance on the hypervisor.
Nov 15 08:13:26 user nova-compute[95467]: DEBUG oslo.service.loopingcall [None req-17e4886c-d335-4085-9b0f-bb8733718155 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=95467) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 08:13:26 user nova-compute[95467]: DEBUG nova.compute.manager [-] [instance: 43f602f1-89c4-40b4-92f4-f054b980ce8a] Deallocating network for instance {{(pid=95467) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 08:13:26 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: 43f602f1-89c4-40b4-92f4-f054b980ce8a] deallocate_for_instance() {{(pid=95467) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 08:13:26 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: 43f602f1-89c4-40b4-92f4-f054b980ce8a] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:13:27 user nova-compute[95467]: INFO nova.compute.manager [-] [instance: 43f602f1-89c4-40b4-92f4-f054b980ce8a] Took 0.74 seconds to deallocate network for instance.
Nov 15 08:13:27 user nova-compute[95467]: DEBUG nova.compute.manager [req-3a9b0933-5687-41b6-bd00-3a5124461f91 req-6facf869-bef2-4574-a7ba-929d3222602b service nova] [instance: 43f602f1-89c4-40b4-92f4-f054b980ce8a] Received event network-vif-deleted-fe613d21-e0c1-49b3-8b93-0dd6b2926fc3 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:13:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-17e4886c-d335-4085-9b0f-bb8733718155 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:13:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-17e4886c-d335-4085-9b0f-bb8733718155 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:13:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:27 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-17e4886c-d335-4085-9b0f-bb8733718155 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:13:27 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-17e4886c-d335-4085-9b0f-bb8733718155 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:13:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-17e4886c-d335-4085-9b0f-bb8733718155 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.609s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:13:27 user nova-compute[95467]: INFO nova.scheduler.client.report [None req-17e4886c-d335-4085-9b0f-bb8733718155 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Deleted allocations for instance 43f602f1-89c4-40b4-92f4-f054b980ce8a
Nov 15 08:13:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-17e4886c-d335-4085-9b0f-bb8733718155 tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Lock "43f602f1-89c4-40b4-92f4-f054b980ce8a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.330s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:13:28 user nova-compute[95467]: DEBUG nova.compute.manager [req-a8678993-eee7-4f2e-be07-796e242f5df2 req-046373f9-b3c9-4cb8-924b-a80e4d327574 service nova] [instance: 43f602f1-89c4-40b4-92f4-f054b980ce8a] Received event network-vif-plugged-fe613d21-e0c1-49b3-8b93-0dd6b2926fc3 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:13:28 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-a8678993-eee7-4f2e-be07-796e242f5df2 req-046373f9-b3c9-4cb8-924b-a80e4d327574 service nova] Acquiring lock "43f602f1-89c4-40b4-92f4-f054b980ce8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:13:28 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-a8678993-eee7-4f2e-be07-796e242f5df2 req-046373f9-b3c9-4cb8-924b-a80e4d327574 service nova] Lock "43f602f1-89c4-40b4-92f4-f054b980ce8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:13:28 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-a8678993-eee7-4f2e-be07-796e242f5df2 req-046373f9-b3c9-4cb8-924b-a80e4d327574 service nova] Lock "43f602f1-89c4-40b4-92f4-f054b980ce8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:13:28 user nova-compute[95467]: DEBUG nova.compute.manager [req-a8678993-eee7-4f2e-be07-796e242f5df2 req-046373f9-b3c9-4cb8-924b-a80e4d327574 service nova] [instance: 43f602f1-89c4-40b4-92f4-f054b980ce8a] No waiting events found dispatching network-vif-plugged-fe613d21-e0c1-49b3-8b93-0dd6b2926fc3 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:13:28 user nova-compute[95467]: WARNING nova.compute.manager [req-a8678993-eee7-4f2e-be07-796e242f5df2 req-046373f9-b3c9-4cb8-924b-a80e4d327574 service nova] [instance: 43f602f1-89c4-40b4-92f4-f054b980ce8a] Received unexpected event network-vif-plugged-fe613d21-e0c1-49b3-8b93-0dd6b2926fc3 for instance with vm_state deleted and task_state None.
Nov 15 08:13:30 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:31 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:34 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:34 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:13:34 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:13:34 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=95467) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 08:13:36 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:36 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:36 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:13:36 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:13:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:38 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Acquiring lock "3711c883-ec5f-4a09-88f8-d4c0668ae570" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:13:38 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "3711c883-ec5f-4a09-88f8-d4c0668ae570" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:13:38 user nova-compute[95467]: DEBUG nova.compute.manager [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Starting instance... {{(pid=95467) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 08:13:38 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:13:38 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:13:38 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=95467) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 08:13:38 user nova-compute[95467]: INFO nova.compute.claims [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Claim successful on node user
Nov 15 08:13:38 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager.update_available_resource {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:13:38 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:13:38 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:13:38 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:13:38 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.427s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:13:38 user nova-compute[95467]: DEBUG nova.compute.manager [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Start building networks asynchronously for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 08:13:38 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.213s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:13:38 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:13:38 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Auditing locally available compute resources for user (node: user) {{(pid=95467) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 08:13:38 user nova-compute[95467]: DEBUG nova.compute.manager [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Allocating IP information in the background. {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 08:13:38 user nova-compute[95467]: DEBUG nova.network.neutron [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] allocate_for_instance() {{(pid=95467) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 08:13:38 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 08:13:38 user nova-compute[95467]: DEBUG nova.compute.manager [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Start building block device mappings for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 08:13:39 user nova-compute[95467]: DEBUG nova.policy [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2d9b34339b404facac21f500f40b1686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a1aa4f562c64545a94157d4aaf8d14e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95467) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 08:13:39 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:39 user nova-compute[95467]: DEBUG nova.compute.manager [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Start spawning the instance on the hypervisor. {{(pid=95467) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 08:13:39 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Creating instance directory {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 08:13:39 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Creating image(s)
Nov 15 08:13:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Acquiring lock "/opt/stack/data/nova/instances/3711c883-ec5f-4a09-88f8-d4c0668ae570/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:13:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "/opt/stack/data/nova/instances/3711c883-ec5f-4a09-88f8-d4c0668ae570/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:13:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "/opt/stack/data/nova/instances/3711c883-ec5f-4a09-88f8-d4c0668ae570/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:13:39 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:39 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:13:39 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:39 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.189s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:13:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Acquiring lock "a3fcf60225fcefd310404971cd18ab9851c548dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:13:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:13:39 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:39 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:13:39 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68264a44-5adf-4873-b380-26bcafe2ba04/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:39 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.183s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:13:39 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/3711c883-ec5f-4a09-88f8-d4c0668ae570/disk 1073741824 {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:39 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/3711c883-ec5f-4a09-88f8-d4c0668ae570/disk 1073741824" returned: 0 in 0.048s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:13:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:13:39 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:39 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68264a44-5adf-4873-b380-26bcafe2ba04/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:13:39 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68264a44-5adf-4873-b380-26bcafe2ba04/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:39 user nova-compute[95467]: DEBUG nova.network.neutron [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Successfully created port: a30d1fd9-58f1-4efc-8331-ddcaa241fd9b {{(pid=95467) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 08:13:39 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.214s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:13:39 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3711c883-ec5f-4a09-88f8-d4c0668ae570/disk. size=1073741824 {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 08:13:39 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3711c883-ec5f-4a09-88f8-d4c0668ae570/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:39 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68264a44-5adf-4873-b380-26bcafe2ba04/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:13:39 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35bbed35-d10e-4637-b673-754a85f9d2ff/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3711c883-ec5f-4a09-88f8-d4c0668ae570/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:13:40 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Cannot resize image /opt/stack/data/nova/instances/3711c883-ec5f-4a09-88f8-d4c0668ae570/disk to a smaller size. {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 08:13:40 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Created local disks {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 08:13:40 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Ensure instance console log exists: /opt/stack/data/nova/instances/3711c883-ec5f-4a09-88f8-d4c0668ae570/console.log {{(pid=95467) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 08:13:40 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:13:40 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:13:40 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:13:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35bbed35-d10e-4637-b673-754a85f9d2ff/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:13:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35bbed35-d10e-4637-b673-754a85f9d2ff/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35bbed35-d10e-4637-b673-754a85f9d2ff/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:13:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5748cf5d-9c57-4477-8952-ec39d0d18f55/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5748cf5d-9c57-4477-8952-ec39d0d18f55/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:13:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5748cf5d-9c57-4477-8952-ec39d0d18f55/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:40 user nova-compute[95467]: DEBUG nova.network.neutron [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Successfully updated port: a30d1fd9-58f1-4efc-8331-ddcaa241fd9b {{(pid=95467) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 08:13:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5748cf5d-9c57-4477-8952-ec39d0d18f55/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:13:40 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:13:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1edf7591-3991-4df9-98c9-ebc4ca9e5a4a/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:40 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Acquiring lock "refresh_cache-3711c883-ec5f-4a09-88f8-d4c0668ae570" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:13:40 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Acquired lock "refresh_cache-3711c883-ec5f-4a09-88f8-d4c0668ae570" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:13:40 user nova-compute[95467]: DEBUG nova.network.neutron [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:13:40 user nova-compute[95467]: DEBUG nova.compute.manager [req-8cd033a2-f130-4a18-afeb-fbe73979c991 req-5c1897d3-3bde-47ef-ab70-ea58cd82563d service nova] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Received event network-changed-a30d1fd9-58f1-4efc-8331-ddcaa241fd9b {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:13:40 user nova-compute[95467]: DEBUG nova.compute.manager [req-8cd033a2-f130-4a18-afeb-fbe73979c991 req-5c1897d3-3bde-47ef-ab70-ea58cd82563d service nova] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Refreshing instance network info cache due to event network-changed-a30d1fd9-58f1-4efc-8331-ddcaa241fd9b. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:13:40 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-8cd033a2-f130-4a18-afeb-fbe73979c991 req-5c1897d3-3bde-47ef-ab70-ea58cd82563d service nova] Acquiring lock "refresh_cache-3711c883-ec5f-4a09-88f8-d4c0668ae570" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:13:40 user nova-compute[95467]: DEBUG nova.network.neutron [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Instance cache missing network info. {{(pid=95467) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 08:13:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1edf7591-3991-4df9-98c9-ebc4ca9e5a4a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:13:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1edf7591-3991-4df9-98c9-ebc4ca9e5a4a/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1edf7591-3991-4df9-98c9-ebc4ca9e5a4a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:13:41 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:13:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:41 user nova-compute[95467]: DEBUG nova.network.neutron [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Updating instance_info_cache with network_info: [{"id": "a30d1fd9-58f1-4efc-8331-ddcaa241fd9b", "address": "fa:16:3e:bf:61:9e", "network": {"id": "d8a362dc-0dc8-49dd-b2da-0e0749d5edca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-256373617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a1aa4f562c64545a94157d4aaf8d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa30d1fd9-58", "ovs_interfaceid": "a30d1fd9-58f1-4efc-8331-ddcaa241fd9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:13:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:13:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Releasing lock "refresh_cache-3711c883-ec5f-4a09-88f8-d4c0668ae570" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:13:41 user nova-compute[95467]: DEBUG nova.compute.manager [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Instance network_info: |[{"id": "a30d1fd9-58f1-4efc-8331-ddcaa241fd9b", "address": "fa:16:3e:bf:61:9e", "network": {"id": "d8a362dc-0dc8-49dd-b2da-0e0749d5edca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-256373617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a1aa4f562c64545a94157d4aaf8d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa30d1fd9-58", "ovs_interfaceid": "a30d1fd9-58f1-4efc-8331-ddcaa241fd9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 08:13:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-8cd033a2-f130-4a18-afeb-fbe73979c991 req-5c1897d3-3bde-47ef-ab70-ea58cd82563d service nova] Acquired lock "refresh_cache-3711c883-ec5f-4a09-88f8-d4c0668ae570" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:13:41 user nova-compute[95467]: DEBUG nova.network.neutron [req-8cd033a2-f130-4a18-afeb-fbe73979c991 req-5c1897d3-3bde-47ef-ab70-ea58cd82563d service nova] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Refreshing network info cache for port a30d1fd9-58f1-4efc-8331-ddcaa241fd9b {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:13:41 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Start _get_guest_xml network_info=[{"id": "a30d1fd9-58f1-4efc-8331-ddcaa241fd9b", "address": "fa:16:3e:bf:61:9e", "network": {"id": "d8a362dc-0dc8-49dd-b2da-0e0749d5edca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-256373617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a1aa4f562c64545a94157d4aaf8d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa30d1fd9-58", "ovs_interfaceid": "a30d1fd9-58f1-4efc-8331-ddcaa241fd9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'ed9c48aa-ce73-4b3b-9db1-235898be671b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:13:41 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:13:41 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:13:41 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:13:41 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:13:41 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:13:41 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:13:41 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:13:41 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:13:41 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:13:41 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:13:41 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:13:41 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:13:41 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:13:41 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:13:41 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:13:41 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:13:41 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:13:41 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:13:41 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:13:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-687199955',display_name='tempest-tempest.common.compute-instance-687199955',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-687199955',id=17,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCNocaX54qCPZAA9ULAdwlEWPInJDPNBSZ9W8AQmBrWmivIiKz/S0iGFfDxJElLCR+9ambdrPTd00JJrCoxQkWwaJ0sGcUaHDPo10f7hFEQSvZGXEdlnJ7SNY9krWZQ+oQ==',key_name='tempest-keypair-1527809969',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0a1aa4f562c64545a94157d4aaf8d14e',ramdisk_id='',reservation_id='r-nbpm0erc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-937420730',owner_user_name='tempest-ServerActionsTestOtherA-937420730-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:13:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d9b34339b404facac21f500f40b1686',uuid=3711c883-ec5f-4a09-88f8-d4c0668ae570,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a30d1fd9-58f1-4efc-8331-ddcaa241fd9b", "address": "fa:16:3e:bf:61:9e", "network": {"id": "d8a362dc-0dc8-49dd-b2da-0e0749d5edca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-256373617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a1aa4f562c64545a94157d4aaf8d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa30d1fd9-58", "ovs_interfaceid": "a30d1fd9-58f1-4efc-8331-ddcaa241fd9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:13:41 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Converting VIF {"id": "a30d1fd9-58f1-4efc-8331-ddcaa241fd9b", "address": "fa:16:3e:bf:61:9e", "network": {"id": "d8a362dc-0dc8-49dd-b2da-0e0749d5edca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-256373617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a1aa4f562c64545a94157d4aaf8d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa30d1fd9-58", "ovs_interfaceid": "a30d1fd9-58f1-4efc-8331-ddcaa241fd9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:13:41 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:61:9e,bridge_name='br-int',has_traffic_filtering=True,id=a30d1fd9-58f1-4efc-8331-ddcaa241fd9b,network=Network(d8a362dc-0dc8-49dd-b2da-0e0749d5edca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa30d1fd9-58') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:13:41 user nova-compute[95467]: DEBUG nova.objects.instance [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lazy-loading 'pci_devices' on Instance uuid 3711c883-ec5f-4a09-88f8-d4c0668ae570 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:13:41 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:13:41 user nova-compute[95467]:   <uuid>3711c883-ec5f-4a09-88f8-d4c0668ae570</uuid>
Nov 15 08:13:41 user nova-compute[95467]:   <name>instance-00000011</name>
Nov 15 08:13:41 user nova-compute[95467]:   <memory>524288</memory>
Nov 15 08:13:41 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:13:41 user nova-compute[95467]:   <metadata>
Nov 15 08:13:41 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:13:41 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:13:41 user nova-compute[95467]:       <nova:name>tempest-tempest.common.compute-instance-687199955</nova:name>
Nov 15 08:13:41 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:13:41</nova:creationTime>
Nov 15 08:13:41 user nova-compute[95467]:       <nova:flavor name="m1.tiny">
Nov 15 08:13:41 user nova-compute[95467]:         <nova:memory>512</nova:memory>
Nov 15 08:13:41 user nova-compute[95467]:         <nova:disk>1</nova:disk>
Nov 15 08:13:41 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:13:41 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:13:41 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:13:41 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:13:41 user nova-compute[95467]:       <nova:owner>
Nov 15 08:13:41 user nova-compute[95467]:         <nova:user uuid="2d9b34339b404facac21f500f40b1686">tempest-ServerActionsTestOtherA-937420730-project-member</nova:user>
Nov 15 08:13:41 user nova-compute[95467]:         <nova:project uuid="0a1aa4f562c64545a94157d4aaf8d14e">tempest-ServerActionsTestOtherA-937420730</nova:project>
Nov 15 08:13:41 user nova-compute[95467]:       </nova:owner>
Nov 15 08:13:41 user nova-compute[95467]:       <nova:root type="image" uuid="ed9c48aa-ce73-4b3b-9db1-235898be671b"/>
Nov 15 08:13:41 user nova-compute[95467]:       <nova:ports>
Nov 15 08:13:41 user nova-compute[95467]:         <nova:port uuid="a30d1fd9-58f1-4efc-8331-ddcaa241fd9b">
Nov 15 08:13:41 user nova-compute[95467]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 08:13:41 user nova-compute[95467]:         </nova:port>
Nov 15 08:13:41 user nova-compute[95467]:       </nova:ports>
Nov 15 08:13:41 user nova-compute[95467]:     </nova:instance>
Nov 15 08:13:41 user nova-compute[95467]:   </metadata>
Nov 15 08:13:41 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:13:41 user nova-compute[95467]:     <system>
Nov 15 08:13:41 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:13:41 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:13:41 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:13:41 user nova-compute[95467]:       <entry name="serial">3711c883-ec5f-4a09-88f8-d4c0668ae570</entry>
Nov 15 08:13:41 user nova-compute[95467]:       <entry name="uuid">3711c883-ec5f-4a09-88f8-d4c0668ae570</entry>
Nov 15 08:13:41 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:13:41 user nova-compute[95467]:     </system>
Nov 15 08:13:41 user nova-compute[95467]:   </sysinfo>
Nov 15 08:13:41 user nova-compute[95467]:   <os>
Nov 15 08:13:41 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:13:41 user nova-compute[95467]:     <boot dev="hd"/>
Nov 15 08:13:41 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:13:41 user nova-compute[95467]:   </os>
Nov 15 08:13:41 user nova-compute[95467]:   <features>
Nov 15 08:13:41 user nova-compute[95467]:     <acpi/>
Nov 15 08:13:41 user nova-compute[95467]:     <apic/>
Nov 15 08:13:41 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:13:41 user nova-compute[95467]:   </features>
Nov 15 08:13:41 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:13:41 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:13:41 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:13:41 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:13:41 user nova-compute[95467]:   </clock>
Nov 15 08:13:41 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:13:41 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:13:41 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:13:41 user nova-compute[95467]:   </cpu>
Nov 15 08:13:41 user nova-compute[95467]:   <devices>
Nov 15 08:13:41 user nova-compute[95467]:     <disk type="file" device="disk">
Nov 15 08:13:41 user nova-compute[95467]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 08:13:41 user nova-compute[95467]:       <source file="/opt/stack/data/nova/instances/3711c883-ec5f-4a09-88f8-d4c0668ae570/disk"/>
Nov 15 08:13:41 user nova-compute[95467]:       <target dev="vda" bus="virtio"/>
Nov 15 08:13:41 user nova-compute[95467]:     </disk>
Nov 15 08:13:41 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:13:41 user nova-compute[95467]:       <mac address="fa:16:3e:bf:61:9e"/>
Nov 15 08:13:41 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:13:41 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:13:41 user nova-compute[95467]:       <target dev="tapa30d1fd9-58"/>
Nov 15 08:13:41 user nova-compute[95467]:     </interface>
Nov 15 08:13:41 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:13:41 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/3711c883-ec5f-4a09-88f8-d4c0668ae570/console.log" append="off"/>
Nov 15 08:13:41 user nova-compute[95467]:     </serial>
Nov 15 08:13:41 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:13:41 user nova-compute[95467]:     <video>
Nov 15 08:13:41 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:13:41 user nova-compute[95467]:     </video>
Nov 15 08:13:41 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:13:41 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:13:41 user nova-compute[95467]:     </rng>
Nov 15 08:13:41 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:13:41 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:13:41 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:13:41 user nova-compute[95467]:     </memballoon>
Nov 15 08:13:41 user nova-compute[95467]:   </devices>
Nov 15 08:13:41 user nova-compute[95467]: </domain>
Nov 15 08:13:41 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:13:41 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:13:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-687199955',display_name='tempest-tempest.common.compute-instance-687199955',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-687199955',id=17,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCNocaX54qCPZAA9ULAdwlEWPInJDPNBSZ9W8AQmBrWmivIiKz/S0iGFfDxJElLCR+9ambdrPTd00JJrCoxQkWwaJ0sGcUaHDPo10f7hFEQSvZGXEdlnJ7SNY9krWZQ+oQ==',key_name='tempest-keypair-1527809969',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0a1aa4f562c64545a94157d4aaf8d14e',ramdisk_id='',reservation_id='r-nbpm0erc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-937420730',owner_user_name='tempest-ServerActionsTestOtherA-937420730-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:13:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d9b34339b404facac21f500f40b1686',uuid=3711c883-ec5f-4a09-88f8-d4c0668ae570,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a30d1fd9-58f1-4efc-8331-ddcaa241fd9b", "address": "fa:16:3e:bf:61:9e", "network": {"id": "d8a362dc-0dc8-49dd-b2da-0e0749d5edca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-256373617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a1aa4f562c64545a94157d4aaf8d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa30d1fd9-58", "ovs_interfaceid": "a30d1fd9-58f1-4efc-8331-ddcaa241fd9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:13:41 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Converting VIF {"id": "a30d1fd9-58f1-4efc-8331-ddcaa241fd9b", "address": "fa:16:3e:bf:61:9e", "network": {"id": "d8a362dc-0dc8-49dd-b2da-0e0749d5edca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-256373617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a1aa4f562c64545a94157d4aaf8d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa30d1fd9-58", "ovs_interfaceid": "a30d1fd9-58f1-4efc-8331-ddcaa241fd9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:13:41 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:61:9e,bridge_name='br-int',has_traffic_filtering=True,id=a30d1fd9-58f1-4efc-8331-ddcaa241fd9b,network=Network(d8a362dc-0dc8-49dd-b2da-0e0749d5edca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa30d1fd9-58') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:13:41 user nova-compute[95467]: DEBUG os_vif [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:61:9e,bridge_name='br-int',has_traffic_filtering=True,id=a30d1fd9-58f1-4efc-8331-ddcaa241fd9b,network=Network(d8a362dc-0dc8-49dd-b2da-0e0749d5edca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa30d1fd9-58') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:13:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:13:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:13:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '716c95ed-0fec-52d1-bb1b-a5ca731e93da', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:13:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:13:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:13:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa30d1fd9-58, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:13:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa30d1fd9-58, col_values=(('qos', UUID('0e87aef9-9a8f-432b-930e-ebd315af74fa')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:13:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa30d1fd9-58, col_values=(('external_ids', {'iface-id': 'a30d1fd9-58f1-4efc-8331-ddcaa241fd9b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:61:9e', 'vm-uuid': '3711c883-ec5f-4a09-88f8-d4c0668ae570'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:13:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:13:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60e20e77-6091-4abc-bbad-b5f21a2071c3/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:41 user nova-compute[95467]: INFO os_vif [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:61:9e,bridge_name='br-int',has_traffic_filtering=True,id=a30d1fd9-58f1-4efc-8331-ddcaa241fd9b,network=Network(d8a362dc-0dc8-49dd-b2da-0e0749d5edca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa30d1fd9-58')
Nov 15 08:13:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-151a80fc-4c56-41c1-b4cb-3ef7e0951cd4 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Acquiring lock "1edf7591-3991-4df9-98c9-ebc4ca9e5a4a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:13:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-151a80fc-4c56-41c1-b4cb-3ef7e0951cd4 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Lock "1edf7591-3991-4df9-98c9-ebc4ca9e5a4a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:13:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-151a80fc-4c56-41c1-b4cb-3ef7e0951cd4 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Acquiring lock "1edf7591-3991-4df9-98c9-ebc4ca9e5a4a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:13:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-151a80fc-4c56-41c1-b4cb-3ef7e0951cd4 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Lock "1edf7591-3991-4df9-98c9-ebc4ca9e5a4a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:13:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-151a80fc-4c56-41c1-b4cb-3ef7e0951cd4 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Lock "1edf7591-3991-4df9-98c9-ebc4ca9e5a4a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:13:41 user nova-compute[95467]: INFO nova.compute.manager [None req-151a80fc-4c56-41c1-b4cb-3ef7e0951cd4 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Terminating instance
Nov 15 08:13:41 user nova-compute[95467]: DEBUG nova.compute.manager [None req-151a80fc-4c56-41c1-b4cb-3ef7e0951cd4 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Start destroying the instance on the hypervisor. {{(pid=95467) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 08:13:41 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:13:41 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] No VIF found with MAC fa:16:3e:bf:61:9e, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:13:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60e20e77-6091-4abc-bbad-b5f21a2071c3/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:13:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60e20e77-6091-4abc-bbad-b5f21a2071c3/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60e20e77-6091-4abc-bbad-b5f21a2071c3/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:13:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0917b083-2bbf-4baf-a0b8-d59ba3e2256b/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:42 user nova-compute[95467]: DEBUG nova.network.neutron [req-8cd033a2-f130-4a18-afeb-fbe73979c991 req-5c1897d3-3bde-47ef-ab70-ea58cd82563d service nova] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Updated VIF entry in instance network info cache for port a30d1fd9-58f1-4efc-8331-ddcaa241fd9b. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:13:42 user nova-compute[95467]: DEBUG nova.network.neutron [req-8cd033a2-f130-4a18-afeb-fbe73979c991 req-5c1897d3-3bde-47ef-ab70-ea58cd82563d service nova] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Updating instance_info_cache with network_info: [{"id": "a30d1fd9-58f1-4efc-8331-ddcaa241fd9b", "address": "fa:16:3e:bf:61:9e", "network": {"id": "d8a362dc-0dc8-49dd-b2da-0e0749d5edca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-256373617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a1aa4f562c64545a94157d4aaf8d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa30d1fd9-58", "ovs_interfaceid": "a30d1fd9-58f1-4efc-8331-ddcaa241fd9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:13:42 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-8cd033a2-f130-4a18-afeb-fbe73979c991 req-5c1897d3-3bde-47ef-ab70-ea58cd82563d service nova] Releasing lock "refresh_cache-3711c883-ec5f-4a09-88f8-d4c0668ae570" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:13:42 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8287a036-9337-4033-b682-eb3271515446 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Acquiring lock "0917b083-2bbf-4baf-a0b8-d59ba3e2256b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:13:42 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8287a036-9337-4033-b682-eb3271515446 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Lock "0917b083-2bbf-4baf-a0b8-d59ba3e2256b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:13:42 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8287a036-9337-4033-b682-eb3271515446 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Acquiring lock "0917b083-2bbf-4baf-a0b8-d59ba3e2256b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:13:42 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8287a036-9337-4033-b682-eb3271515446 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Lock "0917b083-2bbf-4baf-a0b8-d59ba3e2256b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:13:42 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8287a036-9337-4033-b682-eb3271515446 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Lock "0917b083-2bbf-4baf-a0b8-d59ba3e2256b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:13:42 user nova-compute[95467]: INFO nova.compute.manager [None req-8287a036-9337-4033-b682-eb3271515446 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Terminating instance
Nov 15 08:13:42 user nova-compute[95467]: DEBUG nova.compute.manager [None req-8287a036-9337-4033-b682-eb3271515446 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Start destroying the instance on the hypervisor. {{(pid=95467) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 08:13:42 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0917b083-2bbf-4baf-a0b8-d59ba3e2256b/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:13:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0917b083-2bbf-4baf-a0b8-d59ba3e2256b/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:42 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:42 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:42 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:42 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0917b083-2bbf-4baf-a0b8-d59ba3e2256b/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:13:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2aa477-6786-483a-b088-d8ec204fe6aa/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:42 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2aa477-6786-483a-b088-d8ec204fe6aa/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:13:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2aa477-6786-483a-b088-d8ec204fe6aa/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2aa477-6786-483a-b088-d8ec204fe6aa/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG nova.compute.manager [req-ac9096c2-4487-4bea-8432-92e9f6691d57 req-dd30eb2e-d223-480e-87e1-a0d3958060a2 service nova] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Received event network-vif-unplugged-193139f8-f050-4caf-89d7-106a3a504625 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ac9096c2-4487-4bea-8432-92e9f6691d57 req-dd30eb2e-d223-480e-87e1-a0d3958060a2 service nova] Acquiring lock "1edf7591-3991-4df9-98c9-ebc4ca9e5a4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ac9096c2-4487-4bea-8432-92e9f6691d57 req-dd30eb2e-d223-480e-87e1-a0d3958060a2 service nova] Lock "1edf7591-3991-4df9-98c9-ebc4ca9e5a4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ac9096c2-4487-4bea-8432-92e9f6691d57 req-dd30eb2e-d223-480e-87e1-a0d3958060a2 service nova] Lock "1edf7591-3991-4df9-98c9-ebc4ca9e5a4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG nova.compute.manager [req-ac9096c2-4487-4bea-8432-92e9f6691d57 req-dd30eb2e-d223-480e-87e1-a0d3958060a2 service nova] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] No waiting events found dispatching network-vif-unplugged-193139f8-f050-4caf-89d7-106a3a504625 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG nova.compute.manager [req-ac9096c2-4487-4bea-8432-92e9f6691d57 req-dd30eb2e-d223-480e-87e1-a0d3958060a2 service nova] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Received event network-vif-unplugged-193139f8-f050-4caf-89d7-106a3a504625 for instance with task_state deleting. {{(pid=95467) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG nova.compute.manager [req-6db55e26-6201-43da-85cf-1f357c61ba5b req-d9ebbacf-93d0-4589-9165-a08ec6f945d6 service nova] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Received event network-vif-plugged-193139f8-f050-4caf-89d7-106a3a504625 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-6db55e26-6201-43da-85cf-1f357c61ba5b req-d9ebbacf-93d0-4589-9165-a08ec6f945d6 service nova] Acquiring lock "1edf7591-3991-4df9-98c9-ebc4ca9e5a4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-6db55e26-6201-43da-85cf-1f357c61ba5b req-d9ebbacf-93d0-4589-9165-a08ec6f945d6 service nova] Lock "1edf7591-3991-4df9-98c9-ebc4ca9e5a4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-6db55e26-6201-43da-85cf-1f357c61ba5b req-d9ebbacf-93d0-4589-9165-a08ec6f945d6 service nova] Lock "1edf7591-3991-4df9-98c9-ebc4ca9e5a4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG nova.compute.manager [req-6db55e26-6201-43da-85cf-1f357c61ba5b req-d9ebbacf-93d0-4589-9165-a08ec6f945d6 service nova] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] No waiting events found dispatching network-vif-plugged-193139f8-f050-4caf-89d7-106a3a504625 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:13:46 user nova-compute[95467]: WARNING nova.compute.manager [req-6db55e26-6201-43da-85cf-1f357c61ba5b req-d9ebbacf-93d0-4589-9165-a08ec6f945d6 service nova] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Received unexpected event network-vif-plugged-193139f8-f050-4caf-89d7-106a3a504625 for instance with vm_state active and task_state deleting.
Nov 15 08:13:46 user nova-compute[95467]: DEBUG nova.compute.manager [req-6db55e26-6201-43da-85cf-1f357c61ba5b req-d9ebbacf-93d0-4589-9165-a08ec6f945d6 service nova] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Received event network-vif-plugged-a30d1fd9-58f1-4efc-8331-ddcaa241fd9b {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-6db55e26-6201-43da-85cf-1f357c61ba5b req-d9ebbacf-93d0-4589-9165-a08ec6f945d6 service nova] Acquiring lock "3711c883-ec5f-4a09-88f8-d4c0668ae570-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-6db55e26-6201-43da-85cf-1f357c61ba5b req-d9ebbacf-93d0-4589-9165-a08ec6f945d6 service nova] Lock "3711c883-ec5f-4a09-88f8-d4c0668ae570-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-6db55e26-6201-43da-85cf-1f357c61ba5b req-d9ebbacf-93d0-4589-9165-a08ec6f945d6 service nova] Lock "3711c883-ec5f-4a09-88f8-d4c0668ae570-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG nova.compute.manager [req-6db55e26-6201-43da-85cf-1f357c61ba5b req-d9ebbacf-93d0-4589-9165-a08ec6f945d6 service nova] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] No waiting events found dispatching network-vif-plugged-a30d1fd9-58f1-4efc-8331-ddcaa241fd9b {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:13:46 user nova-compute[95467]: WARNING nova.compute.manager [req-6db55e26-6201-43da-85cf-1f357c61ba5b req-d9ebbacf-93d0-4589-9165-a08ec6f945d6 service nova] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Received unexpected event network-vif-plugged-a30d1fd9-58f1-4efc-8331-ddcaa241fd9b for instance with vm_state building and task_state spawning.
Nov 15 08:13:46 user nova-compute[95467]: DEBUG nova.compute.manager [req-6db55e26-6201-43da-85cf-1f357c61ba5b req-d9ebbacf-93d0-4589-9165-a08ec6f945d6 service nova] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Received event network-vif-plugged-a30d1fd9-58f1-4efc-8331-ddcaa241fd9b {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-6db55e26-6201-43da-85cf-1f357c61ba5b req-d9ebbacf-93d0-4589-9165-a08ec6f945d6 service nova] Acquiring lock "3711c883-ec5f-4a09-88f8-d4c0668ae570-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-6db55e26-6201-43da-85cf-1f357c61ba5b req-d9ebbacf-93d0-4589-9165-a08ec6f945d6 service nova] Lock "3711c883-ec5f-4a09-88f8-d4c0668ae570-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-6db55e26-6201-43da-85cf-1f357c61ba5b req-d9ebbacf-93d0-4589-9165-a08ec6f945d6 service nova] Lock "3711c883-ec5f-4a09-88f8-d4c0668ae570-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG nova.compute.manager [req-6db55e26-6201-43da-85cf-1f357c61ba5b req-d9ebbacf-93d0-4589-9165-a08ec6f945d6 service nova] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] No waiting events found dispatching network-vif-plugged-a30d1fd9-58f1-4efc-8331-ddcaa241fd9b {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:13:46 user nova-compute[95467]: WARNING nova.compute.manager [req-6db55e26-6201-43da-85cf-1f357c61ba5b req-d9ebbacf-93d0-4589-9165-a08ec6f945d6 service nova] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Received unexpected event network-vif-plugged-a30d1fd9-58f1-4efc-8331-ddcaa241fd9b for instance with vm_state building and task_state spawning.
Nov 15 08:13:46 user nova-compute[95467]: DEBUG nova.compute.manager [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Instance event wait completed in 0 seconds for  {{(pid=95467) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Guest created on hypervisor {{(pid=95467) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Acquiring lock "bee31898-4f12-4c68-a18b-a678f9f584aa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Lock "bee31898-4f12-4c68-a18b-a678f9f584aa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Acquiring lock "36dccf43-d4a3-47aa-bd73-de9646e1020c" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "36dccf43-d4a3-47aa-bd73-de9646e1020c" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:13:46 user nova-compute[95467]: INFO nova.compute.manager [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Unshelving
Nov 15 08:13:46 user nova-compute[95467]: DEBUG nova.compute.manager [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Starting instance... {{(pid=95467) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 08:13:46 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Instance destroyed successfully.
Nov 15 08:13:46 user nova-compute[95467]: DEBUG nova.objects.instance [None req-151a80fc-4c56-41c1-b4cb-3ef7e0951cd4 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Lazy-loading 'resources' on Instance uuid 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:13:46 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Instance destroyed successfully.
Nov 15 08:13:46 user nova-compute[95467]: DEBUG nova.objects.instance [None req-8287a036-9337-4033-b682-eb3271515446 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Lazy-loading 'resources' on Instance uuid 0917b083-2bbf-4baf-a0b8-d59ba3e2256b {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:13:46 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:13:46 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:13:46 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Hypervisor/Node resource view: name=user free_ram=7442MB free_disk=25.509376525878906GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=95467) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:13:46 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Instance spawned successfully.
Nov 15 08:13:46 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-151a80fc-4c56-41c1-b4cb-3ef7e0951cd4 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:10:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1870022804',display_name='tempest-TestVolumeSwap-server-1870022804',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1870022804',id=8,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGwq1WBdUFZ1Z3ja7L/L4p6PACTYXD5PCPUPwRd3lrb9GL1RliBoFLJu6tB1C0dYROS9DCw1p9N09wCw7neE0hJs1hvrRMkMivRvvefdvnZjgHfG6FuuJIwTc2fFKMIg/Q==',key_name='tempest-keypair-1249332897',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:10:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6f70df4261044d978ed77e71a44d51c4',ramdisk_id='',reservation_id='r-3raibaz5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1759371360',owner_user_name='tempest-TestVolumeSwap-1759371360-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:10:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad3d95ab283840bebdb388b34d039c6d',uuid=1edf7591-3991-4df9-98c9-ebc4ca9e5a4a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "193139f8-f050-4caf-89d7-106a3a504625", "address": "fa:16:3e:ff:f2:53", "network": {"id": "f0b11bd0-0901-4ad2-982b-eda46e03fa1c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1915160333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f70df4261044d978ed77e71a44d51c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap193139f8-f0", "ovs_interfaceid": "193139f8-f050-4caf-89d7-106a3a504625", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-151a80fc-4c56-41c1-b4cb-3ef7e0951cd4 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Converting VIF {"id": "193139f8-f050-4caf-89d7-106a3a504625", "address": "fa:16:3e:ff:f2:53", "network": {"id": "f0b11bd0-0901-4ad2-982b-eda46e03fa1c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1915160333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f70df4261044d978ed77e71a44d51c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap193139f8-f0", "ovs_interfaceid": "193139f8-f050-4caf-89d7-106a3a504625", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-151a80fc-4c56-41c1-b4cb-3ef7e0951cd4 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ff:f2:53,bridge_name='br-int',has_traffic_filtering=True,id=193139f8-f050-4caf-89d7-106a3a504625,network=Network(f0b11bd0-0901-4ad2-982b-eda46e03fa1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap193139f8-f0') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG os_vif [None req-151a80fc-4c56-41c1-b4cb-3ef7e0951cd4 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:f2:53,bridge_name='br-int',has_traffic_filtering=True,id=193139f8-f050-4caf-89d7-106a3a504625,network=Network(f0b11bd0-0901-4ad2-982b-eda46e03fa1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap193139f8-f0') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-8287a036-9337-4033-b682-eb3271515446 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T08:10:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-940506734',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-940506734',id=9,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOGNo6GmVxPWDErmWkQ6fepU8heeIoJyOQ4cdNTLpFz1E0Ctc05CX23OX/CDepMfdF3Ar0clX85i/1Lr4zTu3ZjElr//sRBIxLqJHKfdYZdCUYYo+kOnMpjx+ZoNdO+nnQ==',key_name='tempest-keypair-1459138786',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:10:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='18fe2aa7cd7c4943a8c848dd52b9697b',ramdisk_id='',reservation_id='r-edurmax0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2023837645',owner_user_name='tempest-TaggedAttachmentsTest-2023837645-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:10:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c29ac74b4e745a09af7ecedde0f5697',uuid=0917b083-2bbf-4baf-a0b8-d59ba3e2256b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f6d25344-c8fc-4794-b302-a3665c62b78c", "address": "fa:16:3e:b4:72:56", "network": {"id": "76e3f53b-50a0-47d5-9e18-0bb9c42d5ba3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-182207081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18fe2aa7cd7c4943a8c848dd52b9697b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6d25344-c8", "ovs_interfaceid": "f6d25344-c8fc-4794-b302-a3665c62b78c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-8287a036-9337-4033-b682-eb3271515446 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Converting VIF {"id": "f6d25344-c8fc-4794-b302-a3665c62b78c", "address": "fa:16:3e:b4:72:56", "network": {"id": "76e3f53b-50a0-47d5-9e18-0bb9c42d5ba3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-182207081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18fe2aa7cd7c4943a8c848dd52b9697b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6d25344-c8", "ovs_interfaceid": "f6d25344-c8fc-4794-b302-a3665c62b78c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-8287a036-9337-4033-b682-eb3271515446 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:72:56,bridge_name='br-int',has_traffic_filtering=True,id=f6d25344-c8fc-4794-b302-a3665c62b78c,network=Network(76e3f53b-50a0-47d5-9e18-0bb9c42d5ba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6d25344-c8') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG os_vif [None req-8287a036-9337-4033-b682-eb3271515446 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:72:56,bridge_name='br-int',has_traffic_filtering=True,id=f6d25344-c8fc-4794-b302-a3665c62b78c,network=Network(76e3f53b-50a0-47d5-9e18-0bb9c42d5ba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6d25344-c8') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap193139f8-f0, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf6d25344-c8, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8e17af2a-c6b6-4196-8565-4ca348e2b781) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5d30567e-722c-4a7b-8bb9-047dd125e517) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:13:46 user nova-compute[95467]: INFO os_vif [None req-151a80fc-4c56-41c1-b4cb-3ef7e0951cd4 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:f2:53,bridge_name='br-int',has_traffic_filtering=True,id=193139f8-f050-4caf-89d7-106a3a504625,network=Network(f0b11bd0-0901-4ad2-982b-eda46e03fa1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap193139f8-f0')
Nov 15 08:13:46 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-151a80fc-4c56-41c1-b4cb-3ef7e0951cd4 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Deleting instance files /opt/stack/data/nova/instances/1edf7591-3991-4df9-98c9-ebc4ca9e5a4a_del
Nov 15 08:13:46 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-151a80fc-4c56-41c1-b4cb-3ef7e0951cd4 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Deletion of /opt/stack/data/nova/instances/1edf7591-3991-4df9-98c9-ebc4ca9e5a4a_del complete
Nov 15 08:13:46 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Found default for hw_cdrom_bus of ide {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Found default for hw_disk_bus of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Found default for hw_input_bus of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Found default for hw_pointer_model of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Found default for hw_video_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Found default for hw_vif_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:13:46 user nova-compute[95467]: INFO os_vif [None req-8287a036-9337-4033-b682-eb3271515446 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:72:56,bridge_name='br-int',has_traffic_filtering=True,id=f6d25344-c8fc-4794-b302-a3665c62b78c,network=Network(76e3f53b-50a0-47d5-9e18-0bb9c42d5ba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6d25344-c8')
Nov 15 08:13:46 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-8287a036-9337-4033-b682-eb3271515446 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Deleting instance files /opt/stack/data/nova/instances/0917b083-2bbf-4baf-a0b8-d59ba3e2256b_del
Nov 15 08:13:46 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-8287a036-9337-4033-b682-eb3271515446 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Deletion of /opt/stack/data/nova/instances/0917b083-2bbf-4baf-a0b8-d59ba3e2256b_del complete
Nov 15 08:13:46 user nova-compute[95467]: INFO nova.virt.block_device [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Booting with volume cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77 at /dev/vdc
Nov 15 08:13:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG os_brick.utils [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc36107-36ae-4f69-bf46-c00072ab8781]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:882ae90641f\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance ee2aa477-6786-483a-b088-d8ec204fe6aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 5748cf5d-9c57-4477-8952-ec39d0d18f55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 73fe8852-c47a-47ab-a56f-6864c8ed5479 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 68264a44-5adf-4873-b380-26bcafe2ba04 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 7e53d93e-1222-4b1a-9745-d512da0f7925 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 0917b083-2bbf-4baf-a0b8-d59ba3e2256b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 60e20e77-6091-4abc-bbad-b5f21a2071c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 21cf2ada-b15c-490d-ac37-96e9c87e9056 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 35bbed35-d10e-4637-b673-754a85f9d2ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 3711c883-ec5f-4a09-88f8-d4c0668ae570 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb8328f-d5ca-4db2-afcd-5438da92a568]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:46 user nova-compute[95467]: INFO nova.compute.manager [None req-151a80fc-4c56-41c1-b4cb-3ef7e0951cd4 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Took 5.23 seconds to destroy the instance on the hypervisor.
Nov 15 08:13:46 user nova-compute[95467]: DEBUG oslo.service.loopingcall [None req-151a80fc-4c56-41c1-b4cb-3ef7e0951cd4 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=95467) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG nova.compute.manager [-] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Deallocating network for instance {{(pid=95467) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] deallocate_for_instance() {{(pid=95467) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 08:13:46 user nova-compute[95467]: INFO nova.compute.manager [None req-8287a036-9337-4033-b682-eb3271515446 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Took 4.65 seconds to destroy the instance on the hypervisor.
Nov 15 08:13:46 user nova-compute[95467]: DEBUG oslo.service.loopingcall [None req-8287a036-9337-4033-b682-eb3271515446 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=95467) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG nova.compute.manager [-] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Deallocating network for instance {{(pid=95467) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] deallocate_for_instance() {{(pid=95467) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89c5ff4-7fb6-43be-9eaf-9d8a119cb367]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb21f53-d381-4730-a12d-19e31aba507b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Running cmd (subprocess): nvme version {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] 'nvme version' failed. Not Retrying. {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] nvme not present on system {{(pid=95467) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 08:13:46 user nova-compute[95467]: INFO nova.compute.manager [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Took 7.68 seconds to spawn the instance on the hypervisor.
Nov 15 08:13:46 user nova-compute[95467]: DEBUG nova.compute.manager [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 36dccf43-d4a3-47aa-bd73-de9646e1020c has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:13:46 user nova-compute[95467]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 08:13:46 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc17f08c-685b-4b4f-956e-cca0755dd4c5]: (4, '') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=95467) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] LIGHTOS: no hostnqn found. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG os_brick.utils [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:882ae90641f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG nova.virt.block_device [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Updating existing volume attachment record: d9d2d0b1-57da-4609-ae82-17a85f49eb4e {{(pid=95467) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance bee31898-4f12-4c68-a18b-a678f9f584aa has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 08:13:46 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 08:13:46 user nova-compute[95467]: INFO nova.compute.manager [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Took 8.56 seconds to build instance.
Nov 15 08:13:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7089abc9-fcd4-4d9c-8bf2-89339c65991c tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "3711c883-ec5f-4a09-88f8-d4c0668ae570" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.663s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:13:47 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:47 user nova-compute[95467]: DEBUG nova.compute.manager [req-85bc4bb5-f462-4df8-a5ff-46330258f6a5 req-f2706798-ab37-4922-9e97-427fa57ed8e4 service nova] [instance: 60e20e77-6091-4abc-bbad-b5f21a2071c3] Received event network-changed-f5cfd0fc-8461-4ed8-aa91-08fe7a2eb6c0 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:13:47 user nova-compute[95467]: DEBUG nova.compute.manager [req-85bc4bb5-f462-4df8-a5ff-46330258f6a5 req-f2706798-ab37-4922-9e97-427fa57ed8e4 service nova] [instance: 60e20e77-6091-4abc-bbad-b5f21a2071c3] Refreshing instance network info cache due to event network-changed-f5cfd0fc-8461-4ed8-aa91-08fe7a2eb6c0. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:13:47 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-85bc4bb5-f462-4df8-a5ff-46330258f6a5 req-f2706798-ab37-4922-9e97-427fa57ed8e4 service nova] Acquiring lock "refresh_cache-60e20e77-6091-4abc-bbad-b5f21a2071c3" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:13:47 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-85bc4bb5-f462-4df8-a5ff-46330258f6a5 req-f2706798-ab37-4922-9e97-427fa57ed8e4 service nova] Acquired lock "refresh_cache-60e20e77-6091-4abc-bbad-b5f21a2071c3" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:13:47 user nova-compute[95467]: DEBUG nova.network.neutron [req-85bc4bb5-f462-4df8-a5ff-46330258f6a5 req-f2706798-ab37-4922-9e97-427fa57ed8e4 service nova] [instance: 60e20e77-6091-4abc-bbad-b5f21a2071c3] Refreshing network info cache for port f5cfd0fc-8461-4ed8-aa91-08fe7a2eb6c0 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:13:47 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:13:47 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:13:47 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Compute_service record updated for user:user {{(pid=95467) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 08:13:47 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.011s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:13:47 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.889s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:13:47 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=95467) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 08:13:47 user nova-compute[95467]: INFO nova.compute.claims [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Claim successful on node user
Nov 15 08:13:47 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:13:47 user nova-compute[95467]: INFO nova.compute.manager [-] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Took 1.00 seconds to deallocate network for instance.
Nov 15 08:13:47 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-2b0af5ce-be80-4133-ae8f-ff5e16e7057e tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Acquiring lock "60e20e77-6091-4abc-bbad-b5f21a2071c3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:13:47 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-2b0af5ce-be80-4133-ae8f-ff5e16e7057e tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "60e20e77-6091-4abc-bbad-b5f21a2071c3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:13:47 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-2b0af5ce-be80-4133-ae8f-ff5e16e7057e tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Acquiring lock "60e20e77-6091-4abc-bbad-b5f21a2071c3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:13:47 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-2b0af5ce-be80-4133-ae8f-ff5e16e7057e tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "60e20e77-6091-4abc-bbad-b5f21a2071c3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:13:47 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-2b0af5ce-be80-4133-ae8f-ff5e16e7057e tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "60e20e77-6091-4abc-bbad-b5f21a2071c3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:13:47 user nova-compute[95467]: INFO nova.compute.manager [None req-2b0af5ce-be80-4133-ae8f-ff5e16e7057e tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 60e20e77-6091-4abc-bbad-b5f21a2071c3] Terminating instance
Nov 15 08:13:47 user nova-compute[95467]: DEBUG nova.compute.manager [None req-2b0af5ce-be80-4133-ae8f-ff5e16e7057e tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 60e20e77-6091-4abc-bbad-b5f21a2071c3] Start destroying the instance on the hypervisor. {{(pid=95467) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 08:13:47 user nova-compute[95467]: DEBUG nova.compute.manager [req-1c3f4cd6-9007-4829-8906-bcf519550525 req-8619df30-0473-430f-b3de-f15741393beb service nova] [instance: 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a] Received event network-vif-deleted-193139f8-f050-4caf-89d7-106a3a504625 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:13:47 user nova-compute[95467]: DEBUG nova.compute.manager [req-f094e198-4a9d-44da-9031-e1fa9b9cd837 req-c20110c2-0dd9-447b-84f3-8d9f2cf3001d service nova] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Received event network-vif-deleted-f6d25344-c8fc-4794-b302-a3665c62b78c {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:13:47 user nova-compute[95467]: INFO nova.compute.manager [req-f094e198-4a9d-44da-9031-e1fa9b9cd837 req-c20110c2-0dd9-447b-84f3-8d9f2cf3001d service nova] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Neutron deleted interface f6d25344-c8fc-4794-b302-a3665c62b78c; detaching it from the instance and deleting it from the info cache
Nov 15 08:13:47 user nova-compute[95467]: DEBUG nova.network.neutron [req-f094e198-4a9d-44da-9031-e1fa9b9cd837 req-c20110c2-0dd9-447b-84f3-8d9f2cf3001d service nova] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:13:47 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-151a80fc-4c56-41c1-b4cb-3ef7e0951cd4 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:13:47 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:13:47 user nova-compute[95467]: INFO nova.compute.manager [-] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Took 1.10 seconds to deallocate network for instance.
Nov 15 08:13:47 user nova-compute[95467]: DEBUG nova.compute.manager [req-f094e198-4a9d-44da-9031-e1fa9b9cd837 req-c20110c2-0dd9-447b-84f3-8d9f2cf3001d service nova] [instance: 0917b083-2bbf-4baf-a0b8-d59ba3e2256b] Detach interface failed, port_id=f6d25344-c8fc-4794-b302-a3665c62b78c, reason: Instance 0917b083-2bbf-4baf-a0b8-d59ba3e2256b could not be found. {{(pid=95467) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 08:13:47 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:47 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:47 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8287a036-9337-4033-b682-eb3271515446 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:13:48 user nova-compute[95467]: DEBUG nova.network.neutron [req-85bc4bb5-f462-4df8-a5ff-46330258f6a5 req-f2706798-ab37-4922-9e97-427fa57ed8e4 service nova] [instance: 60e20e77-6091-4abc-bbad-b5f21a2071c3] Updated VIF entry in instance network info cache for port f5cfd0fc-8461-4ed8-aa91-08fe7a2eb6c0. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:13:48 user nova-compute[95467]: DEBUG nova.network.neutron [req-85bc4bb5-f462-4df8-a5ff-46330258f6a5 req-f2706798-ab37-4922-9e97-427fa57ed8e4 service nova] [instance: 60e20e77-6091-4abc-bbad-b5f21a2071c3] Updating instance_info_cache with network_info: [{"id": "f5cfd0fc-8461-4ed8-aa91-08fe7a2eb6c0", "address": "fa:16:3e:34:38:5d", "network": {"id": "27fd2b0f-65bd-4ae4-b5c8-dfca91668078", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1310727750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50e2fec6a90a41a5a586c6da227caacc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5cfd0fc-84", "ovs_interfaceid": "f5cfd0fc-8461-4ed8-aa91-08fe7a2eb6c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:13:48 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:13:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-85bc4bb5-f462-4df8-a5ff-46330258f6a5 req-f2706798-ab37-4922-9e97-427fa57ed8e4 service nova] Releasing lock "refresh_cache-60e20e77-6091-4abc-bbad-b5f21a2071c3" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:13:48 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:13:48 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.703s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:13:48 user nova-compute[95467]: DEBUG nova.compute.manager [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Start building networks asynchronously for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 08:13:48 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-151a80fc-4c56-41c1-b4cb-3ef7e0951cd4 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.383s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:13:48 user nova-compute[95467]: DEBUG nova.compute.manager [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Allocating IP information in the background. {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 08:13:48 user nova-compute[95467]: DEBUG nova.network.neutron [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] allocate_for_instance() {{(pid=95467) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 08:13:48 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 08:13:48 user nova-compute[95467]: DEBUG nova.compute.manager [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Start building block device mappings for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 08:13:48 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 60e20e77-6091-4abc-bbad-b5f21a2071c3] Instance destroyed successfully.
Nov 15 08:13:48 user nova-compute[95467]: DEBUG nova.objects.instance [None req-2b0af5ce-be80-4133-ae8f-ff5e16e7057e tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lazy-loading 'resources' on Instance uuid 60e20e77-6091-4abc-bbad-b5f21a2071c3 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:13:48 user nova-compute[95467]: DEBUG nova.policy [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fd652210088a41839fcca0be41322dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f7599b8526444a8276cac35f0a1500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95467) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 08:13:48 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-2b0af5ce-be80-4133-ae8f-ff5e16e7057e tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:11:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1804987502',display_name='tempest-AttachVolumeNegativeTest-server-1804987502',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1804987502',id=14,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAJTP5SnvAN0j4EJK+a5w/6hkXDZoSBbTszMsD4b/7Zc3910mK5WZI3GsMsFoeELSAKCVxo2sJ/Le5sbATPGI/ViNcM5cmJ40+sP3Lwu4iJBHmdNrF5EDc20OMN3OmUUiw==',key_name='tempest-keypair-50938293',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:12:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='50e2fec6a90a41a5a586c6da227caacc',ramdisk_id='',reservation_id='r-stlwbs0i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1750086293',owner_user_name='tempest-AttachVolumeNegativeTest-1750086293-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:12:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='acce273b07b64e44af6e062175afa92d',uuid=60e20e77-6091-4abc-bbad-b5f21a2071c3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5cfd0fc-8461-4ed8-aa91-08fe7a2eb6c0", "address": "fa:16:3e:34:38:5d", "network": {"id": "27fd2b0f-65bd-4ae4-b5c8-dfca91668078", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1310727750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50e2fec6a90a41a5a586c6da227caacc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5cfd0fc-84", "ovs_interfaceid": "f5cfd0fc-8461-4ed8-aa91-08fe7a2eb6c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:13:48 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-2b0af5ce-be80-4133-ae8f-ff5e16e7057e tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Converting VIF {"id": "f5cfd0fc-8461-4ed8-aa91-08fe7a2eb6c0", "address": "fa:16:3e:34:38:5d", "network": {"id": "27fd2b0f-65bd-4ae4-b5c8-dfca91668078", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1310727750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50e2fec6a90a41a5a586c6da227caacc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5cfd0fc-84", "ovs_interfaceid": "f5cfd0fc-8461-4ed8-aa91-08fe7a2eb6c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:13:48 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-2b0af5ce-be80-4133-ae8f-ff5e16e7057e tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:38:5d,bridge_name='br-int',has_traffic_filtering=True,id=f5cfd0fc-8461-4ed8-aa91-08fe7a2eb6c0,network=Network(27fd2b0f-65bd-4ae4-b5c8-dfca91668078),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5cfd0fc-84') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:13:48 user nova-compute[95467]: DEBUG os_vif [None req-2b0af5ce-be80-4133-ae8f-ff5e16e7057e tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:38:5d,bridge_name='br-int',has_traffic_filtering=True,id=f5cfd0fc-8461-4ed8-aa91-08fe7a2eb6c0,network=Network(27fd2b0f-65bd-4ae4-b5c8-dfca91668078),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5cfd0fc-84') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:13:48 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:48 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf5cfd0fc-84, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:13:48 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:48 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:13:48 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:48 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c1c5bfed-5a8c-4ad3-ac01-04970fa33a69) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:13:48 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:48 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:13:48 user nova-compute[95467]: INFO os_vif [None req-2b0af5ce-be80-4133-ae8f-ff5e16e7057e tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:38:5d,bridge_name='br-int',has_traffic_filtering=True,id=f5cfd0fc-8461-4ed8-aa91-08fe7a2eb6c0,network=Network(27fd2b0f-65bd-4ae4-b5c8-dfca91668078),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5cfd0fc-84')
Nov 15 08:13:48 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-2b0af5ce-be80-4133-ae8f-ff5e16e7057e tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 60e20e77-6091-4abc-bbad-b5f21a2071c3] Deleting instance files /opt/stack/data/nova/instances/60e20e77-6091-4abc-bbad-b5f21a2071c3_del
Nov 15 08:13:48 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-2b0af5ce-be80-4133-ae8f-ff5e16e7057e tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 60e20e77-6091-4abc-bbad-b5f21a2071c3] Deletion of /opt/stack/data/nova/instances/60e20e77-6091-4abc-bbad-b5f21a2071c3_del complete
Nov 15 08:13:48 user nova-compute[95467]: DEBUG nova.compute.manager [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Start spawning the instance on the hypervisor. {{(pid=95467) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 08:13:48 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Creating instance directory {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 08:13:48 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Creating image(s)
Nov 15 08:13:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Acquiring lock "/opt/stack/data/nova/instances/bee31898-4f12-4c68-a18b-a678f9f584aa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:13:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Lock "/opt/stack/data/nova/instances/bee31898-4f12-4c68-a18b-a678f9f584aa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:13:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Lock "/opt/stack/data/nova/instances/bee31898-4f12-4c68-a18b-a678f9f584aa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:13:48 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:13:48 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:13:48 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Starting heal instance info cache {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 08:13:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:48 user nova-compute[95467]: INFO nova.compute.manager [None req-2b0af5ce-be80-4133-ae8f-ff5e16e7057e tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 60e20e77-6091-4abc-bbad-b5f21a2071c3] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 15 08:13:48 user nova-compute[95467]: DEBUG oslo.service.loopingcall [None req-2b0af5ce-be80-4133-ae8f-ff5e16e7057e tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=95467) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 08:13:48 user nova-compute[95467]: DEBUG nova.compute.manager [-] [instance: 60e20e77-6091-4abc-bbad-b5f21a2071c3] Deallocating network for instance {{(pid=95467) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 08:13:48 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: 60e20e77-6091-4abc-bbad-b5f21a2071c3] deallocate_for_instance() {{(pid=95467) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 08:13:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "refresh_cache-73fe8852-c47a-47ab-a56f-6864c8ed5479" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:13:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquired lock "refresh_cache-73fe8852-c47a-47ab-a56f-6864c8ed5479" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:13:48 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] Forcefully refreshing network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 08:13:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.187s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:13:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Acquiring lock "a3fcf60225fcefd310404971cd18ab9851c548dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:13:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:13:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:48 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-151a80fc-4c56-41c1-b4cb-3ef7e0951cd4 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:13:48 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-151a80fc-4c56-41c1-b4cb-3ef7e0951cd4 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:13:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-151a80fc-4c56-41c1-b4cb-3ef7e0951cd4 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.644s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:13:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8287a036-9337-4033-b682-eb3271515446 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.892s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:13:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.178s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:13:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/bee31898-4f12-4c68-a18b-a678f9f584aa/disk 1073741824 {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:48 user nova-compute[95467]: INFO nova.scheduler.client.report [None req-151a80fc-4c56-41c1-b4cb-3ef7e0951cd4 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Deleted allocations for instance 1edf7591-3991-4df9-98c9-ebc4ca9e5a4a
Nov 15 08:13:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/bee31898-4f12-4c68-a18b-a678f9f584aa/disk 1073741824" returned: 0 in 0.066s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:13:49 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:13:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:49 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-151a80fc-4c56-41c1-b4cb-3ef7e0951cd4 tempest-TestVolumeSwap-1759371360 tempest-TestVolumeSwap-1759371360-project-member] Lock "1edf7591-3991-4df9-98c9-ebc4ca9e5a4a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.651s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:13:49 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] Updating instance_info_cache with network_info: [{"id": "d7e5ca44-eee3-4452-9649-5fcbfe5ed5ad", "address": "fa:16:3e:e5:16:8b", "network": {"id": "d8a362dc-0dc8-49dd-b2da-0e0749d5edca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-256373617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a1aa4f562c64545a94157d4aaf8d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7e5ca44-ee", "ovs_interfaceid": "d7e5ca44-eee3-4452-9649-5fcbfe5ed5ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:13:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.297s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:13:49 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bee31898-4f12-4c68-a18b-a678f9f584aa/disk. size=1073741824 {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 08:13:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bee31898-4f12-4c68-a18b-a678f9f584aa/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:49 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Releasing lock "refresh_cache-73fe8852-c47a-47ab-a56f-6864c8ed5479" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:13:49 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] Updated the network info_cache for instance {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 08:13:49 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:13:49 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:13:49 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:13:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bee31898-4f12-4c68-a18b-a678f9f584aa/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:13:49 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Cannot resize image /opt/stack/data/nova/instances/bee31898-4f12-4c68-a18b-a678f9f584aa/disk to a smaller size. {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 08:13:49 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Created local disks {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 08:13:49 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Ensure instance console log exists: /opt/stack/data/nova/instances/bee31898-4f12-4c68-a18b-a678f9f584aa/console.log {{(pid=95467) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 08:13:49 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:13:49 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:13:49 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:13:49 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-8287a036-9337-4033-b682-eb3271515446 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:13:49 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-8287a036-9337-4033-b682-eb3271515446 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:13:49 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8287a036-9337-4033-b682-eb3271515446 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.970s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:13:49 user nova-compute[95467]: INFO nova.scheduler.client.report [None req-8287a036-9337-4033-b682-eb3271515446 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Deleted allocations for instance 0917b083-2bbf-4baf-a0b8-d59ba3e2256b
Nov 15 08:13:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8287a036-9337-4033-b682-eb3271515446 tempest-TaggedAttachmentsTest-2023837645 tempest-TaggedAttachmentsTest-2023837645-project-member] Lock "0917b083-2bbf-4baf-a0b8-d59ba3e2256b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.910s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:13:50 user nova-compute[95467]: DEBUG nova.compute.manager [req-94f71558-fb38-4ad4-9124-082dd1a4e54e req-7481e614-7da8-4c73-aed9-de0318273f08 service nova] [instance: 60e20e77-6091-4abc-bbad-b5f21a2071c3] Received event network-vif-unplugged-f5cfd0fc-8461-4ed8-aa91-08fe7a2eb6c0 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:13:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-94f71558-fb38-4ad4-9124-082dd1a4e54e req-7481e614-7da8-4c73-aed9-de0318273f08 service nova] Acquiring lock "60e20e77-6091-4abc-bbad-b5f21a2071c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:13:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-94f71558-fb38-4ad4-9124-082dd1a4e54e req-7481e614-7da8-4c73-aed9-de0318273f08 service nova] Lock "60e20e77-6091-4abc-bbad-b5f21a2071c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:13:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-94f71558-fb38-4ad4-9124-082dd1a4e54e req-7481e614-7da8-4c73-aed9-de0318273f08 service nova] Lock "60e20e77-6091-4abc-bbad-b5f21a2071c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:13:50 user nova-compute[95467]: DEBUG nova.compute.manager [req-94f71558-fb38-4ad4-9124-082dd1a4e54e req-7481e614-7da8-4c73-aed9-de0318273f08 service nova] [instance: 60e20e77-6091-4abc-bbad-b5f21a2071c3] No waiting events found dispatching network-vif-unplugged-f5cfd0fc-8461-4ed8-aa91-08fe7a2eb6c0 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:13:50 user nova-compute[95467]: DEBUG nova.compute.manager [req-94f71558-fb38-4ad4-9124-082dd1a4e54e req-7481e614-7da8-4c73-aed9-de0318273f08 service nova] [instance: 60e20e77-6091-4abc-bbad-b5f21a2071c3] Received event network-vif-unplugged-f5cfd0fc-8461-4ed8-aa91-08fe7a2eb6c0 for instance with task_state deleting. {{(pid=95467) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 08:13:50 user nova-compute[95467]: DEBUG nova.network.neutron [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Successfully created port: eea925f5-c956-40d3-99a5-b45573318378 {{(pid=95467) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 08:13:51 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: 60e20e77-6091-4abc-bbad-b5f21a2071c3] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:13:51 user nova-compute[95467]: INFO nova.compute.manager [-] [instance: 60e20e77-6091-4abc-bbad-b5f21a2071c3] Took 2.38 seconds to deallocate network for instance.
Nov 15 08:13:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-2b0af5ce-be80-4133-ae8f-ff5e16e7057e tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:13:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-2b0af5ce-be80-4133-ae8f-ff5e16e7057e tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:13:51 user nova-compute[95467]: DEBUG nova.network.neutron [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Successfully updated port: eea925f5-c956-40d3-99a5-b45573318378 {{(pid=95467) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 08:13:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Acquiring lock "refresh_cache-bee31898-4f12-4c68-a18b-a678f9f584aa" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:13:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Acquired lock "refresh_cache-bee31898-4f12-4c68-a18b-a678f9f584aa" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:13:51 user nova-compute[95467]: DEBUG nova.network.neutron [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:13:51 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-2b0af5ce-be80-4133-ae8f-ff5e16e7057e tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:13:51 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-2b0af5ce-be80-4133-ae8f-ff5e16e7057e tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:13:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-2b0af5ce-be80-4133-ae8f-ff5e16e7057e tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.555s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:13:51 user nova-compute[95467]: DEBUG nova.network.neutron [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Instance cache missing network info. {{(pid=95467) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 08:13:51 user nova-compute[95467]: INFO nova.scheduler.client.report [None req-2b0af5ce-be80-4133-ae8f-ff5e16e7057e tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Deleted allocations for instance 60e20e77-6091-4abc-bbad-b5f21a2071c3
Nov 15 08:13:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Acquiring lock "abdf29d1-f80e-48c8-8c09-d7c9c0326833" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:13:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "abdf29d1-f80e-48c8-8c09-d7c9c0326833" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:13:51 user nova-compute[95467]: DEBUG nova.compute.manager [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] Starting instance... {{(pid=95467) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 08:13:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-2b0af5ce-be80-4133-ae8f-ff5e16e7057e tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "60e20e77-6091-4abc-bbad-b5f21a2071c3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.026s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:13:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:13:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:13:51 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=95467) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 08:13:51 user nova-compute[95467]: INFO nova.compute.claims [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] Claim successful on node user
Nov 15 08:13:52 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:52 user nova-compute[95467]: DEBUG nova.compute.manager [req-64bbb780-9afa-4e3d-825e-b76f97ee7081 req-1c726189-0faf-4a7a-b0f1-201aac4074ae service nova] [instance: 60e20e77-6091-4abc-bbad-b5f21a2071c3] Received event network-vif-plugged-f5cfd0fc-8461-4ed8-aa91-08fe7a2eb6c0 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:13:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-64bbb780-9afa-4e3d-825e-b76f97ee7081 req-1c726189-0faf-4a7a-b0f1-201aac4074ae service nova] Acquiring lock "60e20e77-6091-4abc-bbad-b5f21a2071c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:13:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-64bbb780-9afa-4e3d-825e-b76f97ee7081 req-1c726189-0faf-4a7a-b0f1-201aac4074ae service nova] Lock "60e20e77-6091-4abc-bbad-b5f21a2071c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:13:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-64bbb780-9afa-4e3d-825e-b76f97ee7081 req-1c726189-0faf-4a7a-b0f1-201aac4074ae service nova] Lock "60e20e77-6091-4abc-bbad-b5f21a2071c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:13:52 user nova-compute[95467]: DEBUG nova.compute.manager [req-64bbb780-9afa-4e3d-825e-b76f97ee7081 req-1c726189-0faf-4a7a-b0f1-201aac4074ae service nova] [instance: 60e20e77-6091-4abc-bbad-b5f21a2071c3] No waiting events found dispatching network-vif-plugged-f5cfd0fc-8461-4ed8-aa91-08fe7a2eb6c0 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:13:52 user nova-compute[95467]: WARNING nova.compute.manager [req-64bbb780-9afa-4e3d-825e-b76f97ee7081 req-1c726189-0faf-4a7a-b0f1-201aac4074ae service nova] [instance: 60e20e77-6091-4abc-bbad-b5f21a2071c3] Received unexpected event network-vif-plugged-f5cfd0fc-8461-4ed8-aa91-08fe7a2eb6c0 for instance with vm_state deleted and task_state None.
Nov 15 08:13:52 user nova-compute[95467]: DEBUG nova.compute.manager [req-64bbb780-9afa-4e3d-825e-b76f97ee7081 req-1c726189-0faf-4a7a-b0f1-201aac4074ae service nova] [instance: 60e20e77-6091-4abc-bbad-b5f21a2071c3] Received event network-vif-deleted-f5cfd0fc-8461-4ed8-aa91-08fe7a2eb6c0 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:13:52 user nova-compute[95467]: DEBUG nova.compute.manager [req-64bbb780-9afa-4e3d-825e-b76f97ee7081 req-1c726189-0faf-4a7a-b0f1-201aac4074ae service nova] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Received event network-changed-eea925f5-c956-40d3-99a5-b45573318378 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:13:52 user nova-compute[95467]: DEBUG nova.compute.manager [req-64bbb780-9afa-4e3d-825e-b76f97ee7081 req-1c726189-0faf-4a7a-b0f1-201aac4074ae service nova] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Refreshing instance network info cache due to event network-changed-eea925f5-c956-40d3-99a5-b45573318378. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:13:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-64bbb780-9afa-4e3d-825e-b76f97ee7081 req-1c726189-0faf-4a7a-b0f1-201aac4074ae service nova] Acquiring lock "refresh_cache-bee31898-4f12-4c68-a18b-a678f9f584aa" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:13:52 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:13:52 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:13:52 user nova-compute[95467]: DEBUG nova.network.neutron [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Updating instance_info_cache with network_info: [{"id": "eea925f5-c956-40d3-99a5-b45573318378", "address": "fa:16:3e:b4:e9:ab", "network": {"id": "dcbc2304-8d20-4589-b81e-a75a22ef7114", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-333949369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6f7599b8526444a8276cac35f0a1500", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeea925f5-c9", "ovs_interfaceid": "eea925f5-c956-40d3-99a5-b45573318378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:13:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.516s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:13:52 user nova-compute[95467]: DEBUG nova.compute.manager [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] Start building networks asynchronously for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 08:13:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Releasing lock "refresh_cache-bee31898-4f12-4c68-a18b-a678f9f584aa" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:13:52 user nova-compute[95467]: DEBUG nova.compute.manager [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Instance network_info: |[{"id": "eea925f5-c956-40d3-99a5-b45573318378", "address": "fa:16:3e:b4:e9:ab", "network": {"id": "dcbc2304-8d20-4589-b81e-a75a22ef7114", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-333949369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6f7599b8526444a8276cac35f0a1500", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeea925f5-c9", "ovs_interfaceid": "eea925f5-c956-40d3-99a5-b45573318378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 08:13:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-64bbb780-9afa-4e3d-825e-b76f97ee7081 req-1c726189-0faf-4a7a-b0f1-201aac4074ae service nova] Acquired lock "refresh_cache-bee31898-4f12-4c68-a18b-a678f9f584aa" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:13:52 user nova-compute[95467]: DEBUG nova.network.neutron [req-64bbb780-9afa-4e3d-825e-b76f97ee7081 req-1c726189-0faf-4a7a-b0f1-201aac4074ae service nova] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Refreshing network info cache for port eea925f5-c956-40d3-99a5-b45573318378 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:13:52 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Start _get_guest_xml network_info=[{"id": "eea925f5-c956-40d3-99a5-b45573318378", "address": "fa:16:3e:b4:e9:ab", "network": {"id": "dcbc2304-8d20-4589-b81e-a75a22ef7114", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-333949369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6f7599b8526444a8276cac35f0a1500", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeea925f5-c9", "ovs_interfaceid": "eea925f5-c956-40d3-99a5-b45573318378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'ed9c48aa-ce73-4b3b-9db1-235898be671b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:13:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:13:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:13:52 user nova-compute[95467]: DEBUG nova.objects.instance [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lazy-loading 'pci_requests' on Instance uuid 36dccf43-d4a3-47aa-bd73-de9646e1020c {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:13:52 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:13:52 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:13:52 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:13:52 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:13:52 user nova-compute[95467]: DEBUG nova.objects.instance [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lazy-loading 'numa_topology' on Instance uuid 36dccf43-d4a3-47aa-bd73-de9646e1020c {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:13:52 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:13:52 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:13:52 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:13:52 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:13:52 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:13:52 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:13:52 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:13:52 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:13:52 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:13:52 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:13:52 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:13:52 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:13:52 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:13:52 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:13:52 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:13:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1122164487',display_name='tempest-ServerStableDeviceRescueTest-server-1122164487',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1122164487',id=18,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC73Es7i1dvV3LCl2zYhULAGR03vami/IaiKmQSVJ68TybZ572m0/Ot5YFz5r9uOo9phDDYCr9s7SvGnvG3a6hG2FKLwECxJAhXmm41agKdBv9qR6a3hPpbXRn0iKH8nfg==',key_name='tempest-keypair-1738856651',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6f7599b8526444a8276cac35f0a1500',ramdisk_id='',reservation_id='r-1fnevzzw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1999795038',owner_user_name='tempest-ServerStableDeviceRescueTest-1999795038-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:13:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd652210088a41839fcca0be41322dad',uuid=bee31898-4f12-4c68-a18b-a678f9f584aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eea925f5-c956-40d3-99a5-b45573318378", "address": "fa:16:3e:b4:e9:ab", "network": {"id": "dcbc2304-8d20-4589-b81e-a75a22ef7114", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-333949369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6f7599b8526444a8276cac35f0a1500", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeea925f5-c9", "ovs_interfaceid": "eea925f5-c956-40d3-99a5-b45573318378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:13:52 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Converting VIF {"id": "eea925f5-c956-40d3-99a5-b45573318378", "address": "fa:16:3e:b4:e9:ab", "network": {"id": "dcbc2304-8d20-4589-b81e-a75a22ef7114", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-333949369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6f7599b8526444a8276cac35f0a1500", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeea925f5-c9", "ovs_interfaceid": "eea925f5-c956-40d3-99a5-b45573318378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:13:52 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:e9:ab,bridge_name='br-int',has_traffic_filtering=True,id=eea925f5-c956-40d3-99a5-b45573318378,network=Network(dcbc2304-8d20-4589-b81e-a75a22ef7114),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeea925f5-c9') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:13:52 user nova-compute[95467]: DEBUG nova.objects.instance [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Lazy-loading 'pci_devices' on Instance uuid bee31898-4f12-4c68-a18b-a678f9f584aa {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:13:52 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=95467) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 08:13:52 user nova-compute[95467]: INFO nova.compute.claims [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Claim successful on node user
Nov 15 08:13:52 user nova-compute[95467]: DEBUG nova.compute.manager [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] Allocating IP information in the background. {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 08:13:52 user nova-compute[95467]: DEBUG nova.network.neutron [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] allocate_for_instance() {{(pid=95467) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 08:13:52 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:13:52 user nova-compute[95467]:   <uuid>bee31898-4f12-4c68-a18b-a678f9f584aa</uuid>
Nov 15 08:13:52 user nova-compute[95467]:   <name>instance-00000012</name>
Nov 15 08:13:52 user nova-compute[95467]:   <memory>524288</memory>
Nov 15 08:13:52 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:13:52 user nova-compute[95467]:   <metadata>
Nov 15 08:13:52 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:13:52 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:13:52 user nova-compute[95467]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1122164487</nova:name>
Nov 15 08:13:52 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:13:52</nova:creationTime>
Nov 15 08:13:52 user nova-compute[95467]:       <nova:flavor name="m1.tiny">
Nov 15 08:13:52 user nova-compute[95467]:         <nova:memory>512</nova:memory>
Nov 15 08:13:52 user nova-compute[95467]:         <nova:disk>1</nova:disk>
Nov 15 08:13:52 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:13:52 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:13:52 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:13:52 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:13:52 user nova-compute[95467]:       <nova:owner>
Nov 15 08:13:52 user nova-compute[95467]:         <nova:user uuid="fd652210088a41839fcca0be41322dad">tempest-ServerStableDeviceRescueTest-1999795038-project-member</nova:user>
Nov 15 08:13:52 user nova-compute[95467]:         <nova:project uuid="b6f7599b8526444a8276cac35f0a1500">tempest-ServerStableDeviceRescueTest-1999795038</nova:project>
Nov 15 08:13:52 user nova-compute[95467]:       </nova:owner>
Nov 15 08:13:52 user nova-compute[95467]:       <nova:root type="image" uuid="ed9c48aa-ce73-4b3b-9db1-235898be671b"/>
Nov 15 08:13:52 user nova-compute[95467]:       <nova:ports>
Nov 15 08:13:52 user nova-compute[95467]:         <nova:port uuid="eea925f5-c956-40d3-99a5-b45573318378">
Nov 15 08:13:52 user nova-compute[95467]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 08:13:52 user nova-compute[95467]:         </nova:port>
Nov 15 08:13:52 user nova-compute[95467]:       </nova:ports>
Nov 15 08:13:52 user nova-compute[95467]:     </nova:instance>
Nov 15 08:13:52 user nova-compute[95467]:   </metadata>
Nov 15 08:13:52 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:13:52 user nova-compute[95467]:     <system>
Nov 15 08:13:52 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:13:52 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:13:52 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:13:52 user nova-compute[95467]:       <entry name="serial">bee31898-4f12-4c68-a18b-a678f9f584aa</entry>
Nov 15 08:13:52 user nova-compute[95467]:       <entry name="uuid">bee31898-4f12-4c68-a18b-a678f9f584aa</entry>
Nov 15 08:13:52 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:13:52 user nova-compute[95467]:     </system>
Nov 15 08:13:52 user nova-compute[95467]:   </sysinfo>
Nov 15 08:13:52 user nova-compute[95467]:   <os>
Nov 15 08:13:52 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:13:52 user nova-compute[95467]:     <boot dev="hd"/>
Nov 15 08:13:52 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:13:52 user nova-compute[95467]:   </os>
Nov 15 08:13:52 user nova-compute[95467]:   <features>
Nov 15 08:13:52 user nova-compute[95467]:     <acpi/>
Nov 15 08:13:52 user nova-compute[95467]:     <apic/>
Nov 15 08:13:52 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:13:52 user nova-compute[95467]:   </features>
Nov 15 08:13:52 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:13:52 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:13:52 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:13:52 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:13:52 user nova-compute[95467]:   </clock>
Nov 15 08:13:52 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:13:52 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:13:52 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:13:52 user nova-compute[95467]:   </cpu>
Nov 15 08:13:52 user nova-compute[95467]:   <devices>
Nov 15 08:13:52 user nova-compute[95467]:     <disk type="file" device="disk">
Nov 15 08:13:52 user nova-compute[95467]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 08:13:52 user nova-compute[95467]:       <source file="/opt/stack/data/nova/instances/bee31898-4f12-4c68-a18b-a678f9f584aa/disk"/>
Nov 15 08:13:52 user nova-compute[95467]:       <target dev="vda" bus="virtio"/>
Nov 15 08:13:52 user nova-compute[95467]:     </disk>
Nov 15 08:13:52 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:13:52 user nova-compute[95467]:       <mac address="fa:16:3e:b4:e9:ab"/>
Nov 15 08:13:52 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:13:52 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:13:52 user nova-compute[95467]:       <target dev="tapeea925f5-c9"/>
Nov 15 08:13:52 user nova-compute[95467]:     </interface>
Nov 15 08:13:52 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:13:52 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/bee31898-4f12-4c68-a18b-a678f9f584aa/console.log" append="off"/>
Nov 15 08:13:52 user nova-compute[95467]:     </serial>
Nov 15 08:13:52 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:13:52 user nova-compute[95467]:     <video>
Nov 15 08:13:52 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:13:52 user nova-compute[95467]:     </video>
Nov 15 08:13:52 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:13:52 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:13:52 user nova-compute[95467]:     </rng>
Nov 15 08:13:52 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:13:52 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:13:52 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:13:52 user nova-compute[95467]:     </memballoon>
Nov 15 08:13:52 user nova-compute[95467]:   </devices>
Nov 15 08:13:52 user nova-compute[95467]: </domain>
Nov 15 08:13:52 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:13:52 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:13:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1122164487',display_name='tempest-ServerStableDeviceRescueTest-server-1122164487',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1122164487',id=18,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC73Es7i1dvV3LCl2zYhULAGR03vami/IaiKmQSVJ68TybZ572m0/Ot5YFz5r9uOo9phDDYCr9s7SvGnvG3a6hG2FKLwECxJAhXmm41agKdBv9qR6a3hPpbXRn0iKH8nfg==',key_name='tempest-keypair-1738856651',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6f7599b8526444a8276cac35f0a1500',ramdisk_id='',reservation_id='r-1fnevzzw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1999795038',owner_user_name='tempest-ServerStableDeviceRescueTest-1999795038-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:13:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd652210088a41839fcca0be41322dad',uuid=bee31898-4f12-4c68-a18b-a678f9f584aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eea925f5-c956-40d3-99a5-b45573318378", "address": "fa:16:3e:b4:e9:ab", "network": {"id": "dcbc2304-8d20-4589-b81e-a75a22ef7114", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-333949369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6f7599b8526444a8276cac35f0a1500", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeea925f5-c9", "ovs_interfaceid": "eea925f5-c956-40d3-99a5-b45573318378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:13:52 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Converting VIF {"id": "eea925f5-c956-40d3-99a5-b45573318378", "address": "fa:16:3e:b4:e9:ab", "network": {"id": "dcbc2304-8d20-4589-b81e-a75a22ef7114", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-333949369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6f7599b8526444a8276cac35f0a1500", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeea925f5-c9", "ovs_interfaceid": "eea925f5-c956-40d3-99a5-b45573318378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:13:52 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:e9:ab,bridge_name='br-int',has_traffic_filtering=True,id=eea925f5-c956-40d3-99a5-b45573318378,network=Network(dcbc2304-8d20-4589-b81e-a75a22ef7114),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeea925f5-c9') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:13:52 user nova-compute[95467]: DEBUG os_vif [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:e9:ab,bridge_name='br-int',has_traffic_filtering=True,id=eea925f5-c956-40d3-99a5-b45573318378,network=Network(dcbc2304-8d20-4589-b81e-a75a22ef7114),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeea925f5-c9') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:13:52 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:52 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:13:52 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:13:52 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:52 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cbf11789-9c71-5f3e-a887-2b9ccb855a3b', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:13:52 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:52 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:13:52 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:52 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeea925f5-c9, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:13:52 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeea925f5-c9, col_values=(('qos', UUID('5818d387-0c69-4a41-87ab-15423af3d53f')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:13:52 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeea925f5-c9, col_values=(('external_ids', {'iface-id': 'eea925f5-c956-40d3-99a5-b45573318378', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:e9:ab', 'vm-uuid': 'bee31898-4f12-4c68-a18b-a678f9f584aa'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:13:52 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:52 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 08:13:52 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:13:52 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:52 user nova-compute[95467]: INFO os_vif [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:e9:ab,bridge_name='br-int',has_traffic_filtering=True,id=eea925f5-c956-40d3-99a5-b45573318378,network=Network(dcbc2304-8d20-4589-b81e-a75a22ef7114),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeea925f5-c9')
Nov 15 08:13:52 user nova-compute[95467]: DEBUG nova.compute.manager [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] Start building block device mappings for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 08:13:52 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:13:52 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] No VIF found with MAC fa:16:3e:b4:e9:ab, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:13:52 user nova-compute[95467]: INFO nova.virt.block_device [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] Booting with volume snapshot 5cb96bce-bd6b-4ee1-b454-655471c34ab8 at /dev/vda
Nov 15 08:13:52 user nova-compute[95467]: DEBUG nova.policy [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '11bbbd3ef322402cb5dc60455a54319b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7791bd92c7c488aa72474ecde2e1155', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95467) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 08:13:52 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:13:52 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:13:53 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.623s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:13:53 user nova-compute[95467]: INFO nova.network.neutron [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Updating port 5b51bd20-90a5-4fb1-816c-3d8e8824cb41 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 15 08:13:53 user nova-compute[95467]: DEBUG nova.network.neutron [req-64bbb780-9afa-4e3d-825e-b76f97ee7081 req-1c726189-0faf-4a7a-b0f1-201aac4074ae service nova] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Updated VIF entry in instance network info cache for port eea925f5-c956-40d3-99a5-b45573318378. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:13:53 user nova-compute[95467]: DEBUG nova.network.neutron [req-64bbb780-9afa-4e3d-825e-b76f97ee7081 req-1c726189-0faf-4a7a-b0f1-201aac4074ae service nova] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Updating instance_info_cache with network_info: [{"id": "eea925f5-c956-40d3-99a5-b45573318378", "address": "fa:16:3e:b4:e9:ab", "network": {"id": "dcbc2304-8d20-4589-b81e-a75a22ef7114", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-333949369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6f7599b8526444a8276cac35f0a1500", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeea925f5-c9", "ovs_interfaceid": "eea925f5-c956-40d3-99a5-b45573318378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:13:53 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-64bbb780-9afa-4e3d-825e-b76f97ee7081 req-1c726189-0faf-4a7a-b0f1-201aac4074ae service nova] Releasing lock "refresh_cache-bee31898-4f12-4c68-a18b-a678f9f584aa" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:13:53 user nova-compute[95467]: DEBUG nova.network.neutron [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] Successfully created port: efd5c9da-7c4f-4885-93f2-111ea8040673 {{(pid=95467) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 08:13:53 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Acquiring lock "refresh_cache-36dccf43-d4a3-47aa-bd73-de9646e1020c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:13:53 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Acquired lock "refresh_cache-36dccf43-d4a3-47aa-bd73-de9646e1020c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:13:53 user nova-compute[95467]: DEBUG nova.network.neutron [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:13:53 user nova-compute[95467]: DEBUG nova.compute.manager [req-05811c0f-5201-49fa-9382-6517c2632463 req-a31d6141-9e53-4e16-a469-bf5d0441709d service nova] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Received event network-changed-5b51bd20-90a5-4fb1-816c-3d8e8824cb41 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:13:53 user nova-compute[95467]: DEBUG nova.compute.manager [req-05811c0f-5201-49fa-9382-6517c2632463 req-a31d6141-9e53-4e16-a469-bf5d0441709d service nova] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Refreshing instance network info cache due to event network-changed-5b51bd20-90a5-4fb1-816c-3d8e8824cb41. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:13:53 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-05811c0f-5201-49fa-9382-6517c2632463 req-a31d6141-9e53-4e16-a469-bf5d0441709d service nova] Acquiring lock "refresh_cache-36dccf43-d4a3-47aa-bd73-de9646e1020c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:13:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:54 user nova-compute[95467]: DEBUG nova.network.neutron [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] Successfully updated port: efd5c9da-7c4f-4885-93f2-111ea8040673 {{(pid=95467) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 08:13:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Acquiring lock "refresh_cache-abdf29d1-f80e-48c8-8c09-d7c9c0326833" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:13:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Acquired lock "refresh_cache-abdf29d1-f80e-48c8-8c09-d7c9c0326833" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:13:54 user nova-compute[95467]: DEBUG nova.network.neutron [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:13:54 user nova-compute[95467]: DEBUG nova.network.neutron [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] Instance cache missing network info. {{(pid=95467) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 08:13:54 user nova-compute[95467]: DEBUG nova.compute.manager [req-0dfd308f-a978-4ebf-aace-0db18401baf5 req-70c113d3-59b1-4c01-a3e1-07cdc0dfec83 service nova] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] Received event network-changed-efd5c9da-7c4f-4885-93f2-111ea8040673 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:13:54 user nova-compute[95467]: DEBUG nova.compute.manager [req-0dfd308f-a978-4ebf-aace-0db18401baf5 req-70c113d3-59b1-4c01-a3e1-07cdc0dfec83 service nova] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] Refreshing instance network info cache due to event network-changed-efd5c9da-7c4f-4885-93f2-111ea8040673. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:13:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-0dfd308f-a978-4ebf-aace-0db18401baf5 req-70c113d3-59b1-4c01-a3e1-07cdc0dfec83 service nova] Acquiring lock "refresh_cache-abdf29d1-f80e-48c8-8c09-d7c9c0326833" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:13:54 user nova-compute[95467]: DEBUG nova.network.neutron [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] Updating instance_info_cache with network_info: [{"id": "efd5c9da-7c4f-4885-93f2-111ea8040673", "address": "fa:16:3e:07:c6:87", "network": {"id": "96d9262b-11fb-497d-8e38-fa46076c010f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2069167691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7791bd92c7c488aa72474ecde2e1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefd5c9da-7c", "ovs_interfaceid": "efd5c9da-7c4f-4885-93f2-111ea8040673", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:13:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Releasing lock "refresh_cache-abdf29d1-f80e-48c8-8c09-d7c9c0326833" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:13:54 user nova-compute[95467]: DEBUG nova.compute.manager [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] Instance network_info: |[{"id": "efd5c9da-7c4f-4885-93f2-111ea8040673", "address": "fa:16:3e:07:c6:87", "network": {"id": "96d9262b-11fb-497d-8e38-fa46076c010f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2069167691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7791bd92c7c488aa72474ecde2e1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefd5c9da-7c", "ovs_interfaceid": "efd5c9da-7c4f-4885-93f2-111ea8040673", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 08:13:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-0dfd308f-a978-4ebf-aace-0db18401baf5 req-70c113d3-59b1-4c01-a3e1-07cdc0dfec83 service nova] Acquired lock "refresh_cache-abdf29d1-f80e-48c8-8c09-d7c9c0326833" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:13:54 user nova-compute[95467]: DEBUG nova.network.neutron [req-0dfd308f-a978-4ebf-aace-0db18401baf5 req-70c113d3-59b1-4c01-a3e1-07cdc0dfec83 service nova] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] Refreshing network info cache for port efd5c9da-7c4f-4885-93f2-111ea8040673 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:13:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:54 user nova-compute[95467]: DEBUG nova.network.neutron [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Updating instance_info_cache with network_info: [{"id": "5b51bd20-90a5-4fb1-816c-3d8e8824cb41", "address": "fa:16:3e:79:70:b1", "network": {"id": "f7871b75-73b3-4f0a-8e6c-814bc61ebd6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-945672014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b04c448c61451d8d46ebc7a61a5e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b51bd20-90", "ovs_interfaceid": "5b51bd20-90a5-4fb1-816c-3d8e8824cb41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:13:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Releasing lock "refresh_cache-36dccf43-d4a3-47aa-bd73-de9646e1020c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:13:54 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Creating instance directory {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 08:13:54 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Creating image(s)
Nov 15 08:13:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Acquiring lock "/opt/stack/data/nova/instances/36dccf43-d4a3-47aa-bd73-de9646e1020c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:13:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "/opt/stack/data/nova/instances/36dccf43-d4a3-47aa-bd73-de9646e1020c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:13:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "/opt/stack/data/nova/instances/36dccf43-d4a3-47aa-bd73-de9646e1020c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:13:54 user nova-compute[95467]: DEBUG nova.objects.instance [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lazy-loading 'trusted_certs' on Instance uuid 36dccf43-d4a3-47aa-bd73-de9646e1020c {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:13:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-05811c0f-5201-49fa-9382-6517c2632463 req-a31d6141-9e53-4e16-a469-bf5d0441709d service nova] Acquired lock "refresh_cache-36dccf43-d4a3-47aa-bd73-de9646e1020c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:13:54 user nova-compute[95467]: DEBUG nova.network.neutron [req-05811c0f-5201-49fa-9382-6517c2632463 req-a31d6141-9e53-4e16-a469-bf5d0441709d service nova] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Refreshing network info cache for port 5b51bd20-90a5-4fb1-816c-3d8e8824cb41 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:13:54 user nova-compute[95467]: DEBUG nova.objects.base [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Object Instance<36dccf43-d4a3-47aa-bd73-de9646e1020c> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=95467) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 08:13:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Acquiring lock "8c2f34cc3466f923251e6f953906e0c05be64824" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:13:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "8c2f34cc3466f923251e6f953906e0c05be64824" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:13:54 user nova-compute[95467]: DEBUG nova.network.neutron [req-0dfd308f-a978-4ebf-aace-0db18401baf5 req-70c113d3-59b1-4c01-a3e1-07cdc0dfec83 service nova] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] Updated VIF entry in instance network info cache for port efd5c9da-7c4f-4885-93f2-111ea8040673. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:13:54 user nova-compute[95467]: DEBUG nova.network.neutron [req-0dfd308f-a978-4ebf-aace-0db18401baf5 req-70c113d3-59b1-4c01-a3e1-07cdc0dfec83 service nova] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] Updating instance_info_cache with network_info: [{"id": "efd5c9da-7c4f-4885-93f2-111ea8040673", "address": "fa:16:3e:07:c6:87", "network": {"id": "96d9262b-11fb-497d-8e38-fa46076c010f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2069167691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7791bd92c7c488aa72474ecde2e1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefd5c9da-7c", "ovs_interfaceid": "efd5c9da-7c4f-4885-93f2-111ea8040673", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:13:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-0dfd308f-a978-4ebf-aace-0db18401baf5 req-70c113d3-59b1-4c01-a3e1-07cdc0dfec83 service nova] Releasing lock "refresh_cache-abdf29d1-f80e-48c8-8c09-d7c9c0326833" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:13:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c2f34cc3466f923251e6f953906e0c05be64824.part --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c2f34cc3466f923251e6f953906e0c05be64824.part --force-share --output=json" returned: 0 in 0.174s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:13:56 user nova-compute[95467]: DEBUG nova.virt.images [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] 30ebae06-a194-4c9e-ba4b-9067f89f8a9c was qcow2, converting to raw {{(pid=95467) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 08:13:56 user nova-compute[95467]: DEBUG nova.privsep.utils [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=95467) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 08:13:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8c2f34cc3466f923251e6f953906e0c05be64824.part /opt/stack/data/nova/instances/_base/8c2f34cc3466f923251e6f953906e0c05be64824.converted {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:56 user nova-compute[95467]: DEBUG nova.compute.manager [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Instance event wait completed in 0 seconds for  {{(pid=95467) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 08:13:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Guest created on hypervisor {{(pid=95467) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 08:13:56 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Instance spawned successfully.
Nov 15 08:13:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 08:13:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Found default for hw_cdrom_bus of ide {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:13:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Found default for hw_disk_bus of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:13:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Found default for hw_input_bus of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:13:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Found default for hw_pointer_model of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:13:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Found default for hw_video_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:13:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Found default for hw_vif_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:13:56 user nova-compute[95467]: DEBUG nova.compute.manager [req-b5eb9394-27e5-4793-a329-671ffac9fca1 req-637d979b-b81d-4fdb-9958-fa5f225c6621 service nova] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Received event network-vif-plugged-eea925f5-c956-40d3-99a5-b45573318378 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:13:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b5eb9394-27e5-4793-a329-671ffac9fca1 req-637d979b-b81d-4fdb-9958-fa5f225c6621 service nova] Acquiring lock "bee31898-4f12-4c68-a18b-a678f9f584aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:13:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b5eb9394-27e5-4793-a329-671ffac9fca1 req-637d979b-b81d-4fdb-9958-fa5f225c6621 service nova] Lock "bee31898-4f12-4c68-a18b-a678f9f584aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:13:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b5eb9394-27e5-4793-a329-671ffac9fca1 req-637d979b-b81d-4fdb-9958-fa5f225c6621 service nova] Lock "bee31898-4f12-4c68-a18b-a678f9f584aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:13:56 user nova-compute[95467]: DEBUG nova.compute.manager [req-b5eb9394-27e5-4793-a329-671ffac9fca1 req-637d979b-b81d-4fdb-9958-fa5f225c6621 service nova] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] No waiting events found dispatching network-vif-plugged-eea925f5-c956-40d3-99a5-b45573318378 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:13:56 user nova-compute[95467]: WARNING nova.compute.manager [req-b5eb9394-27e5-4793-a329-671ffac9fca1 req-637d979b-b81d-4fdb-9958-fa5f225c6621 service nova] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Received unexpected event network-vif-plugged-eea925f5-c956-40d3-99a5-b45573318378 for instance with vm_state building and task_state spawning.
Nov 15 08:13:56 user nova-compute[95467]: DEBUG nova.compute.manager [req-b5eb9394-27e5-4793-a329-671ffac9fca1 req-637d979b-b81d-4fdb-9958-fa5f225c6621 service nova] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Received event network-vif-plugged-eea925f5-c956-40d3-99a5-b45573318378 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:13:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b5eb9394-27e5-4793-a329-671ffac9fca1 req-637d979b-b81d-4fdb-9958-fa5f225c6621 service nova] Acquiring lock "bee31898-4f12-4c68-a18b-a678f9f584aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:13:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b5eb9394-27e5-4793-a329-671ffac9fca1 req-637d979b-b81d-4fdb-9958-fa5f225c6621 service nova] Lock "bee31898-4f12-4c68-a18b-a678f9f584aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:13:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b5eb9394-27e5-4793-a329-671ffac9fca1 req-637d979b-b81d-4fdb-9958-fa5f225c6621 service nova] Lock "bee31898-4f12-4c68-a18b-a678f9f584aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:13:56 user nova-compute[95467]: DEBUG nova.compute.manager [req-b5eb9394-27e5-4793-a329-671ffac9fca1 req-637d979b-b81d-4fdb-9958-fa5f225c6621 service nova] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] No waiting events found dispatching network-vif-plugged-eea925f5-c956-40d3-99a5-b45573318378 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:13:56 user nova-compute[95467]: WARNING nova.compute.manager [req-b5eb9394-27e5-4793-a329-671ffac9fca1 req-637d979b-b81d-4fdb-9958-fa5f225c6621 service nova] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Received unexpected event network-vif-plugged-eea925f5-c956-40d3-99a5-b45573318378 for instance with vm_state building and task_state spawning.
Nov 15 08:13:56 user nova-compute[95467]: DEBUG nova.network.neutron [req-05811c0f-5201-49fa-9382-6517c2632463 req-a31d6141-9e53-4e16-a469-bf5d0441709d service nova] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Updated VIF entry in instance network info cache for port 5b51bd20-90a5-4fb1-816c-3d8e8824cb41. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:13:56 user nova-compute[95467]: DEBUG nova.network.neutron [req-05811c0f-5201-49fa-9382-6517c2632463 req-a31d6141-9e53-4e16-a469-bf5d0441709d service nova] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Updating instance_info_cache with network_info: [{"id": "5b51bd20-90a5-4fb1-816c-3d8e8824cb41", "address": "fa:16:3e:79:70:b1", "network": {"id": "f7871b75-73b3-4f0a-8e6c-814bc61ebd6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-945672014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b04c448c61451d8d46ebc7a61a5e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b51bd20-90", "ovs_interfaceid": "5b51bd20-90a5-4fb1-816c-3d8e8824cb41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:13:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-05811c0f-5201-49fa-9382-6517c2632463 req-a31d6141-9e53-4e16-a469-bf5d0441709d service nova] Releasing lock "refresh_cache-36dccf43-d4a3-47aa-bd73-de9646e1020c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:13:56 user nova-compute[95467]: INFO nova.compute.manager [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Took 7.91 seconds to spawn the instance on the hypervisor.
Nov 15 08:13:56 user nova-compute[95467]: DEBUG nova.compute.manager [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:13:56 user nova-compute[95467]: INFO nova.compute.manager [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Took 9.95 seconds to build instance.
Nov 15 08:13:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-05fbb036-6851-44ef-9349-dc84f6ed0687 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Lock "bee31898-4f12-4c68-a18b-a678f9f584aa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.142s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:13:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8c2f34cc3466f923251e6f953906e0c05be64824.part /opt/stack/data/nova/instances/_base/8c2f34cc3466f923251e6f953906e0c05be64824.converted" returned: 0 in 0.519s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:13:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c2f34cc3466f923251e6f953906e0c05be64824.converted --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-18c12c2e-f461-4ec5-87b8-6e934222fd75 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Acquiring lock "7e53d93e-1222-4b1a-9745-d512da0f7925" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:13:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-18c12c2e-f461-4ec5-87b8-6e934222fd75 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Lock "7e53d93e-1222-4b1a-9745-d512da0f7925" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:13:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-18c12c2e-f461-4ec5-87b8-6e934222fd75 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Acquiring lock "7e53d93e-1222-4b1a-9745-d512da0f7925-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:13:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-18c12c2e-f461-4ec5-87b8-6e934222fd75 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Lock "7e53d93e-1222-4b1a-9745-d512da0f7925-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:13:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-18c12c2e-f461-4ec5-87b8-6e934222fd75 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Lock "7e53d93e-1222-4b1a-9745-d512da0f7925-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:13:56 user nova-compute[95467]: INFO nova.compute.manager [None req-18c12c2e-f461-4ec5-87b8-6e934222fd75 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Terminating instance
Nov 15 08:13:56 user nova-compute[95467]: DEBUG nova.compute.manager [None req-18c12c2e-f461-4ec5-87b8-6e934222fd75 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Start destroying the instance on the hypervisor. {{(pid=95467) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 08:13:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c2f34cc3466f923251e6f953906e0c05be64824.converted --force-share --output=json" returned: 0 in 0.190s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:13:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "8c2f34cc3466f923251e6f953906e0c05be64824" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.995s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:13:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c2f34cc3466f923251e6f953906e0c05be64824 --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c2f34cc3466f923251e6f953906e0c05be64824 --force-share --output=json" returned: 0 in 0.198s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Acquiring lock "8c2f34cc3466f923251e6f953906e0c05be64824" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "8c2f34cc3466f923251e6f953906e0c05be64824" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c2f34cc3466f923251e6f953906e0c05be64824 --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c2f34cc3466f923251e6f953906e0c05be64824 --force-share --output=json" returned: 0 in 0.184s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c2f34cc3466f923251e6f953906e0c05be64824,backing_fmt=raw /opt/stack/data/nova/instances/36dccf43-d4a3-47aa-bd73-de9646e1020c/disk 1073741824 {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c2f34cc3466f923251e6f953906e0c05be64824,backing_fmt=raw /opt/stack/data/nova/instances/36dccf43-d4a3-47aa-bd73-de9646e1020c/disk 1073741824" returned: 0 in 0.048s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "8c2f34cc3466f923251e6f953906e0c05be64824" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c2f34cc3466f923251e6f953906e0c05be64824 --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c2f34cc3466f923251e6f953906e0c05be64824 --force-share --output=json" returned: 0 in 0.180s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG nova.objects.instance [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lazy-loading 'migration_context' on Instance uuid 36dccf43-d4a3-47aa-bd73-de9646e1020c {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG nova.objects.base [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Object Instance<36dccf43-d4a3-47aa-bd73-de9646e1020c> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=95467) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 08:13:57 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Rebasing disk image.
Nov 15 08:13:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:57 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Instance destroyed successfully.
Nov 15 08:13:57 user nova-compute[95467]: DEBUG nova.objects.instance [None req-18c12c2e-f461-4ec5-87b8-6e934222fd75 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Lazy-loading 'resources' on Instance uuid 7e53d93e-1222-4b1a-9745-d512da0f7925 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-18c12c2e-f461-4ec5-87b8-6e934222fd75 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T08:10:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1930677760',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-123252793',id=7,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAC1BuAs3ejJ+aRw6D/CB1xzKj78ip7ytDqvO2vvfGnTsB6+r8q33E0IAISM3h9/kVw6ZoQQmHwLT2P/3YuBA4w/px39kz5Vj5TaIA4bkzJYmqXkT5MBbT73nDHHxYjkVA==',key_name='tempest-keypair-986720723',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:12:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='81b11067a2d84bba8e6929713034b422',ramdisk_id='',reservation_id='r-pdz8drr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1288833049',owner_user_name='tempest-ServerActionsV293TestJSON-1288833049-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:12:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='54bfe816a1bf4ee485e055604f0b7609',uuid=7e53d93e-1222-4b1a-9745-d512da0f7925,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2", "address": "fa:16:3e:b1:d4:80", "network": {"id": "d8daee94-e2d9-42cf-9675-8c06e7292d36", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-765825262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81b11067a2d84bba8e6929713034b422", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d8e0cf8-c3", "ovs_interfaceid": "1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-18c12c2e-f461-4ec5-87b8-6e934222fd75 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Converting VIF {"id": "1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2", "address": "fa:16:3e:b1:d4:80", "network": {"id": "d8daee94-e2d9-42cf-9675-8c06e7292d36", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-765825262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81b11067a2d84bba8e6929713034b422", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d8e0cf8-c3", "ovs_interfaceid": "1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-18c12c2e-f461-4ec5-87b8-6e934222fd75 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b1:d4:80,bridge_name='br-int',has_traffic_filtering=True,id=1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2,network=Network(d8daee94-e2d9-42cf-9675-8c06e7292d36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d8e0cf8-c3') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG os_vif [None req-18c12c2e-f461-4ec5-87b8-6e934222fd75 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:d4:80,bridge_name='br-int',has_traffic_filtering=True,id=1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2,network=Network(d8daee94-e2d9-42cf-9675-8c06e7292d36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d8e0cf8-c3') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1d8e0cf8-c3, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e669cc0b-341a-4e3e-bd1d-f796efc8933b) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:13:57 user nova-compute[95467]: INFO os_vif [None req-18c12c2e-f461-4ec5-87b8-6e934222fd75 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:d4:80,bridge_name='br-int',has_traffic_filtering=True,id=1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2,network=Network(d8daee94-e2d9-42cf-9675-8c06e7292d36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d8e0cf8-c3')
Nov 15 08:13:57 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18c12c2e-f461-4ec5-87b8-6e934222fd75 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] calling os-brick to detach iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c12c2e-f461-4ec5-87b8-6e934222fd75 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, {'target_iqn': 'iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mZKOEzLI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:13:57 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-18c12c2e-f461-4ec5-87b8-6e934222fd75 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:13:57 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-18c12c2e-f461-4ec5-87b8-6e934222fd75 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-18c12c2e-f461-4ec5-87b8-6e934222fd75 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[954c2dcd-fb94-4121-8f26-38fa6102e00e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c12c2e-f461-4ec5-87b8-6e934222fd75 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 08:13:57 user nova-compute[95467]: No targets found.
Nov 15 08:13:57 user nova-compute[95467]: iSNS:
Nov 15 08:13:57 user nova-compute[95467]: No targets found.
Nov 15 08:13:57 user nova-compute[95467]: STATIC:
Nov 15 08:13:57 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f
Nov 15 08:13:57 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:13:57 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:13:57 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de
Nov 15 08:13:57 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:13:57 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:13:57 user nova-compute[95467]: FIRMWARE:
Nov 15 08:13:57 user nova-compute[95467]: No targets found.
Nov 15 08:13:57 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c12c2e-f461-4ec5-87b8-6e934222fd75 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 08:13:57 user nova-compute[95467]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 08:13:57 user nova-compute[95467]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=95467) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c12c2e-f461-4ec5-87b8-6e934222fd75 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f', 0)] {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe5fa2f-0b2b-4bbb-8d21-7164618b62ff]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83161b0-dfd6-428f-9c58-1bb77767650b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c12c2e-f461-4ec5-87b8-6e934222fd75 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)
Nov 15 08:13:57 user nova-compute[95467]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)
Nov 15 08:13:57 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c12c2e-f461-4ec5-87b8-6e934222fd75 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f (non-flash)
Nov 15 08:13:57 user nova-compute[95467]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)
Nov 15 08:13:57 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c12c2e-f461-4ec5-87b8-6e934222fd75 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efec8216170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f'): ({'sdb'}, set())}) {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-18c12c2e-f461-4ec5-87b8-6e934222fd75 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Removing single pathed devices sdb {{(pid=95467) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.211s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc -F raw /opt/stack/data/nova/instances/36dccf43-d4a3-47aa-bd73-de9646e1020c/disk {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8315bd21-ac18-4aa7-85ad-fd0a551b5a11]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f112ce-49a8-4df3-987f-fc7dc5177a5f]: (4, ('ok\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-18c12c2e-f461-4ec5-87b8-6e934222fd75 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Flushing IO for device /dev/sdb {{(pid=95467) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9a7f69-537e-4039-a6e4-06fba4fc31d3]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-18c12c2e-f461-4ec5-87b8-6e934222fd75 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=95467) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85574de-f383-4a4b-8b5e-08d35ce8b73b]: (4, ('1', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-18c12c2e-f461-4ec5-87b8-6e934222fd75 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-18c12c2e-f461-4ec5-87b8-6e934222fd75 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] SCSI volumes sdb have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c12c2e-f461-4ec5-87b8-6e934222fd75 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f')] {{(pid=95467) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1ef486-a505-42c0-90fb-bb230da5c6e0]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c12c2e-f461-4ec5-87b8-6e934222fd75 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f -p 172.16.0.220:3260 --logout {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[95fc8f69-e36f-430b-b24b-e38b531b7254]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c12c2e-f461-4ec5-87b8-6e934222fd75 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f, portal: 172.16.0.220,3260]
Nov 15 08:13:57 user nova-compute[95467]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f, portal: 172.16.0.220,3260] successful.
Nov 15 08:13:57 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f -p 172.16.0.220:3260 --op delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01b18fa8-0d71-4fef-b5f2-44b7afba773f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd68b71-d4c3-40aa-89c2-2d871fee9163]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c12c2e-f461-4ec5-87b8-6e934222fd75 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-18c12c2e-f461-4ec5-87b8-6e934222fd75 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c12c2e-f461-4ec5-87b8-6e934222fd75 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] <== disconnect_volume: return (375ms) None {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:13:57 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18c12c2e-f461-4ec5-87b8-6e934222fd75 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Disconnected iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 08:13:57 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-18c12c2e-f461-4ec5-87b8-6e934222fd75 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Deleting instance files /opt/stack/data/nova/instances/7e53d93e-1222-4b1a-9745-d512da0f7925_del
Nov 15 08:13:57 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-18c12c2e-f461-4ec5-87b8-6e934222fd75 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Deletion of /opt/stack/data/nova/instances/7e53d93e-1222-4b1a-9745-d512da0f7925_del complete
Nov 15 08:13:58 user nova-compute[95467]: INFO nova.compute.manager [None req-18c12c2e-f461-4ec5-87b8-6e934222fd75 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Took 1.32 seconds to destroy the instance on the hypervisor.
Nov 15 08:13:58 user nova-compute[95467]: DEBUG oslo.service.loopingcall [None req-18c12c2e-f461-4ec5-87b8-6e934222fd75 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=95467) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 08:13:58 user nova-compute[95467]: DEBUG nova.compute.manager [-] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Deallocating network for instance {{(pid=95467) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 08:13:58 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] deallocate_for_instance() {{(pid=95467) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 08:13:58 user nova-compute[95467]: DEBUG nova.compute.manager [req-29c2992a-6716-4ebf-9814-879b69abe5b7 req-a4b9b6a4-2bd2-4d75-acee-55814136926f service nova] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Received event network-vif-unplugged-1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:13:58 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-29c2992a-6716-4ebf-9814-879b69abe5b7 req-a4b9b6a4-2bd2-4d75-acee-55814136926f service nova] Acquiring lock "7e53d93e-1222-4b1a-9745-d512da0f7925-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:13:58 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-29c2992a-6716-4ebf-9814-879b69abe5b7 req-a4b9b6a4-2bd2-4d75-acee-55814136926f service nova] Lock "7e53d93e-1222-4b1a-9745-d512da0f7925-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:13:58 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-29c2992a-6716-4ebf-9814-879b69abe5b7 req-a4b9b6a4-2bd2-4d75-acee-55814136926f service nova] Lock "7e53d93e-1222-4b1a-9745-d512da0f7925-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:13:58 user nova-compute[95467]: DEBUG nova.compute.manager [req-29c2992a-6716-4ebf-9814-879b69abe5b7 req-a4b9b6a4-2bd2-4d75-acee-55814136926f service nova] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] No waiting events found dispatching network-vif-unplugged-1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:13:58 user nova-compute[95467]: DEBUG nova.compute.manager [req-29c2992a-6716-4ebf-9814-879b69abe5b7 req-a4b9b6a4-2bd2-4d75-acee-55814136926f service nova] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Received event network-vif-unplugged-1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2 for instance with task_state deleting. {{(pid=95467) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 08:13:58 user nova-compute[95467]: DEBUG nova.compute.manager [req-29c2992a-6716-4ebf-9814-879b69abe5b7 req-a4b9b6a4-2bd2-4d75-acee-55814136926f service nova] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Received event network-vif-plugged-1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:13:58 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-29c2992a-6716-4ebf-9814-879b69abe5b7 req-a4b9b6a4-2bd2-4d75-acee-55814136926f service nova] Acquiring lock "7e53d93e-1222-4b1a-9745-d512da0f7925-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:13:58 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-29c2992a-6716-4ebf-9814-879b69abe5b7 req-a4b9b6a4-2bd2-4d75-acee-55814136926f service nova] Lock "7e53d93e-1222-4b1a-9745-d512da0f7925-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:13:58 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-29c2992a-6716-4ebf-9814-879b69abe5b7 req-a4b9b6a4-2bd2-4d75-acee-55814136926f service nova] Lock "7e53d93e-1222-4b1a-9745-d512da0f7925-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:13:58 user nova-compute[95467]: DEBUG nova.compute.manager [req-29c2992a-6716-4ebf-9814-879b69abe5b7 req-a4b9b6a4-2bd2-4d75-acee-55814136926f service nova] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] No waiting events found dispatching network-vif-plugged-1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:13:58 user nova-compute[95467]: WARNING nova.compute.manager [req-29c2992a-6716-4ebf-9814-879b69abe5b7 req-a4b9b6a4-2bd2-4d75-acee-55814136926f service nova] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Received unexpected event network-vif-plugged-1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2 for instance with vm_state active and task_state deleting.
Nov 15 08:13:58 user nova-compute[95467]: DEBUG os_brick.utils [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:13:58 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:58 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:13:58 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6543b29-dbd8-4e82-8fd3-f8dd8d0aab08]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:882ae90641f\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:13:58 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:58 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:13:58 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2aa487b-3358-487d-9ecb-c78c41712a38]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:13:58 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:58 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.029s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:13:58 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71493ca-7e42-4b54-bda8-e2afd56357f8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:13:58 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d344c02-d277-42c2-aa43-6219ff3d87f7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:13:58 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Running cmd (subprocess): nvme version {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:58 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] 'nvme version' failed. Not Retrying. {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:13:58 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] nvme not present on system {{(pid=95467) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 08:13:58 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:13:58 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:13:58 user nova-compute[95467]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 08:13:58 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e12d08-0554-42b5-9fe9-51a3eea8450f]: (4, '') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:13:58 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=95467) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 08:13:58 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 08:13:58 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] LIGHTOS: no hostnqn found. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 08:13:58 user nova-compute[95467]: DEBUG os_brick.utils [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:882ae90641f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:13:58 user nova-compute[95467]: DEBUG nova.virt.block_device [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] Updating existing volume attachment record: d7217446-7318-4a72-b605-c95aca921b00 {{(pid=95467) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 08:13:58 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:13:58 user nova-compute[95467]: INFO nova.compute.manager [-] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Took 0.76 seconds to deallocate network for instance.
Nov 15 08:13:59 user nova-compute[95467]: INFO nova.compute.manager [None req-18c12c2e-f461-4ec5-87b8-6e934222fd75 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Took 0.83 seconds to detach 1 volumes for instance.
Nov 15 08:13:59 user nova-compute[95467]: DEBUG nova.compute.manager [None req-18c12c2e-f461-4ec5-87b8-6e934222fd75 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Deleting volume: 01b18fa8-0d71-4fef-b5f2-44b7afba773f {{(pid=95467) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 08:13:59 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-18c12c2e-f461-4ec5-87b8-6e934222fd75 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:13:59 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-18c12c2e-f461-4ec5-87b8-6e934222fd75 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc -F raw /opt/stack/data/nova/instances/36dccf43-d4a3-47aa-bd73-de9646e1020c/disk" returned: 0 in 2.337s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Created local disks {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Ensure instance console log exists: /opt/stack/data/nova/instances/36dccf43-d4a3-47aa-bd73-de9646e1020c/console.log {{(pid=95467) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Start _get_guest_xml network_info=[{"id": "5b51bd20-90a5-4fb1-816c-3d8e8824cb41", "address": "fa:16:3e:79:70:b1", "network": {"id": "f7871b75-73b3-4f0a-8e6c-814bc61ebd6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-945672014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b04c448c61451d8d46ebc7a61a5e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b51bd20-90", "ovs_interfaceid": "5b51bd20-90a5-4fb1-816c-3d8e8824cb41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='fadc8a9a5351e94febc1b9c01d3ea036',container_format='bare',created_at=2023-11-15T08:11:51Z,direct_url=<?>,disk_format='qcow2',id=30ebae06-a194-4c9e-ba4b-9067f89f8a9c,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1540652883-shelved',owner='94b04c448c61451d8d46ebc7a61a5e6e',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-15T08:11:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'ed9c48aa-ce73-4b3b-9db1-235898be671b'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'd9d2d0b1-57da-4609-ae82-17a85f49eb4e', 'delete_on_termination': False, 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dVBZyxzk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '36dccf43-d4a3-47aa-bd73-de9646e1020c', 'attached_at': '', 'detached_at': '', 'volume_id': 'cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77', 'serial': 'cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77'}, 'volume_type': None} {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:14:00 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:14:00 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:14:00 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='fadc8a9a5351e94febc1b9c01d3ea036',container_format='bare',created_at=2023-11-15T08:11:51Z,direct_url=<?>,disk_format='qcow2',id=30ebae06-a194-4c9e-ba4b-9067f89f8a9c,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1540652883-shelved',owner='94b04c448c61451d8d46ebc7a61a5e6e',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-15T08:11:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG nova.objects.instance [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lazy-loading 'vcpu_model' on Instance uuid 36dccf43-d4a3-47aa-bd73-de9646e1020c {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG nova.objects.base [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Object Instance<36dccf43-d4a3-47aa-bd73-de9646e1020c> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=95467) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Calling os-brick to attach iSCSI Volume {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dVBZyxzk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:14:00 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:14:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:14:00 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:14:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:14:00 user nova-compute[95467]: INFO os_brick.initiator.connectors.iscsi [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 08:14:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77 -p 172.16.0.220:3260 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ea80f4-3d40-43c1-8642-8316e09fa9a2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 08:14:00 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77 -p 172.16.0.220:3260 --interface default --op new {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-18c12c2e-f461-4ec5-87b8-6e934222fd75 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-18c12c2e-f461-4ec5-87b8-6e934222fd75 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[21331591-003a-42fe-be59-7b1bfb77912a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77] added\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77] added
Nov 15 08:14:00 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.149s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc760a3a-83a7-433e-88b0-5e7ba8317624]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-18c12c2e-f461-4ec5-87b8-6e934222fd75 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.593s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ffc907-c199-4114-9fff-e9928a9d492a]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dVBZyxzk {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG nova.compute.manager [req-99c5f87c-e5cd-463a-a6d1-61daf6a768d7 req-05f6c118-3739-4948-ae01-03024fd6ff87 service nova] [instance: 7e53d93e-1222-4b1a-9745-d512da0f7925] Received event network-vif-deleted-1d8e0cf8-c3a0-4b46-8886-245d27ca7ad2 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dVBZyxzk" returned: 0 in 0.026s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b2fe952-678a-47d5-b090-ea331d6cf42d]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dVBZyxzk'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:14:00 user nova-compute[95467]: INFO nova.scheduler.client.report [None req-18c12c2e-f461-4ec5-87b8-6e934222fd75 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Deleted allocations for instance 7e53d93e-1222-4b1a-9745-d512da0f7925
Nov 15 08:14:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7d57b4-68eb-4034-850f-42ea1aaf4b4c]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ddd4cc0-0890-4963-9b5e-260fee306ce5]: (4, ('tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)
Nov 15 08:14:00 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] iscsi session list stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)
Nov 15 08:14:00 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77 -p 172.16.0.220:3260 --login {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-18c12c2e-f461-4ec5-87b8-6e934222fd75 tempest-ServerActionsV293TestJSON-1288833049 tempest-ServerActionsV293TestJSON-1288833049-project-member] Lock "7e53d93e-1222-4b1a-9745-d512da0f7925" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.808s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[6381b45b-bb03-4b79-9d96-f71a811f9c8c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77, portal: 172.16.0.220,3260]
Nov 15 08:14:00 user nova-compute[95467]: Login to [iface: default, target: iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77, portal: 172.16.0.220,3260] successful.
Nov 15 08:14:00 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[04204608-4545-4e1f-ba9c-271301142325]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d8637f-1fa6-4fe3-9b22-897fa4136c01]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77 (non-flash)
Nov 15 08:14:00 user nova-compute[95467]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)
Nov 15 08:14:00 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77 (non-flash)
Nov 15 08:14:00 user nova-compute[95467]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)
Nov 15 08:14:00 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.468s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Connected to 172.16.0.220:3260 {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=95467) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=95467) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[7feac833-6de4-48a5-86bb-c2bfb124d5aa]: (4, ('- - 0', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:14:00 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: None {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:14:01 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:14:01 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dVBZyxzk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 08:14:01 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.504s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:14:01 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] <== connect_volume: return (1505ms) {'type': 'block', 'scsi_wwn': '23238323130346663', 'path': '/dev/sdb'} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:14:01 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23238323130346663', 'path': '/dev/sdb'} {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 08:14:01 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T08:09:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1540652883',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1540652883',id=5,image_ref='30ebae06-a194-4c9e-ba4b-9067f89f8a9c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1788942377',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:10:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='94b04c448c61451d8d46ebc7a61a5e6e',ramdisk_id='',reservation_id='r-0d1eau01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1251988905',owner_user_name='tempest-AttachVolumeShelveTestJSON-1251988905-project-member',shelved_at='2023-11-15T08:11:55.202910',shelved_host='user',shelved_image_id='30ebae06-a194-4c9e-ba4b-9067f89f8a9c'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:13:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b03564d022e84f5cb133b9771e76bae8',uuid=36dccf43-d4a3-47aa-bd73-de9646e1020c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "5b51bd20-90a5-4fb1-816c-3d8e8824cb41", "address": "fa:16:3e:79:70:b1", "network": {"id": "f7871b75-73b3-4f0a-8e6c-814bc61ebd6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-945672014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b04c448c61451d8d46ebc7a61a5e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b51bd20-90", "ovs_interfaceid": "5b51bd20-90a5-4fb1-816c-3d8e8824cb41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:14:01 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Converting VIF {"id": "5b51bd20-90a5-4fb1-816c-3d8e8824cb41", "address": "fa:16:3e:79:70:b1", "network": {"id": "f7871b75-73b3-4f0a-8e6c-814bc61ebd6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-945672014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b04c448c61451d8d46ebc7a61a5e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b51bd20-90", "ovs_interfaceid": "5b51bd20-90a5-4fb1-816c-3d8e8824cb41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:14:01 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:70:b1,bridge_name='br-int',has_traffic_filtering=True,id=5b51bd20-90a5-4fb1-816c-3d8e8824cb41,network=Network(f7871b75-73b3-4f0a-8e6c-814bc61ebd6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b51bd20-90') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:14:01 user nova-compute[95467]: DEBUG nova.objects.instance [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lazy-loading 'pci_devices' on Instance uuid 36dccf43-d4a3-47aa-bd73-de9646e1020c {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:14:01 user nova-compute[95467]: DEBUG nova.objects.base [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Object Instance<36dccf43-d4a3-47aa-bd73-de9646e1020c> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=95467) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 08:14:01 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:14:01 user nova-compute[95467]:   <uuid>36dccf43-d4a3-47aa-bd73-de9646e1020c</uuid>
Nov 15 08:14:01 user nova-compute[95467]:   <name>instance-00000005</name>
Nov 15 08:14:01 user nova-compute[95467]:   <memory>524288</memory>
Nov 15 08:14:01 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:14:01 user nova-compute[95467]:   <metadata>
Nov 15 08:14:01 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:14:01 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:14:01 user nova-compute[95467]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1540652883</nova:name>
Nov 15 08:14:01 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:14:00</nova:creationTime>
Nov 15 08:14:01 user nova-compute[95467]:       <nova:flavor name="m1.tiny">
Nov 15 08:14:01 user nova-compute[95467]:         <nova:memory>512</nova:memory>
Nov 15 08:14:01 user nova-compute[95467]:         <nova:disk>1</nova:disk>
Nov 15 08:14:01 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:14:01 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:14:01 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:14:01 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:14:01 user nova-compute[95467]:       <nova:owner>
Nov 15 08:14:01 user nova-compute[95467]:         <nova:user uuid="b03564d022e84f5cb133b9771e76bae8">tempest-AttachVolumeShelveTestJSON-1251988905-project-member</nova:user>
Nov 15 08:14:01 user nova-compute[95467]:         <nova:project uuid="94b04c448c61451d8d46ebc7a61a5e6e">tempest-AttachVolumeShelveTestJSON-1251988905</nova:project>
Nov 15 08:14:01 user nova-compute[95467]:       </nova:owner>
Nov 15 08:14:01 user nova-compute[95467]:       <nova:root type="image" uuid="30ebae06-a194-4c9e-ba4b-9067f89f8a9c"/>
Nov 15 08:14:01 user nova-compute[95467]:       <nova:ports>
Nov 15 08:14:01 user nova-compute[95467]:         <nova:port uuid="5b51bd20-90a5-4fb1-816c-3d8e8824cb41">
Nov 15 08:14:01 user nova-compute[95467]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 08:14:01 user nova-compute[95467]:         </nova:port>
Nov 15 08:14:01 user nova-compute[95467]:       </nova:ports>
Nov 15 08:14:01 user nova-compute[95467]:     </nova:instance>
Nov 15 08:14:01 user nova-compute[95467]:   </metadata>
Nov 15 08:14:01 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:14:01 user nova-compute[95467]:     <system>
Nov 15 08:14:01 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:14:01 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:14:01 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:14:01 user nova-compute[95467]:       <entry name="serial">36dccf43-d4a3-47aa-bd73-de9646e1020c</entry>
Nov 15 08:14:01 user nova-compute[95467]:       <entry name="uuid">36dccf43-d4a3-47aa-bd73-de9646e1020c</entry>
Nov 15 08:14:01 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:14:01 user nova-compute[95467]:     </system>
Nov 15 08:14:01 user nova-compute[95467]:   </sysinfo>
Nov 15 08:14:01 user nova-compute[95467]:   <os>
Nov 15 08:14:01 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:14:01 user nova-compute[95467]:     <boot dev="hd"/>
Nov 15 08:14:01 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:14:01 user nova-compute[95467]:   </os>
Nov 15 08:14:01 user nova-compute[95467]:   <features>
Nov 15 08:14:01 user nova-compute[95467]:     <acpi/>
Nov 15 08:14:01 user nova-compute[95467]:     <apic/>
Nov 15 08:14:01 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:14:01 user nova-compute[95467]:   </features>
Nov 15 08:14:01 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:14:01 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:14:01 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:14:01 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:14:01 user nova-compute[95467]:   </clock>
Nov 15 08:14:01 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:14:01 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:14:01 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:14:01 user nova-compute[95467]:   </cpu>
Nov 15 08:14:01 user nova-compute[95467]:   <devices>
Nov 15 08:14:01 user nova-compute[95467]:     <disk type="file" device="disk">
Nov 15 08:14:01 user nova-compute[95467]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 08:14:01 user nova-compute[95467]:       <source file="/opt/stack/data/nova/instances/36dccf43-d4a3-47aa-bd73-de9646e1020c/disk"/>
Nov 15 08:14:01 user nova-compute[95467]:       <target dev="vda" bus="virtio"/>
Nov 15 08:14:01 user nova-compute[95467]:     </disk>
Nov 15 08:14:01 user nova-compute[95467]:     <disk type="block" device="disk">
Nov 15 08:14:01 user nova-compute[95467]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:14:01 user nova-compute[95467]:       <source dev="/dev/sdb"/>
Nov 15 08:14:01 user nova-compute[95467]:       <target dev="vdc" bus="virtio"/>
Nov 15 08:14:01 user nova-compute[95467]:       <serial>cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77</serial>
Nov 15 08:14:01 user nova-compute[95467]:     </disk>
Nov 15 08:14:01 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:14:01 user nova-compute[95467]:       <mac address="fa:16:3e:79:70:b1"/>
Nov 15 08:14:01 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:14:01 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:14:01 user nova-compute[95467]:       <target dev="tap5b51bd20-90"/>
Nov 15 08:14:01 user nova-compute[95467]:     </interface>
Nov 15 08:14:01 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:14:01 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/36dccf43-d4a3-47aa-bd73-de9646e1020c/console.log" append="off"/>
Nov 15 08:14:01 user nova-compute[95467]:     </serial>
Nov 15 08:14:01 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:14:01 user nova-compute[95467]:     <video>
Nov 15 08:14:01 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:14:01 user nova-compute[95467]:     </video>
Nov 15 08:14:01 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:14:01 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:14:01 user nova-compute[95467]:     </rng>
Nov 15 08:14:01 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:14:01 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:14:01 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:14:01 user nova-compute[95467]:     </memballoon>
Nov 15 08:14:01 user nova-compute[95467]:   </devices>
Nov 15 08:14:01 user nova-compute[95467]: </domain>
Nov 15 08:14:01 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:14:01 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T08:09:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1540652883',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1540652883',id=5,image_ref='30ebae06-a194-4c9e-ba4b-9067f89f8a9c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1788942377',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:10:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='94b04c448c61451d8d46ebc7a61a5e6e',ramdisk_id='',reservation_id='r-0d1eau01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1251988905',owner_user_name='tempest-AttachVolumeShelveTestJSON-1251988905-project-member',shelved_at='2023-11-15T08:11:55.202910',shelved_host='user',shelved_image_id='30ebae06-a194-4c9e-ba4b-9067f89f8a9c'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:13:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b03564d022e84f5cb133b9771e76bae8',uuid=36dccf43-d4a3-47aa-bd73-de9646e1020c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "5b51bd20-90a5-4fb1-816c-3d8e8824cb41", "address": "fa:16:3e:79:70:b1", "network": {"id": "f7871b75-73b3-4f0a-8e6c-814bc61ebd6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-945672014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b04c448c61451d8d46ebc7a61a5e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b51bd20-90", "ovs_interfaceid": "5b51bd20-90a5-4fb1-816c-3d8e8824cb41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:14:01 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Converting VIF {"id": "5b51bd20-90a5-4fb1-816c-3d8e8824cb41", "address": "fa:16:3e:79:70:b1", "network": {"id": "f7871b75-73b3-4f0a-8e6c-814bc61ebd6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-945672014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b04c448c61451d8d46ebc7a61a5e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b51bd20-90", "ovs_interfaceid": "5b51bd20-90a5-4fb1-816c-3d8e8824cb41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:14:01 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:70:b1,bridge_name='br-int',has_traffic_filtering=True,id=5b51bd20-90a5-4fb1-816c-3d8e8824cb41,network=Network(f7871b75-73b3-4f0a-8e6c-814bc61ebd6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b51bd20-90') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:14:01 user nova-compute[95467]: DEBUG os_vif [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:70:b1,bridge_name='br-int',has_traffic_filtering=True,id=5b51bd20-90a5-4fb1-816c-3d8e8824cb41,network=Network(f7871b75-73b3-4f0a-8e6c-814bc61ebd6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b51bd20-90') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:14:01 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:01 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:14:01 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:14:01 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:01 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7e62ca1b-d74e-5c0b-949c-e8a0ece1b8a6', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:14:01 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:01 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:01 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:01 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b51bd20-90, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:14:01 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5b51bd20-90, col_values=(('qos', UUID('c8d3a0a4-73c1-4355-ac9f-68a4ddf1176a')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:14:01 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5b51bd20-90, col_values=(('external_ids', {'iface-id': '5b51bd20-90a5-4fb1-816c-3d8e8824cb41', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:70:b1', 'vm-uuid': '36dccf43-d4a3-47aa-bd73-de9646e1020c'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:14:01 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:01 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:14:01 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:01 user nova-compute[95467]: INFO os_vif [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:70:b1,bridge_name='br-int',has_traffic_filtering=True,id=5b51bd20-90a5-4fb1-816c-3d8e8824cb41,network=Network(f7871b75-73b3-4f0a-8e6c-814bc61ebd6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b51bd20-90')
Nov 15 08:14:01 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:14:01 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] No BDM found with device name vdc, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:14:01 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] No VIF found with MAC fa:16:3e:79:70:b1, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:14:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:03 user nova-compute[95467]: DEBUG nova.compute.manager [req-7b0822d1-1c18-4abe-ba8b-74bef064e06f req-234459c5-d203-4048-8aca-e83aafbc45bc service nova] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Received event network-vif-plugged-5b51bd20-90a5-4fb1-816c-3d8e8824cb41 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:14:03 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-7b0822d1-1c18-4abe-ba8b-74bef064e06f req-234459c5-d203-4048-8aca-e83aafbc45bc service nova] Acquiring lock "36dccf43-d4a3-47aa-bd73-de9646e1020c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:14:03 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-7b0822d1-1c18-4abe-ba8b-74bef064e06f req-234459c5-d203-4048-8aca-e83aafbc45bc service nova] Lock "36dccf43-d4a3-47aa-bd73-de9646e1020c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:14:03 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-7b0822d1-1c18-4abe-ba8b-74bef064e06f req-234459c5-d203-4048-8aca-e83aafbc45bc service nova] Lock "36dccf43-d4a3-47aa-bd73-de9646e1020c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:14:03 user nova-compute[95467]: DEBUG nova.compute.manager [req-7b0822d1-1c18-4abe-ba8b-74bef064e06f req-234459c5-d203-4048-8aca-e83aafbc45bc service nova] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] No waiting events found dispatching network-vif-plugged-5b51bd20-90a5-4fb1-816c-3d8e8824cb41 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:14:03 user nova-compute[95467]: WARNING nova.compute.manager [req-7b0822d1-1c18-4abe-ba8b-74bef064e06f req-234459c5-d203-4048-8aca-e83aafbc45bc service nova] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Received unexpected event network-vif-plugged-5b51bd20-90a5-4fb1-816c-3d8e8824cb41 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 15 08:14:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG nova.compute.manager [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] Start spawning the instance on the hypervisor. {{(pid=95467) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] Creating instance directory {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 08:14:04 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] Creating image(s)
Nov 15 08:14:04 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] Did not create local disks {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] Ensure instance console log exists: /opt/stack/data/nova/instances/abdf29d1-f80e-48c8-8c09-d7c9c0326833/console.log {{(pid=95467) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] Start _get_guest_xml network_info=[{"id": "efd5c9da-7c4f-4885-93f2-111ea8040673", "address": "fa:16:3e:07:c6:87", "network": {"id": "96d9262b-11fb-497d-8e38-fa46076c010f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2069167691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7791bd92c7c488aa72474ecde2e1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefd5c9da-7c", "ovs_interfaceid": "efd5c9da-7c4f-4885-93f2-111ea8040673", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'd7217446-7318-4a72-b605-c95aca921b00', 'delete_on_termination': True, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jIMzydlu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'abdf29d1-f80e-48c8-8c09-d7c9c0326833', 'attached_at': '', 'detached_at': '', 'volume_id': '7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4', 'serial': '7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4'}, 'volume_type': None} {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:14:04 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:14:04 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:14:04 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] Calling os-brick to attach iSCSI Volume {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jIMzydlu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:14:04 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:14:04 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:14:04 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:14:04 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:14:04 user nova-compute[95467]: INFO os_brick.initiator.connectors.iscsi [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 08:14:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4 -p 172.16.0.220:3260 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6b1bab-6cb1-440a-8abb-27af11277fd1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 08:14:04 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4 -p 172.16.0.220:3260 --interface default --op new {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde495c7-ddbd-4d05-a7a1-9198522b8c9b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4] added\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4] added
Nov 15 08:14:04 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cca9685-9ffb-4522-baa3-8cc5d8173ad5]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2a18ce-e880-4a50-81fb-50e0a8114e29]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jIMzydlu {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jIMzydlu" returned: 0 in 0.025s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a7bdd3-9ac2-442f-8a12-a3d52aab1a5c]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jIMzydlu'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e49b36e-0fcd-4d20-ba3e-339ce461431f]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f605e7e5-c890-4cbc-9ff6-696c6bf1145e]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77 (non-flash)
Nov 15 08:14:04 user nova-compute[95467]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)
Nov 15 08:14:04 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77 (non-flash)
Nov 15 08:14:04 user nova-compute[95467]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)
Nov 15 08:14:04 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4 -p 172.16.0.220:3260 --login {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[094ce7ca-7581-4653-b210-90ef428a6d65]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4, portal: 172.16.0.220,3260]
Nov 15 08:14:04 user nova-compute[95467]: Login to [iface: default, target: iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4, portal: 172.16.0.220,3260] successful.
Nov 15 08:14:04 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f001ca9-b4a9-4e40-a309-144694b3ee8a]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fbad973-5ab9-464e-bb6f-60ded2645616]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77 (non-flash)
Nov 15 08:14:04 user nova-compute[95467]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4 (non-flash)
Nov 15 08:14:04 user nova-compute[95467]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)
Nov 15 08:14:04 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77 (non-flash)
Nov 15 08:14:04 user nova-compute[95467]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4 (non-flash)
Nov 15 08:14:04 user nova-compute[95467]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)
Nov 15 08:14:04 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Connected to 172.16.0.220:3260 {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=95467) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=95467) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.014s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[de779117-1aec-4e5a-806a-47de7f1aa664]: (4, ('- - 0', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:14:04 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jIMzydlu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 08:14:05 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:14:05 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '26239316136326238', 'path': '/dev/sdc'} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:14:05 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26239316136326238', 'path': '/dev/sdc'} {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 08:14:05 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:13:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-447314755',display_name='tempest-TestVolumeBootPattern-server-447314755',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-447314755',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7791bd92c7c488aa72474ecde2e1155',ramdisk_id='',reservation_id='r-gu1on84m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-978207351',owner_user_name='tempest-TestVolumeBootPattern-978207351-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:13:53Z,user_data=None,user_id='11bbbd3ef322402cb5dc60455a54319b',uuid=abdf29d1-f80e-48c8-8c09-d7c9c0326833,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "efd5c9da-7c4f-4885-93f2-111ea8040673", "address": "fa:16:3e:07:c6:87", "network": {"id": "96d9262b-11fb-497d-8e38-fa46076c010f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2069167691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7791bd92c7c488aa72474ecde2e1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefd5c9da-7c", "ovs_interfaceid": "efd5c9da-7c4f-4885-93f2-111ea8040673", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:14:05 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Converting VIF {"id": "efd5c9da-7c4f-4885-93f2-111ea8040673", "address": "fa:16:3e:07:c6:87", "network": {"id": "96d9262b-11fb-497d-8e38-fa46076c010f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2069167691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7791bd92c7c488aa72474ecde2e1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefd5c9da-7c", "ovs_interfaceid": "efd5c9da-7c4f-4885-93f2-111ea8040673", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:14:05 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:c6:87,bridge_name='br-int',has_traffic_filtering=True,id=efd5c9da-7c4f-4885-93f2-111ea8040673,network=Network(96d9262b-11fb-497d-8e38-fa46076c010f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefd5c9da-7c') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:14:05 user nova-compute[95467]: DEBUG nova.objects.instance [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lazy-loading 'pci_devices' on Instance uuid abdf29d1-f80e-48c8-8c09-d7c9c0326833 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:14:05 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:14:05 user nova-compute[95467]:   <uuid>abdf29d1-f80e-48c8-8c09-d7c9c0326833</uuid>
Nov 15 08:14:05 user nova-compute[95467]:   <name>instance-00000013</name>
Nov 15 08:14:05 user nova-compute[95467]:   <memory>524288</memory>
Nov 15 08:14:05 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:14:05 user nova-compute[95467]:   <metadata>
Nov 15 08:14:05 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:14:05 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:14:05 user nova-compute[95467]:       <nova:name>tempest-TestVolumeBootPattern-server-447314755</nova:name>
Nov 15 08:14:05 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:14:04</nova:creationTime>
Nov 15 08:14:05 user nova-compute[95467]:       <nova:flavor name="m1.tiny">
Nov 15 08:14:05 user nova-compute[95467]:         <nova:memory>512</nova:memory>
Nov 15 08:14:05 user nova-compute[95467]:         <nova:disk>1</nova:disk>
Nov 15 08:14:05 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:14:05 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:14:05 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:14:05 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:14:05 user nova-compute[95467]:       <nova:owner>
Nov 15 08:14:05 user nova-compute[95467]:         <nova:user uuid="11bbbd3ef322402cb5dc60455a54319b">tempest-TestVolumeBootPattern-978207351-project-member</nova:user>
Nov 15 08:14:05 user nova-compute[95467]:         <nova:project uuid="e7791bd92c7c488aa72474ecde2e1155">tempest-TestVolumeBootPattern-978207351</nova:project>
Nov 15 08:14:05 user nova-compute[95467]:       </nova:owner>
Nov 15 08:14:05 user nova-compute[95467]:       <nova:ports>
Nov 15 08:14:05 user nova-compute[95467]:         <nova:port uuid="efd5c9da-7c4f-4885-93f2-111ea8040673">
Nov 15 08:14:05 user nova-compute[95467]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 08:14:05 user nova-compute[95467]:         </nova:port>
Nov 15 08:14:05 user nova-compute[95467]:       </nova:ports>
Nov 15 08:14:05 user nova-compute[95467]:     </nova:instance>
Nov 15 08:14:05 user nova-compute[95467]:   </metadata>
Nov 15 08:14:05 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:14:05 user nova-compute[95467]:     <system>
Nov 15 08:14:05 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:14:05 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:14:05 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:14:05 user nova-compute[95467]:       <entry name="serial">abdf29d1-f80e-48c8-8c09-d7c9c0326833</entry>
Nov 15 08:14:05 user nova-compute[95467]:       <entry name="uuid">abdf29d1-f80e-48c8-8c09-d7c9c0326833</entry>
Nov 15 08:14:05 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:14:05 user nova-compute[95467]:     </system>
Nov 15 08:14:05 user nova-compute[95467]:   </sysinfo>
Nov 15 08:14:05 user nova-compute[95467]:   <os>
Nov 15 08:14:05 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:14:05 user nova-compute[95467]:     <boot dev="hd"/>
Nov 15 08:14:05 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:14:05 user nova-compute[95467]:   </os>
Nov 15 08:14:05 user nova-compute[95467]:   <features>
Nov 15 08:14:05 user nova-compute[95467]:     <acpi/>
Nov 15 08:14:05 user nova-compute[95467]:     <apic/>
Nov 15 08:14:05 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:14:05 user nova-compute[95467]:   </features>
Nov 15 08:14:05 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:14:05 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:14:05 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:14:05 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:14:05 user nova-compute[95467]:   </clock>
Nov 15 08:14:05 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:14:05 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:14:05 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:14:05 user nova-compute[95467]:   </cpu>
Nov 15 08:14:05 user nova-compute[95467]:   <devices>
Nov 15 08:14:05 user nova-compute[95467]:     <disk type="block" device="disk">
Nov 15 08:14:05 user nova-compute[95467]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:14:05 user nova-compute[95467]:       <source dev="/dev/sdc"/>
Nov 15 08:14:05 user nova-compute[95467]:       <target dev="vda" bus="virtio"/>
Nov 15 08:14:05 user nova-compute[95467]:       <serial>7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4</serial>
Nov 15 08:14:05 user nova-compute[95467]:     </disk>
Nov 15 08:14:05 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:14:05 user nova-compute[95467]:       <mac address="fa:16:3e:07:c6:87"/>
Nov 15 08:14:05 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:14:05 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:14:05 user nova-compute[95467]:       <target dev="tapefd5c9da-7c"/>
Nov 15 08:14:05 user nova-compute[95467]:     </interface>
Nov 15 08:14:05 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:14:05 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/abdf29d1-f80e-48c8-8c09-d7c9c0326833/console.log" append="off"/>
Nov 15 08:14:05 user nova-compute[95467]:     </serial>
Nov 15 08:14:05 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:14:05 user nova-compute[95467]:     <video>
Nov 15 08:14:05 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:14:05 user nova-compute[95467]:     </video>
Nov 15 08:14:05 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:14:05 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:14:05 user nova-compute[95467]:     </rng>
Nov 15 08:14:05 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:14:05 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:14:05 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:14:05 user nova-compute[95467]:     </memballoon>
Nov 15 08:14:05 user nova-compute[95467]:   </devices>
Nov 15 08:14:05 user nova-compute[95467]: </domain>
Nov 15 08:14:05 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:14:05 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:13:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-447314755',display_name='tempest-TestVolumeBootPattern-server-447314755',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-447314755',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7791bd92c7c488aa72474ecde2e1155',ramdisk_id='',reservation_id='r-gu1on84m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-978207351',owner_user_name='tempest-TestVolumeBootPattern-978207351-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:13:53Z,user_data=None,user_id='11bbbd3ef322402cb5dc60455a54319b',uuid=abdf29d1-f80e-48c8-8c09-d7c9c0326833,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "efd5c9da-7c4f-4885-93f2-111ea8040673", "address": "fa:16:3e:07:c6:87", "network": {"id": "96d9262b-11fb-497d-8e38-fa46076c010f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2069167691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7791bd92c7c488aa72474ecde2e1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefd5c9da-7c", "ovs_interfaceid": "efd5c9da-7c4f-4885-93f2-111ea8040673", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:14:05 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Converting VIF {"id": "efd5c9da-7c4f-4885-93f2-111ea8040673", "address": "fa:16:3e:07:c6:87", "network": {"id": "96d9262b-11fb-497d-8e38-fa46076c010f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2069167691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7791bd92c7c488aa72474ecde2e1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefd5c9da-7c", "ovs_interfaceid": "efd5c9da-7c4f-4885-93f2-111ea8040673", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:14:05 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:c6:87,bridge_name='br-int',has_traffic_filtering=True,id=efd5c9da-7c4f-4885-93f2-111ea8040673,network=Network(96d9262b-11fb-497d-8e38-fa46076c010f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefd5c9da-7c') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:14:05 user nova-compute[95467]: DEBUG os_vif [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:c6:87,bridge_name='br-int',has_traffic_filtering=True,id=efd5c9da-7c4f-4885-93f2-111ea8040673,network=Network(96d9262b-11fb-497d-8e38-fa46076c010f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefd5c9da-7c') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:14:05 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:05 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:14:05 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:14:05 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:05 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6ed079de-7ced-5b46-8f93-be9352e181a9', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:14:05 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:05 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:14:05 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:05 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapefd5c9da-7c, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:14:05 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapefd5c9da-7c, col_values=(('qos', UUID('34f4cc60-d4d8-4c87-b778-cb4fb42aad01')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:14:05 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapefd5c9da-7c, col_values=(('external_ids', {'iface-id': 'efd5c9da-7c4f-4885-93f2-111ea8040673', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:c6:87', 'vm-uuid': 'abdf29d1-f80e-48c8-8c09-d7c9c0326833'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:14:05 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:05 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:14:05 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:05 user nova-compute[95467]: INFO os_vif [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:c6:87,bridge_name='br-int',has_traffic_filtering=True,id=efd5c9da-7c4f-4885-93f2-111ea8040673,network=Network(96d9262b-11fb-497d-8e38-fa46076c010f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefd5c9da-7c')
Nov 15 08:14:05 user nova-compute[95467]: DEBUG nova.compute.manager [req-f0b78d44-9c6f-497d-86c3-5ef9120b2053 req-e7b9a84b-3a34-4218-8499-4a558a6d7539 service nova] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Received event network-vif-plugged-5b51bd20-90a5-4fb1-816c-3d8e8824cb41 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:14:05 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-f0b78d44-9c6f-497d-86c3-5ef9120b2053 req-e7b9a84b-3a34-4218-8499-4a558a6d7539 service nova] Acquiring lock "36dccf43-d4a3-47aa-bd73-de9646e1020c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:14:05 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-f0b78d44-9c6f-497d-86c3-5ef9120b2053 req-e7b9a84b-3a34-4218-8499-4a558a6d7539 service nova] Lock "36dccf43-d4a3-47aa-bd73-de9646e1020c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:14:05 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-f0b78d44-9c6f-497d-86c3-5ef9120b2053 req-e7b9a84b-3a34-4218-8499-4a558a6d7539 service nova] Lock "36dccf43-d4a3-47aa-bd73-de9646e1020c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:14:05 user nova-compute[95467]: DEBUG nova.compute.manager [req-f0b78d44-9c6f-497d-86c3-5ef9120b2053 req-e7b9a84b-3a34-4218-8499-4a558a6d7539 service nova] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] No waiting events found dispatching network-vif-plugged-5b51bd20-90a5-4fb1-816c-3d8e8824cb41 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:14:05 user nova-compute[95467]: WARNING nova.compute.manager [req-f0b78d44-9c6f-497d-86c3-5ef9120b2053 req-e7b9a84b-3a34-4218-8499-4a558a6d7539 service nova] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Received unexpected event network-vif-plugged-5b51bd20-90a5-4fb1-816c-3d8e8824cb41 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 15 08:14:05 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:14:05 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] No VIF found with MAC fa:16:3e:07:c6:87, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:14:05 user nova-compute[95467]: DEBUG nova.compute.manager [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Instance event wait completed in 0 seconds for  {{(pid=95467) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 08:14:05 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Guest created on hypervisor {{(pid=95467) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 08:14:05 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Instance spawned successfully.
Nov 15 08:14:06 user nova-compute[95467]: DEBUG nova.compute.manager [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:14:06 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e83e0ebe-fb05-4b6c-84f0-c9c8b4713c0b tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "36dccf43-d4a3-47aa-bd73-de9646e1020c" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 19.654s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:14:06 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:06 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:06 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:07 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:07 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:07 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:07 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:07 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:07 user nova-compute[95467]: DEBUG nova.compute.manager [req-a98acd59-7431-4967-bdfc-4a0062b8d466 req-3e11965a-c35e-4d68-8536-33f9ce8f441a service nova] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] Received event network-vif-plugged-efd5c9da-7c4f-4885-93f2-111ea8040673 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:14:07 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-a98acd59-7431-4967-bdfc-4a0062b8d466 req-3e11965a-c35e-4d68-8536-33f9ce8f441a service nova] Acquiring lock "abdf29d1-f80e-48c8-8c09-d7c9c0326833-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:14:07 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-a98acd59-7431-4967-bdfc-4a0062b8d466 req-3e11965a-c35e-4d68-8536-33f9ce8f441a service nova] Lock "abdf29d1-f80e-48c8-8c09-d7c9c0326833-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:14:07 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-a98acd59-7431-4967-bdfc-4a0062b8d466 req-3e11965a-c35e-4d68-8536-33f9ce8f441a service nova] Lock "abdf29d1-f80e-48c8-8c09-d7c9c0326833-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:14:07 user nova-compute[95467]: DEBUG nova.compute.manager [req-a98acd59-7431-4967-bdfc-4a0062b8d466 req-3e11965a-c35e-4d68-8536-33f9ce8f441a service nova] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] No waiting events found dispatching network-vif-plugged-efd5c9da-7c4f-4885-93f2-111ea8040673 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:14:07 user nova-compute[95467]: WARNING nova.compute.manager [req-a98acd59-7431-4967-bdfc-4a0062b8d466 req-3e11965a-c35e-4d68-8536-33f9ce8f441a service nova] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] Received unexpected event network-vif-plugged-efd5c9da-7c4f-4885-93f2-111ea8040673 for instance with vm_state building and task_state spawning.
Nov 15 08:14:09 user nova-compute[95467]: DEBUG nova.compute.manager [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] Instance event wait completed in 0 seconds for  {{(pid=95467) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 08:14:09 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] Guest created on hypervisor {{(pid=95467) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 08:14:09 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] Instance spawned successfully.
Nov 15 08:14:09 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 08:14:09 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] Found default for hw_cdrom_bus of ide {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:14:09 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] Found default for hw_disk_bus of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:14:09 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] Found default for hw_input_bus of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:14:09 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] Found default for hw_pointer_model of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:14:09 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] Found default for hw_video_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:14:09 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] Found default for hw_vif_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:14:09 user nova-compute[95467]: INFO nova.compute.manager [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] Took 5.21 seconds to spawn the instance on the hypervisor.
Nov 15 08:14:09 user nova-compute[95467]: DEBUG nova.compute.manager [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:14:09 user nova-compute[95467]: INFO nova.compute.manager [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] Took 17.48 seconds to build instance.
Nov 15 08:14:09 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0e41f463-5c5e-4221-a4c0-99e71e74fb77 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "abdf29d1-f80e-48c8-8c09-d7c9c0326833" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.583s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:14:09 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:09 user nova-compute[95467]: DEBUG nova.compute.manager [req-a15ef814-1ff2-4487-9de7-badb295299e1 req-516427c5-8f87-4f80-9474-75ce7735a151 service nova] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] Received event network-vif-plugged-efd5c9da-7c4f-4885-93f2-111ea8040673 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:14:09 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-a15ef814-1ff2-4487-9de7-badb295299e1 req-516427c5-8f87-4f80-9474-75ce7735a151 service nova] Acquiring lock "abdf29d1-f80e-48c8-8c09-d7c9c0326833-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:14:09 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-a15ef814-1ff2-4487-9de7-badb295299e1 req-516427c5-8f87-4f80-9474-75ce7735a151 service nova] Lock "abdf29d1-f80e-48c8-8c09-d7c9c0326833-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:14:09 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-a15ef814-1ff2-4487-9de7-badb295299e1 req-516427c5-8f87-4f80-9474-75ce7735a151 service nova] Lock "abdf29d1-f80e-48c8-8c09-d7c9c0326833-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:14:09 user nova-compute[95467]: DEBUG nova.compute.manager [req-a15ef814-1ff2-4487-9de7-badb295299e1 req-516427c5-8f87-4f80-9474-75ce7735a151 service nova] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] No waiting events found dispatching network-vif-plugged-efd5c9da-7c4f-4885-93f2-111ea8040673 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:14:09 user nova-compute[95467]: WARNING nova.compute.manager [req-a15ef814-1ff2-4487-9de7-badb295299e1 req-516427c5-8f87-4f80-9474-75ce7735a151 service nova] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] Received unexpected event network-vif-plugged-efd5c9da-7c4f-4885-93f2-111ea8040673 for instance with vm_state active and task_state None.
Nov 15 08:14:10 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:15 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:15 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:17 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:20 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:24 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:30 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:30 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:34 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:14:34 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=95467) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 08:14:35 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Acquiring lock "da9c7b9d-aad7-4d4f-b190-fda71735fde6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:14:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Lock "da9c7b9d-aad7-4d4f-b190-fda71735fde6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:14:36 user nova-compute[95467]: DEBUG nova.compute.manager [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] Starting instance... {{(pid=95467) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 08:14:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:14:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:14:36 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=95467) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 08:14:36 user nova-compute[95467]: INFO nova.compute.claims [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] Claim successful on node user
Nov 15 08:14:36 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:14:36 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:14:36 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:14:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.407s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:14:36 user nova-compute[95467]: DEBUG nova.compute.manager [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] Start building networks asynchronously for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 08:14:36 user nova-compute[95467]: DEBUG nova.compute.manager [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] Allocating IP information in the background. {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 08:14:36 user nova-compute[95467]: DEBUG nova.network.neutron [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] allocate_for_instance() {{(pid=95467) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 08:14:36 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 15 08:14:36 user nova-compute[95467]: DEBUG nova.compute.manager [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] Start building block device mappings for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 08:14:36 user nova-compute[95467]: DEBUG nova.policy [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ad8085ad83aa4adf841f2dba2554f409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37bcd8e333c4c2faf96b5d445319274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95467) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 08:14:36 user nova-compute[95467]: DEBUG nova.compute.manager [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] Start spawning the instance on the hypervisor. {{(pid=95467) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 08:14:36 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] Creating instance directory {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 08:14:36 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] Creating image(s)
Nov 15 08:14:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Acquiring lock "/opt/stack/data/nova/instances/da9c7b9d-aad7-4d4f-b190-fda71735fde6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:14:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Lock "/opt/stack/data/nova/instances/da9c7b9d-aad7-4d4f-b190-fda71735fde6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:14:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Lock "/opt/stack/data/nova/instances/da9c7b9d-aad7-4d4f-b190-fda71735fde6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:14:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Acquiring lock "a655b15ca592705b435c4494527eeb7b91653cfe" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:14:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Lock "a655b15ca592705b435c4494527eeb7b91653cfe" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:14:37 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a655b15ca592705b435c4494527eeb7b91653cfe.part --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:14:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:37 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:14:37 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a655b15ca592705b435c4494527eeb7b91653cfe.part --force-share --output=json" returned: 0 in 0.230s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:14:37 user nova-compute[95467]: DEBUG nova.virt.images [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] 4c8406cc-4745-436b-966f-bdfe4fda5eb3 was qcow2, converting to raw {{(pid=95467) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 08:14:37 user nova-compute[95467]: DEBUG nova.privsep.utils [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=95467) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 08:14:37 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a655b15ca592705b435c4494527eeb7b91653cfe.part /opt/stack/data/nova/instances/_base/a655b15ca592705b435c4494527eeb7b91653cfe.converted {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:14:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a655b15ca592705b435c4494527eeb7b91653cfe.part /opt/stack/data/nova/instances/_base/a655b15ca592705b435c4494527eeb7b91653cfe.converted" returned: 0 in 0.367s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:14:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a655b15ca592705b435c4494527eeb7b91653cfe.converted --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:14:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a655b15ca592705b435c4494527eeb7b91653cfe.converted --force-share --output=json" returned: 0 in 0.184s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:14:38 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Lock "a655b15ca592705b435c4494527eeb7b91653cfe" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.424s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:14:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a655b15ca592705b435c4494527eeb7b91653cfe --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:14:38 user nova-compute[95467]: DEBUG nova.network.neutron [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] Successfully created port: 86652dd5-39a8-410c-aed4-3664980165f3 {{(pid=95467) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 08:14:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a655b15ca592705b435c4494527eeb7b91653cfe --force-share --output=json" returned: 0 in 0.207s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:14:38 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Acquiring lock "a655b15ca592705b435c4494527eeb7b91653cfe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:14:38 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Lock "a655b15ca592705b435c4494527eeb7b91653cfe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:14:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a655b15ca592705b435c4494527eeb7b91653cfe --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:14:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a655b15ca592705b435c4494527eeb7b91653cfe --force-share --output=json" returned: 0 in 0.169s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:14:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a655b15ca592705b435c4494527eeb7b91653cfe,backing_fmt=raw /opt/stack/data/nova/instances/da9c7b9d-aad7-4d4f-b190-fda71735fde6/disk 1073741824 {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:14:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a655b15ca592705b435c4494527eeb7b91653cfe,backing_fmt=raw /opt/stack/data/nova/instances/da9c7b9d-aad7-4d4f-b190-fda71735fde6/disk 1073741824" returned: 0 in 0.046s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:14:38 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Lock "a655b15ca592705b435c4494527eeb7b91653cfe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:14:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a655b15ca592705b435c4494527eeb7b91653cfe --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:14:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a655b15ca592705b435c4494527eeb7b91653cfe --force-share --output=json" returned: 0 in 0.175s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:14:38 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Checking if we can resize image /opt/stack/data/nova/instances/da9c7b9d-aad7-4d4f-b190-fda71735fde6/disk. size=1073741824 {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 08:14:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da9c7b9d-aad7-4d4f-b190-fda71735fde6/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da9c7b9d-aad7-4d4f-b190-fda71735fde6/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Cannot resize image /opt/stack/data/nova/instances/da9c7b9d-aad7-4d4f-b190-fda71735fde6/disk to a smaller size. {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] Created local disks {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] Ensure instance console log exists: /opt/stack/data/nova/instances/da9c7b9d-aad7-4d4f-b190-fda71735fde6/console.log {{(pid=95467) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-16e65720-c2b2-4fe0-810f-972e8537e44b tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Acquiring lock "5748cf5d-9c57-4477-8952-ec39d0d18f55" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-16e65720-c2b2-4fe0-810f-972e8537e44b tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "5748cf5d-9c57-4477-8952-ec39d0d18f55" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:14:39 user nova-compute[95467]: INFO nova.compute.manager [None req-16e65720-c2b2-4fe0-810f-972e8537e44b tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] Detaching volume 90e04b69-1404-4a84-a441-9de70a5ca0de
Nov 15 08:14:39 user nova-compute[95467]: INFO nova.virt.block_device [None req-16e65720-c2b2-4fe0-810f-972e8537e44b tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] Attempting to driver detach volume 90e04b69-1404-4a84-a441-9de70a5ca0de from mountpoint /dev/vdb
Nov 15 08:14:39 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-16e65720-c2b2-4fe0-810f-972e8537e44b tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Attempting to detach device vdb from instance 5748cf5d-9c57-4477-8952-ec39d0d18f55 from the persistent domain config. {{(pid=95467) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-16e65720-c2b2-4fe0-810f-972e8537e44b tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 08:14:39 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:14:39 user nova-compute[95467]:   <source dev="/dev/sdf"/>
Nov 15 08:14:39 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:14:39 user nova-compute[95467]:   <serial>90e04b69-1404-4a84-a441-9de70a5ca0de</serial>
Nov 15 08:14:39 user nova-compute[95467]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 08:14:39 user nova-compute[95467]: </disk>
Nov 15 08:14:39 user nova-compute[95467]:  {{(pid=95467) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 08:14:39 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-16e65720-c2b2-4fe0-810f-972e8537e44b tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Successfully detached device vdb from instance 5748cf5d-9c57-4477-8952-ec39d0d18f55 from the persistent domain config.
Nov 15 08:14:39 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-16e65720-c2b2-4fe0-810f-972e8537e44b tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5748cf5d-9c57-4477-8952-ec39d0d18f55 from the live domain config. {{(pid=95467) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-16e65720-c2b2-4fe0-810f-972e8537e44b tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 08:14:39 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:14:39 user nova-compute[95467]:   <source dev="/dev/sdf"/>
Nov 15 08:14:39 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:14:39 user nova-compute[95467]:   <serial>90e04b69-1404-4a84-a441-9de70a5ca0de</serial>
Nov 15 08:14:39 user nova-compute[95467]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 08:14:39 user nova-compute[95467]: </disk>
Nov 15 08:14:39 user nova-compute[95467]:  {{(pid=95467) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG nova.network.neutron [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] Successfully updated port: 86652dd5-39a8-410c-aed4-3664980165f3 {{(pid=95467) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Acquiring lock "refresh_cache-da9c7b9d-aad7-4d4f-b190-fda71735fde6" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Acquired lock "refresh_cache-da9c7b9d-aad7-4d4f-b190-fda71735fde6" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG nova.network.neutron [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG nova.compute.manager [req-4582f544-a1a9-42a8-a62f-bbc128f22dde req-8a42ba54-4c95-4317-9dc5-efede8823d82 service nova] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] Received event network-changed-86652dd5-39a8-410c-aed4-3664980165f3 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG nova.compute.manager [req-4582f544-a1a9-42a8-a62f-bbc128f22dde req-8a42ba54-4c95-4317-9dc5-efede8823d82 service nova] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] Refreshing instance network info cache due to event network-changed-86652dd5-39a8-410c-aed4-3664980165f3. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-4582f544-a1a9-42a8-a62f-bbc128f22dde req-8a42ba54-4c95-4317-9dc5-efede8823d82 service nova] Acquiring lock "refresh_cache-da9c7b9d-aad7-4d4f-b190-fda71735fde6" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG nova.network.neutron [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] Instance cache missing network info. {{(pid=95467) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG nova.network.neutron [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] Updating instance_info_cache with network_info: [{"id": "86652dd5-39a8-410c-aed4-3664980165f3", "address": "fa:16:3e:20:9d:69", "network": {"id": "99755f0a-da1b-4ec7-aa23-6801f4a0344c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-42152126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c37bcd8e333c4c2faf96b5d445319274", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86652dd5-39", "ovs_interfaceid": "86652dd5-39a8-410c-aed4-3664980165f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager.update_available_resource {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Releasing lock "refresh_cache-da9c7b9d-aad7-4d4f-b190-fda71735fde6" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG nova.compute.manager [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] Instance network_info: |[{"id": "86652dd5-39a8-410c-aed4-3664980165f3", "address": "fa:16:3e:20:9d:69", "network": {"id": "99755f0a-da1b-4ec7-aa23-6801f4a0344c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-42152126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c37bcd8e333c4c2faf96b5d445319274", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86652dd5-39", "ovs_interfaceid": "86652dd5-39a8-410c-aed4-3664980165f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-4582f544-a1a9-42a8-a62f-bbc128f22dde req-8a42ba54-4c95-4317-9dc5-efede8823d82 service nova] Acquired lock "refresh_cache-da9c7b9d-aad7-4d4f-b190-fda71735fde6" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG nova.network.neutron [req-4582f544-a1a9-42a8-a62f-bbc128f22dde req-8a42ba54-4c95-4317-9dc5-efede8823d82 service nova] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] Refreshing network info cache for port 86652dd5-39a8-410c-aed4-3664980165f3 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] Start _get_guest_xml network_info=[{"id": "86652dd5-39a8-410c-aed4-3664980165f3", "address": "fa:16:3e:20:9d:69", "network": {"id": "99755f0a-da1b-4ec7-aa23-6801f4a0344c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-42152126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c37bcd8e333c4c2faf96b5d445319274", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86652dd5-39", "ovs_interfaceid": "86652dd5-39a8-410c-aed4-3664980165f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:14:32Z,direct_url=<?>,disk_format='qcow2',id=4c8406cc-4745-436b-966f-bdfe4fda5eb3,min_disk=0,min_ram=0,name='',owner='99ce0adc92cc48abb09718001b613705',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:14:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'size': 0, 'boot_index': 0, 'disk_bus': 'scsi', 'device_name': '/dev/sda', 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '4c8406cc-4745-436b-966f-bdfe4fda5eb3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:14:39 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:14:39 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:14:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Auditing locally available compute resources for user (node: user) {{(pid=95467) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:14:32Z,direct_url=<?>,disk_format='qcow2',id=4c8406cc-4745-436b-966f-bdfe4fda5eb3,min_disk=0,min_ram=0,name='',owner='99ce0adc92cc48abb09718001b613705',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:14:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T08:14:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1290853586',display_name='tempest-AttachSCSIVolumeTestJSON-server-1290853586',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1290853586',id=20,image_ref='4c8406cc-4745-436b-966f-bdfe4fda5eb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA5wG/b9pTRHKevGZCl4td4AgKNUrmCvyAeB5m6ljfHeoguIysTVFuo9qKYG80EdlXoGcjG3G//ZuZ3U4lIK0mVFpcudiYtUs45EoiPvLqdfByZQWj4BMjOggZ45JRIiSA==',key_name='tempest-keypair-1343666369',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c37bcd8e333c4c2faf96b5d445319274',ramdisk_id='',reservation_id='r-j3hbdk20',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4c8406cc-4745-436b-966f-bdfe4fda5eb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-876730663',owner_user_name='tempest-AttachSCSIVolumeTestJSON-876730663-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:14:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad8085ad83aa4adf841f2dba2554f409',uuid=da9c7b9d-aad7-4d4f-b190-fda71735fde6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86652dd5-39a8-410c-aed4-3664980165f3", "address": "fa:16:3e:20:9d:69", "network": {"id": "99755f0a-da1b-4ec7-aa23-6801f4a0344c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-42152126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c37bcd8e333c4c2faf96b5d445319274", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86652dd5-39", "ovs_interfaceid": "86652dd5-39a8-410c-aed4-3664980165f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Converting VIF {"id": "86652dd5-39a8-410c-aed4-3664980165f3", "address": "fa:16:3e:20:9d:69", "network": {"id": "99755f0a-da1b-4ec7-aa23-6801f4a0344c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-42152126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c37bcd8e333c4c2faf96b5d445319274", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86652dd5-39", "ovs_interfaceid": "86652dd5-39a8-410c-aed4-3664980165f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:9d:69,bridge_name='br-int',has_traffic_filtering=True,id=86652dd5-39a8-410c-aed4-3664980165f3,network=Network(99755f0a-da1b-4ec7-aa23-6801f4a0344c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86652dd5-39') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG nova.objects.instance [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Lazy-loading 'pci_devices' on Instance uuid da9c7b9d-aad7-4d4f-b190-fda71735fde6 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:14:39 user nova-compute[95467]:   <uuid>da9c7b9d-aad7-4d4f-b190-fda71735fde6</uuid>
Nov 15 08:14:39 user nova-compute[95467]:   <name>instance-00000014</name>
Nov 15 08:14:39 user nova-compute[95467]:   <memory>524288</memory>
Nov 15 08:14:39 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:14:39 user nova-compute[95467]:   <metadata>
Nov 15 08:14:39 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:14:39 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:14:39 user nova-compute[95467]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1290853586</nova:name>
Nov 15 08:14:39 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:14:39</nova:creationTime>
Nov 15 08:14:39 user nova-compute[95467]:       <nova:flavor name="m1.tiny">
Nov 15 08:14:39 user nova-compute[95467]:         <nova:memory>512</nova:memory>
Nov 15 08:14:39 user nova-compute[95467]:         <nova:disk>1</nova:disk>
Nov 15 08:14:39 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:14:39 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:14:39 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:14:39 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:14:39 user nova-compute[95467]:       <nova:owner>
Nov 15 08:14:39 user nova-compute[95467]:         <nova:user uuid="ad8085ad83aa4adf841f2dba2554f409">tempest-AttachSCSIVolumeTestJSON-876730663-project-member</nova:user>
Nov 15 08:14:39 user nova-compute[95467]:         <nova:project uuid="c37bcd8e333c4c2faf96b5d445319274">tempest-AttachSCSIVolumeTestJSON-876730663</nova:project>
Nov 15 08:14:39 user nova-compute[95467]:       </nova:owner>
Nov 15 08:14:39 user nova-compute[95467]:       <nova:root type="image" uuid="4c8406cc-4745-436b-966f-bdfe4fda5eb3"/>
Nov 15 08:14:39 user nova-compute[95467]:       <nova:ports>
Nov 15 08:14:39 user nova-compute[95467]:         <nova:port uuid="86652dd5-39a8-410c-aed4-3664980165f3">
Nov 15 08:14:39 user nova-compute[95467]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 08:14:39 user nova-compute[95467]:         </nova:port>
Nov 15 08:14:39 user nova-compute[95467]:       </nova:ports>
Nov 15 08:14:39 user nova-compute[95467]:     </nova:instance>
Nov 15 08:14:39 user nova-compute[95467]:   </metadata>
Nov 15 08:14:39 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:14:39 user nova-compute[95467]:     <system>
Nov 15 08:14:39 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:14:39 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:14:39 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:14:39 user nova-compute[95467]:       <entry name="serial">da9c7b9d-aad7-4d4f-b190-fda71735fde6</entry>
Nov 15 08:14:39 user nova-compute[95467]:       <entry name="uuid">da9c7b9d-aad7-4d4f-b190-fda71735fde6</entry>
Nov 15 08:14:39 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:14:39 user nova-compute[95467]:     </system>
Nov 15 08:14:39 user nova-compute[95467]:   </sysinfo>
Nov 15 08:14:39 user nova-compute[95467]:   <os>
Nov 15 08:14:39 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:14:39 user nova-compute[95467]:     <boot dev="hd"/>
Nov 15 08:14:39 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:14:39 user nova-compute[95467]:   </os>
Nov 15 08:14:39 user nova-compute[95467]:   <features>
Nov 15 08:14:39 user nova-compute[95467]:     <acpi/>
Nov 15 08:14:39 user nova-compute[95467]:     <apic/>
Nov 15 08:14:39 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:14:39 user nova-compute[95467]:   </features>
Nov 15 08:14:39 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:14:39 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:14:39 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:14:39 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:14:39 user nova-compute[95467]:   </clock>
Nov 15 08:14:39 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:14:39 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:14:39 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:14:39 user nova-compute[95467]:   </cpu>
Nov 15 08:14:39 user nova-compute[95467]:   <devices>
Nov 15 08:14:39 user nova-compute[95467]:     <disk type="file" device="disk">
Nov 15 08:14:39 user nova-compute[95467]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 08:14:39 user nova-compute[95467]:       <source file="/opt/stack/data/nova/instances/da9c7b9d-aad7-4d4f-b190-fda71735fde6/disk"/>
Nov 15 08:14:39 user nova-compute[95467]:       <target dev="sda" bus="scsi"/>
Nov 15 08:14:39 user nova-compute[95467]:       <address type="drive" controller="0" unit="0"/>
Nov 15 08:14:39 user nova-compute[95467]:     </disk>
Nov 15 08:14:39 user nova-compute[95467]:     <disk type="file" device="cdrom">
Nov 15 08:14:39 user nova-compute[95467]:       <driver name="qemu" type="raw" cache="none"/>
Nov 15 08:14:39 user nova-compute[95467]:       <source file="/opt/stack/data/nova/instances/da9c7b9d-aad7-4d4f-b190-fda71735fde6/disk.config"/>
Nov 15 08:14:39 user nova-compute[95467]:       <target dev="sdb" bus="scsi"/>
Nov 15 08:14:39 user nova-compute[95467]:       <address type="drive" controller="0" unit="1"/>
Nov 15 08:14:39 user nova-compute[95467]:     </disk>
Nov 15 08:14:39 user nova-compute[95467]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 15 08:14:39 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:14:39 user nova-compute[95467]:       <mac address="fa:16:3e:20:9d:69"/>
Nov 15 08:14:39 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:14:39 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:14:39 user nova-compute[95467]:       <target dev="tap86652dd5-39"/>
Nov 15 08:14:39 user nova-compute[95467]:     </interface>
Nov 15 08:14:39 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:14:39 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/da9c7b9d-aad7-4d4f-b190-fda71735fde6/console.log" append="off"/>
Nov 15 08:14:39 user nova-compute[95467]:     </serial>
Nov 15 08:14:39 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:14:39 user nova-compute[95467]:     <video>
Nov 15 08:14:39 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:14:39 user nova-compute[95467]:     </video>
Nov 15 08:14:39 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:14:39 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:14:39 user nova-compute[95467]:     </rng>
Nov 15 08:14:39 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:14:39 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:14:39 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:14:39 user nova-compute[95467]:     </memballoon>
Nov 15 08:14:39 user nova-compute[95467]:   </devices>
Nov 15 08:14:39 user nova-compute[95467]: </domain>
Nov 15 08:14:39 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T08:14:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1290853586',display_name='tempest-AttachSCSIVolumeTestJSON-server-1290853586',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1290853586',id=20,image_ref='4c8406cc-4745-436b-966f-bdfe4fda5eb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA5wG/b9pTRHKevGZCl4td4AgKNUrmCvyAeB5m6ljfHeoguIysTVFuo9qKYG80EdlXoGcjG3G//ZuZ3U4lIK0mVFpcudiYtUs45EoiPvLqdfByZQWj4BMjOggZ45JRIiSA==',key_name='tempest-keypair-1343666369',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c37bcd8e333c4c2faf96b5d445319274',ramdisk_id='',reservation_id='r-j3hbdk20',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4c8406cc-4745-436b-966f-bdfe4fda5eb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-876730663',owner_user_name='tempest-AttachSCSIVolumeTestJSON-876730663-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:14:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad8085ad83aa4adf841f2dba2554f409',uuid=da9c7b9d-aad7-4d4f-b190-fda71735fde6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86652dd5-39a8-410c-aed4-3664980165f3", "address": "fa:16:3e:20:9d:69", "network": {"id": "99755f0a-da1b-4ec7-aa23-6801f4a0344c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-42152126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c37bcd8e333c4c2faf96b5d445319274", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86652dd5-39", "ovs_interfaceid": "86652dd5-39a8-410c-aed4-3664980165f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Converting VIF {"id": "86652dd5-39a8-410c-aed4-3664980165f3", "address": "fa:16:3e:20:9d:69", "network": {"id": "99755f0a-da1b-4ec7-aa23-6801f4a0344c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-42152126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c37bcd8e333c4c2faf96b5d445319274", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86652dd5-39", "ovs_interfaceid": "86652dd5-39a8-410c-aed4-3664980165f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:9d:69,bridge_name='br-int',has_traffic_filtering=True,id=86652dd5-39a8-410c-aed4-3664980165f3,network=Network(99755f0a-da1b-4ec7-aa23-6801f4a0344c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86652dd5-39') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG os_vif [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:9d:69,bridge_name='br-int',has_traffic_filtering=True,id=86652dd5-39a8-410c-aed4-3664980165f3,network=Network(99755f0a-da1b-4ec7-aa23-6801f4a0344c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86652dd5-39') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b91f72e2-96ec-5f80-847e-96572f53f83f', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-16e65720-c2b2-4fe0-810f-972e8537e44b tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5748cf5d-9c57-4477-8952-ec39d0d18f55 {{(pid=95467) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap86652dd5-39, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap86652dd5-39, col_values=(('qos', UUID('f827d0a4-1b3f-471e-bf11-dc9d91b6ac38')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap86652dd5-39, col_values=(('external_ids', {'iface-id': '86652dd5-39a8-410c-aed4-3664980165f3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:9d:69', 'vm-uuid': 'da9c7b9d-aad7-4d4f-b190-fda71735fde6'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:39 user nova-compute[95467]: INFO os_vif [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:9d:69,bridge_name='br-int',has_traffic_filtering=True,id=86652dd5-39a8-410c-aed4-3664980165f3,network=Network(99755f0a-da1b-4ec7-aa23-6801f4a0344c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86652dd5-39')
Nov 15 08:14:39 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] No BDM found with device name sda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] No BDM found with device name sdb, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:14:39 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] No VIF found with MAC fa:16:3e:20:9d:69, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:14:39 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] Using config drive
Nov 15 08:14:39 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:14:40 user nova-compute[95467]: DEBUG nova.network.neutron [req-4582f544-a1a9-42a8-a62f-bbc128f22dde req-8a42ba54-4c95-4317-9dc5-efede8823d82 service nova] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] Updated VIF entry in instance network info cache for port 86652dd5-39a8-410c-aed4-3664980165f3. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:14:40 user nova-compute[95467]: DEBUG nova.network.neutron [req-4582f544-a1a9-42a8-a62f-bbc128f22dde req-8a42ba54-4c95-4317-9dc5-efede8823d82 service nova] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] Updating instance_info_cache with network_info: [{"id": "86652dd5-39a8-410c-aed4-3664980165f3", "address": "fa:16:3e:20:9d:69", "network": {"id": "99755f0a-da1b-4ec7-aa23-6801f4a0344c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-42152126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c37bcd8e333c4c2faf96b5d445319274", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86652dd5-39", "ovs_interfaceid": "86652dd5-39a8-410c-aed4-3664980165f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:14:40 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-4582f544-a1a9-42a8-a62f-bbc128f22dde req-8a42ba54-4c95-4317-9dc5-efede8823d82 service nova] Releasing lock "refresh_cache-da9c7b9d-aad7-4d4f-b190-fda71735fde6" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:14:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:14:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:14:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:14:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68264a44-5adf-4873-b380-26bcafe2ba04/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:14:40 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] Creating config drive at /opt/stack/data/nova/instances/da9c7b9d-aad7-4d4f-b190-fda71735fde6/disk.config
Nov 15 08:14:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/da9c7b9d-aad7-4d4f-b190-fda71735fde6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpexx_7svi {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:14:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68264a44-5adf-4873-b380-26bcafe2ba04/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:14:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68264a44-5adf-4873-b380-26bcafe2ba04/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:14:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/da9c7b9d-aad7-4d4f-b190-fda71735fde6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpexx_7svi" returned: 0 in 0.101s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:14:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68264a44-5adf-4873-b380-26bcafe2ba04/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:14:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35bbed35-d10e-4637-b673-754a85f9d2ff/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:14:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35bbed35-d10e-4637-b673-754a85f9d2ff/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:14:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35bbed35-d10e-4637-b673-754a85f9d2ff/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:14:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35bbed35-d10e-4637-b673-754a85f9d2ff/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:14:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5748cf5d-9c57-4477-8952-ec39d0d18f55/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:14:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5748cf5d-9c57-4477-8952-ec39d0d18f55/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:14:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5748cf5d-9c57-4477-8952-ec39d0d18f55/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:14:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5748cf5d-9c57-4477-8952-ec39d0d18f55/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:14:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bee31898-4f12-4c68-a18b-a678f9f584aa/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:14:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bee31898-4f12-4c68-a18b-a678f9f584aa/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:14:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bee31898-4f12-4c68-a18b-a678f9f584aa/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:14:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:42 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bee31898-4f12-4c68-a18b-a678f9f584aa/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:14:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:14:42 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:42 user nova-compute[95467]: DEBUG nova.compute.manager [req-5097d6fa-914a-4f7b-a0af-1e918b03cdb1 req-c263568b-b392-41de-bd59-eec3cc1c41a6 service nova] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] Received event network-vif-plugged-86652dd5-39a8-410c-aed4-3664980165f3 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:14:42 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-5097d6fa-914a-4f7b-a0af-1e918b03cdb1 req-c263568b-b392-41de-bd59-eec3cc1c41a6 service nova] Acquiring lock "da9c7b9d-aad7-4d4f-b190-fda71735fde6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:14:42 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-5097d6fa-914a-4f7b-a0af-1e918b03cdb1 req-c263568b-b392-41de-bd59-eec3cc1c41a6 service nova] Lock "da9c7b9d-aad7-4d4f-b190-fda71735fde6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:14:42 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-5097d6fa-914a-4f7b-a0af-1e918b03cdb1 req-c263568b-b392-41de-bd59-eec3cc1c41a6 service nova] Lock "da9c7b9d-aad7-4d4f-b190-fda71735fde6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:14:42 user nova-compute[95467]: DEBUG nova.compute.manager [req-5097d6fa-914a-4f7b-a0af-1e918b03cdb1 req-c263568b-b392-41de-bd59-eec3cc1c41a6 service nova] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] No waiting events found dispatching network-vif-plugged-86652dd5-39a8-410c-aed4-3664980165f3 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:14:42 user nova-compute[95467]: WARNING nova.compute.manager [req-5097d6fa-914a-4f7b-a0af-1e918b03cdb1 req-c263568b-b392-41de-bd59-eec3cc1c41a6 service nova] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] Received unexpected event network-vif-plugged-86652dd5-39a8-410c-aed4-3664980165f3 for instance with vm_state building and task_state spawning.
Nov 15 08:14:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:14:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:14:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:14:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3711c883-ec5f-4a09-88f8-d4c0668ae570/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:14:42 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:42 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:42 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3711c883-ec5f-4a09-88f8-d4c0668ae570/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:14:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3711c883-ec5f-4a09-88f8-d4c0668ae570/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:14:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3711c883-ec5f-4a09-88f8-d4c0668ae570/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:14:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36dccf43-d4a3-47aa-bd73-de9646e1020c/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:14:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36dccf43-d4a3-47aa-bd73-de9646e1020c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:14:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36dccf43-d4a3-47aa-bd73-de9646e1020c/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:14:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36dccf43-d4a3-47aa-bd73-de9646e1020c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:14:43 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:14:43 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:14:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2aa477-6786-483a-b088-d8ec204fe6aa/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:14:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2aa477-6786-483a-b088-d8ec204fe6aa/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:14:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2aa477-6786-483a-b088-d8ec204fe6aa/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:14:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2aa477-6786-483a-b088-d8ec204fe6aa/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:14:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da9c7b9d-aad7-4d4f-b190-fda71735fde6/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:14:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da9c7b9d-aad7-4d4f-b190-fda71735fde6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:14:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da9c7b9d-aad7-4d4f-b190-fda71735fde6/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:14:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da9c7b9d-aad7-4d4f-b190-fda71735fde6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:14:44 user nova-compute[95467]: DEBUG nova.compute.manager [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] Instance event wait completed in 0 seconds for  {{(pid=95467) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 08:14:44 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] Guest created on hypervisor {{(pid=95467) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 08:14:44 user nova-compute[95467]: DEBUG nova.compute.manager [req-857c995a-fd5b-44f0-8106-0beb5842c7a9 req-5e0ec9ce-f13f-4a4a-b251-96683cb64184 service nova] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] Received event network-vif-plugged-86652dd5-39a8-410c-aed4-3664980165f3 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:14:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-857c995a-fd5b-44f0-8106-0beb5842c7a9 req-5e0ec9ce-f13f-4a4a-b251-96683cb64184 service nova] Acquiring lock "da9c7b9d-aad7-4d4f-b190-fda71735fde6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:14:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-857c995a-fd5b-44f0-8106-0beb5842c7a9 req-5e0ec9ce-f13f-4a4a-b251-96683cb64184 service nova] Lock "da9c7b9d-aad7-4d4f-b190-fda71735fde6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:14:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-857c995a-fd5b-44f0-8106-0beb5842c7a9 req-5e0ec9ce-f13f-4a4a-b251-96683cb64184 service nova] Lock "da9c7b9d-aad7-4d4f-b190-fda71735fde6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:14:44 user nova-compute[95467]: DEBUG nova.compute.manager [req-857c995a-fd5b-44f0-8106-0beb5842c7a9 req-5e0ec9ce-f13f-4a4a-b251-96683cb64184 service nova] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] No waiting events found dispatching network-vif-plugged-86652dd5-39a8-410c-aed4-3664980165f3 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:14:44 user nova-compute[95467]: WARNING nova.compute.manager [req-857c995a-fd5b-44f0-8106-0beb5842c7a9 req-5e0ec9ce-f13f-4a4a-b251-96683cb64184 service nova] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] Received unexpected event network-vif-plugged-86652dd5-39a8-410c-aed4-3664980165f3 for instance with vm_state building and task_state spawning.
Nov 15 08:14:44 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:14:44 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:14:44 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Hypervisor/Node resource view: name=user free_ram=7297MB free_disk=25.427127838134766GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=95467) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 08:14:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:14:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:14:44 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] Instance spawned successfully.
Nov 15 08:14:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:44 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 08:14:44 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] Found default for hw_input_bus of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:14:44 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] Found default for hw_pointer_model of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:14:44 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] Found default for hw_video_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:14:44 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] Found default for hw_vif_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:14:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:44 user nova-compute[95467]: INFO nova.compute.manager [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] Took 7.95 seconds to spawn the instance on the hypervisor.
Nov 15 08:14:44 user nova-compute[95467]: DEBUG nova.compute.manager [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:14:44 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance ee2aa477-6786-483a-b088-d8ec204fe6aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:14:44 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 5748cf5d-9c57-4477-8952-ec39d0d18f55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:14:44 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 73fe8852-c47a-47ab-a56f-6864c8ed5479 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:14:44 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 68264a44-5adf-4873-b380-26bcafe2ba04 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:14:44 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 21cf2ada-b15c-490d-ac37-96e9c87e9056 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:14:44 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 35bbed35-d10e-4637-b673-754a85f9d2ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:14:44 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 3711c883-ec5f-4a09-88f8-d4c0668ae570 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:14:44 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 36dccf43-d4a3-47aa-bd73-de9646e1020c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:14:44 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance bee31898-4f12-4c68-a18b-a678f9f584aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:14:44 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance abdf29d1-f80e-48c8-8c09-d7c9c0326833 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:14:44 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance da9c7b9d-aad7-4d4f-b190-fda71735fde6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:14:44 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 08:14:44 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 08:14:44 user nova-compute[95467]: INFO nova.compute.manager [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] Took 8.69 seconds to build instance.
Nov 15 08:14:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-727d822f-c4dd-4345-900f-67238cf6797d tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Lock "da9c7b9d-aad7-4d4f-b190-fda71735fde6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.785s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:14:45 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:14:45 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:14:45 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Compute_service record updated for user:user {{(pid=95467) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 08:14:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.596s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:14:45 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:46 user nova-compute[95467]: DEBUG nova.compute.manager [None req-e9c65aff-70f7-4812-bfa8-869f5b27a628 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:14:46 user nova-compute[95467]: INFO nova.compute.manager [None req-e9c65aff-70f7-4812-bfa8-869f5b27a628 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] instance snapshotting
Nov 15 08:14:46 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:14:46 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:14:46 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Starting heal instance info cache {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 08:14:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "refresh_cache-36dccf43-d4a3-47aa-bd73-de9646e1020c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:14:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquired lock "refresh_cache-36dccf43-d4a3-47aa-bd73-de9646e1020c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:14:46 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Forcefully refreshing network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 08:14:46 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-e9c65aff-70f7-4812-bfa8-869f5b27a628 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Beginning live snapshot process
Nov 15 08:14:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-e9c65aff-70f7-4812-bfa8-869f5b27a628 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json -f qcow2 {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:14:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-e9c65aff-70f7-4812-bfa8-869f5b27a628 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json -f qcow2" returned: 0 in 0.246s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:14:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-e9c65aff-70f7-4812-bfa8-869f5b27a628 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json -f qcow2 {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:14:46 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Updating instance_info_cache with network_info: [{"id": "5b51bd20-90a5-4fb1-816c-3d8e8824cb41", "address": "fa:16:3e:79:70:b1", "network": {"id": "f7871b75-73b3-4f0a-8e6c-814bc61ebd6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-945672014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b04c448c61451d8d46ebc7a61a5e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b51bd20-90", "ovs_interfaceid": "5b51bd20-90a5-4fb1-816c-3d8e8824cb41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:14:47 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Releasing lock "refresh_cache-36dccf43-d4a3-47aa-bd73-de9646e1020c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:14:47 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Updated the network info_cache for instance {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 08:14:47 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:14:47 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:14:47 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:14:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-e9c65aff-70f7-4812-bfa8-869f5b27a628 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json -f qcow2" returned: 0 in 0.202s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:14:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-e9c65aff-70f7-4812-bfa8-869f5b27a628 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:14:47 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-e9c65aff-70f7-4812-bfa8-869f5b27a628 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.190s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:14:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-e9c65aff-70f7-4812-bfa8-869f5b27a628 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp69je4rom/a81bfdc3f0384b438ba49ec6d13e9ca9.delta 1073741824 {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:14:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-e9c65aff-70f7-4812-bfa8-869f5b27a628 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp69je4rom/a81bfdc3f0384b438ba49ec6d13e9ca9.delta 1073741824" returned: 0 in 0.051s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:14:47 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-e9c65aff-70f7-4812-bfa8-869f5b27a628 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 15 08:14:48 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-e9c65aff-70f7-4812-bfa8-869f5b27a628 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=95467) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 08:14:48 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-e9c65aff-70f7-4812-bfa8-869f5b27a628 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=95467) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 08:14:48 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-e9c65aff-70f7-4812-bfa8-869f5b27a628 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 15 08:14:48 user nova-compute[95467]: DEBUG nova.privsep.utils [None req-e9c65aff-70f7-4812-bfa8-869f5b27a628 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=95467) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 08:14:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-e9c65aff-70f7-4812-bfa8-869f5b27a628 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp69je4rom/a81bfdc3f0384b438ba49ec6d13e9ca9.delta /opt/stack/data/nova/instances/snapshots/tmp69je4rom/a81bfdc3f0384b438ba49ec6d13e9ca9 {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:14:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-e9c65aff-70f7-4812-bfa8-869f5b27a628 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp69je4rom/a81bfdc3f0384b438ba49ec6d13e9ca9.delta /opt/stack/data/nova/instances/snapshots/tmp69je4rom/a81bfdc3f0384b438ba49ec6d13e9ca9" returned: 0 in 0.706s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:14:49 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-e9c65aff-70f7-4812-bfa8-869f5b27a628 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Snapshot extracted, beginning image upload
Nov 15 08:14:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:51 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:52 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-e9c65aff-70f7-4812-bfa8-869f5b27a628 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Snapshot image upload complete
Nov 15 08:14:52 user nova-compute[95467]: INFO nova.compute.manager [None req-e9c65aff-70f7-4812-bfa8-869f5b27a628 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Took 6.61 seconds to snapshot the instance on the hypervisor.
Nov 15 08:14:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0cec1609-8a7d-43f8-9626-524ed91db017 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Acquiring lock "35bbed35-d10e-4637-b673-754a85f9d2ff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:14:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0cec1609-8a7d-43f8-9626-524ed91db017 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Lock "35bbed35-d10e-4637-b673-754a85f9d2ff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:14:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0cec1609-8a7d-43f8-9626-524ed91db017 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Acquiring lock "35bbed35-d10e-4637-b673-754a85f9d2ff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:14:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0cec1609-8a7d-43f8-9626-524ed91db017 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Lock "35bbed35-d10e-4637-b673-754a85f9d2ff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:14:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0cec1609-8a7d-43f8-9626-524ed91db017 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Lock "35bbed35-d10e-4637-b673-754a85f9d2ff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:14:55 user nova-compute[95467]: INFO nova.compute.manager [None req-0cec1609-8a7d-43f8-9626-524ed91db017 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 35bbed35-d10e-4637-b673-754a85f9d2ff] Terminating instance
Nov 15 08:14:55 user nova-compute[95467]: DEBUG nova.compute.manager [None req-0cec1609-8a7d-43f8-9626-524ed91db017 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 35bbed35-d10e-4637-b673-754a85f9d2ff] Start destroying the instance on the hypervisor. {{(pid=95467) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 08:14:55 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:55 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:55 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:55 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:55 user nova-compute[95467]: DEBUG nova.compute.manager [req-d6928b41-8b69-4969-af44-465143413ab7 req-13070980-75ce-4bd6-9529-47508a30ae0f service nova] [instance: 35bbed35-d10e-4637-b673-754a85f9d2ff] Received event network-vif-unplugged-df2a067b-ea66-44ff-9b4c-c1a738e193b0 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:14:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-d6928b41-8b69-4969-af44-465143413ab7 req-13070980-75ce-4bd6-9529-47508a30ae0f service nova] Acquiring lock "35bbed35-d10e-4637-b673-754a85f9d2ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:14:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-d6928b41-8b69-4969-af44-465143413ab7 req-13070980-75ce-4bd6-9529-47508a30ae0f service nova] Lock "35bbed35-d10e-4637-b673-754a85f9d2ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:14:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-d6928b41-8b69-4969-af44-465143413ab7 req-13070980-75ce-4bd6-9529-47508a30ae0f service nova] Lock "35bbed35-d10e-4637-b673-754a85f9d2ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:14:55 user nova-compute[95467]: DEBUG nova.compute.manager [req-d6928b41-8b69-4969-af44-465143413ab7 req-13070980-75ce-4bd6-9529-47508a30ae0f service nova] [instance: 35bbed35-d10e-4637-b673-754a85f9d2ff] No waiting events found dispatching network-vif-unplugged-df2a067b-ea66-44ff-9b4c-c1a738e193b0 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:14:55 user nova-compute[95467]: DEBUG nova.compute.manager [req-d6928b41-8b69-4969-af44-465143413ab7 req-13070980-75ce-4bd6-9529-47508a30ae0f service nova] [instance: 35bbed35-d10e-4637-b673-754a85f9d2ff] Received event network-vif-unplugged-df2a067b-ea66-44ff-9b4c-c1a738e193b0 for instance with task_state deleting. {{(pid=95467) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 08:14:56 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 35bbed35-d10e-4637-b673-754a85f9d2ff] Instance destroyed successfully.
Nov 15 08:14:56 user nova-compute[95467]: DEBUG nova.objects.instance [None req-0cec1609-8a7d-43f8-9626-524ed91db017 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Lazy-loading 'resources' on Instance uuid 35bbed35-d10e-4637-b673-754a85f9d2ff {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:14:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-0cec1609-8a7d-43f8-9626-524ed91db017 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:12:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1120244885',display_name='tempest-VolumesAdminNegativeTest-server-1120244885',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1120244885',id=16,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:13:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d6f1d989dd2242bfad9c3a5d7380c887',ramdisk_id='',reservation_id='r-q6v13chn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1724237472',owner_user_name='tempest-VolumesAdminNegativeTest-1724237472-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:13:07Z,user_data=None,user_id='331b706f494247759f827dbb1efcb663',uuid=35bbed35-d10e-4637-b673-754a85f9d2ff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "df2a067b-ea66-44ff-9b4c-c1a738e193b0", "address": "fa:16:3e:67:3f:73", "network": {"id": "4e5f387a-ee4d-4e5b-bbb3-0d3af738de45", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-839692973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6f1d989dd2242bfad9c3a5d7380c887", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf2a067b-ea", "ovs_interfaceid": "df2a067b-ea66-44ff-9b4c-c1a738e193b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:14:56 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-0cec1609-8a7d-43f8-9626-524ed91db017 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Converting VIF {"id": "df2a067b-ea66-44ff-9b4c-c1a738e193b0", "address": "fa:16:3e:67:3f:73", "network": {"id": "4e5f387a-ee4d-4e5b-bbb3-0d3af738de45", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-839692973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6f1d989dd2242bfad9c3a5d7380c887", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf2a067b-ea", "ovs_interfaceid": "df2a067b-ea66-44ff-9b4c-c1a738e193b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:14:56 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-0cec1609-8a7d-43f8-9626-524ed91db017 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:3f:73,bridge_name='br-int',has_traffic_filtering=True,id=df2a067b-ea66-44ff-9b4c-c1a738e193b0,network=Network(4e5f387a-ee4d-4e5b-bbb3-0d3af738de45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf2a067b-ea') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:14:56 user nova-compute[95467]: DEBUG os_vif [None req-0cec1609-8a7d-43f8-9626-524ed91db017 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:3f:73,bridge_name='br-int',has_traffic_filtering=True,id=df2a067b-ea66-44ff-9b4c-c1a738e193b0,network=Network(4e5f387a-ee4d-4e5b-bbb3-0d3af738de45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf2a067b-ea') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:14:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdf2a067b-ea, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:14:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:14:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=71611802-16dd-4704-892b-d448433dc6a4) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:14:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:14:56 user nova-compute[95467]: INFO os_vif [None req-0cec1609-8a7d-43f8-9626-524ed91db017 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:3f:73,bridge_name='br-int',has_traffic_filtering=True,id=df2a067b-ea66-44ff-9b4c-c1a738e193b0,network=Network(4e5f387a-ee4d-4e5b-bbb3-0d3af738de45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf2a067b-ea')
Nov 15 08:14:56 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-0cec1609-8a7d-43f8-9626-524ed91db017 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 35bbed35-d10e-4637-b673-754a85f9d2ff] Deleting instance files /opt/stack/data/nova/instances/35bbed35-d10e-4637-b673-754a85f9d2ff_del
Nov 15 08:14:56 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-0cec1609-8a7d-43f8-9626-524ed91db017 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 35bbed35-d10e-4637-b673-754a85f9d2ff] Deletion of /opt/stack/data/nova/instances/35bbed35-d10e-4637-b673-754a85f9d2ff_del complete
Nov 15 08:14:56 user nova-compute[95467]: INFO nova.compute.manager [None req-0cec1609-8a7d-43f8-9626-524ed91db017 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 35bbed35-d10e-4637-b673-754a85f9d2ff] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 15 08:14:56 user nova-compute[95467]: DEBUG oslo.service.loopingcall [None req-0cec1609-8a7d-43f8-9626-524ed91db017 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=95467) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 08:14:56 user nova-compute[95467]: DEBUG nova.compute.manager [-] [instance: 35bbed35-d10e-4637-b673-754a85f9d2ff] Deallocating network for instance {{(pid=95467) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 08:14:56 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: 35bbed35-d10e-4637-b673-754a85f9d2ff] deallocate_for_instance() {{(pid=95467) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 08:14:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:57 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: 35bbed35-d10e-4637-b673-754a85f9d2ff] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:14:57 user nova-compute[95467]: INFO nova.compute.manager [-] [instance: 35bbed35-d10e-4637-b673-754a85f9d2ff] Took 1.00 seconds to deallocate network for instance.
Nov 15 08:14:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0cec1609-8a7d-43f8-9626-524ed91db017 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:14:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0cec1609-8a7d-43f8-9626-524ed91db017 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:14:57 user nova-compute[95467]: DEBUG nova.compute.manager [req-b76084c8-3334-40bf-aebe-b50c06aa49f9 req-d91f3548-50f5-4d54-bd6f-44a939971b6f service nova] [instance: 35bbed35-d10e-4637-b673-754a85f9d2ff] Received event network-vif-deleted-df2a067b-ea66-44ff-9b4c-c1a738e193b0 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:14:57 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-0cec1609-8a7d-43f8-9626-524ed91db017 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:14:57 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-0cec1609-8a7d-43f8-9626-524ed91db017 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:14:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0cec1609-8a7d-43f8-9626-524ed91db017 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.394s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:14:57 user nova-compute[95467]: DEBUG nova.compute.manager [req-ca785728-4fa1-4a76-8aac-4d2f0f66bf14 req-eb506f5c-b150-4ce4-8a40-5e03f50ba5bc service nova] [instance: 35bbed35-d10e-4637-b673-754a85f9d2ff] Received event network-vif-plugged-df2a067b-ea66-44ff-9b4c-c1a738e193b0 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:14:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ca785728-4fa1-4a76-8aac-4d2f0f66bf14 req-eb506f5c-b150-4ce4-8a40-5e03f50ba5bc service nova] Acquiring lock "35bbed35-d10e-4637-b673-754a85f9d2ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:14:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ca785728-4fa1-4a76-8aac-4d2f0f66bf14 req-eb506f5c-b150-4ce4-8a40-5e03f50ba5bc service nova] Lock "35bbed35-d10e-4637-b673-754a85f9d2ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:14:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ca785728-4fa1-4a76-8aac-4d2f0f66bf14 req-eb506f5c-b150-4ce4-8a40-5e03f50ba5bc service nova] Lock "35bbed35-d10e-4637-b673-754a85f9d2ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:14:57 user nova-compute[95467]: DEBUG nova.compute.manager [req-ca785728-4fa1-4a76-8aac-4d2f0f66bf14 req-eb506f5c-b150-4ce4-8a40-5e03f50ba5bc service nova] [instance: 35bbed35-d10e-4637-b673-754a85f9d2ff] No waiting events found dispatching network-vif-plugged-df2a067b-ea66-44ff-9b4c-c1a738e193b0 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:14:57 user nova-compute[95467]: WARNING nova.compute.manager [req-ca785728-4fa1-4a76-8aac-4d2f0f66bf14 req-eb506f5c-b150-4ce4-8a40-5e03f50ba5bc service nova] [instance: 35bbed35-d10e-4637-b673-754a85f9d2ff] Received unexpected event network-vif-plugged-df2a067b-ea66-44ff-9b4c-c1a738e193b0 for instance with vm_state deleted and task_state None.
Nov 15 08:14:57 user nova-compute[95467]: INFO nova.scheduler.client.report [None req-0cec1609-8a7d-43f8-9626-524ed91db017 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Deleted allocations for instance 35bbed35-d10e-4637-b673-754a85f9d2ff
Nov 15 08:14:58 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0cec1609-8a7d-43f8-9626-524ed91db017 tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Lock "35bbed35-d10e-4637-b673-754a85f9d2ff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.630s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:14:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:14:59 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-16e65720-c2b2-4fe0-810f-972e8537e44b tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5748cf5d-9c57-4477-8952-ec39d0d18f55 is timed out.
Nov 15 08:14:59 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-16e65720-c2b2-4fe0-810f-972e8537e44b tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Successfully detached device vdb from instance 5748cf5d-9c57-4477-8952-ec39d0d18f55 from the live domain config.
Nov 15 08:14:59 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16e65720-c2b2-4fe0-810f-972e8537e44b tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] calling os-brick to detach iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 08:14:59 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-16e65720-c2b2-4fe0-810f-972e8537e44b tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, {'target_iqn': 'iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aqDmsYSV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:14:59 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-16e65720-c2b2-4fe0-810f-972e8537e44b tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:14:59 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-16e65720-c2b2-4fe0-810f-972e8537e44b tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:14:59 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-16e65720-c2b2-4fe0-810f-972e8537e44b tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:14:59 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:14:59 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:14:59 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c9d875-750d-4aa3-b98d-a8456c663254]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:14:59 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-16e65720-c2b2-4fe0-810f-972e8537e44b tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 08:14:59 user nova-compute[95467]: No targets found.
Nov 15 08:14:59 user nova-compute[95467]: iSNS:
Nov 15 08:14:59 user nova-compute[95467]: No targets found.
Nov 15 08:14:59 user nova-compute[95467]: STATIC:
Nov 15 08:14:59 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de
Nov 15 08:14:59 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:14:59 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:14:59 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4
Nov 15 08:14:59 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:14:59 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:14:59 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77
Nov 15 08:14:59 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:14:59 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:14:59 user nova-compute[95467]: FIRMWARE:
Nov 15 08:14:59 user nova-compute[95467]: No targets found.
Nov 15 08:14:59 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:14:59 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-16e65720-c2b2-4fe0-810f-972e8537e44b tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 08:14:59 user nova-compute[95467]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 08:14:59 user nova-compute[95467]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=95467) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 08:14:59 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-16e65720-c2b2-4fe0-810f-972e8537e44b tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de', 0)] {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 08:14:59 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:14:59 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:14:59 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[00113d37-e8e3-40ac-99fa-d7879a1a80e8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:14:59 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:14:59 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:14:59 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4cc6d8-6901-4723-9bb7-9a2fcf1e6002]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:14:59 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-16e65720-c2b2-4fe0-810f-972e8537e44b tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77 (non-flash)
Nov 15 08:14:59 user nova-compute[95467]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4 (non-flash)
Nov 15 08:14:59 user nova-compute[95467]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)
Nov 15 08:14:59 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:14:59 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-16e65720-c2b2-4fe0-810f-972e8537e44b tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77 (non-flash)
Nov 15 08:14:59 user nova-compute[95467]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4 (non-flash)
Nov 15 08:14:59 user nova-compute[95467]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de (non-flash)
Nov 15 08:14:59 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:14:59 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-16e65720-c2b2-4fe0-810f-972e8537e44b tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efec8319000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de'): ({'sdf'}, set())}) {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 08:14:59 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-16e65720-c2b2-4fe0-810f-972e8537e44b tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Removing single pathed devices sdf {{(pid=95467) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 08:14:59 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:14:59 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:14:59 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1fdc54e-e9f6-44a9-b9f2-7f3be0ecc019]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:14:59 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:14:59 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:14:59 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5567a1-19f7-4bbd-9b92-2f7bbb53f4d3]: (4, ('ok\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:14:59 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-16e65720-c2b2-4fe0-810f-972e8537e44b tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Flushing IO for device /dev/sdf {{(pid=95467) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 08:14:59 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:14:59 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:14:59 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5ebc82-fd1f-4f4e-b5e0-9e2b8bd1b6d0]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:14:59 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-16e65720-c2b2-4fe0-810f-972e8537e44b tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=95467) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 08:14:59 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.051s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:00 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce62f37-3804-49e3-8e2b-cf18d55621f8]: (4, ('1', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:00 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-16e65720-c2b2-4fe0-810f-972e8537e44b tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 08:15:00 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-16e65720-c2b2-4fe0-810f-972e8537e44b tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] SCSI volumes sdf have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 08:15:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-16e65720-c2b2-4fe0-810f-972e8537e44b tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de')] {{(pid=95467) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 08:15:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:00 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7aa33b-41f3-4d57-830b-dba41d08864d]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-16e65720-c2b2-4fe0-810f-972e8537e44b tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:15:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de -p 172.16.0.220:3260 --logout {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:00 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[2937ad28-78a7-4416-b1b1-055f0a1297a2]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-16e65720-c2b2-4fe0-810f-972e8537e44b tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de, portal: 172.16.0.220,3260]
Nov 15 08:15:00 user nova-compute[95467]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de, portal: 172.16.0.220,3260] successful.
Nov 15 08:15:00 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:15:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de -p 172.16.0.220:3260 --op delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90e04b69-1404-4a84-a441-9de70a5ca0de -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:00 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[934c6403-8996-4fb1-a823-8907b73d9ee5]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-16e65720-c2b2-4fe0-810f-972e8537e44b tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:15:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-16e65720-c2b2-4fe0-810f-972e8537e44b tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:15:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-16e65720-c2b2-4fe0-810f-972e8537e44b tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] <== disconnect_volume: return (363ms) None {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:15:00 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16e65720-c2b2-4fe0-810f-972e8537e44b tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] Disconnected iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 08:15:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:01 user nova-compute[95467]: DEBUG nova.objects.instance [None req-16e65720-c2b2-4fe0-810f-972e8537e44b tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lazy-loading 'flavor' on Instance uuid 5748cf5d-9c57-4477-8952-ec39d0d18f55 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:15:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-16e65720-c2b2-4fe0-810f-972e8537e44b tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "5748cf5d-9c57-4477-8952-ec39d0d18f55" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.098s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:15:01 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Acquiring lock "b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:15:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:15:02 user nova-compute[95467]: DEBUG nova.compute.manager [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Starting instance... {{(pid=95467) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 08:15:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:15:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:15:02 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=95467) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 08:15:02 user nova-compute[95467]: INFO nova.compute.claims [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Claim successful on node user
Nov 15 08:15:03 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:15:03 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:15:03 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.432s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:15:03 user nova-compute[95467]: DEBUG nova.compute.manager [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Start building networks asynchronously for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 08:15:03 user nova-compute[95467]: DEBUG nova.compute.manager [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Allocating IP information in the background. {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 08:15:03 user nova-compute[95467]: DEBUG nova.network.neutron [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] allocate_for_instance() {{(pid=95467) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 08:15:03 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 08:15:03 user nova-compute[95467]: DEBUG nova.compute.manager [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Start building block device mappings for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 08:15:03 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Acquiring lock "10d73b73-ca65-4192-8954-288dc1df9f24" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:15:03 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "10d73b73-ca65-4192-8954-288dc1df9f24" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:15:03 user nova-compute[95467]: DEBUG nova.compute.manager [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Starting instance... {{(pid=95467) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 08:15:03 user nova-compute[95467]: DEBUG nova.policy [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c07f8dbc38004ecd973f61bba63606d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd281be4e94a4d31a47a13267d51d9b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95467) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 08:15:03 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:15:03 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:15:03 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=95467) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 08:15:03 user nova-compute[95467]: INFO nova.compute.claims [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Claim successful on node user
Nov 15 08:15:03 user nova-compute[95467]: DEBUG nova.compute.manager [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Start spawning the instance on the hypervisor. {{(pid=95467) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 08:15:03 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Creating instance directory {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 08:15:03 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Creating image(s)
Nov 15 08:15:03 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Acquiring lock "/opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:15:03 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "/opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:15:03 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "/opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:15:03 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.221s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:04 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Acquiring lock "a3fcf60225fcefd310404971cd18ab9851c548dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:15:04 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:15:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.201s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk 1073741824 {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:04 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:15:04 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:15:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk 1073741824" returned: 0 in 0.112s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:04 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.318s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:15:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:04 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.920s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:15:04 user nova-compute[95467]: DEBUG nova.compute.manager [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Start building networks asynchronously for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 08:15:04 user nova-compute[95467]: DEBUG nova.compute.manager [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Allocating IP information in the background. {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 08:15:04 user nova-compute[95467]: DEBUG nova.network.neutron [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] allocate_for_instance() {{(pid=95467) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 08:15:04 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 08:15:04 user nova-compute[95467]: DEBUG nova.compute.manager [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Start building block device mappings for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 08:15:04 user nova-compute[95467]: DEBUG nova.network.neutron [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Successfully created port: 1436eae1-0899-4fc5-8bbe-575fa2c70d42 {{(pid=95467) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 08:15:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.193s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:04 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk. size=1073741824 {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 08:15:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:04 user nova-compute[95467]: DEBUG nova.policy [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c07f8dbc38004ecd973f61bba63606d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd281be4e94a4d31a47a13267d51d9b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95467) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 08:15:04 user nova-compute[95467]: DEBUG nova.compute.manager [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Start spawning the instance on the hypervisor. {{(pid=95467) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 08:15:04 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Creating instance directory {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 08:15:04 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Creating image(s)
Nov 15 08:15:04 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Acquiring lock "/opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:15:04 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "/opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:15:04 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "/opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:15:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:04 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Cannot resize image /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk to a smaller size. {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 08:15:04 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Created local disks {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 08:15:04 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Ensure instance console log exists: /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/console.log {{(pid=95467) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 08:15:04 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:15:04 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:15:04 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:15:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.178s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:04 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Acquiring lock "a3fcf60225fcefd310404971cd18ab9851c548dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:15:04 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:15:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:05 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.170s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:05 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk 1073741824 {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:05 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk 1073741824" returned: 0 in 0.052s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:05 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:15:05 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:05 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.182s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:05 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Checking if we can resize image /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk. size=1073741824 {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 08:15:05 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:05 user nova-compute[95467]: DEBUG nova.network.neutron [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Successfully updated port: 1436eae1-0899-4fc5-8bbe-575fa2c70d42 {{(pid=95467) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 08:15:05 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Acquiring lock "refresh_cache-b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:15:05 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Acquired lock "refresh_cache-b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:15:05 user nova-compute[95467]: DEBUG nova.network.neutron [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:15:05 user nova-compute[95467]: DEBUG nova.compute.manager [req-c9b39b13-394d-44e3-ac24-cfdc2b5c34a7 req-9a5804ea-2269-47df-8b76-95792603eda2 service nova] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Received event network-changed-1436eae1-0899-4fc5-8bbe-575fa2c70d42 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:15:05 user nova-compute[95467]: DEBUG nova.compute.manager [req-c9b39b13-394d-44e3-ac24-cfdc2b5c34a7 req-9a5804ea-2269-47df-8b76-95792603eda2 service nova] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Refreshing instance network info cache due to event network-changed-1436eae1-0899-4fc5-8bbe-575fa2c70d42. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:15:05 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-c9b39b13-394d-44e3-ac24-cfdc2b5c34a7 req-9a5804ea-2269-47df-8b76-95792603eda2 service nova] Acquiring lock "refresh_cache-b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:15:05 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:05 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Cannot resize image /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk to a smaller size. {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 08:15:05 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Created local disks {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 08:15:05 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Ensure instance console log exists: /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/console.log {{(pid=95467) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 08:15:05 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:15:05 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:15:05 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:15:05 user nova-compute[95467]: DEBUG nova.network.neutron [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Successfully created port: b88ee27b-7174-45f5-a5a5-45db71caac08 {{(pid=95467) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 08:15:05 user nova-compute[95467]: DEBUG nova.network.neutron [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Instance cache missing network info. {{(pid=95467) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 08:15:05 user nova-compute[95467]: DEBUG nova.network.neutron [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Updating instance_info_cache with network_info: [{"id": "1436eae1-0899-4fc5-8bbe-575fa2c70d42", "address": "fa:16:3e:08:e7:36", "network": {"id": "369d2a6f-60b7-4c92-8b2d-1f3828f6698b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1491709218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd281be4e94a4d31a47a13267d51d9b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1436eae1-08", "ovs_interfaceid": "1436eae1-0899-4fc5-8bbe-575fa2c70d42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:15:05 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Releasing lock "refresh_cache-b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:15:05 user nova-compute[95467]: DEBUG nova.compute.manager [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Instance network_info: |[{"id": "1436eae1-0899-4fc5-8bbe-575fa2c70d42", "address": "fa:16:3e:08:e7:36", "network": {"id": "369d2a6f-60b7-4c92-8b2d-1f3828f6698b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1491709218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd281be4e94a4d31a47a13267d51d9b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1436eae1-08", "ovs_interfaceid": "1436eae1-0899-4fc5-8bbe-575fa2c70d42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 08:15:05 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-c9b39b13-394d-44e3-ac24-cfdc2b5c34a7 req-9a5804ea-2269-47df-8b76-95792603eda2 service nova] Acquired lock "refresh_cache-b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:15:05 user nova-compute[95467]: DEBUG nova.network.neutron [req-c9b39b13-394d-44e3-ac24-cfdc2b5c34a7 req-9a5804ea-2269-47df-8b76-95792603eda2 service nova] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Refreshing network info cache for port 1436eae1-0899-4fc5-8bbe-575fa2c70d42 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:15:05 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Start _get_guest_xml network_info=[{"id": "1436eae1-0899-4fc5-8bbe-575fa2c70d42", "address": "fa:16:3e:08:e7:36", "network": {"id": "369d2a6f-60b7-4c92-8b2d-1f3828f6698b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1491709218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd281be4e94a4d31a47a13267d51d9b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1436eae1-08", "ovs_interfaceid": "1436eae1-0899-4fc5-8bbe-575fa2c70d42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'ed9c48aa-ce73-4b3b-9db1-235898be671b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:15:05 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:15:05 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:15:05 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:15:05 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:15:05 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:15:05 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:15:05 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:15:05 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:15:05 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:15:05 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:15:05 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:15:05 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:15:05 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:15:05 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:15:05 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:15:05 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:15:05 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:15:05 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:15:05 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:15:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-438049731',display_name='tempest-ServerRescueNegativeTestJSON-server-438049731',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-438049731',id=21,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd281be4e94a4d31a47a13267d51d9b6',ramdisk_id='',reservation_id='r-x5tle0vp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1148442534',owner_user_name='tempest-ServerRescueNegativeTestJSON-1148442534-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:15:03Z,user_data=None,user_id='c07f8dbc38004ecd973f61bba63606d4',uuid=b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1436eae1-0899-4fc5-8bbe-575fa2c70d42", "address": "fa:16:3e:08:e7:36", "network": {"id": "369d2a6f-60b7-4c92-8b2d-1f3828f6698b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1491709218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd281be4e94a4d31a47a13267d51d9b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1436eae1-08", "ovs_interfaceid": "1436eae1-0899-4fc5-8bbe-575fa2c70d42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:15:05 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Converting VIF {"id": "1436eae1-0899-4fc5-8bbe-575fa2c70d42", "address": "fa:16:3e:08:e7:36", "network": {"id": "369d2a6f-60b7-4c92-8b2d-1f3828f6698b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1491709218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd281be4e94a4d31a47a13267d51d9b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1436eae1-08", "ovs_interfaceid": "1436eae1-0899-4fc5-8bbe-575fa2c70d42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:15:05 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:e7:36,bridge_name='br-int',has_traffic_filtering=True,id=1436eae1-0899-4fc5-8bbe-575fa2c70d42,network=Network(369d2a6f-60b7-4c92-8b2d-1f3828f6698b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1436eae1-08') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:15:05 user nova-compute[95467]: DEBUG nova.objects.instance [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lazy-loading 'pci_devices' on Instance uuid b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:15:05 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:15:05 user nova-compute[95467]:   <uuid>b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67</uuid>
Nov 15 08:15:05 user nova-compute[95467]:   <name>instance-00000015</name>
Nov 15 08:15:05 user nova-compute[95467]:   <memory>524288</memory>
Nov 15 08:15:05 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:15:05 user nova-compute[95467]:   <metadata>
Nov 15 08:15:05 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:15:05 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:15:05 user nova-compute[95467]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-438049731</nova:name>
Nov 15 08:15:05 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:15:05</nova:creationTime>
Nov 15 08:15:05 user nova-compute[95467]:       <nova:flavor name="m1.tiny">
Nov 15 08:15:05 user nova-compute[95467]:         <nova:memory>512</nova:memory>
Nov 15 08:15:05 user nova-compute[95467]:         <nova:disk>1</nova:disk>
Nov 15 08:15:05 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:15:05 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:15:05 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:15:05 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:15:05 user nova-compute[95467]:       <nova:owner>
Nov 15 08:15:05 user nova-compute[95467]:         <nova:user uuid="c07f8dbc38004ecd973f61bba63606d4">tempest-ServerRescueNegativeTestJSON-1148442534-project-member</nova:user>
Nov 15 08:15:05 user nova-compute[95467]:         <nova:project uuid="bd281be4e94a4d31a47a13267d51d9b6">tempest-ServerRescueNegativeTestJSON-1148442534</nova:project>
Nov 15 08:15:05 user nova-compute[95467]:       </nova:owner>
Nov 15 08:15:05 user nova-compute[95467]:       <nova:root type="image" uuid="ed9c48aa-ce73-4b3b-9db1-235898be671b"/>
Nov 15 08:15:05 user nova-compute[95467]:       <nova:ports>
Nov 15 08:15:05 user nova-compute[95467]:         <nova:port uuid="1436eae1-0899-4fc5-8bbe-575fa2c70d42">
Nov 15 08:15:05 user nova-compute[95467]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 08:15:05 user nova-compute[95467]:         </nova:port>
Nov 15 08:15:05 user nova-compute[95467]:       </nova:ports>
Nov 15 08:15:05 user nova-compute[95467]:     </nova:instance>
Nov 15 08:15:05 user nova-compute[95467]:   </metadata>
Nov 15 08:15:05 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:15:05 user nova-compute[95467]:     <system>
Nov 15 08:15:05 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:15:05 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:15:05 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:15:05 user nova-compute[95467]:       <entry name="serial">b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67</entry>
Nov 15 08:15:05 user nova-compute[95467]:       <entry name="uuid">b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67</entry>
Nov 15 08:15:05 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:15:05 user nova-compute[95467]:     </system>
Nov 15 08:15:05 user nova-compute[95467]:   </sysinfo>
Nov 15 08:15:05 user nova-compute[95467]:   <os>
Nov 15 08:15:05 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:15:05 user nova-compute[95467]:     <boot dev="hd"/>
Nov 15 08:15:05 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:15:05 user nova-compute[95467]:   </os>
Nov 15 08:15:05 user nova-compute[95467]:   <features>
Nov 15 08:15:05 user nova-compute[95467]:     <acpi/>
Nov 15 08:15:05 user nova-compute[95467]:     <apic/>
Nov 15 08:15:05 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:15:05 user nova-compute[95467]:   </features>
Nov 15 08:15:05 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:15:05 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:15:05 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:15:05 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:15:05 user nova-compute[95467]:   </clock>
Nov 15 08:15:05 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:15:05 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:15:05 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:15:05 user nova-compute[95467]:   </cpu>
Nov 15 08:15:05 user nova-compute[95467]:   <devices>
Nov 15 08:15:05 user nova-compute[95467]:     <disk type="file" device="disk">
Nov 15 08:15:05 user nova-compute[95467]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 08:15:05 user nova-compute[95467]:       <source file="/opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk"/>
Nov 15 08:15:05 user nova-compute[95467]:       <target dev="vda" bus="virtio"/>
Nov 15 08:15:05 user nova-compute[95467]:     </disk>
Nov 15 08:15:05 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:15:05 user nova-compute[95467]:       <mac address="fa:16:3e:08:e7:36"/>
Nov 15 08:15:05 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:15:05 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:15:05 user nova-compute[95467]:       <target dev="tap1436eae1-08"/>
Nov 15 08:15:05 user nova-compute[95467]:     </interface>
Nov 15 08:15:05 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:15:05 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/console.log" append="off"/>
Nov 15 08:15:05 user nova-compute[95467]:     </serial>
Nov 15 08:15:05 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:15:05 user nova-compute[95467]:     <video>
Nov 15 08:15:05 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:15:05 user nova-compute[95467]:     </video>
Nov 15 08:15:05 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:15:05 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:15:05 user nova-compute[95467]:     </rng>
Nov 15 08:15:05 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:15:05 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:15:05 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:15:05 user nova-compute[95467]:     </memballoon>
Nov 15 08:15:05 user nova-compute[95467]:   </devices>
Nov 15 08:15:05 user nova-compute[95467]: </domain>
Nov 15 08:15:05 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:15:05 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:15:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-438049731',display_name='tempest-ServerRescueNegativeTestJSON-server-438049731',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-438049731',id=21,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd281be4e94a4d31a47a13267d51d9b6',ramdisk_id='',reservation_id='r-x5tle0vp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1148442534',owner_user_name='tempest-ServerRescueNegativeTestJSON-1148442534-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:15:03Z,user_data=None,user_id='c07f8dbc38004ecd973f61bba63606d4',uuid=b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1436eae1-0899-4fc5-8bbe-575fa2c70d42", "address": "fa:16:3e:08:e7:36", "network": {"id": "369d2a6f-60b7-4c92-8b2d-1f3828f6698b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1491709218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd281be4e94a4d31a47a13267d51d9b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1436eae1-08", "ovs_interfaceid": "1436eae1-0899-4fc5-8bbe-575fa2c70d42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:15:05 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Converting VIF {"id": "1436eae1-0899-4fc5-8bbe-575fa2c70d42", "address": "fa:16:3e:08:e7:36", "network": {"id": "369d2a6f-60b7-4c92-8b2d-1f3828f6698b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1491709218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd281be4e94a4d31a47a13267d51d9b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1436eae1-08", "ovs_interfaceid": "1436eae1-0899-4fc5-8bbe-575fa2c70d42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:15:05 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:e7:36,bridge_name='br-int',has_traffic_filtering=True,id=1436eae1-0899-4fc5-8bbe-575fa2c70d42,network=Network(369d2a6f-60b7-4c92-8b2d-1f3828f6698b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1436eae1-08') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:15:05 user nova-compute[95467]: DEBUG os_vif [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:e7:36,bridge_name='br-int',has_traffic_filtering=True,id=1436eae1-0899-4fc5-8bbe-575fa2c70d42,network=Network(369d2a6f-60b7-4c92-8b2d-1f3828f6698b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1436eae1-08') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:15:05 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:05 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:15:05 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:15:05 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:05 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '710d55d4-78cd-53e2-b747-04146fed90cc', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:15:05 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:05 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:15:05 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:05 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1436eae1-08, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:15:05 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1436eae1-08, col_values=(('qos', UUID('1b74b1d3-2374-42c0-a181-12cb9ce35fb2')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:15:05 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1436eae1-08, col_values=(('external_ids', {'iface-id': '1436eae1-0899-4fc5-8bbe-575fa2c70d42', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:e7:36', 'vm-uuid': 'b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:15:05 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:05 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:15:05 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:05 user nova-compute[95467]: INFO os_vif [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:e7:36,bridge_name='br-int',has_traffic_filtering=True,id=1436eae1-0899-4fc5-8bbe-575fa2c70d42,network=Network(369d2a6f-60b7-4c92-8b2d-1f3828f6698b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1436eae1-08')
Nov 15 08:15:05 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:15:05 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] No VIF found with MAC fa:16:3e:08:e7:36, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:15:06 user nova-compute[95467]: DEBUG nova.network.neutron [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Successfully updated port: b88ee27b-7174-45f5-a5a5-45db71caac08 {{(pid=95467) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 08:15:06 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Acquiring lock "refresh_cache-10d73b73-ca65-4192-8954-288dc1df9f24" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:15:06 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Acquired lock "refresh_cache-10d73b73-ca65-4192-8954-288dc1df9f24" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:15:06 user nova-compute[95467]: DEBUG nova.network.neutron [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:15:06 user nova-compute[95467]: DEBUG nova.network.neutron [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Instance cache missing network info. {{(pid=95467) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 08:15:06 user nova-compute[95467]: DEBUG nova.compute.manager [req-b6f16237-94b3-4dba-8b74-79b9baf076bc req-c04cfa2a-51c6-4d75-9ad5-78bb2fb1a9ba service nova] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Received event network-changed-b88ee27b-7174-45f5-a5a5-45db71caac08 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:15:06 user nova-compute[95467]: DEBUG nova.compute.manager [req-b6f16237-94b3-4dba-8b74-79b9baf076bc req-c04cfa2a-51c6-4d75-9ad5-78bb2fb1a9ba service nova] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Refreshing instance network info cache due to event network-changed-b88ee27b-7174-45f5-a5a5-45db71caac08. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:15:06 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b6f16237-94b3-4dba-8b74-79b9baf076bc req-c04cfa2a-51c6-4d75-9ad5-78bb2fb1a9ba service nova] Acquiring lock "refresh_cache-10d73b73-ca65-4192-8954-288dc1df9f24" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:15:06 user nova-compute[95467]: DEBUG nova.network.neutron [req-c9b39b13-394d-44e3-ac24-cfdc2b5c34a7 req-9a5804ea-2269-47df-8b76-95792603eda2 service nova] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Updated VIF entry in instance network info cache for port 1436eae1-0899-4fc5-8bbe-575fa2c70d42. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:15:06 user nova-compute[95467]: DEBUG nova.network.neutron [req-c9b39b13-394d-44e3-ac24-cfdc2b5c34a7 req-9a5804ea-2269-47df-8b76-95792603eda2 service nova] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Updating instance_info_cache with network_info: [{"id": "1436eae1-0899-4fc5-8bbe-575fa2c70d42", "address": "fa:16:3e:08:e7:36", "network": {"id": "369d2a6f-60b7-4c92-8b2d-1f3828f6698b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1491709218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd281be4e94a4d31a47a13267d51d9b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1436eae1-08", "ovs_interfaceid": "1436eae1-0899-4fc5-8bbe-575fa2c70d42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:15:06 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-c9b39b13-394d-44e3-ac24-cfdc2b5c34a7 req-9a5804ea-2269-47df-8b76-95792603eda2 service nova] Releasing lock "refresh_cache-b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:15:06 user nova-compute[95467]: DEBUG nova.network.neutron [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Updating instance_info_cache with network_info: [{"id": "b88ee27b-7174-45f5-a5a5-45db71caac08", "address": "fa:16:3e:a0:3b:16", "network": {"id": "369d2a6f-60b7-4c92-8b2d-1f3828f6698b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1491709218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd281be4e94a4d31a47a13267d51d9b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb88ee27b-71", "ovs_interfaceid": "b88ee27b-7174-45f5-a5a5-45db71caac08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:15:06 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Releasing lock "refresh_cache-10d73b73-ca65-4192-8954-288dc1df9f24" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:15:06 user nova-compute[95467]: DEBUG nova.compute.manager [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Instance network_info: |[{"id": "b88ee27b-7174-45f5-a5a5-45db71caac08", "address": "fa:16:3e:a0:3b:16", "network": {"id": "369d2a6f-60b7-4c92-8b2d-1f3828f6698b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1491709218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd281be4e94a4d31a47a13267d51d9b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb88ee27b-71", "ovs_interfaceid": "b88ee27b-7174-45f5-a5a5-45db71caac08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 08:15:06 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b6f16237-94b3-4dba-8b74-79b9baf076bc req-c04cfa2a-51c6-4d75-9ad5-78bb2fb1a9ba service nova] Acquired lock "refresh_cache-10d73b73-ca65-4192-8954-288dc1df9f24" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:15:06 user nova-compute[95467]: DEBUG nova.network.neutron [req-b6f16237-94b3-4dba-8b74-79b9baf076bc req-c04cfa2a-51c6-4d75-9ad5-78bb2fb1a9ba service nova] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Refreshing network info cache for port b88ee27b-7174-45f5-a5a5-45db71caac08 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:15:06 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Start _get_guest_xml network_info=[{"id": "b88ee27b-7174-45f5-a5a5-45db71caac08", "address": "fa:16:3e:a0:3b:16", "network": {"id": "369d2a6f-60b7-4c92-8b2d-1f3828f6698b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1491709218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd281be4e94a4d31a47a13267d51d9b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb88ee27b-71", "ovs_interfaceid": "b88ee27b-7174-45f5-a5a5-45db71caac08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'ed9c48aa-ce73-4b3b-9db1-235898be671b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:15:06 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:15:06 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:15:06 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:15:06 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:15:06 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:15:06 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:15:06 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:15:06 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:15:06 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:15:06 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:15:06 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:15:06 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:15:06 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:15:06 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:15:06 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:15:06 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:15:06 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:15:06 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:15:06 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:15:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1288293325',display_name='tempest-ServerRescueNegativeTestJSON-server-1288293325',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1288293325',id=22,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd281be4e94a4d31a47a13267d51d9b6',ramdisk_id='',reservation_id='r-egtjqjbc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1148442534',owner_user_name='tempest-ServerRescueNegativeTestJSON-1148442534-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:15:05Z,user_data=None,user_id='c07f8dbc38004ecd973f61bba63606d4',uuid=10d73b73-ca65-4192-8954-288dc1df9f24,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b88ee27b-7174-45f5-a5a5-45db71caac08", "address": "fa:16:3e:a0:3b:16", "network": {"id": "369d2a6f-60b7-4c92-8b2d-1f3828f6698b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1491709218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd281be4e94a4d31a47a13267d51d9b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb88ee27b-71", "ovs_interfaceid": "b88ee27b-7174-45f5-a5a5-45db71caac08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:15:06 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Converting VIF {"id": "b88ee27b-7174-45f5-a5a5-45db71caac08", "address": "fa:16:3e:a0:3b:16", "network": {"id": "369d2a6f-60b7-4c92-8b2d-1f3828f6698b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1491709218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd281be4e94a4d31a47a13267d51d9b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb88ee27b-71", "ovs_interfaceid": "b88ee27b-7174-45f5-a5a5-45db71caac08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:15:06 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:3b:16,bridge_name='br-int',has_traffic_filtering=True,id=b88ee27b-7174-45f5-a5a5-45db71caac08,network=Network(369d2a6f-60b7-4c92-8b2d-1f3828f6698b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb88ee27b-71') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:15:06 user nova-compute[95467]: DEBUG nova.objects.instance [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lazy-loading 'pci_devices' on Instance uuid 10d73b73-ca65-4192-8954-288dc1df9f24 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:15:06 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:15:06 user nova-compute[95467]:   <uuid>10d73b73-ca65-4192-8954-288dc1df9f24</uuid>
Nov 15 08:15:06 user nova-compute[95467]:   <name>instance-00000016</name>
Nov 15 08:15:06 user nova-compute[95467]:   <memory>524288</memory>
Nov 15 08:15:06 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:15:06 user nova-compute[95467]:   <metadata>
Nov 15 08:15:06 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:15:06 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:15:06 user nova-compute[95467]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1288293325</nova:name>
Nov 15 08:15:06 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:15:06</nova:creationTime>
Nov 15 08:15:06 user nova-compute[95467]:       <nova:flavor name="m1.tiny">
Nov 15 08:15:06 user nova-compute[95467]:         <nova:memory>512</nova:memory>
Nov 15 08:15:06 user nova-compute[95467]:         <nova:disk>1</nova:disk>
Nov 15 08:15:06 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:15:06 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:15:06 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:15:06 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:15:06 user nova-compute[95467]:       <nova:owner>
Nov 15 08:15:06 user nova-compute[95467]:         <nova:user uuid="c07f8dbc38004ecd973f61bba63606d4">tempest-ServerRescueNegativeTestJSON-1148442534-project-member</nova:user>
Nov 15 08:15:06 user nova-compute[95467]:         <nova:project uuid="bd281be4e94a4d31a47a13267d51d9b6">tempest-ServerRescueNegativeTestJSON-1148442534</nova:project>
Nov 15 08:15:06 user nova-compute[95467]:       </nova:owner>
Nov 15 08:15:06 user nova-compute[95467]:       <nova:root type="image" uuid="ed9c48aa-ce73-4b3b-9db1-235898be671b"/>
Nov 15 08:15:06 user nova-compute[95467]:       <nova:ports>
Nov 15 08:15:06 user nova-compute[95467]:         <nova:port uuid="b88ee27b-7174-45f5-a5a5-45db71caac08">
Nov 15 08:15:06 user nova-compute[95467]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 08:15:06 user nova-compute[95467]:         </nova:port>
Nov 15 08:15:06 user nova-compute[95467]:       </nova:ports>
Nov 15 08:15:06 user nova-compute[95467]:     </nova:instance>
Nov 15 08:15:06 user nova-compute[95467]:   </metadata>
Nov 15 08:15:06 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:15:06 user nova-compute[95467]:     <system>
Nov 15 08:15:06 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:15:06 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:15:06 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:15:06 user nova-compute[95467]:       <entry name="serial">10d73b73-ca65-4192-8954-288dc1df9f24</entry>
Nov 15 08:15:06 user nova-compute[95467]:       <entry name="uuid">10d73b73-ca65-4192-8954-288dc1df9f24</entry>
Nov 15 08:15:06 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:15:06 user nova-compute[95467]:     </system>
Nov 15 08:15:06 user nova-compute[95467]:   </sysinfo>
Nov 15 08:15:06 user nova-compute[95467]:   <os>
Nov 15 08:15:06 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:15:06 user nova-compute[95467]:     <boot dev="hd"/>
Nov 15 08:15:06 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:15:06 user nova-compute[95467]:   </os>
Nov 15 08:15:06 user nova-compute[95467]:   <features>
Nov 15 08:15:06 user nova-compute[95467]:     <acpi/>
Nov 15 08:15:06 user nova-compute[95467]:     <apic/>
Nov 15 08:15:06 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:15:06 user nova-compute[95467]:   </features>
Nov 15 08:15:06 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:15:06 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:15:06 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:15:06 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:15:06 user nova-compute[95467]:   </clock>
Nov 15 08:15:06 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:15:06 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:15:06 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:15:06 user nova-compute[95467]:   </cpu>
Nov 15 08:15:06 user nova-compute[95467]:   <devices>
Nov 15 08:15:06 user nova-compute[95467]:     <disk type="file" device="disk">
Nov 15 08:15:06 user nova-compute[95467]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 08:15:06 user nova-compute[95467]:       <source file="/opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk"/>
Nov 15 08:15:06 user nova-compute[95467]:       <target dev="vda" bus="virtio"/>
Nov 15 08:15:06 user nova-compute[95467]:     </disk>
Nov 15 08:15:06 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:15:06 user nova-compute[95467]:       <mac address="fa:16:3e:a0:3b:16"/>
Nov 15 08:15:06 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:15:06 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:15:06 user nova-compute[95467]:       <target dev="tapb88ee27b-71"/>
Nov 15 08:15:06 user nova-compute[95467]:     </interface>
Nov 15 08:15:06 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:15:06 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/console.log" append="off"/>
Nov 15 08:15:06 user nova-compute[95467]:     </serial>
Nov 15 08:15:06 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:15:06 user nova-compute[95467]:     <video>
Nov 15 08:15:06 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:15:06 user nova-compute[95467]:     </video>
Nov 15 08:15:06 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:15:06 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:15:06 user nova-compute[95467]:     </rng>
Nov 15 08:15:06 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:15:06 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:15:06 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:15:06 user nova-compute[95467]:     </memballoon>
Nov 15 08:15:06 user nova-compute[95467]:   </devices>
Nov 15 08:15:06 user nova-compute[95467]: </domain>
Nov 15 08:15:06 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:15:06 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:15:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1288293325',display_name='tempest-ServerRescueNegativeTestJSON-server-1288293325',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1288293325',id=22,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd281be4e94a4d31a47a13267d51d9b6',ramdisk_id='',reservation_id='r-egtjqjbc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1148442534',owner_user_name='tempest-ServerRescueNegativeTestJSON-1148442534-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:15:05Z,user_data=None,user_id='c07f8dbc38004ecd973f61bba63606d4',uuid=10d73b73-ca65-4192-8954-288dc1df9f24,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b88ee27b-7174-45f5-a5a5-45db71caac08", "address": "fa:16:3e:a0:3b:16", "network": {"id": "369d2a6f-60b7-4c92-8b2d-1f3828f6698b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1491709218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd281be4e94a4d31a47a13267d51d9b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb88ee27b-71", "ovs_interfaceid": "b88ee27b-7174-45f5-a5a5-45db71caac08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:15:06 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Converting VIF {"id": "b88ee27b-7174-45f5-a5a5-45db71caac08", "address": "fa:16:3e:a0:3b:16", "network": {"id": "369d2a6f-60b7-4c92-8b2d-1f3828f6698b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1491709218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd281be4e94a4d31a47a13267d51d9b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb88ee27b-71", "ovs_interfaceid": "b88ee27b-7174-45f5-a5a5-45db71caac08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:15:06 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:3b:16,bridge_name='br-int',has_traffic_filtering=True,id=b88ee27b-7174-45f5-a5a5-45db71caac08,network=Network(369d2a6f-60b7-4c92-8b2d-1f3828f6698b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb88ee27b-71') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:15:06 user nova-compute[95467]: DEBUG os_vif [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:3b:16,bridge_name='br-int',has_traffic_filtering=True,id=b88ee27b-7174-45f5-a5a5-45db71caac08,network=Network(369d2a6f-60b7-4c92-8b2d-1f3828f6698b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb88ee27b-71') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:15:06 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:06 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:15:06 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:15:06 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:06 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b4dfec09-ffd3-534c-849b-4e4ab9fdc19d', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:15:06 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:06 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:15:06 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:06 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:06 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb88ee27b-71, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:15:06 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb88ee27b-71, col_values=(('qos', UUID('7a8cec7c-747e-4c45-9db2-c0ca233009b1')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:15:06 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb88ee27b-71, col_values=(('external_ids', {'iface-id': 'b88ee27b-7174-45f5-a5a5-45db71caac08', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:3b:16', 'vm-uuid': '10d73b73-ca65-4192-8954-288dc1df9f24'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:15:06 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:06 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:15:06 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:06 user nova-compute[95467]: INFO os_vif [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:3b:16,bridge_name='br-int',has_traffic_filtering=True,id=b88ee27b-7174-45f5-a5a5-45db71caac08,network=Network(369d2a6f-60b7-4c92-8b2d-1f3828f6698b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb88ee27b-71')
Nov 15 08:15:06 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:15:06 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] No VIF found with MAC fa:16:3e:a0:3b:16, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:15:06 user nova-compute[95467]: DEBUG nova.network.neutron [req-b6f16237-94b3-4dba-8b74-79b9baf076bc req-c04cfa2a-51c6-4d75-9ad5-78bb2fb1a9ba service nova] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Updated VIF entry in instance network info cache for port b88ee27b-7174-45f5-a5a5-45db71caac08. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:15:06 user nova-compute[95467]: DEBUG nova.network.neutron [req-b6f16237-94b3-4dba-8b74-79b9baf076bc req-c04cfa2a-51c6-4d75-9ad5-78bb2fb1a9ba service nova] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Updating instance_info_cache with network_info: [{"id": "b88ee27b-7174-45f5-a5a5-45db71caac08", "address": "fa:16:3e:a0:3b:16", "network": {"id": "369d2a6f-60b7-4c92-8b2d-1f3828f6698b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1491709218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd281be4e94a4d31a47a13267d51d9b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb88ee27b-71", "ovs_interfaceid": "b88ee27b-7174-45f5-a5a5-45db71caac08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:15:06 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b6f16237-94b3-4dba-8b74-79b9baf076bc req-c04cfa2a-51c6-4d75-9ad5-78bb2fb1a9ba service nova] Releasing lock "refresh_cache-10d73b73-ca65-4192-8954-288dc1df9f24" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:15:07 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:07 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:07 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:07 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:07 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:07 user nova-compute[95467]: DEBUG nova.compute.manager [req-df9097af-f089-4b79-b17a-12073859d028 req-6a1e8c2b-dff4-4843-a371-9614936a2c7b service nova] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Received event network-vif-plugged-1436eae1-0899-4fc5-8bbe-575fa2c70d42 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:15:07 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-df9097af-f089-4b79-b17a-12073859d028 req-6a1e8c2b-dff4-4843-a371-9614936a2c7b service nova] Acquiring lock "b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:15:07 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-df9097af-f089-4b79-b17a-12073859d028 req-6a1e8c2b-dff4-4843-a371-9614936a2c7b service nova] Lock "b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:15:07 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-df9097af-f089-4b79-b17a-12073859d028 req-6a1e8c2b-dff4-4843-a371-9614936a2c7b service nova] Lock "b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:15:07 user nova-compute[95467]: DEBUG nova.compute.manager [req-df9097af-f089-4b79-b17a-12073859d028 req-6a1e8c2b-dff4-4843-a371-9614936a2c7b service nova] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] No waiting events found dispatching network-vif-plugged-1436eae1-0899-4fc5-8bbe-575fa2c70d42 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:15:07 user nova-compute[95467]: WARNING nova.compute.manager [req-df9097af-f089-4b79-b17a-12073859d028 req-6a1e8c2b-dff4-4843-a371-9614936a2c7b service nova] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Received unexpected event network-vif-plugged-1436eae1-0899-4fc5-8bbe-575fa2c70d42 for instance with vm_state building and task_state spawning.
Nov 15 08:15:08 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:08 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:08 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:08 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:08 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:08 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:08 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:08 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:09 user nova-compute[95467]: DEBUG nova.compute.manager [req-68c14bef-95b2-4dee-8d73-9cfaf4120251 req-c9607b6b-6127-4afe-8afc-dbff59eb270f service nova] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Received event network-vif-plugged-b88ee27b-7174-45f5-a5a5-45db71caac08 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:15:09 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-68c14bef-95b2-4dee-8d73-9cfaf4120251 req-c9607b6b-6127-4afe-8afc-dbff59eb270f service nova] Acquiring lock "10d73b73-ca65-4192-8954-288dc1df9f24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:15:09 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-68c14bef-95b2-4dee-8d73-9cfaf4120251 req-c9607b6b-6127-4afe-8afc-dbff59eb270f service nova] Lock "10d73b73-ca65-4192-8954-288dc1df9f24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:15:09 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-68c14bef-95b2-4dee-8d73-9cfaf4120251 req-c9607b6b-6127-4afe-8afc-dbff59eb270f service nova] Lock "10d73b73-ca65-4192-8954-288dc1df9f24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:15:09 user nova-compute[95467]: DEBUG nova.compute.manager [req-68c14bef-95b2-4dee-8d73-9cfaf4120251 req-c9607b6b-6127-4afe-8afc-dbff59eb270f service nova] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] No waiting events found dispatching network-vif-plugged-b88ee27b-7174-45f5-a5a5-45db71caac08 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:15:09 user nova-compute[95467]: WARNING nova.compute.manager [req-68c14bef-95b2-4dee-8d73-9cfaf4120251 req-c9607b6b-6127-4afe-8afc-dbff59eb270f service nova] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Received unexpected event network-vif-plugged-b88ee27b-7174-45f5-a5a5-45db71caac08 for instance with vm_state building and task_state spawning.
Nov 15 08:15:09 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:09 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:09 user nova-compute[95467]: DEBUG nova.compute.manager [req-7c0a0412-9a53-401b-9ca7-4e2faaec116c req-9e8ea8c5-0a49-460e-897f-778381bb8c07 service nova] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Received event network-vif-plugged-1436eae1-0899-4fc5-8bbe-575fa2c70d42 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:15:09 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-7c0a0412-9a53-401b-9ca7-4e2faaec116c req-9e8ea8c5-0a49-460e-897f-778381bb8c07 service nova] Acquiring lock "b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:15:09 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-7c0a0412-9a53-401b-9ca7-4e2faaec116c req-9e8ea8c5-0a49-460e-897f-778381bb8c07 service nova] Lock "b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:15:09 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-7c0a0412-9a53-401b-9ca7-4e2faaec116c req-9e8ea8c5-0a49-460e-897f-778381bb8c07 service nova] Lock "b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:15:09 user nova-compute[95467]: DEBUG nova.compute.manager [req-7c0a0412-9a53-401b-9ca7-4e2faaec116c req-9e8ea8c5-0a49-460e-897f-778381bb8c07 service nova] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] No waiting events found dispatching network-vif-plugged-1436eae1-0899-4fc5-8bbe-575fa2c70d42 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:15:09 user nova-compute[95467]: WARNING nova.compute.manager [req-7c0a0412-9a53-401b-9ca7-4e2faaec116c req-9e8ea8c5-0a49-460e-897f-778381bb8c07 service nova] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Received unexpected event network-vif-plugged-1436eae1-0899-4fc5-8bbe-575fa2c70d42 for instance with vm_state building and task_state spawning.
Nov 15 08:15:11 user nova-compute[95467]: DEBUG nova.compute.manager [req-b3a66897-6fd2-48f4-b71a-f0182f3a83b1 req-3ed314c2-9b69-437d-88e6-27ca91401328 service nova] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Received event network-vif-plugged-b88ee27b-7174-45f5-a5a5-45db71caac08 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:15:11 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b3a66897-6fd2-48f4-b71a-f0182f3a83b1 req-3ed314c2-9b69-437d-88e6-27ca91401328 service nova] Acquiring lock "10d73b73-ca65-4192-8954-288dc1df9f24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:15:11 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b3a66897-6fd2-48f4-b71a-f0182f3a83b1 req-3ed314c2-9b69-437d-88e6-27ca91401328 service nova] Lock "10d73b73-ca65-4192-8954-288dc1df9f24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:15:11 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b3a66897-6fd2-48f4-b71a-f0182f3a83b1 req-3ed314c2-9b69-437d-88e6-27ca91401328 service nova] Lock "10d73b73-ca65-4192-8954-288dc1df9f24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:15:11 user nova-compute[95467]: DEBUG nova.compute.manager [req-b3a66897-6fd2-48f4-b71a-f0182f3a83b1 req-3ed314c2-9b69-437d-88e6-27ca91401328 service nova] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] No waiting events found dispatching network-vif-plugged-b88ee27b-7174-45f5-a5a5-45db71caac08 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:15:11 user nova-compute[95467]: WARNING nova.compute.manager [req-b3a66897-6fd2-48f4-b71a-f0182f3a83b1 req-3ed314c2-9b69-437d-88e6-27ca91401328 service nova] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Received unexpected event network-vif-plugged-b88ee27b-7174-45f5-a5a5-45db71caac08 for instance with vm_state building and task_state spawning.
Nov 15 08:15:11 user nova-compute[95467]: DEBUG nova.compute.manager [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Instance event wait completed in 0 seconds for  {{(pid=95467) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 08:15:11 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Guest created on hypervisor {{(pid=95467) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 08:15:11 user nova-compute[95467]: DEBUG nova.compute.manager [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Instance event wait completed in 0 seconds for  {{(pid=95467) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 08:15:11 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Guest created on hypervisor {{(pid=95467) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 08:15:11 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Instance spawned successfully.
Nov 15 08:15:11 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 08:15:11 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Instance spawned successfully.
Nov 15 08:15:11 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 08:15:11 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Found default for hw_cdrom_bus of ide {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:15:11 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Found default for hw_disk_bus of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:15:11 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Found default for hw_input_bus of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:15:11 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Found default for hw_pointer_model of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:15:11 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Found default for hw_video_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:15:11 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Found default for hw_vif_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:15:11 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Found default for hw_cdrom_bus of ide {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:15:11 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Found default for hw_disk_bus of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:15:11 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Found default for hw_input_bus of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:15:11 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Found default for hw_pointer_model of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:15:11 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Found default for hw_video_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:15:11 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Found default for hw_vif_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:15:11 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:11 user nova-compute[95467]: INFO nova.compute.manager [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Took 7.74 seconds to spawn the instance on the hypervisor.
Nov 15 08:15:11 user nova-compute[95467]: DEBUG nova.compute.manager [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:15:11 user nova-compute[95467]: INFO nova.compute.manager [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Took 6.90 seconds to spawn the instance on the hypervisor.
Nov 15 08:15:11 user nova-compute[95467]: DEBUG nova.compute.manager [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:15:11 user nova-compute[95467]: INFO nova.compute.manager [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Took 8.85 seconds to build instance.
Nov 15 08:15:11 user nova-compute[95467]: INFO nova.compute.manager [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Took 8.21 seconds to build instance.
Nov 15 08:15:11 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a9aeb605-c56c-420e-88a4-4268b7de9318 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.947s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:15:11 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d18d112c-4b39-4ce8-a00b-e3a9bd99903b tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "10d73b73-ca65-4192-8954-288dc1df9f24" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.307s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:15:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:15 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:16 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:17 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:18 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:21 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:21 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:23 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] Acquiring lock "d5a35226-6b98-44ad-ab4d-e0e86b14ba9d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:15:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] Lock "d5a35226-6b98-44ad-ab4d-e0e86b14ba9d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:15:24 user nova-compute[95467]: DEBUG nova.compute.manager [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] [instance: d5a35226-6b98-44ad-ab4d-e0e86b14ba9d] Starting instance... {{(pid=95467) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 08:15:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:15:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:15:25 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=95467) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 08:15:25 user nova-compute[95467]: INFO nova.compute.claims [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] [instance: d5a35226-6b98-44ad-ab4d-e0e86b14ba9d] Claim successful on node user
Nov 15 08:15:25 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:15:25 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:15:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.561s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:15:25 user nova-compute[95467]: DEBUG nova.compute.manager [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] [instance: d5a35226-6b98-44ad-ab4d-e0e86b14ba9d] Start building networks asynchronously for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 08:15:25 user nova-compute[95467]: DEBUG nova.compute.manager [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] [instance: d5a35226-6b98-44ad-ab4d-e0e86b14ba9d] Allocating IP information in the background. {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 08:15:25 user nova-compute[95467]: DEBUG nova.network.neutron [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] [instance: d5a35226-6b98-44ad-ab4d-e0e86b14ba9d] allocate_for_instance() {{(pid=95467) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 08:15:25 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] [instance: d5a35226-6b98-44ad-ab4d-e0e86b14ba9d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 08:15:25 user nova-compute[95467]: DEBUG nova.compute.manager [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] [instance: d5a35226-6b98-44ad-ab4d-e0e86b14ba9d] Start building block device mappings for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 08:15:25 user nova-compute[95467]: DEBUG nova.policy [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a5c053bb80724bc2a2e117c9994a92b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bcf0714bf348ecb7a99388dcdd98dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95467) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 08:15:25 user nova-compute[95467]: DEBUG nova.compute.manager [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] [instance: d5a35226-6b98-44ad-ab4d-e0e86b14ba9d] Start spawning the instance on the hypervisor. {{(pid=95467) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 08:15:25 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] [instance: d5a35226-6b98-44ad-ab4d-e0e86b14ba9d] Creating instance directory {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 08:15:25 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] [instance: d5a35226-6b98-44ad-ab4d-e0e86b14ba9d] Creating image(s)
Nov 15 08:15:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] Acquiring lock "/opt/stack/data/nova/instances/d5a35226-6b98-44ad-ab4d-e0e86b14ba9d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:15:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] Lock "/opt/stack/data/nova/instances/d5a35226-6b98-44ad-ab4d-e0e86b14ba9d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:15:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] Lock "/opt/stack/data/nova/instances/d5a35226-6b98-44ad-ab4d-e0e86b14ba9d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:15:25 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:26 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.232s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] Acquiring lock "a3fcf60225fcefd310404971cd18ab9851c548dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:15:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:15:26 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:26 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.195s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:26 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/d5a35226-6b98-44ad-ab4d-e0e86b14ba9d/disk 1073741824 {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:26 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/d5a35226-6b98-44ad-ab4d-e0e86b14ba9d/disk 1073741824" returned: 0 in 0.056s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:15:26 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:26 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.182s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:26 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d5a35226-6b98-44ad-ab4d-e0e86b14ba9d/disk. size=1073741824 {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 08:15:26 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a35226-6b98-44ad-ab4d-e0e86b14ba9d/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:26 user nova-compute[95467]: DEBUG nova.network.neutron [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] [instance: d5a35226-6b98-44ad-ab4d-e0e86b14ba9d] Successfully created port: 54ecf559-43dd-428e-af76-0966723dbaf6 {{(pid=95467) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 08:15:26 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a35226-6b98-44ad-ab4d-e0e86b14ba9d/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:26 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] Cannot resize image /opt/stack/data/nova/instances/d5a35226-6b98-44ad-ab4d-e0e86b14ba9d/disk to a smaller size. {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 08:15:26 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] [instance: d5a35226-6b98-44ad-ab4d-e0e86b14ba9d] Created local disks {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 08:15:26 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] [instance: d5a35226-6b98-44ad-ab4d-e0e86b14ba9d] Ensure instance console log exists: /opt/stack/data/nova/instances/d5a35226-6b98-44ad-ab4d-e0e86b14ba9d/console.log {{(pid=95467) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 08:15:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:15:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:15:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:15:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:27 user nova-compute[95467]: DEBUG nova.network.neutron [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] [instance: d5a35226-6b98-44ad-ab4d-e0e86b14ba9d] Successfully updated port: 54ecf559-43dd-428e-af76-0966723dbaf6 {{(pid=95467) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 08:15:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] Acquiring lock "refresh_cache-d5a35226-6b98-44ad-ab4d-e0e86b14ba9d" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:15:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] Acquired lock "refresh_cache-d5a35226-6b98-44ad-ab4d-e0e86b14ba9d" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:15:27 user nova-compute[95467]: DEBUG nova.network.neutron [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] [instance: d5a35226-6b98-44ad-ab4d-e0e86b14ba9d] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:15:27 user nova-compute[95467]: DEBUG nova.compute.manager [req-780ad4f6-1f30-4d46-8e1c-39ca8685785e req-97953a9f-79f7-409b-975f-3fd3aa636073 service nova] [instance: d5a35226-6b98-44ad-ab4d-e0e86b14ba9d] Received event network-changed-54ecf559-43dd-428e-af76-0966723dbaf6 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:15:27 user nova-compute[95467]: DEBUG nova.compute.manager [req-780ad4f6-1f30-4d46-8e1c-39ca8685785e req-97953a9f-79f7-409b-975f-3fd3aa636073 service nova] [instance: d5a35226-6b98-44ad-ab4d-e0e86b14ba9d] Refreshing instance network info cache due to event network-changed-54ecf559-43dd-428e-af76-0966723dbaf6. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:15:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-780ad4f6-1f30-4d46-8e1c-39ca8685785e req-97953a9f-79f7-409b-975f-3fd3aa636073 service nova] Acquiring lock "refresh_cache-d5a35226-6b98-44ad-ab4d-e0e86b14ba9d" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:15:27 user nova-compute[95467]: DEBUG nova.network.neutron [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] [instance: d5a35226-6b98-44ad-ab4d-e0e86b14ba9d] Instance cache missing network info. {{(pid=95467) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 08:15:27 user nova-compute[95467]: DEBUG nova.network.neutron [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] [instance: d5a35226-6b98-44ad-ab4d-e0e86b14ba9d] Updating instance_info_cache with network_info: [{"id": "54ecf559-43dd-428e-af76-0966723dbaf6", "address": "fa:16:3e:a7:15:c9", "network": {"id": "7f71e1f3-188f-4e92-87a3-b1e11c44e727", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2039589401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5bcf0714bf348ecb7a99388dcdd98dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ecf559-43", "ovs_interfaceid": "54ecf559-43dd-428e-af76-0966723dbaf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:15:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] Releasing lock "refresh_cache-d5a35226-6b98-44ad-ab4d-e0e86b14ba9d" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:15:27 user nova-compute[95467]: DEBUG nova.compute.manager [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] [instance: d5a35226-6b98-44ad-ab4d-e0e86b14ba9d] Instance network_info: |[{"id": "54ecf559-43dd-428e-af76-0966723dbaf6", "address": "fa:16:3e:a7:15:c9", "network": {"id": "7f71e1f3-188f-4e92-87a3-b1e11c44e727", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2039589401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5bcf0714bf348ecb7a99388dcdd98dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ecf559-43", "ovs_interfaceid": "54ecf559-43dd-428e-af76-0966723dbaf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 08:15:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-780ad4f6-1f30-4d46-8e1c-39ca8685785e req-97953a9f-79f7-409b-975f-3fd3aa636073 service nova] Acquired lock "refresh_cache-d5a35226-6b98-44ad-ab4d-e0e86b14ba9d" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:15:27 user nova-compute[95467]: DEBUG nova.network.neutron [req-780ad4f6-1f30-4d46-8e1c-39ca8685785e req-97953a9f-79f7-409b-975f-3fd3aa636073 service nova] [instance: d5a35226-6b98-44ad-ab4d-e0e86b14ba9d] Refreshing network info cache for port 54ecf559-43dd-428e-af76-0966723dbaf6 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:15:27 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] [instance: d5a35226-6b98-44ad-ab4d-e0e86b14ba9d] Start _get_guest_xml network_info=[{"id": "54ecf559-43dd-428e-af76-0966723dbaf6", "address": "fa:16:3e:a7:15:c9", "network": {"id": "7f71e1f3-188f-4e92-87a3-b1e11c44e727", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2039589401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5bcf0714bf348ecb7a99388dcdd98dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ecf559-43", "ovs_interfaceid": "54ecf559-43dd-428e-af76-0966723dbaf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'ed9c48aa-ce73-4b3b-9db1-235898be671b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:15:27 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:15:27 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:15:27 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:15:27 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:15:28 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:15:28 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:15:28 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:15:28 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:15:28 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:15:28 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:15:28 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:15:28 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:15:28 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:15:28 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:15:28 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:15:28 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:15:28 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:15:28 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:15:28 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:15:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-543357104',display_name='tempest-VolumesActionsTest-instance-543357104',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-543357104',id=23,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5bcf0714bf348ecb7a99388dcdd98dc',ramdisk_id='',reservation_id='r-n3o00if9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1609645107',owner_user_name='tempest-VolumesActionsTest-1609645107-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:15:26Z,user_data=None,user_id='a5c053bb80724bc2a2e117c9994a92b3',uuid=d5a35226-6b98-44ad-ab4d-e0e86b14ba9d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54ecf559-43dd-428e-af76-0966723dbaf6", "address": "fa:16:3e:a7:15:c9", "network": {"id": "7f71e1f3-188f-4e92-87a3-b1e11c44e727", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2039589401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5bcf0714bf348ecb7a99388dcdd98dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ecf559-43", "ovs_interfaceid": "54ecf559-43dd-428e-af76-0966723dbaf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:15:28 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] Converting VIF {"id": "54ecf559-43dd-428e-af76-0966723dbaf6", "address": "fa:16:3e:a7:15:c9", "network": {"id": "7f71e1f3-188f-4e92-87a3-b1e11c44e727", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2039589401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5bcf0714bf348ecb7a99388dcdd98dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ecf559-43", "ovs_interfaceid": "54ecf559-43dd-428e-af76-0966723dbaf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:15:28 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:15:c9,bridge_name='br-int',has_traffic_filtering=True,id=54ecf559-43dd-428e-af76-0966723dbaf6,network=Network(7f71e1f3-188f-4e92-87a3-b1e11c44e727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54ecf559-43') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:15:28 user nova-compute[95467]: DEBUG nova.objects.instance [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] Lazy-loading 'pci_devices' on Instance uuid d5a35226-6b98-44ad-ab4d-e0e86b14ba9d {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:15:28 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] [instance: d5a35226-6b98-44ad-ab4d-e0e86b14ba9d] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:15:28 user nova-compute[95467]:   <uuid>d5a35226-6b98-44ad-ab4d-e0e86b14ba9d</uuid>
Nov 15 08:15:28 user nova-compute[95467]:   <name>instance-00000017</name>
Nov 15 08:15:28 user nova-compute[95467]:   <memory>524288</memory>
Nov 15 08:15:28 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:15:28 user nova-compute[95467]:   <metadata>
Nov 15 08:15:28 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:15:28 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:15:28 user nova-compute[95467]:       <nova:name>tempest-VolumesActionsTest-instance-543357104</nova:name>
Nov 15 08:15:28 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:15:27</nova:creationTime>
Nov 15 08:15:28 user nova-compute[95467]:       <nova:flavor name="m1.tiny">
Nov 15 08:15:28 user nova-compute[95467]:         <nova:memory>512</nova:memory>
Nov 15 08:15:28 user nova-compute[95467]:         <nova:disk>1</nova:disk>
Nov 15 08:15:28 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:15:28 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:15:28 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:15:28 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:15:28 user nova-compute[95467]:       <nova:owner>
Nov 15 08:15:28 user nova-compute[95467]:         <nova:user uuid="a5c053bb80724bc2a2e117c9994a92b3">tempest-VolumesActionsTest-1609645107-project-member</nova:user>
Nov 15 08:15:28 user nova-compute[95467]:         <nova:project uuid="c5bcf0714bf348ecb7a99388dcdd98dc">tempest-VolumesActionsTest-1609645107</nova:project>
Nov 15 08:15:28 user nova-compute[95467]:       </nova:owner>
Nov 15 08:15:28 user nova-compute[95467]:       <nova:root type="image" uuid="ed9c48aa-ce73-4b3b-9db1-235898be671b"/>
Nov 15 08:15:28 user nova-compute[95467]:       <nova:ports>
Nov 15 08:15:28 user nova-compute[95467]:         <nova:port uuid="54ecf559-43dd-428e-af76-0966723dbaf6">
Nov 15 08:15:28 user nova-compute[95467]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 08:15:28 user nova-compute[95467]:         </nova:port>
Nov 15 08:15:28 user nova-compute[95467]:       </nova:ports>
Nov 15 08:15:28 user nova-compute[95467]:     </nova:instance>
Nov 15 08:15:28 user nova-compute[95467]:   </metadata>
Nov 15 08:15:28 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:15:28 user nova-compute[95467]:     <system>
Nov 15 08:15:28 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:15:28 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:15:28 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:15:28 user nova-compute[95467]:       <entry name="serial">d5a35226-6b98-44ad-ab4d-e0e86b14ba9d</entry>
Nov 15 08:15:28 user nova-compute[95467]:       <entry name="uuid">d5a35226-6b98-44ad-ab4d-e0e86b14ba9d</entry>
Nov 15 08:15:28 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:15:28 user nova-compute[95467]:     </system>
Nov 15 08:15:28 user nova-compute[95467]:   </sysinfo>
Nov 15 08:15:28 user nova-compute[95467]:   <os>
Nov 15 08:15:28 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:15:28 user nova-compute[95467]:     <boot dev="hd"/>
Nov 15 08:15:28 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:15:28 user nova-compute[95467]:   </os>
Nov 15 08:15:28 user nova-compute[95467]:   <features>
Nov 15 08:15:28 user nova-compute[95467]:     <acpi/>
Nov 15 08:15:28 user nova-compute[95467]:     <apic/>
Nov 15 08:15:28 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:15:28 user nova-compute[95467]:   </features>
Nov 15 08:15:28 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:15:28 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:15:28 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:15:28 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:15:28 user nova-compute[95467]:   </clock>
Nov 15 08:15:28 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:15:28 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:15:28 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:15:28 user nova-compute[95467]:   </cpu>
Nov 15 08:15:28 user nova-compute[95467]:   <devices>
Nov 15 08:15:28 user nova-compute[95467]:     <disk type="file" device="disk">
Nov 15 08:15:28 user nova-compute[95467]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 08:15:28 user nova-compute[95467]:       <source file="/opt/stack/data/nova/instances/d5a35226-6b98-44ad-ab4d-e0e86b14ba9d/disk"/>
Nov 15 08:15:28 user nova-compute[95467]:       <target dev="vda" bus="virtio"/>
Nov 15 08:15:28 user nova-compute[95467]:     </disk>
Nov 15 08:15:28 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:15:28 user nova-compute[95467]:       <mac address="fa:16:3e:a7:15:c9"/>
Nov 15 08:15:28 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:15:28 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:15:28 user nova-compute[95467]:       <target dev="tap54ecf559-43"/>
Nov 15 08:15:28 user nova-compute[95467]:     </interface>
Nov 15 08:15:28 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:15:28 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/d5a35226-6b98-44ad-ab4d-e0e86b14ba9d/console.log" append="off"/>
Nov 15 08:15:28 user nova-compute[95467]:     </serial>
Nov 15 08:15:28 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:15:28 user nova-compute[95467]:     <video>
Nov 15 08:15:28 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:15:28 user nova-compute[95467]:     </video>
Nov 15 08:15:28 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:15:28 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:15:28 user nova-compute[95467]:     </rng>
Nov 15 08:15:28 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:15:28 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:15:28 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:15:28 user nova-compute[95467]:     </memballoon>
Nov 15 08:15:28 user nova-compute[95467]:   </devices>
Nov 15 08:15:28 user nova-compute[95467]: </domain>
Nov 15 08:15:28 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:15:28 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:15:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-543357104',display_name='tempest-VolumesActionsTest-instance-543357104',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-543357104',id=23,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5bcf0714bf348ecb7a99388dcdd98dc',ramdisk_id='',reservation_id='r-n3o00if9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1609645107',owner_user_name='tempest-VolumesActionsTest-1609645107-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:15:26Z,user_data=None,user_id='a5c053bb80724bc2a2e117c9994a92b3',uuid=d5a35226-6b98-44ad-ab4d-e0e86b14ba9d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54ecf559-43dd-428e-af76-0966723dbaf6", "address": "fa:16:3e:a7:15:c9", "network": {"id": "7f71e1f3-188f-4e92-87a3-b1e11c44e727", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2039589401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5bcf0714bf348ecb7a99388dcdd98dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ecf559-43", "ovs_interfaceid": "54ecf559-43dd-428e-af76-0966723dbaf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:15:28 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] Converting VIF {"id": "54ecf559-43dd-428e-af76-0966723dbaf6", "address": "fa:16:3e:a7:15:c9", "network": {"id": "7f71e1f3-188f-4e92-87a3-b1e11c44e727", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2039589401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5bcf0714bf348ecb7a99388dcdd98dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ecf559-43", "ovs_interfaceid": "54ecf559-43dd-428e-af76-0966723dbaf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:15:28 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:15:c9,bridge_name='br-int',has_traffic_filtering=True,id=54ecf559-43dd-428e-af76-0966723dbaf6,network=Network(7f71e1f3-188f-4e92-87a3-b1e11c44e727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54ecf559-43') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:15:28 user nova-compute[95467]: DEBUG os_vif [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:15:c9,bridge_name='br-int',has_traffic_filtering=True,id=54ecf559-43dd-428e-af76-0966723dbaf6,network=Network(7f71e1f3-188f-4e92-87a3-b1e11c44e727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54ecf559-43') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:15:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:15:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:15:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '69269524-4940-52fd-ba56-a1acacb3fec6', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:15:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:15:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap54ecf559-43, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:15:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap54ecf559-43, col_values=(('qos', UUID('794291e0-6e1a-4656-beff-faf15c657bef')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:15:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap54ecf559-43, col_values=(('external_ids', {'iface-id': '54ecf559-43dd-428e-af76-0966723dbaf6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:15:c9', 'vm-uuid': 'd5a35226-6b98-44ad-ab4d-e0e86b14ba9d'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:15:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:15:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:28 user nova-compute[95467]: INFO os_vif [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:15:c9,bridge_name='br-int',has_traffic_filtering=True,id=54ecf559-43dd-428e-af76-0966723dbaf6,network=Network(7f71e1f3-188f-4e92-87a3-b1e11c44e727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54ecf559-43')
Nov 15 08:15:28 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:15:28 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] No VIF found with MAC fa:16:3e:a7:15:c9, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:15:28 user nova-compute[95467]: DEBUG nova.network.neutron [req-780ad4f6-1f30-4d46-8e1c-39ca8685785e req-97953a9f-79f7-409b-975f-3fd3aa636073 service nova] [instance: d5a35226-6b98-44ad-ab4d-e0e86b14ba9d] Updated VIF entry in instance network info cache for port 54ecf559-43dd-428e-af76-0966723dbaf6. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:15:28 user nova-compute[95467]: DEBUG nova.network.neutron [req-780ad4f6-1f30-4d46-8e1c-39ca8685785e req-97953a9f-79f7-409b-975f-3fd3aa636073 service nova] [instance: d5a35226-6b98-44ad-ab4d-e0e86b14ba9d] Updating instance_info_cache with network_info: [{"id": "54ecf559-43dd-428e-af76-0966723dbaf6", "address": "fa:16:3e:a7:15:c9", "network": {"id": "7f71e1f3-188f-4e92-87a3-b1e11c44e727", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2039589401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5bcf0714bf348ecb7a99388dcdd98dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ecf559-43", "ovs_interfaceid": "54ecf559-43dd-428e-af76-0966723dbaf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:15:28 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-780ad4f6-1f30-4d46-8e1c-39ca8685785e req-97953a9f-79f7-409b-975f-3fd3aa636073 service nova] Releasing lock "refresh_cache-d5a35226-6b98-44ad-ab4d-e0e86b14ba9d" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:15:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-038eb4db-2462-4898-91f9-4a14e1feb95c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Acquiring lock "5748cf5d-9c57-4477-8952-ec39d0d18f55" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:15:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-038eb4db-2462-4898-91f9-4a14e1feb95c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "5748cf5d-9c57-4477-8952-ec39d0d18f55" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:15:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-038eb4db-2462-4898-91f9-4a14e1feb95c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Acquiring lock "5748cf5d-9c57-4477-8952-ec39d0d18f55-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:15:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-038eb4db-2462-4898-91f9-4a14e1feb95c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "5748cf5d-9c57-4477-8952-ec39d0d18f55-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:15:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-038eb4db-2462-4898-91f9-4a14e1feb95c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "5748cf5d-9c57-4477-8952-ec39d0d18f55-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:15:29 user nova-compute[95467]: INFO nova.compute.manager [None req-038eb4db-2462-4898-91f9-4a14e1feb95c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] Terminating instance
Nov 15 08:15:29 user nova-compute[95467]: DEBUG nova.compute.manager [None req-038eb4db-2462-4898-91f9-4a14e1feb95c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] Start destroying the instance on the hypervisor. {{(pid=95467) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 08:15:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:29 user nova-compute[95467]: DEBUG nova.compute.manager [req-f2491883-2a58-4906-a4ee-8fb7bc5c20a0 req-6a0361b7-83e7-44d0-91ab-113afe1cd6cb service nova] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Received event network-changed-a30d1fd9-58f1-4efc-8331-ddcaa241fd9b {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:15:29 user nova-compute[95467]: DEBUG nova.compute.manager [req-f2491883-2a58-4906-a4ee-8fb7bc5c20a0 req-6a0361b7-83e7-44d0-91ab-113afe1cd6cb service nova] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Refreshing instance network info cache due to event network-changed-a30d1fd9-58f1-4efc-8331-ddcaa241fd9b. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:15:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-f2491883-2a58-4906-a4ee-8fb7bc5c20a0 req-6a0361b7-83e7-44d0-91ab-113afe1cd6cb service nova] Acquiring lock "refresh_cache-3711c883-ec5f-4a09-88f8-d4c0668ae570" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:15:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-f2491883-2a58-4906-a4ee-8fb7bc5c20a0 req-6a0361b7-83e7-44d0-91ab-113afe1cd6cb service nova] Acquired lock "refresh_cache-3711c883-ec5f-4a09-88f8-d4c0668ae570" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:15:29 user nova-compute[95467]: DEBUG nova.network.neutron [req-f2491883-2a58-4906-a4ee-8fb7bc5c20a0 req-6a0361b7-83e7-44d0-91ab-113afe1cd6cb service nova] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Refreshing network info cache for port a30d1fd9-58f1-4efc-8331-ddcaa241fd9b {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:15:30 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a802d0f8-f85a-4e1f-9068-e3182eaec5df tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Acquiring lock "3711c883-ec5f-4a09-88f8-d4c0668ae570" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:15:30 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a802d0f8-f85a-4e1f-9068-e3182eaec5df tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "3711c883-ec5f-4a09-88f8-d4c0668ae570" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:15:30 user nova-compute[95467]: DEBUG nova.objects.instance [None req-a802d0f8-f85a-4e1f-9068-e3182eaec5df tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lazy-loading 'flavor' on Instance uuid 3711c883-ec5f-4a09-88f8-d4c0668ae570 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:15:30 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a802d0f8-f85a-4e1f-9068-e3182eaec5df tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "3711c883-ec5f-4a09-88f8-d4c0668ae570" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.088s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:15:30 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:30 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:30 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] Instance destroyed successfully.
Nov 15 08:15:30 user nova-compute[95467]: DEBUG nova.objects.instance [None req-038eb4db-2462-4898-91f9-4a14e1feb95c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lazy-loading 'resources' on Instance uuid 5748cf5d-9c57-4477-8952-ec39d0d18f55 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:15:30 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:30 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:30 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-038eb4db-2462-4898-91f9-4a14e1feb95c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:09:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1047071283',display_name='tempest-AttachVolumeNegativeTest-server-1047071283',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1047071283',id=3,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ0p3cr8xQKIlacwsP0Le9zxhWI+xEV5ZTCaTEBT5gz12us8WDTJMZgWcSe6Fyc/NmqFm9TsRD+uPTN2bXx7sKzNBKUvOWTry7Vty4Aom2efjxdGJU2arOxdLNCSuJmytA==',key_name='tempest-keypair-1462846547',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:10:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='50e2fec6a90a41a5a586c6da227caacc',ramdisk_id='',reservation_id='r-dqbpyq5n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1750086293',owner_user_name='tempest-AttachVolumeNegativeTest-1750086293-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:10:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='acce273b07b64e44af6e062175afa92d',uuid=5748cf5d-9c57-4477-8952-ec39d0d18f55,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "015c421f-8bfc-4576-a9cc-bf990e3803ab", "address": "fa:16:3e:e1:8a:d4", "network": {"id": "27fd2b0f-65bd-4ae4-b5c8-dfca91668078", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1310727750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50e2fec6a90a41a5a586c6da227caacc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap015c421f-8b", "ovs_interfaceid": "015c421f-8bfc-4576-a9cc-bf990e3803ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:15:30 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-038eb4db-2462-4898-91f9-4a14e1feb95c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Converting VIF {"id": "015c421f-8bfc-4576-a9cc-bf990e3803ab", "address": "fa:16:3e:e1:8a:d4", "network": {"id": "27fd2b0f-65bd-4ae4-b5c8-dfca91668078", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1310727750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50e2fec6a90a41a5a586c6da227caacc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap015c421f-8b", "ovs_interfaceid": "015c421f-8bfc-4576-a9cc-bf990e3803ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:15:30 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-038eb4db-2462-4898-91f9-4a14e1feb95c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e1:8a:d4,bridge_name='br-int',has_traffic_filtering=True,id=015c421f-8bfc-4576-a9cc-bf990e3803ab,network=Network(27fd2b0f-65bd-4ae4-b5c8-dfca91668078),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap015c421f-8b') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:15:30 user nova-compute[95467]: DEBUG os_vif [None req-038eb4db-2462-4898-91f9-4a14e1feb95c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:8a:d4,bridge_name='br-int',has_traffic_filtering=True,id=015c421f-8bfc-4576-a9cc-bf990e3803ab,network=Network(27fd2b0f-65bd-4ae4-b5c8-dfca91668078),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap015c421f-8b') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:15:30 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:30 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:30 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap015c421f-8b, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:15:30 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a802d0f8-f85a-4e1f-9068-e3182eaec5df tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Acquiring lock "3711c883-ec5f-4a09-88f8-d4c0668ae570" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:15:30 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a802d0f8-f85a-4e1f-9068-e3182eaec5df tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "3711c883-ec5f-4a09-88f8-d4c0668ae570" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:15:30 user nova-compute[95467]: INFO nova.compute.manager [None req-a802d0f8-f85a-4e1f-9068-e3182eaec5df tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Attaching volume 60b831aa-76f1-46c0-9c6c-6f3de448b059 to /dev/vdb
Nov 15 08:15:30 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:15:30 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:30 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:30 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:30 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:30 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cd976560-c81b-4099-9ffd-61651cb61d3b) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:15:30 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:30 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:15:30 user nova-compute[95467]: DEBUG os_brick.utils [None req-a802d0f8-f85a-4e1f-9068-e3182eaec5df tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:15:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:30 user nova-compute[95467]: INFO os_vif [None req-038eb4db-2462-4898-91f9-4a14e1feb95c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:8a:d4,bridge_name='br-int',has_traffic_filtering=True,id=015c421f-8bfc-4576-a9cc-bf990e3803ab,network=Network(27fd2b0f-65bd-4ae4-b5c8-dfca91668078),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap015c421f-8b')
Nov 15 08:15:30 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-038eb4db-2462-4898-91f9-4a14e1feb95c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] Deleting instance files /opt/stack/data/nova/instances/5748cf5d-9c57-4477-8952-ec39d0d18f55_del
Nov 15 08:15:30 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-038eb4db-2462-4898-91f9-4a14e1feb95c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] Deletion of /opt/stack/data/nova/instances/5748cf5d-9c57-4477-8952-ec39d0d18f55_del complete
Nov 15 08:15:30 user nova-compute[95467]: DEBUG nova.network.neutron [req-f2491883-2a58-4906-a4ee-8fb7bc5c20a0 req-6a0361b7-83e7-44d0-91ab-113afe1cd6cb service nova] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Updated VIF entry in instance network info cache for port a30d1fd9-58f1-4efc-8331-ddcaa241fd9b. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:15:30 user nova-compute[95467]: DEBUG nova.network.neutron [req-f2491883-2a58-4906-a4ee-8fb7bc5c20a0 req-6a0361b7-83e7-44d0-91ab-113afe1cd6cb service nova] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Updating instance_info_cache with network_info: [{"id": "a30d1fd9-58f1-4efc-8331-ddcaa241fd9b", "address": "fa:16:3e:bf:61:9e", "network": {"id": "d8a362dc-0dc8-49dd-b2da-0e0749d5edca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-256373617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a1aa4f562c64545a94157d4aaf8d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa30d1fd9-58", "ovs_interfaceid": "a30d1fd9-58f1-4efc-8331-ddcaa241fd9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:15:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:30 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[1714f6dc-c053-4972-96b7-d951b5c5c1c6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:882ae90641f\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:30 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-f2491883-2a58-4906-a4ee-8fb7bc5c20a0 req-6a0361b7-83e7-44d0-91ab-113afe1cd6cb service nova] Releasing lock "refresh_cache-3711c883-ec5f-4a09-88f8-d4c0668ae570" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:15:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:30 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[70dc8254-17da-42b1-8102-6238109bd9cb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:30 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:30 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c54c3c9-c10c-4af3-b160-f6a76117c32f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:30 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f1dd98-89bf-4aed-a665-2462e3bc5ff1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a802d0f8-f85a-4e1f-9068-e3182eaec5df tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Running cmd (subprocess): nvme version {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a802d0f8-f85a-4e1f-9068-e3182eaec5df tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] 'nvme version' failed. Not Retrying. {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:15:30 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a802d0f8-f85a-4e1f-9068-e3182eaec5df tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] nvme not present on system {{(pid=95467) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 08:15:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:30 user nova-compute[95467]: INFO nova.compute.manager [None req-038eb4db-2462-4898-91f9-4a14e1feb95c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] Took 1.07 seconds to destroy the instance on the hypervisor.
Nov 15 08:15:30 user nova-compute[95467]: DEBUG oslo.service.loopingcall [None req-038eb4db-2462-4898-91f9-4a14e1feb95c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=95467) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 08:15:30 user nova-compute[95467]: DEBUG nova.compute.manager [-] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] Deallocating network for instance {{(pid=95467) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 08:15:30 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] deallocate_for_instance() {{(pid=95467) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 08:15:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:15:30 user nova-compute[95467]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 08:15:30 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[15cd3047-bb3b-481f-9502-b6e24e6e0a23]: (4, '') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-a802d0f8-f85a-4e1f-9068-e3182eaec5df tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=95467) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 08:15:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-a802d0f8-f85a-4e1f-9068-e3182eaec5df tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 08:15:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-a802d0f8-f85a-4e1f-9068-e3182eaec5df tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] LIGHTOS: no hostnqn found. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 08:15:30 user nova-compute[95467]: DEBUG os_brick.utils [None req-a802d0f8-f85a-4e1f-9068-e3182eaec5df tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:882ae90641f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:15:30 user nova-compute[95467]: DEBUG nova.virt.block_device [None req-a802d0f8-f85a-4e1f-9068-e3182eaec5df tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Updating existing volume attachment record: 548c7ae8-1a28-4b2d-aa7d-1587a5b2a4d4 {{(pid=95467) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 08:15:31 user nova-compute[95467]: DEBUG nova.compute.manager [req-08c5ee0f-98e5-49b5-8f8f-6ea1a7fb8764 req-c3869cd5-22ee-4883-a78f-3346d13b9e92 service nova] [instance: d5a35226-6b98-44ad-ab4d-e0e86b14ba9d] Received event network-vif-plugged-54ecf559-43dd-428e-af76-0966723dbaf6 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:15:31 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-08c5ee0f-98e5-49b5-8f8f-6ea1a7fb8764 req-c3869cd5-22ee-4883-a78f-3346d13b9e92 service nova] Acquiring lock "d5a35226-6b98-44ad-ab4d-e0e86b14ba9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:15:31 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-08c5ee0f-98e5-49b5-8f8f-6ea1a7fb8764 req-c3869cd5-22ee-4883-a78f-3346d13b9e92 service nova] Lock "d5a35226-6b98-44ad-ab4d-e0e86b14ba9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:15:31 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-08c5ee0f-98e5-49b5-8f8f-6ea1a7fb8764 req-c3869cd5-22ee-4883-a78f-3346d13b9e92 service nova] Lock "d5a35226-6b98-44ad-ab4d-e0e86b14ba9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:15:31 user nova-compute[95467]: DEBUG nova.compute.manager [req-08c5ee0f-98e5-49b5-8f8f-6ea1a7fb8764 req-c3869cd5-22ee-4883-a78f-3346d13b9e92 service nova] [instance: d5a35226-6b98-44ad-ab4d-e0e86b14ba9d] No waiting events found dispatching network-vif-plugged-54ecf559-43dd-428e-af76-0966723dbaf6 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:15:31 user nova-compute[95467]: WARNING nova.compute.manager [req-08c5ee0f-98e5-49b5-8f8f-6ea1a7fb8764 req-c3869cd5-22ee-4883-a78f-3346d13b9e92 service nova] [instance: d5a35226-6b98-44ad-ab4d-e0e86b14ba9d] Received unexpected event network-vif-plugged-54ecf559-43dd-428e-af76-0966723dbaf6 for instance with vm_state building and task_state spawning.
Nov 15 08:15:31 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:15:31 user nova-compute[95467]: INFO nova.compute.manager [-] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] Took 0.69 seconds to deallocate network for instance.
Nov 15 08:15:31 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-038eb4db-2462-4898-91f9-4a14e1feb95c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:15:31 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-038eb4db-2462-4898-91f9-4a14e1feb95c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:15:31 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:15:31 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-038eb4db-2462-4898-91f9-4a14e1feb95c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:15:31 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-038eb4db-2462-4898-91f9-4a14e1feb95c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:15:31 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-038eb4db-2462-4898-91f9-4a14e1feb95c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.412s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:15:31 user nova-compute[95467]: DEBUG nova.compute.manager [req-bb3fa6ea-d5e1-44ca-a204-462ddc35d8b0 req-d6e85a10-0687-49ec-a316-8da46eead775 service nova] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] Received event network-vif-unplugged-015c421f-8bfc-4576-a9cc-bf990e3803ab {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:15:31 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-bb3fa6ea-d5e1-44ca-a204-462ddc35d8b0 req-d6e85a10-0687-49ec-a316-8da46eead775 service nova] Acquiring lock "5748cf5d-9c57-4477-8952-ec39d0d18f55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:15:31 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-bb3fa6ea-d5e1-44ca-a204-462ddc35d8b0 req-d6e85a10-0687-49ec-a316-8da46eead775 service nova] Lock "5748cf5d-9c57-4477-8952-ec39d0d18f55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:15:31 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-bb3fa6ea-d5e1-44ca-a204-462ddc35d8b0 req-d6e85a10-0687-49ec-a316-8da46eead775 service nova] Lock "5748cf5d-9c57-4477-8952-ec39d0d18f55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:15:31 user nova-compute[95467]: DEBUG nova.compute.manager [req-bb3fa6ea-d5e1-44ca-a204-462ddc35d8b0 req-d6e85a10-0687-49ec-a316-8da46eead775 service nova] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] No waiting events found dispatching network-vif-unplugged-015c421f-8bfc-4576-a9cc-bf990e3803ab {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:15:31 user nova-compute[95467]: WARNING nova.compute.manager [req-bb3fa6ea-d5e1-44ca-a204-462ddc35d8b0 req-d6e85a10-0687-49ec-a316-8da46eead775 service nova] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] Received unexpected event network-vif-unplugged-015c421f-8bfc-4576-a9cc-bf990e3803ab for instance with vm_state deleted and task_state None.
Nov 15 08:15:31 user nova-compute[95467]: DEBUG nova.compute.manager [req-bb3fa6ea-d5e1-44ca-a204-462ddc35d8b0 req-d6e85a10-0687-49ec-a316-8da46eead775 service nova] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] Received event network-vif-plugged-015c421f-8bfc-4576-a9cc-bf990e3803ab {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:15:31 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-bb3fa6ea-d5e1-44ca-a204-462ddc35d8b0 req-d6e85a10-0687-49ec-a316-8da46eead775 service nova] Acquiring lock "5748cf5d-9c57-4477-8952-ec39d0d18f55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:15:31 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-bb3fa6ea-d5e1-44ca-a204-462ddc35d8b0 req-d6e85a10-0687-49ec-a316-8da46eead775 service nova] Lock "5748cf5d-9c57-4477-8952-ec39d0d18f55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:15:31 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-bb3fa6ea-d5e1-44ca-a204-462ddc35d8b0 req-d6e85a10-0687-49ec-a316-8da46eead775 service nova] Lock "5748cf5d-9c57-4477-8952-ec39d0d18f55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:15:31 user nova-compute[95467]: DEBUG nova.compute.manager [req-bb3fa6ea-d5e1-44ca-a204-462ddc35d8b0 req-d6e85a10-0687-49ec-a316-8da46eead775 service nova] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] No waiting events found dispatching network-vif-plugged-015c421f-8bfc-4576-a9cc-bf990e3803ab {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:15:31 user nova-compute[95467]: WARNING nova.compute.manager [req-bb3fa6ea-d5e1-44ca-a204-462ddc35d8b0 req-d6e85a10-0687-49ec-a316-8da46eead775 service nova] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] Received unexpected event network-vif-plugged-015c421f-8bfc-4576-a9cc-bf990e3803ab for instance with vm_state deleted and task_state None.
Nov 15 08:15:31 user nova-compute[95467]: DEBUG nova.compute.manager [req-bb3fa6ea-d5e1-44ca-a204-462ddc35d8b0 req-d6e85a10-0687-49ec-a316-8da46eead775 service nova] [instance: 5748cf5d-9c57-4477-8952-ec39d0d18f55] Received event network-vif-deleted-015c421f-8bfc-4576-a9cc-bf990e3803ab {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:15:31 user nova-compute[95467]: INFO nova.scheduler.client.report [None req-038eb4db-2462-4898-91f9-4a14e1feb95c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Deleted allocations for instance 5748cf5d-9c57-4477-8952-ec39d0d18f55
Nov 15 08:15:31 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-038eb4db-2462-4898-91f9-4a14e1feb95c tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "5748cf5d-9c57-4477-8952-ec39d0d18f55" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.372s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:15:32 user nova-compute[95467]: DEBUG nova.compute.manager [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] [instance: d5a35226-6b98-44ad-ab4d-e0e86b14ba9d] Instance event wait completed in 0 seconds for  {{(pid=95467) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 08:15:32 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] [instance: d5a35226-6b98-44ad-ab4d-e0e86b14ba9d] Guest created on hypervisor {{(pid=95467) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 08:15:32 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: d5a35226-6b98-44ad-ab4d-e0e86b14ba9d] Instance spawned successfully.
Nov 15 08:15:32 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] [instance: d5a35226-6b98-44ad-ab4d-e0e86b14ba9d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 08:15:32 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] [instance: d5a35226-6b98-44ad-ab4d-e0e86b14ba9d] Found default for hw_cdrom_bus of ide {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:15:32 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] [instance: d5a35226-6b98-44ad-ab4d-e0e86b14ba9d] Found default for hw_disk_bus of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:15:32 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] [instance: d5a35226-6b98-44ad-ab4d-e0e86b14ba9d] Found default for hw_input_bus of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:15:32 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] [instance: d5a35226-6b98-44ad-ab4d-e0e86b14ba9d] Found default for hw_pointer_model of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:15:32 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] [instance: d5a35226-6b98-44ad-ab4d-e0e86b14ba9d] Found default for hw_video_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:15:32 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] [instance: d5a35226-6b98-44ad-ab4d-e0e86b14ba9d] Found default for hw_vif_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:15:32 user nova-compute[95467]: INFO nova.compute.manager [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] [instance: d5a35226-6b98-44ad-ab4d-e0e86b14ba9d] Took 6.33 seconds to spawn the instance on the hypervisor.
Nov 15 08:15:32 user nova-compute[95467]: DEBUG nova.compute.manager [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] [instance: d5a35226-6b98-44ad-ab4d-e0e86b14ba9d] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:15:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:32 user nova-compute[95467]: INFO nova.compute.manager [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] [instance: d5a35226-6b98-44ad-ab4d-e0e86b14ba9d] Took 7.23 seconds to build instance.
Nov 15 08:15:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f9869d28-1041-4fa1-a7f5-5b6faab1402c tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] Lock "d5a35226-6b98-44ad-ab4d-e0e86b14ba9d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.373s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:15:33 user nova-compute[95467]: DEBUG nova.compute.manager [req-8a9dc6ba-dda7-4536-bf26-c1f8963ac85c req-bc4db497-1212-4b41-9ffe-c0b029e23f19 service nova] [instance: d5a35226-6b98-44ad-ab4d-e0e86b14ba9d] Received event network-vif-plugged-54ecf559-43dd-428e-af76-0966723dbaf6 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:15:33 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-8a9dc6ba-dda7-4536-bf26-c1f8963ac85c req-bc4db497-1212-4b41-9ffe-c0b029e23f19 service nova] Acquiring lock "d5a35226-6b98-44ad-ab4d-e0e86b14ba9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:15:33 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-8a9dc6ba-dda7-4536-bf26-c1f8963ac85c req-bc4db497-1212-4b41-9ffe-c0b029e23f19 service nova] Lock "d5a35226-6b98-44ad-ab4d-e0e86b14ba9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:15:33 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-8a9dc6ba-dda7-4536-bf26-c1f8963ac85c req-bc4db497-1212-4b41-9ffe-c0b029e23f19 service nova] Lock "d5a35226-6b98-44ad-ab4d-e0e86b14ba9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:15:33 user nova-compute[95467]: DEBUG nova.compute.manager [req-8a9dc6ba-dda7-4536-bf26-c1f8963ac85c req-bc4db497-1212-4b41-9ffe-c0b029e23f19 service nova] [instance: d5a35226-6b98-44ad-ab4d-e0e86b14ba9d] No waiting events found dispatching network-vif-plugged-54ecf559-43dd-428e-af76-0966723dbaf6 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:15:33 user nova-compute[95467]: WARNING nova.compute.manager [req-8a9dc6ba-dda7-4536-bf26-c1f8963ac85c req-bc4db497-1212-4b41-9ffe-c0b029e23f19 service nova] [instance: d5a35226-6b98-44ad-ab4d-e0e86b14ba9d] Received unexpected event network-vif-plugged-54ecf559-43dd-428e-af76-0966723dbaf6 for instance with vm_state active and task_state None.
Nov 15 08:15:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-47df27f6-73f6-4e94-bfe0-d6ebfe89ff74 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Acquiring lock "36dccf43-d4a3-47aa-bd73-de9646e1020c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:15:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-47df27f6-73f6-4e94-bfe0-d6ebfe89ff74 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "36dccf43-d4a3-47aa-bd73-de9646e1020c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:15:34 user nova-compute[95467]: INFO nova.compute.manager [None req-47df27f6-73f6-4e94-bfe0-d6ebfe89ff74 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Detaching volume cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77
Nov 15 08:15:34 user nova-compute[95467]: INFO nova.virt.block_device [None req-47df27f6-73f6-4e94-bfe0-d6ebfe89ff74 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Attempting to driver detach volume cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77 from mountpoint /dev/vdc
Nov 15 08:15:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-47df27f6-73f6-4e94-bfe0-d6ebfe89ff74 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Attempting to detach device vdc from instance 36dccf43-d4a3-47aa-bd73-de9646e1020c from the persistent domain config. {{(pid=95467) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 08:15:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-47df27f6-73f6-4e94-bfe0-d6ebfe89ff74 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 08:15:34 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:15:34 user nova-compute[95467]:   <source dev="/dev/sdb"/>
Nov 15 08:15:34 user nova-compute[95467]:   <target dev="vdc" bus="virtio"/>
Nov 15 08:15:34 user nova-compute[95467]:   <serial>cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77</serial>
Nov 15 08:15:34 user nova-compute[95467]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 08:15:34 user nova-compute[95467]: </disk>
Nov 15 08:15:34 user nova-compute[95467]:  {{(pid=95467) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 08:15:34 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-47df27f6-73f6-4e94-bfe0-d6ebfe89ff74 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Successfully detached device vdc from instance 36dccf43-d4a3-47aa-bd73-de9646e1020c from the persistent domain config.
Nov 15 08:15:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-47df27f6-73f6-4e94-bfe0-d6ebfe89ff74 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 36dccf43-d4a3-47aa-bd73-de9646e1020c from the live domain config. {{(pid=95467) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 08:15:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-47df27f6-73f6-4e94-bfe0-d6ebfe89ff74 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 08:15:34 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:15:34 user nova-compute[95467]:   <source dev="/dev/sdb"/>
Nov 15 08:15:34 user nova-compute[95467]:   <target dev="vdc" bus="virtio"/>
Nov 15 08:15:34 user nova-compute[95467]:   <serial>cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77</serial>
Nov 15 08:15:34 user nova-compute[95467]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 08:15:34 user nova-compute[95467]: </disk>
Nov 15 08:15:34 user nova-compute[95467]:  {{(pid=95467) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 08:15:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-47df27f6-73f6-4e94-bfe0-d6ebfe89ff74 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 36dccf43-d4a3-47aa-bd73-de9646e1020c {{(pid=95467) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 08:15:35 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:35 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a802d0f8-f85a-4e1f-9068-e3182eaec5df tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Calling os-brick to attach iSCSI Volume {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 08:15:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a802d0f8-f85a-4e1f-9068-e3182eaec5df tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FrEomLTX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:15:35 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-a802d0f8-f85a-4e1f-9068-e3182eaec5df tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:15:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-a802d0f8-f85a-4e1f-9068-e3182eaec5df tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:15:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-a802d0f8-f85a-4e1f-9068-e3182eaec5df tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:15:35 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-a802d0f8-f85a-4e1f-9068-e3182eaec5df tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:15:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-a802d0f8-f85a-4e1f-9068-e3182eaec5df tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:15:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-a802d0f8-f85a-4e1f-9068-e3182eaec5df tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:15:35 user nova-compute[95467]: INFO os_brick.initiator.connectors.iscsi [None req-a802d0f8-f85a-4e1f-9068-e3182eaec5df tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 08:15:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 -p 172.16.0.220:3260 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:35 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb7e2b1-5ae8-444b-aefc-28e01101455c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a802d0f8-f85a-4e1f-9068-e3182eaec5df tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 08:15:35 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:15:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 -p 172.16.0.220:3260 --interface default --op new {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:35 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dbfb06a-d42c-430b-b26c-9ff98a2b10f8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059] added\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a802d0f8-f85a-4e1f-9068-e3182eaec5df tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059] added
Nov 15 08:15:35 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:15:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:35 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c55927-341e-4241-9106-a31aa99d4b2a]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a802d0f8-f85a-4e1f-9068-e3182eaec5df tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:15:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:35 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f780836b-e652-4912-9a18-94240517ed32]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a802d0f8-f85a-4e1f-9068-e3182eaec5df tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:15:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FrEomLTX {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FrEomLTX" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:35 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8842d25-1b03-4bc9-bed5-eb3d8465b2ff]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a802d0f8-f85a-4e1f-9068-e3182eaec5df tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FrEomLTX'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:15:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:35 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[52643f61-32df-496e-9746-6c83dd9b602c]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a802d0f8-f85a-4e1f-9068-e3182eaec5df tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:15:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:35 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff44d772-fcc8-4d99-8f43-27ca2f21a653]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a802d0f8-f85a-4e1f-9068-e3182eaec5df tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77 (non-flash)
Nov 15 08:15:35 user nova-compute[95467]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4 (non-flash)
Nov 15 08:15:35 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:15:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a802d0f8-f85a-4e1f-9068-e3182eaec5df tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77 (non-flash)
Nov 15 08:15:35 user nova-compute[95467]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4 (non-flash)
Nov 15 08:15:35 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:15:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 -p 172.16.0.220:3260 --login {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:35 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d771ce-3423-4209-a5db-b04db2251cfa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a802d0f8-f85a-4e1f-9068-e3182eaec5df tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059, portal: 172.16.0.220,3260]
Nov 15 08:15:35 user nova-compute[95467]: Login to [iface: default, target: iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059, portal: 172.16.0.220,3260] successful.
Nov 15 08:15:35 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:15:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:36 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb08b062-8619-4c0e-a569-2ffa677f4395]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:36 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a802d0f8-f85a-4e1f-9068-e3182eaec5df tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:15:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:36 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[734bc901-ab00-493f-b46b-3bf93859e515]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:36 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a802d0f8-f85a-4e1f-9068-e3182eaec5df tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77 (non-flash)
Nov 15 08:15:36 user nova-compute[95467]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4 (non-flash)
Nov 15 08:15:36 user nova-compute[95467]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 (non-flash)
Nov 15 08:15:36 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:15:36 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a802d0f8-f85a-4e1f-9068-e3182eaec5df tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77 (non-flash)
Nov 15 08:15:36 user nova-compute[95467]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4 (non-flash)
Nov 15 08:15:36 user nova-compute[95467]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 (non-flash)
Nov 15 08:15:36 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:15:36 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-a802d0f8-f85a-4e1f-9068-e3182eaec5df tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:15:36 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a802d0f8-f85a-4e1f-9068-e3182eaec5df tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Connected to 172.16.0.220:3260 {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 08:15:36 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-a802d0f8-f85a-4e1f-9068-e3182eaec5df tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] HCTL ('35', '-', '-', 0) found on session 18 with lun 0 {{(pid=95467) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 08:15:36 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-a802d0f8-f85a-4e1f-9068-e3182eaec5df tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=95467) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 08:15:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:36 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f22788-4e61-4f3e-a6ba-d84f4542f71b]: (4, ('- - 0', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:36 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-a802d0f8-f85a-4e1f-9068-e3182eaec5df tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Searching for a device in session 18 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:15:36 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a802d0f8-f85a-4e1f-9068-e3182eaec5df tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FrEomLTX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 08:15:36 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:15:36 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=95467) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 08:15:36 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:15:36 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Cleaning up deleted instances {{(pid=95467) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 08:15:36 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] There are 0 instances to clean {{(pid=95467) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 08:15:36 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:15:36 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Cleaning up deleted instances with incomplete migration  {{(pid=95467) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 08:15:36 user nova-compute[95467]: DEBUG nova.compute.manager [req-e48af8fe-bd08-4710-bafe-3b9364e7d626 req-9abd1c24-5756-4fea-8f0d-52cd6bba61af service nova] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Received event network-changed-eea925f5-c956-40d3-99a5-b45573318378 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:15:36 user nova-compute[95467]: DEBUG nova.compute.manager [req-e48af8fe-bd08-4710-bafe-3b9364e7d626 req-9abd1c24-5756-4fea-8f0d-52cd6bba61af service nova] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Refreshing instance network info cache due to event network-changed-eea925f5-c956-40d3-99a5-b45573318378. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:15:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-e48af8fe-bd08-4710-bafe-3b9364e7d626 req-9abd1c24-5756-4fea-8f0d-52cd6bba61af service nova] Acquiring lock "refresh_cache-bee31898-4f12-4c68-a18b-a678f9f584aa" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:15:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-e48af8fe-bd08-4710-bafe-3b9364e7d626 req-9abd1c24-5756-4fea-8f0d-52cd6bba61af service nova] Acquired lock "refresh_cache-bee31898-4f12-4c68-a18b-a678f9f584aa" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:15:36 user nova-compute[95467]: DEBUG nova.network.neutron [req-e48af8fe-bd08-4710-bafe-3b9364e7d626 req-9abd1c24-5756-4fea-8f0d-52cd6bba61af service nova] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Refreshing network info cache for port eea925f5-c956-40d3-99a5-b45573318378 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:15:37 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-a802d0f8-f85a-4e1f-9068-e3182eaec5df tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:15:37 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a802d0f8-f85a-4e1f-9068-e3182eaec5df tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '23962373264653163', 'path': '/dev/sdd'} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:15:37 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a802d0f8-f85a-4e1f-9068-e3182eaec5df tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962373264653163', 'path': '/dev/sdd'} {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 08:15:37 user nova-compute[95467]: DEBUG nova.objects.instance [None req-a802d0f8-f85a-4e1f-9068-e3182eaec5df tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lazy-loading 'flavor' on Instance uuid 3711c883-ec5f-4a09-88f8-d4c0668ae570 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:15:37 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-a802d0f8-f85a-4e1f-9068-e3182eaec5df tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 08:15:37 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:15:37 user nova-compute[95467]:   <source dev="/dev/sdd"/>
Nov 15 08:15:37 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:15:37 user nova-compute[95467]:   <serial>60b831aa-76f1-46c0-9c6c-6f3de448b059</serial>
Nov 15 08:15:37 user nova-compute[95467]: </disk>
Nov 15 08:15:37 user nova-compute[95467]:  {{(pid=95467) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 08:15:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:37 user nova-compute[95467]: DEBUG nova.network.neutron [req-e48af8fe-bd08-4710-bafe-3b9364e7d626 req-9abd1c24-5756-4fea-8f0d-52cd6bba61af service nova] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Updated VIF entry in instance network info cache for port eea925f5-c956-40d3-99a5-b45573318378. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:15:37 user nova-compute[95467]: DEBUG nova.network.neutron [req-e48af8fe-bd08-4710-bafe-3b9364e7d626 req-9abd1c24-5756-4fea-8f0d-52cd6bba61af service nova] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Updating instance_info_cache with network_info: [{"id": "eea925f5-c956-40d3-99a5-b45573318378", "address": "fa:16:3e:b4:e9:ab", "network": {"id": "dcbc2304-8d20-4589-b81e-a75a22ef7114", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-333949369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6f7599b8526444a8276cac35f0a1500", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeea925f5-c9", "ovs_interfaceid": "eea925f5-c956-40d3-99a5-b45573318378", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:15:37 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-e48af8fe-bd08-4710-bafe-3b9364e7d626 req-9abd1c24-5756-4fea-8f0d-52cd6bba61af service nova] Releasing lock "refresh_cache-bee31898-4f12-4c68-a18b-a678f9f584aa" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:15:37 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:15:37 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a802d0f8-f85a-4e1f-9068-e3182eaec5df tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:15:37 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a802d0f8-f85a-4e1f-9068-e3182eaec5df tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] No BDM found with device name vdb, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:15:37 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a802d0f8-f85a-4e1f-9068-e3182eaec5df tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] No VIF found with MAC fa:16:3e:bf:61:9e, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:15:37 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a802d0f8-f85a-4e1f-9068-e3182eaec5df tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "3711c883-ec5f-4a09-88f8-d4c0668ae570" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.586s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:15:38 user nova-compute[95467]: DEBUG nova.compute.manager [None req-4f7af5c9-5039-45e0-86b4-56a139279f84 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:15:38 user nova-compute[95467]: INFO nova.compute.manager [None req-4f7af5c9-5039-45e0-86b4-56a139279f84 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] instance snapshotting
Nov 15 08:15:38 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-4f7af5c9-5039-45e0-86b4-56a139279f84 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Beginning live snapshot process
Nov 15 08:15:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-4f7af5c9-5039-45e0-86b4-56a139279f84 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bee31898-4f12-4c68-a18b-a678f9f584aa/disk --force-share --output=json -f qcow2 {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:38 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:15:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-4f7af5c9-5039-45e0-86b4-56a139279f84 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bee31898-4f12-4c68-a18b-a678f9f584aa/disk --force-share --output=json -f qcow2" returned: 0 in 0.207s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-4f7af5c9-5039-45e0-86b4-56a139279f84 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bee31898-4f12-4c68-a18b-a678f9f584aa/disk --force-share --output=json -f qcow2 {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-4f7af5c9-5039-45e0-86b4-56a139279f84 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bee31898-4f12-4c68-a18b-a678f9f584aa/disk --force-share --output=json -f qcow2" returned: 0 in 0.187s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-4f7af5c9-5039-45e0-86b4-56a139279f84 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:39 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-4f7af5c9-5039-45e0-86b4-56a139279f84 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.193s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:39 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-4f7af5c9-5039-45e0-86b4-56a139279f84 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp0_3of9rj/21a26131f59844ec81d8908c91d84473.delta 1073741824 {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:39 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-4f7af5c9-5039-45e0-86b4-56a139279f84 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp0_3of9rj/21a26131f59844ec81d8908c91d84473.delta 1073741824" returned: 0 in 0.050s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:39 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-4f7af5c9-5039-45e0-86b4-56a139279f84 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 15 08:15:39 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:15:39 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-4f7af5c9-5039-45e0-86b4-56a139279f84 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=95467) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 08:15:39 user nova-compute[95467]: INFO nova.compute.manager [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Rebuilding instance
Nov 15 08:15:40 user nova-compute[95467]: DEBUG nova.compute.manager [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:15:40 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-4f7af5c9-5039-45e0-86b4-56a139279f84 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] COPY block job progress, current cursor: 19070976 final cursor: 75497472 {{(pid=95467) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 08:15:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:40 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager.update_available_resource {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:15:40 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:15:40 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:15:40 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:15:40 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Auditing locally available compute resources for user (node: user) {{(pid=95467) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 08:15:40 user nova-compute[95467]: DEBUG nova.compute.manager [req-2b3a612a-364a-4f7d-b1cc-57a8ef1a2ea1 req-567ae53a-c4de-436b-9af4-29b0c4355e23 service nova] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Received event network-vif-unplugged-a30d1fd9-58f1-4efc-8331-ddcaa241fd9b {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:15:40 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-2b3a612a-364a-4f7d-b1cc-57a8ef1a2ea1 req-567ae53a-c4de-436b-9af4-29b0c4355e23 service nova] Acquiring lock "3711c883-ec5f-4a09-88f8-d4c0668ae570-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:15:40 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-2b3a612a-364a-4f7d-b1cc-57a8ef1a2ea1 req-567ae53a-c4de-436b-9af4-29b0c4355e23 service nova] Lock "3711c883-ec5f-4a09-88f8-d4c0668ae570-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:15:40 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-2b3a612a-364a-4f7d-b1cc-57a8ef1a2ea1 req-567ae53a-c4de-436b-9af4-29b0c4355e23 service nova] Lock "3711c883-ec5f-4a09-88f8-d4c0668ae570-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:15:40 user nova-compute[95467]: DEBUG nova.compute.manager [req-2b3a612a-364a-4f7d-b1cc-57a8ef1a2ea1 req-567ae53a-c4de-436b-9af4-29b0c4355e23 service nova] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] No waiting events found dispatching network-vif-unplugged-a30d1fd9-58f1-4efc-8331-ddcaa241fd9b {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:15:40 user nova-compute[95467]: WARNING nova.compute.manager [req-2b3a612a-364a-4f7d-b1cc-57a8ef1a2ea1 req-567ae53a-c4de-436b-9af4-29b0c4355e23 service nova] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Received unexpected event network-vif-unplugged-a30d1fd9-58f1-4efc-8331-ddcaa241fd9b for instance with vm_state active and task_state rebuilding.
Nov 15 08:15:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:40 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-4f7af5c9-5039-45e0-86b4-56a139279f84 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=95467) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 08:15:40 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-4f7af5c9-5039-45e0-86b4-56a139279f84 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 15 08:15:41 user nova-compute[95467]: DEBUG nova.privsep.utils [None req-4f7af5c9-5039-45e0-86b4-56a139279f84 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=95467) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 08:15:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-4f7af5c9-5039-45e0-86b4-56a139279f84 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp0_3of9rj/21a26131f59844ec81d8908c91d84473.delta /opt/stack/data/nova/instances/snapshots/tmp0_3of9rj/21a26131f59844ec81d8908c91d84473 {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:41 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Instance destroyed successfully.
Nov 15 08:15:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:41 user nova-compute[95467]: INFO nova.compute.manager [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Detaching volume 60b831aa-76f1-46c0-9c6c-6f3de448b059
Nov 15 08:15:41 user nova-compute[95467]: INFO nova.virt.block_device [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Attempting to driver detach volume 60b831aa-76f1-46c0-9c6c-6f3de448b059 from mountpoint /dev/vdb
Nov 15 08:15:41 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Attempting to detach device vdb from instance 3711c883-ec5f-4a09-88f8-d4c0668ae570 from the persistent domain config. {{(pid=95467) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 08:15:41 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 08:15:41 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:15:41 user nova-compute[95467]:   <source dev="/dev/sdd"/>
Nov 15 08:15:41 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:15:41 user nova-compute[95467]:   <serial>60b831aa-76f1-46c0-9c6c-6f3de448b059</serial>
Nov 15 08:15:41 user nova-compute[95467]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 08:15:41 user nova-compute[95467]: </disk>
Nov 15 08:15:41 user nova-compute[95467]:  {{(pid=95467) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 08:15:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:41 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Successfully detached device vdb from instance 3711c883-ec5f-4a09-88f8-d4c0668ae570 from the persistent domain config.
Nov 15 08:15:41 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] calling os-brick to detach iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 08:15:41 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, {'target_iqn': 'iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FrEomLTX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:15:41 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 08:15:41 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:15:41 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:15:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:41 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[443e8420-506c-46da-8d99-df11c5882b77]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:41 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 08:15:41 user nova-compute[95467]: No targets found.
Nov 15 08:15:41 user nova-compute[95467]: iSNS:
Nov 15 08:15:41 user nova-compute[95467]: No targets found.
Nov 15 08:15:41 user nova-compute[95467]: STATIC:
Nov 15 08:15:41 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059
Nov 15 08:15:41 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:15:41 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:15:41 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4
Nov 15 08:15:41 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:15:41 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:15:41 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77
Nov 15 08:15:41 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:15:41 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:15:41 user nova-compute[95467]: FIRMWARE:
Nov 15 08:15:41 user nova-compute[95467]: No targets found.
Nov 15 08:15:41 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:15:41 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 08:15:41 user nova-compute[95467]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 08:15:41 user nova-compute[95467]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=95467) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 08:15:41 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059', 0)] {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 08:15:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:41 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[979596ef-a25f-487a-9f84-f38d0152a8f8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:41 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4a573a-742c-41ff-8488-fd971e0c64a9]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:41 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77 (non-flash)
Nov 15 08:15:41 user nova-compute[95467]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4 (non-flash)
Nov 15 08:15:41 user nova-compute[95467]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 (non-flash)
Nov 15 08:15:41 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:15:41 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77 (non-flash)
Nov 15 08:15:41 user nova-compute[95467]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4 (non-flash)
Nov 15 08:15:41 user nova-compute[95467]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 (non-flash)
Nov 15 08:15:41 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:15:41 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efec8348820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059'): ({'sdd'}, set())}) {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 08:15:41 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Removing single pathed devices sdd {{(pid=95467) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 08:15:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-4f7af5c9-5039-45e0-86b4-56a139279f84 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp0_3of9rj/21a26131f59844ec81d8908c91d84473.delta /opt/stack/data/nova/instances/snapshots/tmp0_3of9rj/21a26131f59844ec81d8908c91d84473" returned: 0 in 0.637s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:41 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-4f7af5c9-5039-45e0-86b4-56a139279f84 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Snapshot extracted, beginning image upload
Nov 15 08:15:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:41 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d8654d-b8fa-49a0-8b9c-5e95240d3042]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:41 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8787195f-f36b-474b-aa92-3070b210c3a7]: (4, ('ok\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:41 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Flushing IO for device /dev/sdd {{(pid=95467) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 08:15:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68264a44-5adf-4873-b380-26bcafe2ba04/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:41 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[445552f7-1ce4-4283-8983-3ee59477a889]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:41 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=95467) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 08:15:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.060s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:41 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a3b391-db2c-4023-a439-f7e9ad84f958]: (4, ('1', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:41 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 08:15:41 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] SCSI volumes sdd have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 08:15:41 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059')] {{(pid=95467) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 08:15:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:42 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d286fee1-13f3-4316-828c-e97254556cde]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:15:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 -p 172.16.0.220:3260 --logout {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68264a44-5adf-4873-b380-26bcafe2ba04/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68264a44-5adf-4873-b380-26bcafe2ba04/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:42 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade86370-aa59-4e87-8f09-63af779b1b18]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059, portal: 172.16.0.220,3260]
Nov 15 08:15:42 user nova-compute[95467]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059, portal: 172.16.0.220,3260] successful.
Nov 15 08:15:42 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:15:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 -p 172.16.0.220:3260 --op delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:42 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[91051f44-16f3-4d4a-b936-b0e9f5a56662]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:15:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.415s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:15:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] <== disconnect_volume: return (419ms) None {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:15:42 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Disconnected iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 08:15:42 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68264a44-5adf-4873-b380-26bcafe2ba04/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:42 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7b85e658-0cc1-4098-8831-a7574f984647 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Acquiring lock "abdf29d1-f80e-48c8-8c09-d7c9c0326833" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:15:42 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7b85e658-0cc1-4098-8831-a7574f984647 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "abdf29d1-f80e-48c8-8c09-d7c9c0326833" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:15:42 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7b85e658-0cc1-4098-8831-a7574f984647 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Acquiring lock "abdf29d1-f80e-48c8-8c09-d7c9c0326833-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:15:42 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7b85e658-0cc1-4098-8831-a7574f984647 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "abdf29d1-f80e-48c8-8c09-d7c9c0326833-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:15:42 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7b85e658-0cc1-4098-8831-a7574f984647 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "abdf29d1-f80e-48c8-8c09-d7c9c0326833-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:15:42 user nova-compute[95467]: INFO nova.compute.manager [None req-7b85e658-0cc1-4098-8831-a7574f984647 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] Terminating instance
Nov 15 08:15:42 user nova-compute[95467]: DEBUG nova.compute.manager [None req-7b85e658-0cc1-4098-8831-a7574f984647 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] Start destroying the instance on the hypervisor. {{(pid=95467) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 08:15:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bee31898-4f12-4c68-a18b-a678f9f584aa/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:42 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:42 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:42 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:42 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:42 user nova-compute[95467]: DEBUG nova.compute.manager [req-620a2439-b43b-40df-a7c7-a497dad9bc03 req-c7023610-1aa2-436b-86c3-63fc729060de service nova] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Received event network-vif-plugged-a30d1fd9-58f1-4efc-8331-ddcaa241fd9b {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:15:42 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-620a2439-b43b-40df-a7c7-a497dad9bc03 req-c7023610-1aa2-436b-86c3-63fc729060de service nova] Acquiring lock "3711c883-ec5f-4a09-88f8-d4c0668ae570-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:15:42 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-620a2439-b43b-40df-a7c7-a497dad9bc03 req-c7023610-1aa2-436b-86c3-63fc729060de service nova] Lock "3711c883-ec5f-4a09-88f8-d4c0668ae570-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:15:42 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-620a2439-b43b-40df-a7c7-a497dad9bc03 req-c7023610-1aa2-436b-86c3-63fc729060de service nova] Lock "3711c883-ec5f-4a09-88f8-d4c0668ae570-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:15:42 user nova-compute[95467]: DEBUG nova.compute.manager [req-620a2439-b43b-40df-a7c7-a497dad9bc03 req-c7023610-1aa2-436b-86c3-63fc729060de service nova] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] No waiting events found dispatching network-vif-plugged-a30d1fd9-58f1-4efc-8331-ddcaa241fd9b {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:15:42 user nova-compute[95467]: WARNING nova.compute.manager [req-620a2439-b43b-40df-a7c7-a497dad9bc03 req-c7023610-1aa2-436b-86c3-63fc729060de service nova] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Received unexpected event network-vif-plugged-a30d1fd9-58f1-4efc-8331-ddcaa241fd9b for instance with vm_state active and task_state rebuilding.
Nov 15 08:15:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bee31898-4f12-4c68-a18b-a678f9f584aa/disk --force-share --output=json" returned: 0 in 0.294s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bee31898-4f12-4c68-a18b-a678f9f584aa/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:43 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Instance destroyed successfully.
Nov 15 08:15:43 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:13:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-687199955',display_name='tempest-ServerActionsTestOtherA-server-94598860',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-687199955',id=17,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCNocaX54qCPZAA9ULAdwlEWPInJDPNBSZ9W8AQmBrWmivIiKz/S0iGFfDxJElLCR+9ambdrPTd00JJrCoxQkWwaJ0sGcUaHDPo10f7hFEQSvZGXEdlnJ7SNY9krWZQ+oQ==',key_name='tempest-keypair-1527809969',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:13:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0a1aa4f562c64545a94157d4aaf8d14e',ramdisk_id='',reservation_id='r-nbpm0erc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-937420730',owner_user_name='tempest-ServerActionsTestOtherA-937420730-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:15:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d9b34339b404facac21f500f40b1686',uuid=3711c883-ec5f-4a09-88f8-d4c0668ae570,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a30d1fd9-58f1-4efc-8331-ddcaa241fd9b", "address": "fa:16:3e:bf:61:9e", "network": {"id": "d8a362dc-0dc8-49dd-b2da-0e0749d5edca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-256373617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a1aa4f562c64545a94157d4aaf8d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa30d1fd9-58", "ovs_interfaceid": "a30d1fd9-58f1-4efc-8331-ddcaa241fd9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Converting VIF {"id": "a30d1fd9-58f1-4efc-8331-ddcaa241fd9b", "address": "fa:16:3e:bf:61:9e", "network": {"id": "d8a362dc-0dc8-49dd-b2da-0e0749d5edca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-256373617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a1aa4f562c64545a94157d4aaf8d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa30d1fd9-58", "ovs_interfaceid": "a30d1fd9-58f1-4efc-8331-ddcaa241fd9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bf:61:9e,bridge_name='br-int',has_traffic_filtering=True,id=a30d1fd9-58f1-4efc-8331-ddcaa241fd9b,network=Network(d8a362dc-0dc8-49dd-b2da-0e0749d5edca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa30d1fd9-58') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG os_vif [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:61:9e,bridge_name='br-int',has_traffic_filtering=True,id=a30d1fd9-58f1-4efc-8331-ddcaa241fd9b,network=Network(d8a362dc-0dc8-49dd-b2da-0e0749d5edca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa30d1fd9-58') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bee31898-4f12-4c68-a18b-a678f9f584aa/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa30d1fd9-58, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a35226-6b98-44ad-ab4d-e0e86b14ba9d/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0e87aef9-9a8f-432b-930e-ebd315af74fa) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:43 user nova-compute[95467]: INFO os_vif [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:61:9e,bridge_name='br-int',has_traffic_filtering=True,id=a30d1fd9-58f1-4efc-8331-ddcaa241fd9b,network=Network(d8a362dc-0dc8-49dd-b2da-0e0749d5edca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa30d1fd9-58')
Nov 15 08:15:43 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] calling os-brick to detach iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, {'target_iqn': 'iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FrEomLTX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:15:43 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 08:15:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c62d2e-882a-43e3-856c-814e6f8ca9cf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 08:15:43 user nova-compute[95467]: No targets found.
Nov 15 08:15:43 user nova-compute[95467]: iSNS:
Nov 15 08:15:43 user nova-compute[95467]: No targets found.
Nov 15 08:15:43 user nova-compute[95467]: STATIC:
Nov 15 08:15:43 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4
Nov 15 08:15:43 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:15:43 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:15:43 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77
Nov 15 08:15:43 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:15:43 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:15:43 user nova-compute[95467]: FIRMWARE:
Nov 15 08:15:43 user nova-compute[95467]: No targets found.
Nov 15 08:15:43 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 08:15:43 user nova-compute[95467]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 08:15:43 user nova-compute[95467]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=95467) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059', 0)] {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c293408-4f7b-408e-9ed2-4f4900374c87]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[086c209c-9fb8-4481-91a1-60a3c49c889e]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77 (non-flash)
Nov 15 08:15:43 user nova-compute[95467]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4 (non-flash)
Nov 15 08:15:43 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77 (non-flash)
Nov 15 08:15:43 user nova-compute[95467]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4 (non-flash)
Nov 15 08:15:43 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efed82b88b0>, {}) {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Disconnecting from: [] {{(pid=95467) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.082s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] <== disconnect_volume: return (84ms) None {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Disconnected iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 08:15:43 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Deleting instance files /opt/stack/data/nova/instances/3711c883-ec5f-4a09-88f8-d4c0668ae570_del
Nov 15 08:15:43 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Deletion of /opt/stack/data/nova/instances/3711c883-ec5f-4a09-88f8-d4c0668ae570_del complete
Nov 15 08:15:43 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] Instance destroyed successfully.
Nov 15 08:15:43 user nova-compute[95467]: DEBUG nova.objects.instance [None req-7b85e658-0cc1-4098-8831-a7574f984647 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lazy-loading 'resources' on Instance uuid abdf29d1-f80e-48c8-8c09-d7c9c0326833 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a35226-6b98-44ad-ab4d-e0e86b14ba9d/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a35226-6b98-44ad-ab4d-e0e86b14ba9d/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-7b85e658-0cc1-4098-8831-a7574f984647 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:13:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-447314755',display_name='tempest-TestVolumeBootPattern-server-447314755',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-447314755',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:14:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e7791bd92c7c488aa72474ecde2e1155',ramdisk_id='',reservation_id='r-gu1on84m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-978207351',owner_user_name='tempest-TestVolumeBootPattern-978207351-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:14:09Z,user_data=None,user_id='11bbbd3ef322402cb5dc60455a54319b',uuid=abdf29d1-f80e-48c8-8c09-d7c9c0326833,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "efd5c9da-7c4f-4885-93f2-111ea8040673", "address": "fa:16:3e:07:c6:87", "network": {"id": "96d9262b-11fb-497d-8e38-fa46076c010f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2069167691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7791bd92c7c488aa72474ecde2e1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefd5c9da-7c", "ovs_interfaceid": "efd5c9da-7c4f-4885-93f2-111ea8040673", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-7b85e658-0cc1-4098-8831-a7574f984647 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Converting VIF {"id": "efd5c9da-7c4f-4885-93f2-111ea8040673", "address": "fa:16:3e:07:c6:87", "network": {"id": "96d9262b-11fb-497d-8e38-fa46076c010f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2069167691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7791bd92c7c488aa72474ecde2e1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefd5c9da-7c", "ovs_interfaceid": "efd5c9da-7c4f-4885-93f2-111ea8040673", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-7b85e658-0cc1-4098-8831-a7574f984647 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:c6:87,bridge_name='br-int',has_traffic_filtering=True,id=efd5c9da-7c4f-4885-93f2-111ea8040673,network=Network(96d9262b-11fb-497d-8e38-fa46076c010f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefd5c9da-7c') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG os_vif [None req-7b85e658-0cc1-4098-8831-a7574f984647 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:c6:87,bridge_name='br-int',has_traffic_filtering=True,id=efd5c9da-7c4f-4885-93f2-111ea8040673,network=Network(96d9262b-11fb-497d-8e38-fa46076c010f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefd5c9da-7c') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapefd5c9da-7c, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=34f4cc60-d4d8-4c87-b778-cb4fb42aad01) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:43 user nova-compute[95467]: INFO os_vif [None req-7b85e658-0cc1-4098-8831-a7574f984647 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:c6:87,bridge_name='br-int',has_traffic_filtering=True,id=efd5c9da-7c4f-4885-93f2-111ea8040673,network=Network(96d9262b-11fb-497d-8e38-fa46076c010f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefd5c9da-7c')
Nov 15 08:15:43 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b85e658-0cc1-4098-8831-a7574f984647 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] calling os-brick to detach iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b85e658-0cc1-4098-8831-a7574f984647 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, {'target_iqn': 'iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jIMzydlu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:15:43 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-7b85e658-0cc1-4098-8831-a7574f984647 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:15:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-7b85e658-0cc1-4098-8831-a7574f984647 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-7b85e658-0cc1-4098-8831-a7574f984647 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[76306f4e-f1f7-406b-9c6c-cbee3c7bd76a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b85e658-0cc1-4098-8831-a7574f984647 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 08:15:43 user nova-compute[95467]: No targets found.
Nov 15 08:15:43 user nova-compute[95467]: iSNS:
Nov 15 08:15:43 user nova-compute[95467]: No targets found.
Nov 15 08:15:43 user nova-compute[95467]: STATIC:
Nov 15 08:15:43 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4
Nov 15 08:15:43 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:15:43 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:15:43 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77
Nov 15 08:15:43 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:15:43 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:15:43 user nova-compute[95467]: FIRMWARE:
Nov 15 08:15:43 user nova-compute[95467]: No targets found.
Nov 15 08:15:43 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b85e658-0cc1-4098-8831-a7574f984647 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 08:15:43 user nova-compute[95467]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 08:15:43 user nova-compute[95467]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=95467) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b85e658-0cc1-4098-8831-a7574f984647 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4', 0)] {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e0ddbd-432a-40a9-be9e-3ef889a3be4f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:43 user nova-compute[95467]: INFO nova.virt.block_device [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Booting with volume 60b831aa-76f1-46c0-9c6c-6f3de448b059 at /dev/vdb
Nov 15 08:15:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[1032bf64-b8bc-4009-81ce-bd48e5a09f50]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b85e658-0cc1-4098-8831-a7574f984647 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77 (non-flash)
Nov 15 08:15:43 user nova-compute[95467]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4 (non-flash)
Nov 15 08:15:43 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b85e658-0cc1-4098-8831-a7574f984647 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77 (non-flash)
Nov 15 08:15:43 user nova-compute[95467]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4 (non-flash)
Nov 15 08:15:43 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b85e658-0cc1-4098-8831-a7574f984647 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efec82172e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4'): ({'sdc'}, set())}) {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-7b85e658-0cc1-4098-8831-a7574f984647 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Removing single pathed devices sdc {{(pid=95467) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a35226-6b98-44ad-ab4d-e0e86b14ba9d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[256190be-cd56-47d4-b47c-1c2965a3b5cd]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG os_brick.utils [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[3127f47c-b467-4dd3-8b14-9e8f39a8ac2c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:882ae90641f\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff33dc6-8d84-4ea3-bd1e-76d3592dfdf5]: (4, ('ok\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-7b85e658-0cc1-4098-8831-a7574f984647 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Flushing IO for device /dev/sdc {{(pid=95467) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e77ab42-3673-4133-b928-a8f57940943b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b602c7b6-c647-4bce-b3db-8a6fc7851cd8]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-7b85e658-0cc1-4098-8831-a7574f984647 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=95467) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc5ab86-f0c4-46bb-a0c8-4c3e940827b5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[729e2ad2-2aaa-4614-b192-f0f7166c8a31]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Running cmd (subprocess): nvme version {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] 'nvme version' failed. Not Retrying. {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded97eb2-49b5-4966-9cce-9cd4cd56ef83]: (4, ('1', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.nvmeof [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] nvme not present on system {{(pid=95467) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-7b85e658-0cc1-4098-8831-a7574f984647 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-7b85e658-0cc1-4098-8831-a7574f984647 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] SCSI volumes sdc have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26239316136326238', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_a04d3fcc', '/dev/disk/by-id/scsi-1SCST_BIOa04d3fcc-b91a62b8fb9b0fa2') {{(pid=105611) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 08:15:43 user nova-compute[95467]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26239316136326238
Nov 15 08:15:43 user nova-compute[95467]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_a04d3fcc
Nov 15 08:15:43 user nova-compute[95467]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOa04d3fcc-b91a62b8fb9b0fa2
Nov 15 08:15:43 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[59631a3f-fcbe-4ab7-9403-152568ffd485]: (4, None) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b85e658-0cc1-4098-8831-a7574f984647 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4')] {{(pid=95467) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:15:43 user nova-compute[95467]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 08:15:43 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d793f2-0345-44d2-8861-b97785845d21]: (4, '') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=95467) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] LIGHTOS: no hostnqn found. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG os_brick.utils [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:882ae90641f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG nova.virt.block_device [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Updating existing volume attachment record: 35d7f626-cad5-4b51-94ce-62a98ef0d4fe {{(pid=95467) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff456bc-b637-4b4a-8d91-93b7654aa711]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b85e658-0cc1-4098-8831-a7574f984647 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4 -p 172.16.0.220:3260 --logout {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dcf1152-cda4-4b33-b223-3fe1a85f5257]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b85e658-0cc1-4098-8831-a7574f984647 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4, portal: 172.16.0.220,3260]
Nov 15 08:15:43 user nova-compute[95467]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4, portal: 172.16.0.220,3260] successful.
Nov 15 08:15:43 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:15:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4 -p 172.16.0.220:3260 --op delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:44 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa3fc41-59c8-4227-bc6a-d5628b0dd76d]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:44 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b85e658-0cc1-4098-8831-a7574f984647 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:15:44 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-7b85e658-0cc1-4098-8831-a7574f984647 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.440s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:15:44 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b85e658-0cc1-4098-8831-a7574f984647 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] <== disconnect_volume: return (442ms) None {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:15:44 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b85e658-0cc1-4098-8831-a7574f984647 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] Disconnected iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 08:15:44 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-7b85e658-0cc1-4098-8831-a7574f984647 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] Deleting instance files /opt/stack/data/nova/instances/abdf29d1-f80e-48c8-8c09-d7c9c0326833_del
Nov 15 08:15:44 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-7b85e658-0cc1-4098-8831-a7574f984647 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] Deletion of /opt/stack/data/nova/instances/abdf29d1-f80e-48c8-8c09-d7c9c0326833_del complete
Nov 15 08:15:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:44 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Error from libvirt while getting description of instance-00000011: [Error Code 42] Domain not found: no domain with matching uuid '3711c883-ec5f-4a09-88f8-d4c0668ae570' (instance-00000011): libvirt.libvirtError: Domain not found: no domain with matching uuid '3711c883-ec5f-4a09-88f8-d4c0668ae570' (instance-00000011)
Nov 15 08:15:44 user nova-compute[95467]: INFO nova.compute.manager [None req-7b85e658-0cc1-4098-8831-a7574f984647 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] Took 1.42 seconds to destroy the instance on the hypervisor.
Nov 15 08:15:44 user nova-compute[95467]: DEBUG oslo.service.loopingcall [None req-7b85e658-0cc1-4098-8831-a7574f984647 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=95467) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 08:15:44 user nova-compute[95467]: DEBUG nova.compute.manager [-] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] Deallocating network for instance {{(pid=95467) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 08:15:44 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] deallocate_for_instance() {{(pid=95467) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 08:15:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36dccf43-d4a3-47aa-bd73-de9646e1020c/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36dccf43-d4a3-47aa-bd73-de9646e1020c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36dccf43-d4a3-47aa-bd73-de9646e1020c/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36dccf43-d4a3-47aa-bd73-de9646e1020c/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:44 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Error from libvirt while getting description of instance-00000013: [Error Code 42] Domain not found: no domain with matching uuid 'abdf29d1-f80e-48c8-8c09-d7c9c0326833' (instance-00000013): libvirt.libvirtError: Domain not found: no domain with matching uuid 'abdf29d1-f80e-48c8-8c09-d7c9c0326833' (instance-00000013)
Nov 15 08:15:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:44 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:15:44 user nova-compute[95467]: DEBUG nova.compute.manager [req-2b5e3cd7-30ff-4d99-b03d-3e3fde2a9b4f req-c59d796f-6345-4afb-af35-bdd47d3cc925 service nova] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] Received event network-vif-deleted-efd5c9da-7c4f-4885-93f2-111ea8040673 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:15:44 user nova-compute[95467]: INFO nova.compute.manager [req-2b5e3cd7-30ff-4d99-b03d-3e3fde2a9b4f req-c59d796f-6345-4afb-af35-bdd47d3cc925 service nova] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] Neutron deleted interface efd5c9da-7c4f-4885-93f2-111ea8040673; detaching it from the instance and deleting it from the info cache
Nov 15 08:15:44 user nova-compute[95467]: DEBUG nova.network.neutron [req-2b5e3cd7-30ff-4d99-b03d-3e3fde2a9b4f req-c59d796f-6345-4afb-af35-bdd47d3cc925 service nova] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:15:44 user nova-compute[95467]: INFO nova.compute.manager [-] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] Took 0.55 seconds to deallocate network for instance.
Nov 15 08:15:44 user nova-compute[95467]: DEBUG nova.compute.manager [req-2b5e3cd7-30ff-4d99-b03d-3e3fde2a9b4f req-c59d796f-6345-4afb-af35-bdd47d3cc925 service nova] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] Detach interface failed, port_id=efd5c9da-7c4f-4885-93f2-111ea8040673, reason: Instance abdf29d1-f80e-48c8-8c09-d7c9c0326833 could not be found. {{(pid=95467) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 08:15:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:44 user nova-compute[95467]: DEBUG nova.compute.manager [req-b4ab8e28-cb6a-4859-9fd8-06b46317bc83 req-17694667-b092-4bab-8879-f84206c671b5 service nova] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] Received event network-vif-unplugged-efd5c9da-7c4f-4885-93f2-111ea8040673 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:15:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b4ab8e28-cb6a-4859-9fd8-06b46317bc83 req-17694667-b092-4bab-8879-f84206c671b5 service nova] Acquiring lock "abdf29d1-f80e-48c8-8c09-d7c9c0326833-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:15:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b4ab8e28-cb6a-4859-9fd8-06b46317bc83 req-17694667-b092-4bab-8879-f84206c671b5 service nova] Lock "abdf29d1-f80e-48c8-8c09-d7c9c0326833-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:15:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b4ab8e28-cb6a-4859-9fd8-06b46317bc83 req-17694667-b092-4bab-8879-f84206c671b5 service nova] Lock "abdf29d1-f80e-48c8-8c09-d7c9c0326833-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:15:44 user nova-compute[95467]: DEBUG nova.compute.manager [req-b4ab8e28-cb6a-4859-9fd8-06b46317bc83 req-17694667-b092-4bab-8879-f84206c671b5 service nova] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] No waiting events found dispatching network-vif-unplugged-efd5c9da-7c4f-4885-93f2-111ea8040673 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:15:44 user nova-compute[95467]: DEBUG nova.compute.manager [req-b4ab8e28-cb6a-4859-9fd8-06b46317bc83 req-17694667-b092-4bab-8879-f84206c671b5 service nova] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] Received event network-vif-unplugged-efd5c9da-7c4f-4885-93f2-111ea8040673 for instance with task_state deleting. {{(pid=95467) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 08:15:44 user nova-compute[95467]: DEBUG nova.compute.manager [req-b4ab8e28-cb6a-4859-9fd8-06b46317bc83 req-17694667-b092-4bab-8879-f84206c671b5 service nova] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] Received event network-vif-plugged-efd5c9da-7c4f-4885-93f2-111ea8040673 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:15:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b4ab8e28-cb6a-4859-9fd8-06b46317bc83 req-17694667-b092-4bab-8879-f84206c671b5 service nova] Acquiring lock "abdf29d1-f80e-48c8-8c09-d7c9c0326833-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:15:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b4ab8e28-cb6a-4859-9fd8-06b46317bc83 req-17694667-b092-4bab-8879-f84206c671b5 service nova] Lock "abdf29d1-f80e-48c8-8c09-d7c9c0326833-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:15:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b4ab8e28-cb6a-4859-9fd8-06b46317bc83 req-17694667-b092-4bab-8879-f84206c671b5 service nova] Lock "abdf29d1-f80e-48c8-8c09-d7c9c0326833-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:15:44 user nova-compute[95467]: DEBUG nova.compute.manager [req-b4ab8e28-cb6a-4859-9fd8-06b46317bc83 req-17694667-b092-4bab-8879-f84206c671b5 service nova] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] No waiting events found dispatching network-vif-plugged-efd5c9da-7c4f-4885-93f2-111ea8040673 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:15:44 user nova-compute[95467]: WARNING nova.compute.manager [req-b4ab8e28-cb6a-4859-9fd8-06b46317bc83 req-17694667-b092-4bab-8879-f84206c671b5 service nova] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] Received unexpected event network-vif-plugged-efd5c9da-7c4f-4885-93f2-111ea8040673 for instance with vm_state active and task_state deleting.
Nov 15 08:15:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2aa477-6786-483a-b088-d8ec204fe6aa/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:45 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-4f7af5c9-5039-45e0-86b4-56a139279f84 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Snapshot image upload complete
Nov 15 08:15:45 user nova-compute[95467]: INFO nova.compute.manager [None req-4f7af5c9-5039-45e0-86b4-56a139279f84 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Took 6.83 seconds to snapshot the instance on the hypervisor.
Nov 15 08:15:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2aa477-6786-483a-b088-d8ec204fe6aa/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2aa477-6786-483a-b088-d8ec204fe6aa/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:45 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2aa477-6786-483a-b088-d8ec204fe6aa/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da9c7b9d-aad7-4d4f-b190-fda71735fde6/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:45 user nova-compute[95467]: INFO nova.compute.manager [None req-7b85e658-0cc1-4098-8831-a7574f984647 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] Took 0.82 seconds to detach 1 volumes for instance.
Nov 15 08:15:45 user nova-compute[95467]: DEBUG nova.compute.manager [None req-7b85e658-0cc1-4098-8831-a7574f984647 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: abdf29d1-f80e-48c8-8c09-d7c9c0326833] Deleting volume: 7269dfec-a1bd-4d9a-ba8b-81b6dcfdb1a4 {{(pid=95467) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 08:15:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da9c7b9d-aad7-4d4f-b190-fda71735fde6/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da9c7b9d-aad7-4d4f-b190-fda71735fde6/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7b85e658-0cc1-4098-8831-a7574f984647 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:15:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7b85e658-0cc1-4098-8831-a7574f984647 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:15:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da9c7b9d-aad7-4d4f-b190-fda71735fde6/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:46 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-7b85e658-0cc1-4098-8831-a7574f984647 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Refreshing inventories for resource provider f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 08:15:46 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:15:46 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:15:46 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Hypervisor/Node resource view: name=user free_ram=7170MB free_disk=25.303382873535156GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=95467) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 08:15:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:15:46 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-7b85e658-0cc1-4098-8831-a7574f984647 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Updating ProviderTree inventory for provider f56c3524-ed11-494e-82e4-b1a23920d1ae from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 08:15:46 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-7b85e658-0cc1-4098-8831-a7574f984647 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Updating inventory in ProviderTree for provider f56c3524-ed11-494e-82e4-b1a23920d1ae with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 08:15:46 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-7b85e658-0cc1-4098-8831-a7574f984647 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Refreshing aggregate associations for resource provider f56c3524-ed11-494e-82e4-b1a23920d1ae, aggregates: None {{(pid=95467) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 08:15:46 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-7b85e658-0cc1-4098-8831-a7574f984647 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Refreshing trait associations for resource provider f56c3524-ed11-494e-82e4-b1a23920d1ae, traits: COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSSE3,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI {{(pid=95467) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 08:15:46 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:46 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-7b85e658-0cc1-4098-8831-a7574f984647 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:15:46 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-7b85e658-0cc1-4098-8831-a7574f984647 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:15:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7b85e658-0cc1-4098-8831-a7574f984647 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.152s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:15:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.558s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:15:46 user nova-compute[95467]: INFO nova.scheduler.client.report [None req-7b85e658-0cc1-4098-8831-a7574f984647 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Deleted allocations for instance abdf29d1-f80e-48c8-8c09-d7c9c0326833
Nov 15 08:15:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7b85e658-0cc1-4098-8831-a7574f984647 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "abdf29d1-f80e-48c8-8c09-d7c9c0326833" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.243s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:15:46 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance ee2aa477-6786-483a-b088-d8ec204fe6aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:15:46 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 73fe8852-c47a-47ab-a56f-6864c8ed5479 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:15:46 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 68264a44-5adf-4873-b380-26bcafe2ba04 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:15:46 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 21cf2ada-b15c-490d-ac37-96e9c87e9056 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:15:46 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 3711c883-ec5f-4a09-88f8-d4c0668ae570 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:15:46 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 36dccf43-d4a3-47aa-bd73-de9646e1020c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:15:46 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance bee31898-4f12-4c68-a18b-a678f9f584aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:15:46 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance da9c7b9d-aad7-4d4f-b190-fda71735fde6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:15:46 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:15:46 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 10d73b73-ca65-4192-8954-288dc1df9f24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:15:46 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance d5a35226-6b98-44ad-ab4d-e0e86b14ba9d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:15:46 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 08:15:46 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 08:15:47 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:47 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:15:47 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:15:47 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Compute_service record updated for user:user {{(pid=95467) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 08:15:47 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.552s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:15:48 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:15:48 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:15:48 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Starting heal instance info cache {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 08:15:48 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "refresh_cache-68264a44-5adf-4873-b380-26bcafe2ba04" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:15:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquired lock "refresh_cache-68264a44-5adf-4873-b380-26bcafe2ba04" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:15:48 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Forcefully refreshing network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 08:15:48 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:49 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Updating instance_info_cache with network_info: [{"id": "10ed2f01-5666-4615-be28-c574ff652c1d", "address": "fa:16:3e:82:8d:0f", "network": {"id": "4e5f387a-ee4d-4e5b-bbb3-0d3af738de45", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-839692973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6f1d989dd2242bfad9c3a5d7380c887", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10ed2f01-56", "ovs_interfaceid": "10ed2f01-5666-4615-be28-c574ff652c1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:15:49 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Releasing lock "refresh_cache-68264a44-5adf-4873-b380-26bcafe2ba04" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:15:49 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Updated the network info_cache for instance {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 08:15:49 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:15:49 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:15:49 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:15:50 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Creating instance directory {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 08:15:50 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Creating image(s)
Nov 15 08:15:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Acquiring lock "/opt/stack/data/nova/instances/3711c883-ec5f-4a09-88f8-d4c0668ae570/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:15:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "/opt/stack/data/nova/instances/3711c883-ec5f-4a09-88f8-d4c0668ae570/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:15:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "/opt/stack/data/nova/instances/3711c883-ec5f-4a09-88f8-d4c0668ae570/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:15:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.210s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Acquiring lock "a3fcf60225fcefd310404971cd18ab9851c548dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:15:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:15:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.169s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/3711c883-ec5f-4a09-88f8-d4c0668ae570/disk 1073741824 {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/3711c883-ec5f-4a09-88f8-d4c0668ae570/disk 1073741824" returned: 0 in 0.066s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:15:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-2b2d4f6f-40fb-4fcb-9ad5-e5fdc4b984fd tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Acquiring lock "68264a44-5adf-4873-b380-26bcafe2ba04" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:15:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-2b2d4f6f-40fb-4fcb-9ad5-e5fdc4b984fd tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Lock "68264a44-5adf-4873-b380-26bcafe2ba04" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:15:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-2b2d4f6f-40fb-4fcb-9ad5-e5fdc4b984fd tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Acquiring lock "68264a44-5adf-4873-b380-26bcafe2ba04-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:15:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-2b2d4f6f-40fb-4fcb-9ad5-e5fdc4b984fd tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Lock "68264a44-5adf-4873-b380-26bcafe2ba04-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:15:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-2b2d4f6f-40fb-4fcb-9ad5-e5fdc4b984fd tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Lock "68264a44-5adf-4873-b380-26bcafe2ba04-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:15:50 user nova-compute[95467]: INFO nova.compute.manager [None req-2b2d4f6f-40fb-4fcb-9ad5-e5fdc4b984fd tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Terminating instance
Nov 15 08:15:50 user nova-compute[95467]: DEBUG nova.compute.manager [None req-2b2d4f6f-40fb-4fcb-9ad5-e5fdc4b984fd tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Start destroying the instance on the hypervisor. {{(pid=95467) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.189s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3711c883-ec5f-4a09-88f8-d4c0668ae570/disk. size=1073741824 {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3711c883-ec5f-4a09-88f8-d4c0668ae570/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG nova.compute.manager [req-2a596715-8f3c-48d0-9967-a194f11ecaec req-0960c880-a724-48d6-bf56-6cc6307c53f9 service nova] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Received event network-vif-unplugged-10ed2f01-5666-4615-be28-c574ff652c1d {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-2a596715-8f3c-48d0-9967-a194f11ecaec req-0960c880-a724-48d6-bf56-6cc6307c53f9 service nova] Acquiring lock "68264a44-5adf-4873-b380-26bcafe2ba04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-2a596715-8f3c-48d0-9967-a194f11ecaec req-0960c880-a724-48d6-bf56-6cc6307c53f9 service nova] Lock "68264a44-5adf-4873-b380-26bcafe2ba04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-2a596715-8f3c-48d0-9967-a194f11ecaec req-0960c880-a724-48d6-bf56-6cc6307c53f9 service nova] Lock "68264a44-5adf-4873-b380-26bcafe2ba04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG nova.compute.manager [req-2a596715-8f3c-48d0-9967-a194f11ecaec req-0960c880-a724-48d6-bf56-6cc6307c53f9 service nova] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] No waiting events found dispatching network-vif-unplugged-10ed2f01-5666-4615-be28-c574ff652c1d {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG nova.compute.manager [req-2a596715-8f3c-48d0-9967-a194f11ecaec req-0960c880-a724-48d6-bf56-6cc6307c53f9 service nova] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Received event network-vif-unplugged-10ed2f01-5666-4615-be28-c574ff652c1d for instance with task_state deleting. {{(pid=95467) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3711c883-ec5f-4a09-88f8-d4c0668ae570/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Cannot resize image /opt/stack/data/nova/instances/3711c883-ec5f-4a09-88f8-d4c0668ae570/disk to a smaller size. {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Created local disks {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Ensure instance console log exists: /opt/stack/data/nova/instances/3711c883-ec5f-4a09-88f8-d4c0668ae570/console.log {{(pid=95467) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Start _get_guest_xml network_info=[{"id": "a30d1fd9-58f1-4efc-8331-ddcaa241fd9b", "address": "fa:16:3e:bf:61:9e", "network": {"id": "d8a362dc-0dc8-49dd-b2da-0e0749d5edca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-256373617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a1aa4f562c64545a94157d4aaf8d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa30d1fd9-58", "ovs_interfaceid": "a30d1fd9-58f1-4efc-8331-ddcaa241fd9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'ed9c48aa-ce73-4b3b-9db1-235898be671b'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '35d7f626-cad5-4b51-94ce-62a98ef0d4fe', 'delete_on_termination': False, 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FrEomLTX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3711c883-ec5f-4a09-88f8-d4c0668ae570', 'attached_at': '', 'detached_at': '', 'volume_id': '60b831aa-76f1-46c0-9c6c-6f3de448b059', 'serial': '60b831aa-76f1-46c0-9c6c-6f3de448b059'}, 'volume_type': None} {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:15:51 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 15 08:15:51 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 15 08:15:51 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG nova.objects.instance [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3711c883-ec5f-4a09-88f8-d4c0668ae570 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Calling os-brick to attach iSCSI Volume {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FrEomLTX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:15:51 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 08:15:51 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:15:51 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 08:15:51 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:15:51 user nova-compute[95467]: INFO os_brick.initiator.connectors.iscsi [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 08:15:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 -p 172.16.0.220:3260 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[395db6fa-50f8-407b-bc7e-4e956999b1ad]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 08:15:51 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 -p 172.16.0.220:3260 --interface default --op new {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b82a6c-756b-44fe-9885-79cca5848289]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059] added\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059] added
Nov 15 08:15:51 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2a21e0-8efb-45bc-a05c-0b2b5d23135e]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec062c3-e456-42f5-8970-d1fb8563fb0d]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FrEomLTX {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FrEomLTX" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c7fff7-2a6e-4107-bf2f-e3109429a618]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FrEomLTX'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[156fdece-58d9-4be7-83e9-b220dd94bccd]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[39fdec48-7f47-451d-9d64-96c5770e9274]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77 (non-flash)
Nov 15 08:15:51 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77 (non-flash)
Nov 15 08:15:51 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 -p 172.16.0.220:3260 --login {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a00697f-6a2d-4af8-bbd1-4c3ca60ea97f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059, portal: 172.16.0.220,3260]
Nov 15 08:15:51 user nova-compute[95467]: Login to [iface: default, target: iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059, portal: 172.16.0.220,3260] successful.
Nov 15 08:15:51 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[7160c9a2-9649-4332-9dc9-f0c78ca43e4d]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[114d3ca3-ee40-4e3b-9953-77a346d48654]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77 (non-flash)
Nov 15 08:15:51 user nova-compute[95467]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 (non-flash)
Nov 15 08:15:51 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77 (non-flash)
Nov 15 08:15:51 user nova-compute[95467]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 (non-flash)
Nov 15 08:15:51 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Connected to 172.16.0.220:3260 {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] HCTL ('34', '-', '-', 0) found on session 19 with lun 0 {{(pid=95467) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=95467) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[418ef747-e242-4725-b8f4-c5de48361947]: (4, ('- - 0', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Searching for a device in session 19 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FrEomLTX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 08:15:51 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Instance destroyed successfully.
Nov 15 08:15:51 user nova-compute[95467]: DEBUG nova.objects.instance [None req-2b2d4f6f-40fb-4fcb-9ad5-e5fdc4b984fd tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Lazy-loading 'resources' on Instance uuid 68264a44-5adf-4873-b380-26bcafe2ba04 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-2b2d4f6f-40fb-4fcb-9ad5-e5fdc4b984fd tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:10:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-786424798',display_name='tempest-VolumesAdminNegativeTest-server-786424798',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-786424798',id=6,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVFQLpomGOlTe7RQfiaXsxb49npzMYEHUdYLYmq6p1hZqbGb3qfTM22mebsuEDCAbks47UXSp1jmcKxYvQgLP0bqoh37F7q5rCzdt2jYQ94J5zx8A7As4d9iaN26WPb0A==',key_name='tempest-keypair-1487563835',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:10:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d6f1d989dd2242bfad9c3a5d7380c887',ramdisk_id='',reservation_id='r-uc06nhha',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1724237472',owner_user_name='tempest-VolumesAdminNegativeTest-1724237472-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:10:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='331b706f494247759f827dbb1efcb663',uuid=68264a44-5adf-4873-b380-26bcafe2ba04,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "10ed2f01-5666-4615-be28-c574ff652c1d", "address": "fa:16:3e:82:8d:0f", "network": {"id": "4e5f387a-ee4d-4e5b-bbb3-0d3af738de45", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-839692973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6f1d989dd2242bfad9c3a5d7380c887", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10ed2f01-56", "ovs_interfaceid": "10ed2f01-5666-4615-be28-c574ff652c1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-2b2d4f6f-40fb-4fcb-9ad5-e5fdc4b984fd tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Converting VIF {"id": "10ed2f01-5666-4615-be28-c574ff652c1d", "address": "fa:16:3e:82:8d:0f", "network": {"id": "4e5f387a-ee4d-4e5b-bbb3-0d3af738de45", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-839692973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6f1d989dd2242bfad9c3a5d7380c887", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10ed2f01-56", "ovs_interfaceid": "10ed2f01-5666-4615-be28-c574ff652c1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-2b2d4f6f-40fb-4fcb-9ad5-e5fdc4b984fd tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:82:8d:0f,bridge_name='br-int',has_traffic_filtering=True,id=10ed2f01-5666-4615-be28-c574ff652c1d,network=Network(4e5f387a-ee4d-4e5b-bbb3-0d3af738de45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10ed2f01-56') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG os_vif [None req-2b2d4f6f-40fb-4fcb-9ad5-e5fdc4b984fd tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:8d:0f,bridge_name='br-int',has_traffic_filtering=True,id=10ed2f01-5666-4615-be28-c574ff652c1d,network=Network(4e5f387a-ee4d-4e5b-bbb3-0d3af738de45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10ed2f01-56') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap10ed2f01-56, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bd7dcec0-9daf-4aad-b211-5a4897ac7b38) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:51 user nova-compute[95467]: INFO os_vif [None req-2b2d4f6f-40fb-4fcb-9ad5-e5fdc4b984fd tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:8d:0f,bridge_name='br-int',has_traffic_filtering=True,id=10ed2f01-5666-4615-be28-c574ff652c1d,network=Network(4e5f387a-ee4d-4e5b-bbb3-0d3af738de45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10ed2f01-56')
Nov 15 08:15:51 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-2b2d4f6f-40fb-4fcb-9ad5-e5fdc4b984fd tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Deleting instance files /opt/stack/data/nova/instances/68264a44-5adf-4873-b380-26bcafe2ba04_del
Nov 15 08:15:51 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-2b2d4f6f-40fb-4fcb-9ad5-e5fdc4b984fd tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Deletion of /opt/stack/data/nova/instances/68264a44-5adf-4873-b380-26bcafe2ba04_del complete
Nov 15 08:15:51 user nova-compute[95467]: INFO nova.compute.manager [None req-2b2d4f6f-40fb-4fcb-9ad5-e5fdc4b984fd tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 15 08:15:51 user nova-compute[95467]: DEBUG oslo.service.loopingcall [None req-2b2d4f6f-40fb-4fcb-9ad5-e5fdc4b984fd tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=95467) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG nova.compute.manager [-] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Deallocating network for instance {{(pid=95467) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 08:15:51 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] deallocate_for_instance() {{(pid=95467) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 08:15:52 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:52 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:15:52 user nova-compute[95467]: INFO nova.compute.manager [-] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Took 0.69 seconds to deallocate network for instance.
Nov 15 08:15:52 user nova-compute[95467]: DEBUG nova.compute.manager [req-93847fa7-f772-4394-b7df-051788995770 req-4d9fdbdb-7770-4b4d-bc38-bf1ccc640fa3 service nova] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Received event network-vif-deleted-10ed2f01-5666-4615-be28-c574ff652c1d {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:15:52 user nova-compute[95467]: INFO nova.compute.manager [req-93847fa7-f772-4394-b7df-051788995770 req-4d9fdbdb-7770-4b4d-bc38-bf1ccc640fa3 service nova] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Neutron deleted interface 10ed2f01-5666-4615-be28-c574ff652c1d; detaching it from the instance and deleting it from the info cache
Nov 15 08:15:52 user nova-compute[95467]: DEBUG nova.network.neutron [req-93847fa7-f772-4394-b7df-051788995770 req-4d9fdbdb-7770-4b4d-bc38-bf1ccc640fa3 service nova] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:15:52 user nova-compute[95467]: DEBUG nova.compute.manager [req-93847fa7-f772-4394-b7df-051788995770 req-4d9fdbdb-7770-4b4d-bc38-bf1ccc640fa3 service nova] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Detach interface failed, port_id=10ed2f01-5666-4615-be28-c574ff652c1d, reason: Instance 68264a44-5adf-4873-b380-26bcafe2ba04 could not be found. {{(pid=95467) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 08:15:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-2b2d4f6f-40fb-4fcb-9ad5-e5fdc4b984fd tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:15:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-2b2d4f6f-40fb-4fcb-9ad5-e5fdc4b984fd tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:15:52 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:15:52 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23962373264653163', 'path': '/dev/sdc'} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:15:52 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962373264653163', 'path': '/dev/sdc'} {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 08:15:52 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T08:13:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-687199955',display_name='tempest-ServerActionsTestOtherA-server-94598860',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-687199955',id=17,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCNocaX54qCPZAA9ULAdwlEWPInJDPNBSZ9W8AQmBrWmivIiKz/S0iGFfDxJElLCR+9ambdrPTd00JJrCoxQkWwaJ0sGcUaHDPo10f7hFEQSvZGXEdlnJ7SNY9krWZQ+oQ==',key_name='tempest-keypair-1527809969',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:13:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0a1aa4f562c64545a94157d4aaf8d14e',ramdisk_id='',reservation_id='r-nbpm0erc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-937420730',owner_user_name='tempest-ServerActionsTestOtherA-937420730-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:15:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d9b34339b404facac21f500f40b1686',uuid=3711c883-ec5f-4a09-88f8-d4c0668ae570,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a30d1fd9-58f1-4efc-8331-ddcaa241fd9b", "address": "fa:16:3e:bf:61:9e", "network": {"id": "d8a362dc-0dc8-49dd-b2da-0e0749d5edca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-256373617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a1aa4f562c64545a94157d4aaf8d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa30d1fd9-58", "ovs_interfaceid": "a30d1fd9-58f1-4efc-8331-ddcaa241fd9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:15:52 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Converting VIF {"id": "a30d1fd9-58f1-4efc-8331-ddcaa241fd9b", "address": "fa:16:3e:bf:61:9e", "network": {"id": "d8a362dc-0dc8-49dd-b2da-0e0749d5edca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-256373617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a1aa4f562c64545a94157d4aaf8d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa30d1fd9-58", "ovs_interfaceid": "a30d1fd9-58f1-4efc-8331-ddcaa241fd9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:15:52 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bf:61:9e,bridge_name='br-int',has_traffic_filtering=True,id=a30d1fd9-58f1-4efc-8331-ddcaa241fd9b,network=Network(d8a362dc-0dc8-49dd-b2da-0e0749d5edca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa30d1fd9-58') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:15:52 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:15:52 user nova-compute[95467]:   <uuid>3711c883-ec5f-4a09-88f8-d4c0668ae570</uuid>
Nov 15 08:15:52 user nova-compute[95467]:   <name>instance-00000011</name>
Nov 15 08:15:52 user nova-compute[95467]:   <memory>524288</memory>
Nov 15 08:15:52 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:15:52 user nova-compute[95467]:   <metadata>
Nov 15 08:15:52 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:15:52 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:15:52 user nova-compute[95467]:       <nova:name>tempest-ServerActionsTestOtherA-server-94598860</nova:name>
Nov 15 08:15:52 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:15:51</nova:creationTime>
Nov 15 08:15:52 user nova-compute[95467]:       <nova:flavor name="m1.tiny">
Nov 15 08:15:52 user nova-compute[95467]:         <nova:memory>512</nova:memory>
Nov 15 08:15:52 user nova-compute[95467]:         <nova:disk>1</nova:disk>
Nov 15 08:15:52 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:15:52 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:15:52 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:15:52 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:15:52 user nova-compute[95467]:       <nova:owner>
Nov 15 08:15:52 user nova-compute[95467]:         <nova:user uuid="2d9b34339b404facac21f500f40b1686">tempest-ServerActionsTestOtherA-937420730-project-member</nova:user>
Nov 15 08:15:52 user nova-compute[95467]:         <nova:project uuid="0a1aa4f562c64545a94157d4aaf8d14e">tempest-ServerActionsTestOtherA-937420730</nova:project>
Nov 15 08:15:52 user nova-compute[95467]:       </nova:owner>
Nov 15 08:15:52 user nova-compute[95467]:       <nova:root type="image" uuid="ed9c48aa-ce73-4b3b-9db1-235898be671b"/>
Nov 15 08:15:52 user nova-compute[95467]:       <nova:ports>
Nov 15 08:15:52 user nova-compute[95467]:         <nova:port uuid="a30d1fd9-58f1-4efc-8331-ddcaa241fd9b">
Nov 15 08:15:52 user nova-compute[95467]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 08:15:52 user nova-compute[95467]:         </nova:port>
Nov 15 08:15:52 user nova-compute[95467]:       </nova:ports>
Nov 15 08:15:52 user nova-compute[95467]:     </nova:instance>
Nov 15 08:15:52 user nova-compute[95467]:   </metadata>
Nov 15 08:15:52 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:15:52 user nova-compute[95467]:     <system>
Nov 15 08:15:52 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:15:52 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:15:52 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:15:52 user nova-compute[95467]:       <entry name="serial">3711c883-ec5f-4a09-88f8-d4c0668ae570</entry>
Nov 15 08:15:52 user nova-compute[95467]:       <entry name="uuid">3711c883-ec5f-4a09-88f8-d4c0668ae570</entry>
Nov 15 08:15:52 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:15:52 user nova-compute[95467]:     </system>
Nov 15 08:15:52 user nova-compute[95467]:   </sysinfo>
Nov 15 08:15:52 user nova-compute[95467]:   <os>
Nov 15 08:15:52 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:15:52 user nova-compute[95467]:     <boot dev="hd"/>
Nov 15 08:15:52 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:15:52 user nova-compute[95467]:   </os>
Nov 15 08:15:52 user nova-compute[95467]:   <features>
Nov 15 08:15:52 user nova-compute[95467]:     <acpi/>
Nov 15 08:15:52 user nova-compute[95467]:     <apic/>
Nov 15 08:15:52 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:15:52 user nova-compute[95467]:   </features>
Nov 15 08:15:52 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:15:52 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:15:52 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:15:52 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:15:52 user nova-compute[95467]:   </clock>
Nov 15 08:15:52 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:15:52 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:15:52 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:15:52 user nova-compute[95467]:   </cpu>
Nov 15 08:15:52 user nova-compute[95467]:   <devices>
Nov 15 08:15:52 user nova-compute[95467]:     <disk type="file" device="disk">
Nov 15 08:15:52 user nova-compute[95467]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 08:15:52 user nova-compute[95467]:       <source file="/opt/stack/data/nova/instances/3711c883-ec5f-4a09-88f8-d4c0668ae570/disk"/>
Nov 15 08:15:52 user nova-compute[95467]:       <target dev="vda" bus="virtio"/>
Nov 15 08:15:52 user nova-compute[95467]:     </disk>
Nov 15 08:15:52 user nova-compute[95467]:     <disk type="block" device="disk">
Nov 15 08:15:52 user nova-compute[95467]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:15:52 user nova-compute[95467]:       <source dev="/dev/sdc"/>
Nov 15 08:15:52 user nova-compute[95467]:       <target dev="vdb" bus="virtio"/>
Nov 15 08:15:52 user nova-compute[95467]:       <serial>60b831aa-76f1-46c0-9c6c-6f3de448b059</serial>
Nov 15 08:15:52 user nova-compute[95467]:     </disk>
Nov 15 08:15:52 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:15:52 user nova-compute[95467]:       <mac address="fa:16:3e:bf:61:9e"/>
Nov 15 08:15:52 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:15:52 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:15:52 user nova-compute[95467]:       <target dev="tapa30d1fd9-58"/>
Nov 15 08:15:52 user nova-compute[95467]:     </interface>
Nov 15 08:15:52 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:15:52 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/3711c883-ec5f-4a09-88f8-d4c0668ae570/console.log" append="off"/>
Nov 15 08:15:52 user nova-compute[95467]:     </serial>
Nov 15 08:15:52 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:15:52 user nova-compute[95467]:     <video>
Nov 15 08:15:52 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:15:52 user nova-compute[95467]:     </video>
Nov 15 08:15:52 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:15:52 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:15:52 user nova-compute[95467]:     </rng>
Nov 15 08:15:52 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:15:52 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:15:52 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:15:52 user nova-compute[95467]:     </memballoon>
Nov 15 08:15:52 user nova-compute[95467]:   </devices>
Nov 15 08:15:52 user nova-compute[95467]: </domain>
Nov 15 08:15:52 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:15:52 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T08:13:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-687199955',display_name='tempest-ServerActionsTestOtherA-server-94598860',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-687199955',id=17,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCNocaX54qCPZAA9ULAdwlEWPInJDPNBSZ9W8AQmBrWmivIiKz/S0iGFfDxJElLCR+9ambdrPTd00JJrCoxQkWwaJ0sGcUaHDPo10f7hFEQSvZGXEdlnJ7SNY9krWZQ+oQ==',key_name='tempest-keypair-1527809969',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:13:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0a1aa4f562c64545a94157d4aaf8d14e',ramdisk_id='',reservation_id='r-nbpm0erc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-937420730',owner_user_name='tempest-ServerActionsTestOtherA-937420730-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:15:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d9b34339b404facac21f500f40b1686',uuid=3711c883-ec5f-4a09-88f8-d4c0668ae570,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a30d1fd9-58f1-4efc-8331-ddcaa241fd9b", "address": "fa:16:3e:bf:61:9e", "network": {"id": "d8a362dc-0dc8-49dd-b2da-0e0749d5edca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-256373617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a1aa4f562c64545a94157d4aaf8d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa30d1fd9-58", "ovs_interfaceid": "a30d1fd9-58f1-4efc-8331-ddcaa241fd9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:15:52 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Converting VIF {"id": "a30d1fd9-58f1-4efc-8331-ddcaa241fd9b", "address": "fa:16:3e:bf:61:9e", "network": {"id": "d8a362dc-0dc8-49dd-b2da-0e0749d5edca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-256373617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a1aa4f562c64545a94157d4aaf8d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa30d1fd9-58", "ovs_interfaceid": "a30d1fd9-58f1-4efc-8331-ddcaa241fd9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:15:52 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bf:61:9e,bridge_name='br-int',has_traffic_filtering=True,id=a30d1fd9-58f1-4efc-8331-ddcaa241fd9b,network=Network(d8a362dc-0dc8-49dd-b2da-0e0749d5edca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa30d1fd9-58') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:15:52 user nova-compute[95467]: DEBUG os_vif [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:61:9e,bridge_name='br-int',has_traffic_filtering=True,id=a30d1fd9-58f1-4efc-8331-ddcaa241fd9b,network=Network(d8a362dc-0dc8-49dd-b2da-0e0749d5edca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa30d1fd9-58') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:15:52 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:52 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:15:52 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:15:52 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:52 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '716c95ed-0fec-52d1-bb1b-a5ca731e93da', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:15:52 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:52 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:15:52 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:52 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa30d1fd9-58, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:15:52 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa30d1fd9-58, col_values=(('qos', UUID('6d718cb8-552b-4486-80e1-eea9953de1fa')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:15:52 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa30d1fd9-58, col_values=(('external_ids', {'iface-id': 'a30d1fd9-58f1-4efc-8331-ddcaa241fd9b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:61:9e', 'vm-uuid': '3711c883-ec5f-4a09-88f8-d4c0668ae570'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:15:52 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:52 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:15:52 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:52 user nova-compute[95467]: INFO os_vif [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:61:9e,bridge_name='br-int',has_traffic_filtering=True,id=a30d1fd9-58f1-4efc-8331-ddcaa241fd9b,network=Network(d8a362dc-0dc8-49dd-b2da-0e0749d5edca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa30d1fd9-58')
Nov 15 08:15:52 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:15:52 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] No BDM found with device name vdb, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:15:52 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] No VIF found with MAC fa:16:3e:bf:61:9e, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:15:52 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-2b2d4f6f-40fb-4fcb-9ad5-e5fdc4b984fd tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:15:52 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-2b2d4f6f-40fb-4fcb-9ad5-e5fdc4b984fd tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:15:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-2b2d4f6f-40fb-4fcb-9ad5-e5fdc4b984fd tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.378s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:15:53 user nova-compute[95467]: INFO nova.scheduler.client.report [None req-2b2d4f6f-40fb-4fcb-9ad5-e5fdc4b984fd tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Deleted allocations for instance 68264a44-5adf-4873-b380-26bcafe2ba04
Nov 15 08:15:53 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-2b2d4f6f-40fb-4fcb-9ad5-e5fdc4b984fd tempest-VolumesAdminNegativeTest-1724237472 tempest-VolumesAdminNegativeTest-1724237472-project-member] Lock "68264a44-5adf-4873-b380-26bcafe2ba04" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.138s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:15:53 user nova-compute[95467]: DEBUG nova.compute.manager [req-9f7ef89b-bfe2-46c3-bc67-aac265006386 req-e8146d6b-94f3-41af-bdad-6bd48ecb6523 service nova] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Received event network-vif-plugged-10ed2f01-5666-4615-be28-c574ff652c1d {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:15:53 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-9f7ef89b-bfe2-46c3-bc67-aac265006386 req-e8146d6b-94f3-41af-bdad-6bd48ecb6523 service nova] Acquiring lock "68264a44-5adf-4873-b380-26bcafe2ba04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:15:53 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-9f7ef89b-bfe2-46c3-bc67-aac265006386 req-e8146d6b-94f3-41af-bdad-6bd48ecb6523 service nova] Lock "68264a44-5adf-4873-b380-26bcafe2ba04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:15:53 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-9f7ef89b-bfe2-46c3-bc67-aac265006386 req-e8146d6b-94f3-41af-bdad-6bd48ecb6523 service nova] Lock "68264a44-5adf-4873-b380-26bcafe2ba04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:15:53 user nova-compute[95467]: DEBUG nova.compute.manager [req-9f7ef89b-bfe2-46c3-bc67-aac265006386 req-e8146d6b-94f3-41af-bdad-6bd48ecb6523 service nova] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] No waiting events found dispatching network-vif-plugged-10ed2f01-5666-4615-be28-c574ff652c1d {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:15:53 user nova-compute[95467]: WARNING nova.compute.manager [req-9f7ef89b-bfe2-46c3-bc67-aac265006386 req-e8146d6b-94f3-41af-bdad-6bd48ecb6523 service nova] [instance: 68264a44-5adf-4873-b380-26bcafe2ba04] Received unexpected event network-vif-plugged-10ed2f01-5666-4615-be28-c574ff652c1d for instance with vm_state deleted and task_state None.
Nov 15 08:15:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:54 user nova-compute[95467]: DEBUG nova.compute.manager [req-ef05ad06-b9dd-4270-af0f-5e5206b43690 req-57dee900-d5af-463e-b7a9-d0303ac30d70 service nova] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Received event network-vif-plugged-a30d1fd9-58f1-4efc-8331-ddcaa241fd9b {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:15:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ef05ad06-b9dd-4270-af0f-5e5206b43690 req-57dee900-d5af-463e-b7a9-d0303ac30d70 service nova] Acquiring lock "3711c883-ec5f-4a09-88f8-d4c0668ae570-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:15:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ef05ad06-b9dd-4270-af0f-5e5206b43690 req-57dee900-d5af-463e-b7a9-d0303ac30d70 service nova] Lock "3711c883-ec5f-4a09-88f8-d4c0668ae570-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:15:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ef05ad06-b9dd-4270-af0f-5e5206b43690 req-57dee900-d5af-463e-b7a9-d0303ac30d70 service nova] Lock "3711c883-ec5f-4a09-88f8-d4c0668ae570-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:15:54 user nova-compute[95467]: DEBUG nova.compute.manager [req-ef05ad06-b9dd-4270-af0f-5e5206b43690 req-57dee900-d5af-463e-b7a9-d0303ac30d70 service nova] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] No waiting events found dispatching network-vif-plugged-a30d1fd9-58f1-4efc-8331-ddcaa241fd9b {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:15:54 user nova-compute[95467]: WARNING nova.compute.manager [req-ef05ad06-b9dd-4270-af0f-5e5206b43690 req-57dee900-d5af-463e-b7a9-d0303ac30d70 service nova] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Received unexpected event network-vif-plugged-a30d1fd9-58f1-4efc-8331-ddcaa241fd9b for instance with vm_state active and task_state rebuild_spawning.
Nov 15 08:15:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:54 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-47df27f6-73f6-4e94-bfe0-d6ebfe89ff74 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 36dccf43-d4a3-47aa-bd73-de9646e1020c is timed out.
Nov 15 08:15:54 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-47df27f6-73f6-4e94-bfe0-d6ebfe89ff74 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Successfully detached device vdc from instance 36dccf43-d4a3-47aa-bd73-de9646e1020c from the live domain config.
Nov 15 08:15:54 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47df27f6-73f6-4e94-bfe0-d6ebfe89ff74 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] calling os-brick to detach iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 08:15:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-47df27f6-73f6-4e94-bfe0-d6ebfe89ff74 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, {'target_iqn': 'iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dVBZyxzk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:15:54 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-47df27f6-73f6-4e94-bfe0-d6ebfe89ff74 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:15:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-47df27f6-73f6-4e94-bfe0-d6ebfe89ff74 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:15:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-47df27f6-73f6-4e94-bfe0-d6ebfe89ff74 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:15:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:54 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[9daf827c-df32-4e60-8115-de77cf441250]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-47df27f6-73f6-4e94-bfe0-d6ebfe89ff74 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 08:15:54 user nova-compute[95467]: No targets found.
Nov 15 08:15:54 user nova-compute[95467]: iSNS:
Nov 15 08:15:54 user nova-compute[95467]: No targets found.
Nov 15 08:15:54 user nova-compute[95467]: STATIC:
Nov 15 08:15:54 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059
Nov 15 08:15:54 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:15:54 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:15:54 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77
Nov 15 08:15:54 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:15:54 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:15:54 user nova-compute[95467]: FIRMWARE:
Nov 15 08:15:54 user nova-compute[95467]: No targets found.
Nov 15 08:15:54 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:15:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-47df27f6-73f6-4e94-bfe0-d6ebfe89ff74 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 08:15:54 user nova-compute[95467]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 08:15:54 user nova-compute[95467]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=95467) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 08:15:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-47df27f6-73f6-4e94-bfe0-d6ebfe89ff74 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77', 0)] {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 08:15:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:54 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfcb37af-dbbf-471d-b76f-d91b9de10048]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:54 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b799ad-b5bd-4b0d-ad16-8ccbe640bdc7]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-47df27f6-73f6-4e94-bfe0-d6ebfe89ff74 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77 (non-flash)
Nov 15 08:15:54 user nova-compute[95467]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 (non-flash)
Nov 15 08:15:54 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:15:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-47df27f6-73f6-4e94-bfe0-d6ebfe89ff74 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77 (non-flash)
Nov 15 08:15:54 user nova-compute[95467]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 (non-flash)
Nov 15 08:15:54 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:15:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-47df27f6-73f6-4e94-bfe0-d6ebfe89ff74 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efed84343a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77'): ({'sdb'}, set())}) {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 08:15:54 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-47df27f6-73f6-4e94-bfe0-d6ebfe89ff74 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Removing single pathed devices sdb {{(pid=95467) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 08:15:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:54 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0a0cfa-96b7-41a0-bfaf-bb0e0b46189e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:54 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c82146d-9b44-4de2-8693-f7e30caf415f]: (4, ('ok\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:54 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-47df27f6-73f6-4e94-bfe0-d6ebfe89ff74 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Flushing IO for device /dev/sdb {{(pid=95467) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 08:15:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:54 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ef09f4-3b60-407f-8a42-7e34ba3e2b7a]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Acquiring lock "3825a691-ac5c-4c06-b4a4-2a0b40c638c4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:15:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "3825a691-ac5c-4c06-b4a4-2a0b40c638c4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:15:54 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-47df27f6-73f6-4e94-bfe0-d6ebfe89ff74 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=95467) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 08:15:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:54 user nova-compute[95467]: DEBUG nova.compute.manager [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Starting instance... {{(pid=95467) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 08:15:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.134s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:54 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b101e6-fc50-43de-913c-53ca36407269]: (4, ('1', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:54 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-47df27f6-73f6-4e94-bfe0-d6ebfe89ff74 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 08:15:54 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-47df27f6-73f6-4e94-bfe0-d6ebfe89ff74 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] SCSI volumes sdb have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 08:15:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-47df27f6-73f6-4e94-bfe0-d6ebfe89ff74 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77')] {{(pid=95467) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 08:15:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:55 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b81ae0-a586-4184-adb1-70490c8e8283]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-47df27f6-73f6-4e94-bfe0-d6ebfe89ff74 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:15:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77 -p 172.16.0.220:3260 --logout {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:15:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:15:55 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=95467) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 08:15:55 user nova-compute[95467]: INFO nova.compute.claims [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Claim successful on node user
Nov 15 08:15:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:55 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[6081b4c7-35ad-41d4-91e0-ef7eedbb7de7]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-47df27f6-73f6-4e94-bfe0-d6ebfe89ff74 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77, portal: 172.16.0.220,3260]
Nov 15 08:15:55 user nova-compute[95467]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77, portal: 172.16.0.220,3260] successful.
Nov 15 08:15:55 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:15:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77 -p 172.16.0.220:3260 --op delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf7f0b19-1fbe-4b88-9507-0a9c75f5ba77 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:55 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[87515848-356a-46a9-9f1a-4ab2f998d2d1]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:15:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-47df27f6-73f6-4e94-bfe0-d6ebfe89ff74 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:15:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-47df27f6-73f6-4e94-bfe0-d6ebfe89ff74 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.395s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:15:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-47df27f6-73f6-4e94-bfe0-d6ebfe89ff74 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] <== disconnect_volume: return (396ms) None {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:15:55 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47df27f6-73f6-4e94-bfe0-d6ebfe89ff74 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Disconnected iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 08:15:55 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:15:55 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:15:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.471s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:15:55 user nova-compute[95467]: DEBUG nova.compute.manager [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Start building networks asynchronously for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 08:15:55 user nova-compute[95467]: DEBUG nova.compute.manager [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Allocating IP information in the background. {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 08:15:55 user nova-compute[95467]: DEBUG nova.network.neutron [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] allocate_for_instance() {{(pid=95467) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 08:15:55 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 08:15:55 user nova-compute[95467]: DEBUG nova.compute.manager [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Start building block device mappings for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 08:15:55 user nova-compute[95467]: INFO nova.virt.block_device [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Booting with blank volume at /dev/vda
Nov 15 08:15:55 user nova-compute[95467]: DEBUG nova.policy [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6971581ab2604353aeb0c45c5252b4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c34d65a8000347feb2b3966b7ce0d785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95467) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 08:15:56 user nova-compute[95467]: DEBUG nova.objects.instance [None req-47df27f6-73f6-4e94-bfe0-d6ebfe89ff74 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lazy-loading 'flavor' on Instance uuid 36dccf43-d4a3-47aa-bd73-de9646e1020c {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:15:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-47df27f6-73f6-4e94-bfe0-d6ebfe89ff74 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "36dccf43-d4a3-47aa-bd73-de9646e1020c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.965s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:15:56 user nova-compute[95467]: DEBUG nova.network.neutron [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Successfully created port: 3fddc7dd-48af-4964-bc1a-a54623453f62 {{(pid=95467) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 08:15:56 user nova-compute[95467]: DEBUG nova.compute.manager [req-8608a227-72e3-4118-98bb-a34d6d600725 req-30571dc1-824c-4151-a61c-fbbee5990a1e service nova] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Received event network-vif-plugged-a30d1fd9-58f1-4efc-8331-ddcaa241fd9b {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:15:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-8608a227-72e3-4118-98bb-a34d6d600725 req-30571dc1-824c-4151-a61c-fbbee5990a1e service nova] Acquiring lock "3711c883-ec5f-4a09-88f8-d4c0668ae570-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:15:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-8608a227-72e3-4118-98bb-a34d6d600725 req-30571dc1-824c-4151-a61c-fbbee5990a1e service nova] Lock "3711c883-ec5f-4a09-88f8-d4c0668ae570-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:15:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-8608a227-72e3-4118-98bb-a34d6d600725 req-30571dc1-824c-4151-a61c-fbbee5990a1e service nova] Lock "3711c883-ec5f-4a09-88f8-d4c0668ae570-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:15:56 user nova-compute[95467]: DEBUG nova.compute.manager [req-8608a227-72e3-4118-98bb-a34d6d600725 req-30571dc1-824c-4151-a61c-fbbee5990a1e service nova] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] No waiting events found dispatching network-vif-plugged-a30d1fd9-58f1-4efc-8331-ddcaa241fd9b {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:15:56 user nova-compute[95467]: WARNING nova.compute.manager [req-8608a227-72e3-4118-98bb-a34d6d600725 req-30571dc1-824c-4151-a61c-fbbee5990a1e service nova] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Received unexpected event network-vif-plugged-a30d1fd9-58f1-4efc-8331-ddcaa241fd9b for instance with vm_state active and task_state rebuild_spawning.
Nov 15 08:15:56 user nova-compute[95467]: DEBUG nova.compute.manager [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Instance event wait completed in 0 seconds for  {{(pid=95467) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 08:15:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Guest created on hypervisor {{(pid=95467) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 08:15:56 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Instance spawned successfully.
Nov 15 08:15:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 08:15:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Found default for hw_cdrom_bus of ide {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:15:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Found default for hw_disk_bus of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:15:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Found default for hw_input_bus of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:15:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Found default for hw_pointer_model of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:15:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Found default for hw_video_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:15:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Found default for hw_vif_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:15:56 user nova-compute[95467]: DEBUG nova.compute.manager [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:15:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:15:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:15:56 user nova-compute[95467]: DEBUG nova.objects.instance [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Trying to apply a migration context that does not seem to be set for this instance {{(pid=95467) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 15 08:15:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-efc72f13-873e-40f9-be11-6d85f000dd80 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.123s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:15:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Acquiring lock "10968e11-51b2-46a4-87a5-bb85f938f489" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:15:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lock "10968e11-51b2-46a4-87a5-bb85f938f489" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:15:56 user nova-compute[95467]: DEBUG nova.compute.manager [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] Starting instance... {{(pid=95467) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 08:15:56 user nova-compute[95467]: DEBUG nova.network.neutron [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Successfully updated port: 3fddc7dd-48af-4964-bc1a-a54623453f62 {{(pid=95467) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 08:15:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Acquiring lock "refresh_cache-3825a691-ac5c-4c06-b4a4-2a0b40c638c4" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:15:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Acquired lock "refresh_cache-3825a691-ac5c-4c06-b4a4-2a0b40c638c4" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:15:57 user nova-compute[95467]: DEBUG nova.network.neutron [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:15:57 user nova-compute[95467]: DEBUG nova.compute.manager [req-0da696d9-9955-470b-8c9c-f99d3220102f req-9df35959-9f2f-490c-ab86-22151afbc8f7 service nova] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Received event network-changed-3fddc7dd-48af-4964-bc1a-a54623453f62 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:15:57 user nova-compute[95467]: DEBUG nova.compute.manager [req-0da696d9-9955-470b-8c9c-f99d3220102f req-9df35959-9f2f-490c-ab86-22151afbc8f7 service nova] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Refreshing instance network info cache due to event network-changed-3fddc7dd-48af-4964-bc1a-a54623453f62. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:15:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-0da696d9-9955-470b-8c9c-f99d3220102f req-9df35959-9f2f-490c-ab86-22151afbc8f7 service nova] Acquiring lock "refresh_cache-3825a691-ac5c-4c06-b4a4-2a0b40c638c4" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:15:57 user nova-compute[95467]: DEBUG nova.network.neutron [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Instance cache missing network info. {{(pid=95467) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 08:15:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:15:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:15:57 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=95467) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 08:15:57 user nova-compute[95467]: INFO nova.compute.claims [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] Claim successful on node user
Nov 15 08:15:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:57 user nova-compute[95467]: DEBUG nova.network.neutron [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Updating instance_info_cache with network_info: [{"id": "3fddc7dd-48af-4964-bc1a-a54623453f62", "address": "fa:16:3e:c6:49:ac", "network": {"id": "ac9a381d-25fe-4419-b151-f03333413813", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1183680999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34d65a8000347feb2b3966b7ce0d785", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fddc7dd-48", "ovs_interfaceid": "3fddc7dd-48af-4964-bc1a-a54623453f62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:15:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Releasing lock "refresh_cache-3825a691-ac5c-4c06-b4a4-2a0b40c638c4" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:15:57 user nova-compute[95467]: DEBUG nova.compute.manager [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Instance network_info: |[{"id": "3fddc7dd-48af-4964-bc1a-a54623453f62", "address": "fa:16:3e:c6:49:ac", "network": {"id": "ac9a381d-25fe-4419-b151-f03333413813", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1183680999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34d65a8000347feb2b3966b7ce0d785", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fddc7dd-48", "ovs_interfaceid": "3fddc7dd-48af-4964-bc1a-a54623453f62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 08:15:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-0da696d9-9955-470b-8c9c-f99d3220102f req-9df35959-9f2f-490c-ab86-22151afbc8f7 service nova] Acquired lock "refresh_cache-3825a691-ac5c-4c06-b4a4-2a0b40c638c4" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:15:57 user nova-compute[95467]: DEBUG nova.network.neutron [req-0da696d9-9955-470b-8c9c-f99d3220102f req-9df35959-9f2f-490c-ab86-22151afbc8f7 service nova] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Refreshing network info cache for port 3fddc7dd-48af-4964-bc1a-a54623453f62 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:15:57 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:15:57 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:15:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.497s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:15:57 user nova-compute[95467]: DEBUG nova.compute.manager [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] Start building networks asynchronously for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 08:15:57 user nova-compute[95467]: DEBUG nova.compute.manager [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] Allocating IP information in the background. {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 08:15:57 user nova-compute[95467]: DEBUG nova.network.neutron [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] allocate_for_instance() {{(pid=95467) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 08:15:57 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 08:15:57 user nova-compute[95467]: DEBUG nova.compute.manager [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] Start building block device mappings for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 08:15:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:57 user nova-compute[95467]: DEBUG nova.policy [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '993622d17e1848a0980fd759e248edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1fa68347914efe87ae8edd3901e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95467) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 08:15:57 user nova-compute[95467]: DEBUG nova.network.neutron [req-0da696d9-9955-470b-8c9c-f99d3220102f req-9df35959-9f2f-490c-ab86-22151afbc8f7 service nova] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Updated VIF entry in instance network info cache for port 3fddc7dd-48af-4964-bc1a-a54623453f62. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:15:57 user nova-compute[95467]: DEBUG nova.network.neutron [req-0da696d9-9955-470b-8c9c-f99d3220102f req-9df35959-9f2f-490c-ab86-22151afbc8f7 service nova] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Updating instance_info_cache with network_info: [{"id": "3fddc7dd-48af-4964-bc1a-a54623453f62", "address": "fa:16:3e:c6:49:ac", "network": {"id": "ac9a381d-25fe-4419-b151-f03333413813", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1183680999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34d65a8000347feb2b3966b7ce0d785", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fddc7dd-48", "ovs_interfaceid": "3fddc7dd-48af-4964-bc1a-a54623453f62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:15:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-0da696d9-9955-470b-8c9c-f99d3220102f req-9df35959-9f2f-490c-ab86-22151afbc8f7 service nova] Releasing lock "refresh_cache-3825a691-ac5c-4c06-b4a4-2a0b40c638c4" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:15:57 user nova-compute[95467]: DEBUG nova.compute.manager [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] Start spawning the instance on the hypervisor. {{(pid=95467) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 08:15:57 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] Creating instance directory {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 08:15:57 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] Creating image(s)
Nov 15 08:15:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Acquiring lock "/opt/stack/data/nova/instances/10968e11-51b2-46a4-87a5-bb85f938f489/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:15:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lock "/opt/stack/data/nova/instances/10968e11-51b2-46a4-87a5-bb85f938f489/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:15:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lock "/opt/stack/data/nova/instances/10968e11-51b2-46a4-87a5-bb85f938f489/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:15:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:58 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.190s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:58 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Acquiring lock "a3fcf60225fcefd310404971cd18ab9851c548dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:15:58 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:15:58 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:58 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.190s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:58 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/10968e11-51b2-46a4-87a5-bb85f938f489/disk 1073741824 {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:58 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/10968e11-51b2-46a4-87a5-bb85f938f489/disk 1073741824" returned: 0 in 0.049s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:58 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:15:58 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:58 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.184s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:58 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Checking if we can resize image /opt/stack/data/nova/instances/10968e11-51b2-46a4-87a5-bb85f938f489/disk. size=1073741824 {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 08:15:58 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10968e11-51b2-46a4-87a5-bb85f938f489/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:15:58 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10968e11-51b2-46a4-87a5-bb85f938f489/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:15:58 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Cannot resize image /opt/stack/data/nova/instances/10968e11-51b2-46a4-87a5-bb85f938f489/disk to a smaller size. {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 08:15:58 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] Created local disks {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 08:15:58 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] Ensure instance console log exists: /opt/stack/data/nova/instances/10968e11-51b2-46a4-87a5-bb85f938f489/console.log {{(pid=95467) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 08:15:58 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:15:58 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:15:58 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:15:58 user nova-compute[95467]: DEBUG nova.network.neutron [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] Successfully created port: 4ec7d55d-9178-4dbc-8c24-d3ecf46398bc {{(pid=95467) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 08:15:59 user nova-compute[95467]: DEBUG nova.network.neutron [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] Successfully updated port: 4ec7d55d-9178-4dbc-8c24-d3ecf46398bc {{(pid=95467) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 08:15:59 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Acquiring lock "refresh_cache-10968e11-51b2-46a4-87a5-bb85f938f489" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:15:59 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Acquired lock "refresh_cache-10968e11-51b2-46a4-87a5-bb85f938f489" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:15:59 user nova-compute[95467]: DEBUG nova.network.neutron [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:15:59 user nova-compute[95467]: DEBUG nova.compute.manager [req-554e705f-61eb-4be3-a930-280634e3311f req-9c42523d-2a9f-475a-8c31-10e0b9ff14c5 service nova] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] Received event network-changed-4ec7d55d-9178-4dbc-8c24-d3ecf46398bc {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:15:59 user nova-compute[95467]: DEBUG nova.compute.manager [req-554e705f-61eb-4be3-a930-280634e3311f req-9c42523d-2a9f-475a-8c31-10e0b9ff14c5 service nova] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] Refreshing instance network info cache due to event network-changed-4ec7d55d-9178-4dbc-8c24-d3ecf46398bc. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:15:59 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-554e705f-61eb-4be3-a930-280634e3311f req-9c42523d-2a9f-475a-8c31-10e0b9ff14c5 service nova] Acquiring lock "refresh_cache-10968e11-51b2-46a4-87a5-bb85f938f489" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:15:59 user nova-compute[95467]: DEBUG nova.network.neutron [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] Instance cache missing network info. {{(pid=95467) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 08:15:59 user nova-compute[95467]: DEBUG nova.network.neutron [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] Updating instance_info_cache with network_info: [{"id": "4ec7d55d-9178-4dbc-8c24-d3ecf46398bc", "address": "fa:16:3e:89:59:c1", "network": {"id": "8220309c-e09f-4c20-8f74-abdf4688fe64", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-160547739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b1fa68347914efe87ae8edd3901e11a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ec7d55d-91", "ovs_interfaceid": "4ec7d55d-9178-4dbc-8c24-d3ecf46398bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:15:59 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Releasing lock "refresh_cache-10968e11-51b2-46a4-87a5-bb85f938f489" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:15:59 user nova-compute[95467]: DEBUG nova.compute.manager [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] Instance network_info: |[{"id": "4ec7d55d-9178-4dbc-8c24-d3ecf46398bc", "address": "fa:16:3e:89:59:c1", "network": {"id": "8220309c-e09f-4c20-8f74-abdf4688fe64", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-160547739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b1fa68347914efe87ae8edd3901e11a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ec7d55d-91", "ovs_interfaceid": "4ec7d55d-9178-4dbc-8c24-d3ecf46398bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 08:15:59 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-554e705f-61eb-4be3-a930-280634e3311f req-9c42523d-2a9f-475a-8c31-10e0b9ff14c5 service nova] Acquired lock "refresh_cache-10968e11-51b2-46a4-87a5-bb85f938f489" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:15:59 user nova-compute[95467]: DEBUG nova.network.neutron [req-554e705f-61eb-4be3-a930-280634e3311f req-9c42523d-2a9f-475a-8c31-10e0b9ff14c5 service nova] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] Refreshing network info cache for port 4ec7d55d-9178-4dbc-8c24-d3ecf46398bc {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:15:59 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] Start _get_guest_xml network_info=[{"id": "4ec7d55d-9178-4dbc-8c24-d3ecf46398bc", "address": "fa:16:3e:89:59:c1", "network": {"id": "8220309c-e09f-4c20-8f74-abdf4688fe64", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-160547739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b1fa68347914efe87ae8edd3901e11a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ec7d55d-91", "ovs_interfaceid": "4ec7d55d-9178-4dbc-8c24-d3ecf46398bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'ed9c48aa-ce73-4b3b-9db1-235898be671b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:15:59 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:15:59 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:15:59 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:15:59 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:15:59 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:15:59 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:15:59 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:15:59 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:15:59 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:15:59 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:15:59 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:15:59 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:15:59 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:15:59 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:15:59 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:15:59 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:15:59 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:15:59 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:15:59 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:15:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1101118524',display_name='tempest-VolumesSnapshotTestJSON-instance-1101118524',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1101118524',id=25,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjxpbQgsiXxNlI5Ae92vX4yzSpRlM5HGPj1s+fXD7KhgNK2evFVwMx9fAfKTljspB/RcERr/qJ4LJs6vCEQwvrxlhVWWmi21Z5MRmr1omty+++gF1iEdx2zBj6D9D7tzg==',key_name='tempest-keypair-1053291466',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b1fa68347914efe87ae8edd3901e11a',ramdisk_id='',reservation_id='r-u0kwk6qq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-151902651',owner_user_name='tempest-VolumesSnapshotTestJSON-151902651-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:15:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='993622d17e1848a0980fd759e248edda',uuid=10968e11-51b2-46a4-87a5-bb85f938f489,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ec7d55d-9178-4dbc-8c24-d3ecf46398bc", "address": "fa:16:3e:89:59:c1", "network": {"id": "8220309c-e09f-4c20-8f74-abdf4688fe64", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-160547739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b1fa68347914efe87ae8edd3901e11a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ec7d55d-91", "ovs_interfaceid": "4ec7d55d-9178-4dbc-8c24-d3ecf46398bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:15:59 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Converting VIF {"id": "4ec7d55d-9178-4dbc-8c24-d3ecf46398bc", "address": "fa:16:3e:89:59:c1", "network": {"id": "8220309c-e09f-4c20-8f74-abdf4688fe64", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-160547739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b1fa68347914efe87ae8edd3901e11a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ec7d55d-91", "ovs_interfaceid": "4ec7d55d-9178-4dbc-8c24-d3ecf46398bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:15:59 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:59:c1,bridge_name='br-int',has_traffic_filtering=True,id=4ec7d55d-9178-4dbc-8c24-d3ecf46398bc,network=Network(8220309c-e09f-4c20-8f74-abdf4688fe64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ec7d55d-91') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:15:59 user nova-compute[95467]: DEBUG nova.objects.instance [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lazy-loading 'pci_devices' on Instance uuid 10968e11-51b2-46a4-87a5-bb85f938f489 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:15:59 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:15:59 user nova-compute[95467]:   <uuid>10968e11-51b2-46a4-87a5-bb85f938f489</uuid>
Nov 15 08:15:59 user nova-compute[95467]:   <name>instance-00000019</name>
Nov 15 08:15:59 user nova-compute[95467]:   <memory>524288</memory>
Nov 15 08:15:59 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:15:59 user nova-compute[95467]:   <metadata>
Nov 15 08:15:59 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:15:59 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:15:59 user nova-compute[95467]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1101118524</nova:name>
Nov 15 08:15:59 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:15:59</nova:creationTime>
Nov 15 08:15:59 user nova-compute[95467]:       <nova:flavor name="m1.tiny">
Nov 15 08:15:59 user nova-compute[95467]:         <nova:memory>512</nova:memory>
Nov 15 08:15:59 user nova-compute[95467]:         <nova:disk>1</nova:disk>
Nov 15 08:15:59 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:15:59 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:15:59 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:15:59 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:15:59 user nova-compute[95467]:       <nova:owner>
Nov 15 08:15:59 user nova-compute[95467]:         <nova:user uuid="993622d17e1848a0980fd759e248edda">tempest-VolumesSnapshotTestJSON-151902651-project-member</nova:user>
Nov 15 08:15:59 user nova-compute[95467]:         <nova:project uuid="0b1fa68347914efe87ae8edd3901e11a">tempest-VolumesSnapshotTestJSON-151902651</nova:project>
Nov 15 08:15:59 user nova-compute[95467]:       </nova:owner>
Nov 15 08:15:59 user nova-compute[95467]:       <nova:root type="image" uuid="ed9c48aa-ce73-4b3b-9db1-235898be671b"/>
Nov 15 08:15:59 user nova-compute[95467]:       <nova:ports>
Nov 15 08:15:59 user nova-compute[95467]:         <nova:port uuid="4ec7d55d-9178-4dbc-8c24-d3ecf46398bc">
Nov 15 08:15:59 user nova-compute[95467]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 08:15:59 user nova-compute[95467]:         </nova:port>
Nov 15 08:15:59 user nova-compute[95467]:       </nova:ports>
Nov 15 08:15:59 user nova-compute[95467]:     </nova:instance>
Nov 15 08:15:59 user nova-compute[95467]:   </metadata>
Nov 15 08:15:59 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:15:59 user nova-compute[95467]:     <system>
Nov 15 08:15:59 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:15:59 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:15:59 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:15:59 user nova-compute[95467]:       <entry name="serial">10968e11-51b2-46a4-87a5-bb85f938f489</entry>
Nov 15 08:15:59 user nova-compute[95467]:       <entry name="uuid">10968e11-51b2-46a4-87a5-bb85f938f489</entry>
Nov 15 08:15:59 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:15:59 user nova-compute[95467]:     </system>
Nov 15 08:15:59 user nova-compute[95467]:   </sysinfo>
Nov 15 08:15:59 user nova-compute[95467]:   <os>
Nov 15 08:15:59 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:15:59 user nova-compute[95467]:     <boot dev="hd"/>
Nov 15 08:15:59 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:15:59 user nova-compute[95467]:   </os>
Nov 15 08:15:59 user nova-compute[95467]:   <features>
Nov 15 08:15:59 user nova-compute[95467]:     <acpi/>
Nov 15 08:15:59 user nova-compute[95467]:     <apic/>
Nov 15 08:15:59 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:15:59 user nova-compute[95467]:   </features>
Nov 15 08:15:59 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:15:59 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:15:59 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:15:59 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:15:59 user nova-compute[95467]:   </clock>
Nov 15 08:15:59 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:15:59 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:15:59 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:15:59 user nova-compute[95467]:   </cpu>
Nov 15 08:15:59 user nova-compute[95467]:   <devices>
Nov 15 08:15:59 user nova-compute[95467]:     <disk type="file" device="disk">
Nov 15 08:15:59 user nova-compute[95467]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 08:15:59 user nova-compute[95467]:       <source file="/opt/stack/data/nova/instances/10968e11-51b2-46a4-87a5-bb85f938f489/disk"/>
Nov 15 08:15:59 user nova-compute[95467]:       <target dev="vda" bus="virtio"/>
Nov 15 08:15:59 user nova-compute[95467]:     </disk>
Nov 15 08:15:59 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:15:59 user nova-compute[95467]:       <mac address="fa:16:3e:89:59:c1"/>
Nov 15 08:15:59 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:15:59 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:15:59 user nova-compute[95467]:       <target dev="tap4ec7d55d-91"/>
Nov 15 08:15:59 user nova-compute[95467]:     </interface>
Nov 15 08:15:59 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:15:59 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/10968e11-51b2-46a4-87a5-bb85f938f489/console.log" append="off"/>
Nov 15 08:15:59 user nova-compute[95467]:     </serial>
Nov 15 08:15:59 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:15:59 user nova-compute[95467]:     <video>
Nov 15 08:15:59 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:15:59 user nova-compute[95467]:     </video>
Nov 15 08:15:59 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:15:59 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:15:59 user nova-compute[95467]:     </rng>
Nov 15 08:15:59 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:15:59 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:15:59 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:15:59 user nova-compute[95467]:     </memballoon>
Nov 15 08:15:59 user nova-compute[95467]:   </devices>
Nov 15 08:15:59 user nova-compute[95467]: </domain>
Nov 15 08:15:59 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:15:59 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:15:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1101118524',display_name='tempest-VolumesSnapshotTestJSON-instance-1101118524',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1101118524',id=25,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjxpbQgsiXxNlI5Ae92vX4yzSpRlM5HGPj1s+fXD7KhgNK2evFVwMx9fAfKTljspB/RcERr/qJ4LJs6vCEQwvrxlhVWWmi21Z5MRmr1omty+++gF1iEdx2zBj6D9D7tzg==',key_name='tempest-keypair-1053291466',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b1fa68347914efe87ae8edd3901e11a',ramdisk_id='',reservation_id='r-u0kwk6qq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-151902651',owner_user_name='tempest-VolumesSnapshotTestJSON-151902651-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:15:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='993622d17e1848a0980fd759e248edda',uuid=10968e11-51b2-46a4-87a5-bb85f938f489,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ec7d55d-9178-4dbc-8c24-d3ecf46398bc", "address": "fa:16:3e:89:59:c1", "network": {"id": "8220309c-e09f-4c20-8f74-abdf4688fe64", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-160547739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b1fa68347914efe87ae8edd3901e11a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ec7d55d-91", "ovs_interfaceid": "4ec7d55d-9178-4dbc-8c24-d3ecf46398bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:15:59 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Converting VIF {"id": "4ec7d55d-9178-4dbc-8c24-d3ecf46398bc", "address": "fa:16:3e:89:59:c1", "network": {"id": "8220309c-e09f-4c20-8f74-abdf4688fe64", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-160547739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b1fa68347914efe87ae8edd3901e11a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ec7d55d-91", "ovs_interfaceid": "4ec7d55d-9178-4dbc-8c24-d3ecf46398bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:15:59 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:59:c1,bridge_name='br-int',has_traffic_filtering=True,id=4ec7d55d-9178-4dbc-8c24-d3ecf46398bc,network=Network(8220309c-e09f-4c20-8f74-abdf4688fe64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ec7d55d-91') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:15:59 user nova-compute[95467]: DEBUG os_vif [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:59:c1,bridge_name='br-int',has_traffic_filtering=True,id=4ec7d55d-9178-4dbc-8c24-d3ecf46398bc,network=Network(8220309c-e09f-4c20-8f74-abdf4688fe64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ec7d55d-91') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:15:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:15:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:15:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6e99a040-82d9-516e-a7e9-0631395c9a69', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:15:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:15:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4ec7d55d-91, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:15:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4ec7d55d-91, col_values=(('qos', UUID('65a0dbcf-dcd8-4217-a2b6-03d62c873e6f')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:15:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4ec7d55d-91, col_values=(('external_ids', {'iface-id': '4ec7d55d-9178-4dbc-8c24-d3ecf46398bc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:59:c1', 'vm-uuid': '10968e11-51b2-46a4-87a5-bb85f938f489'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:15:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:15:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:15:59 user nova-compute[95467]: INFO os_vif [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:59:c1,bridge_name='br-int',has_traffic_filtering=True,id=4ec7d55d-9178-4dbc-8c24-d3ecf46398bc,network=Network(8220309c-e09f-4c20-8f74-abdf4688fe64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ec7d55d-91')
Nov 15 08:16:00 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:16:00 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] No VIF found with MAC fa:16:3e:89:59:c1, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:16:00 user nova-compute[95467]: DEBUG nova.network.neutron [req-554e705f-61eb-4be3-a930-280634e3311f req-9c42523d-2a9f-475a-8c31-10e0b9ff14c5 service nova] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] Updated VIF entry in instance network info cache for port 4ec7d55d-9178-4dbc-8c24-d3ecf46398bc. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:16:00 user nova-compute[95467]: DEBUG nova.network.neutron [req-554e705f-61eb-4be3-a930-280634e3311f req-9c42523d-2a9f-475a-8c31-10e0b9ff14c5 service nova] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] Updating instance_info_cache with network_info: [{"id": "4ec7d55d-9178-4dbc-8c24-d3ecf46398bc", "address": "fa:16:3e:89:59:c1", "network": {"id": "8220309c-e09f-4c20-8f74-abdf4688fe64", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-160547739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b1fa68347914efe87ae8edd3901e11a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ec7d55d-91", "ovs_interfaceid": "4ec7d55d-9178-4dbc-8c24-d3ecf46398bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:16:00 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-554e705f-61eb-4be3-a930-280634e3311f req-9c42523d-2a9f-475a-8c31-10e0b9ff14c5 service nova] Releasing lock "refresh_cache-10968e11-51b2-46a4-87a5-bb85f938f489" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:16:01 user nova-compute[95467]: DEBUG os_brick.utils [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:16:01 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:01 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:01 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[73bcf9aa-afcb-4298-ab6b-6ef86bc0bb51]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:882ae90641f\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:16:01 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:01 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:01 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c4a5de-a901-4565-a24b-91adc5d0d5dc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:16:01 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:01 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:01 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:01 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10a2a5d-d995-4675-a7f8-ac8402010f26]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:16:01 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[9288c035-fc6f-4565-b9dd-1d885d90efbb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:16:01 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Running cmd (subprocess): nvme version {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:01 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] 'nvme version' failed. Not Retrying. {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:16:01 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:01 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] nvme not present on system {{(pid=95467) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 08:16:01 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:01 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:16:01 user nova-compute[95467]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 08:16:01 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df63220-88fc-4baa-820b-068e3c28ad54]: (4, '') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:16:01 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=95467) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 08:16:01 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 08:16:01 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] LIGHTOS: no hostnqn found. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 08:16:01 user nova-compute[95467]: DEBUG os_brick.utils [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] <== get_connector_properties: return (173ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:882ae90641f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:16:01 user nova-compute[95467]: DEBUG nova.virt.block_device [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Updating existing volume attachment record: 99d3e8d0-ffed-4b42-a370-625b29836bc1 {{(pid=95467) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 08:16:01 user nova-compute[95467]: DEBUG nova.compute.manager [req-5f7be96a-4810-45cb-a55b-28a8f6f7a067 req-0846c6ee-3b9f-4e23-b4e4-a4496214df9f service nova] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] Received event network-vif-plugged-4ec7d55d-9178-4dbc-8c24-d3ecf46398bc {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:16:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-5f7be96a-4810-45cb-a55b-28a8f6f7a067 req-0846c6ee-3b9f-4e23-b4e4-a4496214df9f service nova] Acquiring lock "10968e11-51b2-46a4-87a5-bb85f938f489-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:16:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-5f7be96a-4810-45cb-a55b-28a8f6f7a067 req-0846c6ee-3b9f-4e23-b4e4-a4496214df9f service nova] Lock "10968e11-51b2-46a4-87a5-bb85f938f489-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:16:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-5f7be96a-4810-45cb-a55b-28a8f6f7a067 req-0846c6ee-3b9f-4e23-b4e4-a4496214df9f service nova] Lock "10968e11-51b2-46a4-87a5-bb85f938f489-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:16:01 user nova-compute[95467]: DEBUG nova.compute.manager [req-5f7be96a-4810-45cb-a55b-28a8f6f7a067 req-0846c6ee-3b9f-4e23-b4e4-a4496214df9f service nova] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] No waiting events found dispatching network-vif-plugged-4ec7d55d-9178-4dbc-8c24-d3ecf46398bc {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:16:01 user nova-compute[95467]: WARNING nova.compute.manager [req-5f7be96a-4810-45cb-a55b-28a8f6f7a067 req-0846c6ee-3b9f-4e23-b4e4-a4496214df9f service nova] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] Received unexpected event network-vif-plugged-4ec7d55d-9178-4dbc-8c24-d3ecf46398bc for instance with vm_state building and task_state spawning.
Nov 15 08:16:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:03 user nova-compute[95467]: DEBUG nova.compute.manager [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] Instance event wait completed in 0 seconds for  {{(pid=95467) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 08:16:03 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] Guest created on hypervisor {{(pid=95467) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 08:16:03 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] Instance spawned successfully.
Nov 15 08:16:03 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 08:16:03 user nova-compute[95467]: DEBUG nova.compute.manager [req-847bfc36-26a7-49d6-89f8-bb27e9182d63 req-0aeb1296-b88d-4b14-88b2-66dd42c39ee9 service nova] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] Received event network-vif-plugged-4ec7d55d-9178-4dbc-8c24-d3ecf46398bc {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:16:03 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-847bfc36-26a7-49d6-89f8-bb27e9182d63 req-0aeb1296-b88d-4b14-88b2-66dd42c39ee9 service nova] Acquiring lock "10968e11-51b2-46a4-87a5-bb85f938f489-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:16:03 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-847bfc36-26a7-49d6-89f8-bb27e9182d63 req-0aeb1296-b88d-4b14-88b2-66dd42c39ee9 service nova] Lock "10968e11-51b2-46a4-87a5-bb85f938f489-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:16:03 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-847bfc36-26a7-49d6-89f8-bb27e9182d63 req-0aeb1296-b88d-4b14-88b2-66dd42c39ee9 service nova] Lock "10968e11-51b2-46a4-87a5-bb85f938f489-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:16:03 user nova-compute[95467]: DEBUG nova.compute.manager [req-847bfc36-26a7-49d6-89f8-bb27e9182d63 req-0aeb1296-b88d-4b14-88b2-66dd42c39ee9 service nova] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] No waiting events found dispatching network-vif-plugged-4ec7d55d-9178-4dbc-8c24-d3ecf46398bc {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:16:03 user nova-compute[95467]: WARNING nova.compute.manager [req-847bfc36-26a7-49d6-89f8-bb27e9182d63 req-0aeb1296-b88d-4b14-88b2-66dd42c39ee9 service nova] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] Received unexpected event network-vif-plugged-4ec7d55d-9178-4dbc-8c24-d3ecf46398bc for instance with vm_state building and task_state spawning.
Nov 15 08:16:03 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] Found default for hw_cdrom_bus of ide {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:16:03 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] Found default for hw_disk_bus of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:16:03 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] Found default for hw_input_bus of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:16:03 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] Found default for hw_pointer_model of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:16:03 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] Found default for hw_video_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:16:03 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] Found default for hw_vif_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:16:03 user nova-compute[95467]: INFO nova.compute.manager [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] Took 5.93 seconds to spawn the instance on the hypervisor.
Nov 15 08:16:03 user nova-compute[95467]: DEBUG nova.compute.manager [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:16:03 user nova-compute[95467]: INFO nova.compute.manager [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] Took 6.75 seconds to build instance.
Nov 15 08:16:03 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-547fcf27-e298-48e6-be38-40e292dc55bb tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lock "10968e11-51b2-46a4-87a5-bb85f938f489" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.962s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:16:04 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG nova.compute.manager [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Start spawning the instance on the hypervisor. {{(pid=95467) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Creating instance directory {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 08:16:06 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Creating image(s)
Nov 15 08:16:06 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Did not create local disks {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Ensure instance console log exists: /opt/stack/data/nova/instances/3825a691-ac5c-4c06-b4a4-2a0b40c638c4/console.log {{(pid=95467) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Start _get_guest_xml network_info=[{"id": "3fddc7dd-48af-4964-bc1a-a54623453f62", "address": "fa:16:3e:c6:49:ac", "network": {"id": "ac9a381d-25fe-4419-b151-f03333413813", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1183680999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34d65a8000347feb2b3966b7ce0d785", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fddc7dd-48", "ovs_interfaceid": "3fddc7dd-48af-4964-bc1a-a54623453f62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '99d3e8d0-ffed-4b42-a370-625b29836bc1', 'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HFkTLjDm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3825a691-ac5c-4c06-b4a4-2a0b40c638c4', 'attached_at': '', 'detached_at': '', 'volume_id': 'b3089133-4789-4c57-b24a-05d2c0ac013e', 'serial': 'b3089133-4789-4c57-b24a-05d2c0ac013e'}, 'volume_type': None} {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:16:06 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:16:06 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:16:06 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Calling os-brick to attach iSCSI Volume {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HFkTLjDm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:16:06 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:16:06 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:16:06 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:16:06 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:16:06 user nova-compute[95467]: INFO os_brick.initiator.connectors.iscsi [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 08:16:06 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e -p 172.16.0.220:3260 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bab14e3-f400-4a64-9882-f81883c09444]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 08:16:06 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e -p 172.16.0.220:3260 --interface default --op new {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[43fb8092-ba62-4911-b8a6-6ebaadb85189]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e] added\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e] added
Nov 15 08:16:06 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ab2b95-fff7-4a37-8469-67883f98d182]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6bcdb4f-0c72-41fd-a22e-006aa912ef76]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HFkTLjDm {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HFkTLjDm" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1fdc7db-dae8-411f-9fa8-41da1d1ba0fd]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HFkTLjDm'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.033s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3d18bc-ce44-4f70-bb7f-093272e248b8]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f59d3af-cbda-43b9-8597-b845ee2c04ba]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 (non-flash)
Nov 15 08:16:06 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 (non-flash)
Nov 15 08:16:06 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e -p 172.16.0.220:3260 --login {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb21b36d-52ca-41a4-bc20-f21f36ae502b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e, portal: 172.16.0.220,3260]
Nov 15 08:16:06 user nova-compute[95467]: Login to [iface: default, target: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e, portal: 172.16.0.220,3260] successful.
Nov 15 08:16:06 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c72eb5-c95b-4702-a634-d75bf5ab6aee]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[7efe3fb2-dfb2-49c0-86ab-dbc8b2e46e20]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 (non-flash)
Nov 15 08:16:06 user nova-compute[95467]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:16:06 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 (non-flash)
Nov 15 08:16:06 user nova-compute[95467]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:16:06 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Connected to 172.16.0.220:3260 {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=95467) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=95467) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 08:16:06 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:07 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:07 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22dbad7-d1a8-4210-b151-7b085749d9cf]: (4, ('- - 0', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:16:07 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:16:07 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HFkTLjDm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 08:16:07 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:08 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:16:08 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '23338656630333839', 'path': '/dev/sdb'} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:16:08 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23338656630333839', 'path': '/dev/sdb'} {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 08:16:08 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:15:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-483246753',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-483246753',id=24,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c34d65a8000347feb2b3966b7ce0d785',ramdisk_id='',reservation_id='r-qiiyu7bw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1903830225',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:15:56Z,user_data=None,user_id='6971581ab2604353aeb0c45c5252b4fb',uuid=3825a691-ac5c-4c06-b4a4-2a0b40c638c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3fddc7dd-48af-4964-bc1a-a54623453f62", "address": "fa:16:3e:c6:49:ac", "network": {"id": "ac9a381d-25fe-4419-b151-f03333413813", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1183680999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34d65a8000347feb2b3966b7ce0d785", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fddc7dd-48", "ovs_interfaceid": "3fddc7dd-48af-4964-bc1a-a54623453f62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:16:08 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Converting VIF {"id": "3fddc7dd-48af-4964-bc1a-a54623453f62", "address": "fa:16:3e:c6:49:ac", "network": {"id": "ac9a381d-25fe-4419-b151-f03333413813", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1183680999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34d65a8000347feb2b3966b7ce0d785", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fddc7dd-48", "ovs_interfaceid": "3fddc7dd-48af-4964-bc1a-a54623453f62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:16:08 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:49:ac,bridge_name='br-int',has_traffic_filtering=True,id=3fddc7dd-48af-4964-bc1a-a54623453f62,network=Network(ac9a381d-25fe-4419-b151-f03333413813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fddc7dd-48') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:16:08 user nova-compute[95467]: DEBUG nova.objects.instance [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lazy-loading 'pci_devices' on Instance uuid 3825a691-ac5c-4c06-b4a4-2a0b40c638c4 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:16:08 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:16:08 user nova-compute[95467]:   <uuid>3825a691-ac5c-4c06-b4a4-2a0b40c638c4</uuid>
Nov 15 08:16:08 user nova-compute[95467]:   <name>instance-00000018</name>
Nov 15 08:16:08 user nova-compute[95467]:   <memory>524288</memory>
Nov 15 08:16:08 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:16:08 user nova-compute[95467]:   <metadata>
Nov 15 08:16:08 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:16:08 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:16:08 user nova-compute[95467]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-483246753</nova:name>
Nov 15 08:16:08 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:16:06</nova:creationTime>
Nov 15 08:16:08 user nova-compute[95467]:       <nova:flavor name="m1.tiny">
Nov 15 08:16:08 user nova-compute[95467]:         <nova:memory>512</nova:memory>
Nov 15 08:16:08 user nova-compute[95467]:         <nova:disk>1</nova:disk>
Nov 15 08:16:08 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:16:08 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:16:08 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:16:08 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:16:08 user nova-compute[95467]:       <nova:owner>
Nov 15 08:16:08 user nova-compute[95467]:         <nova:user uuid="6971581ab2604353aeb0c45c5252b4fb">tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member</nova:user>
Nov 15 08:16:08 user nova-compute[95467]:         <nova:project uuid="c34d65a8000347feb2b3966b7ce0d785">tempest-ServerBootFromVolumeStableRescueTest-1903830225</nova:project>
Nov 15 08:16:08 user nova-compute[95467]:       </nova:owner>
Nov 15 08:16:08 user nova-compute[95467]:       <nova:root type="image" uuid="ed9c48aa-ce73-4b3b-9db1-235898be671b"/>
Nov 15 08:16:08 user nova-compute[95467]:       <nova:ports>
Nov 15 08:16:08 user nova-compute[95467]:         <nova:port uuid="3fddc7dd-48af-4964-bc1a-a54623453f62">
Nov 15 08:16:08 user nova-compute[95467]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 08:16:08 user nova-compute[95467]:         </nova:port>
Nov 15 08:16:08 user nova-compute[95467]:       </nova:ports>
Nov 15 08:16:08 user nova-compute[95467]:     </nova:instance>
Nov 15 08:16:08 user nova-compute[95467]:   </metadata>
Nov 15 08:16:08 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:16:08 user nova-compute[95467]:     <system>
Nov 15 08:16:08 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:16:08 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:16:08 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:16:08 user nova-compute[95467]:       <entry name="serial">3825a691-ac5c-4c06-b4a4-2a0b40c638c4</entry>
Nov 15 08:16:08 user nova-compute[95467]:       <entry name="uuid">3825a691-ac5c-4c06-b4a4-2a0b40c638c4</entry>
Nov 15 08:16:08 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:16:08 user nova-compute[95467]:     </system>
Nov 15 08:16:08 user nova-compute[95467]:   </sysinfo>
Nov 15 08:16:08 user nova-compute[95467]:   <os>
Nov 15 08:16:08 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:16:08 user nova-compute[95467]:     <boot dev="hd"/>
Nov 15 08:16:08 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:16:08 user nova-compute[95467]:   </os>
Nov 15 08:16:08 user nova-compute[95467]:   <features>
Nov 15 08:16:08 user nova-compute[95467]:     <acpi/>
Nov 15 08:16:08 user nova-compute[95467]:     <apic/>
Nov 15 08:16:08 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:16:08 user nova-compute[95467]:   </features>
Nov 15 08:16:08 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:16:08 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:16:08 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:16:08 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:16:08 user nova-compute[95467]:   </clock>
Nov 15 08:16:08 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:16:08 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:16:08 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:16:08 user nova-compute[95467]:   </cpu>
Nov 15 08:16:08 user nova-compute[95467]:   <devices>
Nov 15 08:16:08 user nova-compute[95467]:     <disk type="block" device="disk">
Nov 15 08:16:08 user nova-compute[95467]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:16:08 user nova-compute[95467]:       <source dev="/dev/sdb"/>
Nov 15 08:16:08 user nova-compute[95467]:       <target dev="vda" bus="virtio"/>
Nov 15 08:16:08 user nova-compute[95467]:       <serial>b3089133-4789-4c57-b24a-05d2c0ac013e</serial>
Nov 15 08:16:08 user nova-compute[95467]:     </disk>
Nov 15 08:16:08 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:16:08 user nova-compute[95467]:       <mac address="fa:16:3e:c6:49:ac"/>
Nov 15 08:16:08 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:16:08 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:16:08 user nova-compute[95467]:       <target dev="tap3fddc7dd-48"/>
Nov 15 08:16:08 user nova-compute[95467]:     </interface>
Nov 15 08:16:08 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:16:08 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/3825a691-ac5c-4c06-b4a4-2a0b40c638c4/console.log" append="off"/>
Nov 15 08:16:08 user nova-compute[95467]:     </serial>
Nov 15 08:16:08 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:16:08 user nova-compute[95467]:     <video>
Nov 15 08:16:08 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:16:08 user nova-compute[95467]:     </video>
Nov 15 08:16:08 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:16:08 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:16:08 user nova-compute[95467]:     </rng>
Nov 15 08:16:08 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:16:08 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:16:08 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:16:08 user nova-compute[95467]:     </memballoon>
Nov 15 08:16:08 user nova-compute[95467]:   </devices>
Nov 15 08:16:08 user nova-compute[95467]: </domain>
Nov 15 08:16:08 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:16:08 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:15:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-483246753',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-483246753',id=24,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c34d65a8000347feb2b3966b7ce0d785',ramdisk_id='',reservation_id='r-qiiyu7bw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1903830225',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:15:56Z,user_data=None,user_id='6971581ab2604353aeb0c45c5252b4fb',uuid=3825a691-ac5c-4c06-b4a4-2a0b40c638c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3fddc7dd-48af-4964-bc1a-a54623453f62", "address": "fa:16:3e:c6:49:ac", "network": {"id": "ac9a381d-25fe-4419-b151-f03333413813", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1183680999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34d65a8000347feb2b3966b7ce0d785", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fddc7dd-48", "ovs_interfaceid": "3fddc7dd-48af-4964-bc1a-a54623453f62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:16:08 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Converting VIF {"id": "3fddc7dd-48af-4964-bc1a-a54623453f62", "address": "fa:16:3e:c6:49:ac", "network": {"id": "ac9a381d-25fe-4419-b151-f03333413813", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1183680999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34d65a8000347feb2b3966b7ce0d785", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fddc7dd-48", "ovs_interfaceid": "3fddc7dd-48af-4964-bc1a-a54623453f62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:16:08 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:49:ac,bridge_name='br-int',has_traffic_filtering=True,id=3fddc7dd-48af-4964-bc1a-a54623453f62,network=Network(ac9a381d-25fe-4419-b151-f03333413813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fddc7dd-48') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:16:08 user nova-compute[95467]: DEBUG os_vif [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:49:ac,bridge_name='br-int',has_traffic_filtering=True,id=3fddc7dd-48af-4964-bc1a-a54623453f62,network=Network(ac9a381d-25fe-4419-b151-f03333413813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fddc7dd-48') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:16:08 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:08 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:16:08 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:16:08 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:08 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2615e0ff-66a5-5394-85a6-8cbf6290e2ad', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:16:08 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:08 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:08 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:08 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3fddc7dd-48, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:16:08 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3fddc7dd-48, col_values=(('qos', UUID('5038da26-ca5d-4c32-93f8-3246791547cf')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:16:08 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3fddc7dd-48, col_values=(('external_ids', {'iface-id': '3fddc7dd-48af-4964-bc1a-a54623453f62', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:49:ac', 'vm-uuid': '3825a691-ac5c-4c06-b4a4-2a0b40c638c4'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:16:08 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:08 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:16:08 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:08 user nova-compute[95467]: INFO os_vif [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:49:ac,bridge_name='br-int',has_traffic_filtering=True,id=3fddc7dd-48af-4964-bc1a-a54623453f62,network=Network(ac9a381d-25fe-4419-b151-f03333413813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fddc7dd-48')
Nov 15 08:16:08 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:16:08 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] No VIF found with MAC fa:16:3e:c6:49:ac, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:16:09 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:09 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:09 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:09 user nova-compute[95467]: DEBUG nova.compute.manager [req-c994e3d7-51d9-4adf-8e2c-49c05af0e1b0 req-c7c3bbf1-8a23-4efb-adbd-b412642ad847 service nova] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Received event network-vif-plugged-3fddc7dd-48af-4964-bc1a-a54623453f62 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:16:09 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-c994e3d7-51d9-4adf-8e2c-49c05af0e1b0 req-c7c3bbf1-8a23-4efb-adbd-b412642ad847 service nova] Acquiring lock "3825a691-ac5c-4c06-b4a4-2a0b40c638c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:16:09 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-c994e3d7-51d9-4adf-8e2c-49c05af0e1b0 req-c7c3bbf1-8a23-4efb-adbd-b412642ad847 service nova] Lock "3825a691-ac5c-4c06-b4a4-2a0b40c638c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:16:09 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-c994e3d7-51d9-4adf-8e2c-49c05af0e1b0 req-c7c3bbf1-8a23-4efb-adbd-b412642ad847 service nova] Lock "3825a691-ac5c-4c06-b4a4-2a0b40c638c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:16:09 user nova-compute[95467]: DEBUG nova.compute.manager [req-c994e3d7-51d9-4adf-8e2c-49c05af0e1b0 req-c7c3bbf1-8a23-4efb-adbd-b412642ad847 service nova] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] No waiting events found dispatching network-vif-plugged-3fddc7dd-48af-4964-bc1a-a54623453f62 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:16:09 user nova-compute[95467]: WARNING nova.compute.manager [req-c994e3d7-51d9-4adf-8e2c-49c05af0e1b0 req-c7c3bbf1-8a23-4efb-adbd-b412642ad847 service nova] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Received unexpected event network-vif-plugged-3fddc7dd-48af-4964-bc1a-a54623453f62 for instance with vm_state building and task_state spawning.
Nov 15 08:16:09 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:09 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:11 user nova-compute[95467]: DEBUG nova.compute.manager [req-a3d5bbe8-5ef1-4ba7-ba21-e9d6d5960fb3 req-a8d82861-a1ad-4c84-873a-76ac2b69ad7b service nova] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Received event network-vif-plugged-3fddc7dd-48af-4964-bc1a-a54623453f62 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:16:11 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-a3d5bbe8-5ef1-4ba7-ba21-e9d6d5960fb3 req-a8d82861-a1ad-4c84-873a-76ac2b69ad7b service nova] Acquiring lock "3825a691-ac5c-4c06-b4a4-2a0b40c638c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:16:11 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-a3d5bbe8-5ef1-4ba7-ba21-e9d6d5960fb3 req-a8d82861-a1ad-4c84-873a-76ac2b69ad7b service nova] Lock "3825a691-ac5c-4c06-b4a4-2a0b40c638c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:16:11 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-a3d5bbe8-5ef1-4ba7-ba21-e9d6d5960fb3 req-a8d82861-a1ad-4c84-873a-76ac2b69ad7b service nova] Lock "3825a691-ac5c-4c06-b4a4-2a0b40c638c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:16:11 user nova-compute[95467]: DEBUG nova.compute.manager [req-a3d5bbe8-5ef1-4ba7-ba21-e9d6d5960fb3 req-a8d82861-a1ad-4c84-873a-76ac2b69ad7b service nova] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] No waiting events found dispatching network-vif-plugged-3fddc7dd-48af-4964-bc1a-a54623453f62 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:16:11 user nova-compute[95467]: WARNING nova.compute.manager [req-a3d5bbe8-5ef1-4ba7-ba21-e9d6d5960fb3 req-a8d82861-a1ad-4c84-873a-76ac2b69ad7b service nova] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Received unexpected event network-vif-plugged-3fddc7dd-48af-4964-bc1a-a54623453f62 for instance with vm_state building and task_state spawning.
Nov 15 08:16:12 user nova-compute[95467]: DEBUG nova.compute.manager [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Instance event wait completed in 0 seconds for  {{(pid=95467) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 08:16:12 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Guest created on hypervisor {{(pid=95467) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 08:16:12 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Instance spawned successfully.
Nov 15 08:16:12 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 08:16:12 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Found default for hw_cdrom_bus of ide {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:16:12 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Found default for hw_disk_bus of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:16:12 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Found default for hw_input_bus of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:16:12 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Found default for hw_pointer_model of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:16:12 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Found default for hw_video_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:16:12 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Found default for hw_vif_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:16:12 user nova-compute[95467]: INFO nova.compute.manager [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Took 5.56 seconds to spawn the instance on the hypervisor.
Nov 15 08:16:12 user nova-compute[95467]: DEBUG nova.compute.manager [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:16:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:12 user nova-compute[95467]: INFO nova.compute.manager [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Took 17.21 seconds to build instance.
Nov 15 08:16:12 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-b3bb7dbd-3a49-4786-945b-f8aaeb9a1c37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "3825a691-ac5c-4c06-b4a4-2a0b40c638c4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.410s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:16:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:14 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._sync_power_states {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:16:15 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Triggering sync for uuid ee2aa477-6786-483a-b088-d8ec204fe6aa {{(pid=95467) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 08:16:15 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Triggering sync for uuid 73fe8852-c47a-47ab-a56f-6864c8ed5479 {{(pid=95467) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 08:16:15 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Triggering sync for uuid 36dccf43-d4a3-47aa-bd73-de9646e1020c {{(pid=95467) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 08:16:15 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Triggering sync for uuid 21cf2ada-b15c-490d-ac37-96e9c87e9056 {{(pid=95467) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 08:16:15 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Triggering sync for uuid 3711c883-ec5f-4a09-88f8-d4c0668ae570 {{(pid=95467) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 08:16:15 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Triggering sync for uuid bee31898-4f12-4c68-a18b-a678f9f584aa {{(pid=95467) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 08:16:15 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Triggering sync for uuid da9c7b9d-aad7-4d4f-b190-fda71735fde6 {{(pid=95467) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 08:16:15 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Triggering sync for uuid b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67 {{(pid=95467) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 08:16:15 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Triggering sync for uuid 10d73b73-ca65-4192-8954-288dc1df9f24 {{(pid=95467) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 08:16:15 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Triggering sync for uuid d5a35226-6b98-44ad-ab4d-e0e86b14ba9d {{(pid=95467) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 08:16:15 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Triggering sync for uuid 3825a691-ac5c-4c06-b4a4-2a0b40c638c4 {{(pid=95467) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 08:16:15 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Triggering sync for uuid 10968e11-51b2-46a4-87a5-bb85f938f489 {{(pid=95467) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 08:16:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "ee2aa477-6786-483a-b088-d8ec204fe6aa" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:16:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "ee2aa477-6786-483a-b088-d8ec204fe6aa" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:16:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "73fe8852-c47a-47ab-a56f-6864c8ed5479" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:16:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "73fe8852-c47a-47ab-a56f-6864c8ed5479" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:16:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "36dccf43-d4a3-47aa-bd73-de9646e1020c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:16:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "36dccf43-d4a3-47aa-bd73-de9646e1020c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:16:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "21cf2ada-b15c-490d-ac37-96e9c87e9056" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:16:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "21cf2ada-b15c-490d-ac37-96e9c87e9056" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:16:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "3711c883-ec5f-4a09-88f8-d4c0668ae570" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:16:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "3711c883-ec5f-4a09-88f8-d4c0668ae570" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:16:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "bee31898-4f12-4c68-a18b-a678f9f584aa" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:16:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "bee31898-4f12-4c68-a18b-a678f9f584aa" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:16:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "da9c7b9d-aad7-4d4f-b190-fda71735fde6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:16:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "da9c7b9d-aad7-4d4f-b190-fda71735fde6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:16:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:16:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:16:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "10d73b73-ca65-4192-8954-288dc1df9f24" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:16:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "10d73b73-ca65-4192-8954-288dc1df9f24" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:16:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "d5a35226-6b98-44ad-ab4d-e0e86b14ba9d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:16:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "d5a35226-6b98-44ad-ab4d-e0e86b14ba9d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:16:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "3825a691-ac5c-4c06-b4a4-2a0b40c638c4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:16:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "3825a691-ac5c-4c06-b4a4-2a0b40c638c4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:16:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "10968e11-51b2-46a4-87a5-bb85f938f489" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:16:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "10968e11-51b2-46a4-87a5-bb85f938f489" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:16:15 user nova-compute[95467]: WARNING oslo_messaging._drivers.amqpdriver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20
Nov 15 08:16:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "ee2aa477-6786-483a-b088-d8ec204fe6aa" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.067s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:16:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "73fe8852-c47a-47ab-a56f-6864c8ed5479" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.080s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:16:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "da9c7b9d-aad7-4d4f-b190-fda71735fde6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.086s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:16:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "36dccf43-d4a3-47aa-bd73-de9646e1020c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.091s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:16:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "bee31898-4f12-4c68-a18b-a678f9f584aa" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.102s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:16:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "3825a691-ac5c-4c06-b4a4-2a0b40c638c4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.099s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:16:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "3711c883-ec5f-4a09-88f8-d4c0668ae570" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.105s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:16:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "d5a35226-6b98-44ad-ab4d-e0e86b14ba9d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.103s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:16:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "21cf2ada-b15c-490d-ac37-96e9c87e9056" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.108s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:16:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.108s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:16:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "10d73b73-ca65-4192-8954-288dc1df9f24" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.114s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:16:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "10968e11-51b2-46a4-87a5-bb85f938f489" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.114s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:16:17 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:18 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:23 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Acquiring lock "2765af98-917a-4f0f-95af-3393e0d50a52" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:16:23 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "2765af98-917a-4f0f-95af-3393e0d50a52" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:16:23 user nova-compute[95467]: DEBUG nova.compute.manager [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] Starting instance... {{(pid=95467) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 08:16:23 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:23 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:16:23 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:16:23 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=95467) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 08:16:23 user nova-compute[95467]: INFO nova.compute.claims [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] Claim successful on node user
Nov 15 08:16:23 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:16:23 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:16:23 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.447s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:16:23 user nova-compute[95467]: DEBUG nova.compute.manager [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] Start building networks asynchronously for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 08:16:23 user nova-compute[95467]: DEBUG nova.compute.manager [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] Allocating IP information in the background. {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 08:16:23 user nova-compute[95467]: DEBUG nova.network.neutron [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] allocate_for_instance() {{(pid=95467) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 08:16:23 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 08:16:23 user nova-compute[95467]: DEBUG nova.compute.manager [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] Start building block device mappings for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 08:16:23 user nova-compute[95467]: DEBUG nova.policy [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'acce273b07b64e44af6e062175afa92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e2fec6a90a41a5a586c6da227caacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95467) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 08:16:23 user nova-compute[95467]: DEBUG nova.compute.manager [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] Start spawning the instance on the hypervisor. {{(pid=95467) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 08:16:23 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] Creating instance directory {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 08:16:23 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] Creating image(s)
Nov 15 08:16:23 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Acquiring lock "/opt/stack/data/nova/instances/2765af98-917a-4f0f-95af-3393e0d50a52/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:16:23 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "/opt/stack/data/nova/instances/2765af98-917a-4f0f-95af-3393e0d50a52/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:16:23 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "/opt/stack/data/nova/instances/2765af98-917a-4f0f-95af-3393e0d50a52/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:16:23 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:23 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.168s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:23 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Acquiring lock "a3fcf60225fcefd310404971cd18ab9851c548dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:16:23 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:16:23 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:24 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.169s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:24 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/2765af98-917a-4f0f-95af-3393e0d50a52/disk 1073741824 {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:24 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/2765af98-917a-4f0f-95af-3393e0d50a52/disk 1073741824" returned: 0 in 0.049s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:16:24 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:24 user nova-compute[95467]: DEBUG nova.network.neutron [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] Successfully created port: 1033bb03-0ef8-48ae-9006-240ec7ab4d63 {{(pid=95467) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 08:16:24 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.172s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:24 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2765af98-917a-4f0f-95af-3393e0d50a52/disk. size=1073741824 {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 08:16:24 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2765af98-917a-4f0f-95af-3393e0d50a52/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8a48be0d-5c28-44b8-a1e5-4f533e6262c0 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Acquiring lock "36dccf43-d4a3-47aa-bd73-de9646e1020c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:16:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8a48be0d-5c28-44b8-a1e5-4f533e6262c0 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "36dccf43-d4a3-47aa-bd73-de9646e1020c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:16:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8a48be0d-5c28-44b8-a1e5-4f533e6262c0 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Acquiring lock "36dccf43-d4a3-47aa-bd73-de9646e1020c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:16:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8a48be0d-5c28-44b8-a1e5-4f533e6262c0 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "36dccf43-d4a3-47aa-bd73-de9646e1020c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:16:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8a48be0d-5c28-44b8-a1e5-4f533e6262c0 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "36dccf43-d4a3-47aa-bd73-de9646e1020c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:16:24 user nova-compute[95467]: INFO nova.compute.manager [None req-8a48be0d-5c28-44b8-a1e5-4f533e6262c0 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Terminating instance
Nov 15 08:16:24 user nova-compute[95467]: DEBUG nova.compute.manager [None req-8a48be0d-5c28-44b8-a1e5-4f533e6262c0 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Start destroying the instance on the hypervisor. {{(pid=95467) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 08:16:24 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:24 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2765af98-917a-4f0f-95af-3393e0d50a52/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:24 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Cannot resize image /opt/stack/data/nova/instances/2765af98-917a-4f0f-95af-3393e0d50a52/disk to a smaller size. {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 08:16:24 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] Created local disks {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 08:16:24 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] Ensure instance console log exists: /opt/stack/data/nova/instances/2765af98-917a-4f0f-95af-3393e0d50a52/console.log {{(pid=95467) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 08:16:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:16:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:16:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:16:24 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:24 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:24 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:24 user nova-compute[95467]: DEBUG nova.compute.manager [req-7325bfb2-a642-4bc9-a107-8ccd9a17d908 req-00b5ceba-75c1-479e-8720-37e0fcd75be5 service nova] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Received event network-vif-unplugged-5b51bd20-90a5-4fb1-816c-3d8e8824cb41 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:16:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-7325bfb2-a642-4bc9-a107-8ccd9a17d908 req-00b5ceba-75c1-479e-8720-37e0fcd75be5 service nova] Acquiring lock "36dccf43-d4a3-47aa-bd73-de9646e1020c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:16:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-7325bfb2-a642-4bc9-a107-8ccd9a17d908 req-00b5ceba-75c1-479e-8720-37e0fcd75be5 service nova] Lock "36dccf43-d4a3-47aa-bd73-de9646e1020c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:16:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-7325bfb2-a642-4bc9-a107-8ccd9a17d908 req-00b5ceba-75c1-479e-8720-37e0fcd75be5 service nova] Lock "36dccf43-d4a3-47aa-bd73-de9646e1020c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:16:24 user nova-compute[95467]: DEBUG nova.compute.manager [req-7325bfb2-a642-4bc9-a107-8ccd9a17d908 req-00b5ceba-75c1-479e-8720-37e0fcd75be5 service nova] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] No waiting events found dispatching network-vif-unplugged-5b51bd20-90a5-4fb1-816c-3d8e8824cb41 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:16:24 user nova-compute[95467]: DEBUG nova.compute.manager [req-7325bfb2-a642-4bc9-a107-8ccd9a17d908 req-00b5ceba-75c1-479e-8720-37e0fcd75be5 service nova] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Received event network-vif-unplugged-5b51bd20-90a5-4fb1-816c-3d8e8824cb41 for instance with task_state deleting. {{(pid=95467) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 08:16:25 user nova-compute[95467]: DEBUG nova.network.neutron [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] Successfully updated port: 1033bb03-0ef8-48ae-9006-240ec7ab4d63 {{(pid=95467) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 08:16:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Acquiring lock "refresh_cache-2765af98-917a-4f0f-95af-3393e0d50a52" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:16:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Acquired lock "refresh_cache-2765af98-917a-4f0f-95af-3393e0d50a52" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:16:25 user nova-compute[95467]: DEBUG nova.network.neutron [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:16:25 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Instance destroyed successfully.
Nov 15 08:16:25 user nova-compute[95467]: DEBUG nova.objects.instance [None req-8a48be0d-5c28-44b8-a1e5-4f533e6262c0 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lazy-loading 'resources' on Instance uuid 36dccf43-d4a3-47aa-bd73-de9646e1020c {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:16:25 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-8a48be0d-5c28-44b8-a1e5-4f533e6262c0 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T08:09:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1540652883',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1540652883',id=5,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPMudjIgLQ94PJgpuT923qN+L46wuVWcOs/AgJykHjR77r/+WQhcSpcm7aHqbK6GHFvMQ7s34dtAlIeCULffYjuYC9U228iElL9IbpM1YAAXm8GMSQ4zQ7BkpCVv6WHbg==',key_name='tempest-keypair-1788942377',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:14:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='94b04c448c61451d8d46ebc7a61a5e6e',ramdisk_id='',reservation_id='r-0d1eau01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1251988905',owner_user_name='tempest-AttachVolumeShelveTestJSON-1251988905-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:14:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b03564d022e84f5cb133b9771e76bae8',uuid=36dccf43-d4a3-47aa-bd73-de9646e1020c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b51bd20-90a5-4fb1-816c-3d8e8824cb41", "address": "fa:16:3e:79:70:b1", "network": {"id": "f7871b75-73b3-4f0a-8e6c-814bc61ebd6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-945672014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b04c448c61451d8d46ebc7a61a5e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b51bd20-90", "ovs_interfaceid": "5b51bd20-90a5-4fb1-816c-3d8e8824cb41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:16:25 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-8a48be0d-5c28-44b8-a1e5-4f533e6262c0 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Converting VIF {"id": "5b51bd20-90a5-4fb1-816c-3d8e8824cb41", "address": "fa:16:3e:79:70:b1", "network": {"id": "f7871b75-73b3-4f0a-8e6c-814bc61ebd6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-945672014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b04c448c61451d8d46ebc7a61a5e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b51bd20-90", "ovs_interfaceid": "5b51bd20-90a5-4fb1-816c-3d8e8824cb41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:16:25 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-8a48be0d-5c28-44b8-a1e5-4f533e6262c0 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:79:70:b1,bridge_name='br-int',has_traffic_filtering=True,id=5b51bd20-90a5-4fb1-816c-3d8e8824cb41,network=Network(f7871b75-73b3-4f0a-8e6c-814bc61ebd6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b51bd20-90') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:16:25 user nova-compute[95467]: DEBUG os_vif [None req-8a48be0d-5c28-44b8-a1e5-4f533e6262c0 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:70:b1,bridge_name='br-int',has_traffic_filtering=True,id=5b51bd20-90a5-4fb1-816c-3d8e8824cb41,network=Network(f7871b75-73b3-4f0a-8e6c-814bc61ebd6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b51bd20-90') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:16:25 user nova-compute[95467]: DEBUG nova.network.neutron [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] Instance cache missing network info. {{(pid=95467) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 08:16:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b51bd20-90, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:16:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:16:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c8d3a0a4-73c1-4355-ac9f-68a4ddf1176a) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:16:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:16:25 user nova-compute[95467]: INFO os_vif [None req-8a48be0d-5c28-44b8-a1e5-4f533e6262c0 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:70:b1,bridge_name='br-int',has_traffic_filtering=True,id=5b51bd20-90a5-4fb1-816c-3d8e8824cb41,network=Network(f7871b75-73b3-4f0a-8e6c-814bc61ebd6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b51bd20-90')
Nov 15 08:16:25 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-8a48be0d-5c28-44b8-a1e5-4f533e6262c0 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Deleting instance files /opt/stack/data/nova/instances/36dccf43-d4a3-47aa-bd73-de9646e1020c_del
Nov 15 08:16:25 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-8a48be0d-5c28-44b8-a1e5-4f533e6262c0 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Deletion of /opt/stack/data/nova/instances/36dccf43-d4a3-47aa-bd73-de9646e1020c_del complete
Nov 15 08:16:25 user nova-compute[95467]: INFO nova.compute.manager [None req-8a48be0d-5c28-44b8-a1e5-4f533e6262c0 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 15 08:16:25 user nova-compute[95467]: DEBUG oslo.service.loopingcall [None req-8a48be0d-5c28-44b8-a1e5-4f533e6262c0 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=95467) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 08:16:25 user nova-compute[95467]: DEBUG nova.compute.manager [-] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Deallocating network for instance {{(pid=95467) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 08:16:25 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] deallocate_for_instance() {{(pid=95467) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 08:16:25 user nova-compute[95467]: DEBUG nova.network.neutron [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] Updating instance_info_cache with network_info: [{"id": "1033bb03-0ef8-48ae-9006-240ec7ab4d63", "address": "fa:16:3e:4b:8a:91", "network": {"id": "27fd2b0f-65bd-4ae4-b5c8-dfca91668078", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1310727750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50e2fec6a90a41a5a586c6da227caacc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1033bb03-0e", "ovs_interfaceid": "1033bb03-0ef8-48ae-9006-240ec7ab4d63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:16:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Releasing lock "refresh_cache-2765af98-917a-4f0f-95af-3393e0d50a52" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:16:25 user nova-compute[95467]: DEBUG nova.compute.manager [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] Instance network_info: |[{"id": "1033bb03-0ef8-48ae-9006-240ec7ab4d63", "address": "fa:16:3e:4b:8a:91", "network": {"id": "27fd2b0f-65bd-4ae4-b5c8-dfca91668078", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1310727750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50e2fec6a90a41a5a586c6da227caacc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1033bb03-0e", "ovs_interfaceid": "1033bb03-0ef8-48ae-9006-240ec7ab4d63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 08:16:25 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] Start _get_guest_xml network_info=[{"id": "1033bb03-0ef8-48ae-9006-240ec7ab4d63", "address": "fa:16:3e:4b:8a:91", "network": {"id": "27fd2b0f-65bd-4ae4-b5c8-dfca91668078", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1310727750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50e2fec6a90a41a5a586c6da227caacc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1033bb03-0e", "ovs_interfaceid": "1033bb03-0ef8-48ae-9006-240ec7ab4d63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'ed9c48aa-ce73-4b3b-9db1-235898be671b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:16:25 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:16:25 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:16:25 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:16:25 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:16:25 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:16:25 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:16:25 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:16:25 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:16:25 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:16:25 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:16:25 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:16:25 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:16:25 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:16:25 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:16:25 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:16:25 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:16:25 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:16:25 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:16:25 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:16:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1315317158',display_name='tempest-AttachVolumeNegativeTest-server-1315317158',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1315317158',id=26,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGbv8JeJz+7mWgEQpg3K6t3RS/zPBmL1s+k5vF27QtCf0pf9iHhis+PQNKAWg1oreYL73UumFeqTUgWx5oJHZUY8nAoislySkyRjbalQkY+/28lMpZBF4HjrsHz3mcnEcQ==',key_name='tempest-keypair-1798096385',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50e2fec6a90a41a5a586c6da227caacc',ramdisk_id='',reservation_id='r-cfmyfa8q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1750086293',owner_user_name='tempest-AttachVolumeNegativeTest-1750086293-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:16:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='acce273b07b64e44af6e062175afa92d',uuid=2765af98-917a-4f0f-95af-3393e0d50a52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1033bb03-0ef8-48ae-9006-240ec7ab4d63", "address": "fa:16:3e:4b:8a:91", "network": {"id": "27fd2b0f-65bd-4ae4-b5c8-dfca91668078", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1310727750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50e2fec6a90a41a5a586c6da227caacc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1033bb03-0e", "ovs_interfaceid": "1033bb03-0ef8-48ae-9006-240ec7ab4d63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:16:25 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Converting VIF {"id": "1033bb03-0ef8-48ae-9006-240ec7ab4d63", "address": "fa:16:3e:4b:8a:91", "network": {"id": "27fd2b0f-65bd-4ae4-b5c8-dfca91668078", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1310727750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50e2fec6a90a41a5a586c6da227caacc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1033bb03-0e", "ovs_interfaceid": "1033bb03-0ef8-48ae-9006-240ec7ab4d63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:16:25 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:8a:91,bridge_name='br-int',has_traffic_filtering=True,id=1033bb03-0ef8-48ae-9006-240ec7ab4d63,network=Network(27fd2b0f-65bd-4ae4-b5c8-dfca91668078),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1033bb03-0e') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:16:25 user nova-compute[95467]: DEBUG nova.objects.instance [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lazy-loading 'pci_devices' on Instance uuid 2765af98-917a-4f0f-95af-3393e0d50a52 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:16:25 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:16:25 user nova-compute[95467]:   <uuid>2765af98-917a-4f0f-95af-3393e0d50a52</uuid>
Nov 15 08:16:25 user nova-compute[95467]:   <name>instance-0000001a</name>
Nov 15 08:16:25 user nova-compute[95467]:   <memory>524288</memory>
Nov 15 08:16:25 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:16:25 user nova-compute[95467]:   <metadata>
Nov 15 08:16:25 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:16:25 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:16:25 user nova-compute[95467]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1315317158</nova:name>
Nov 15 08:16:25 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:16:25</nova:creationTime>
Nov 15 08:16:25 user nova-compute[95467]:       <nova:flavor name="m1.tiny">
Nov 15 08:16:25 user nova-compute[95467]:         <nova:memory>512</nova:memory>
Nov 15 08:16:25 user nova-compute[95467]:         <nova:disk>1</nova:disk>
Nov 15 08:16:25 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:16:25 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:16:25 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:16:25 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:16:25 user nova-compute[95467]:       <nova:owner>
Nov 15 08:16:25 user nova-compute[95467]:         <nova:user uuid="acce273b07b64e44af6e062175afa92d">tempest-AttachVolumeNegativeTest-1750086293-project-member</nova:user>
Nov 15 08:16:25 user nova-compute[95467]:         <nova:project uuid="50e2fec6a90a41a5a586c6da227caacc">tempest-AttachVolumeNegativeTest-1750086293</nova:project>
Nov 15 08:16:25 user nova-compute[95467]:       </nova:owner>
Nov 15 08:16:25 user nova-compute[95467]:       <nova:root type="image" uuid="ed9c48aa-ce73-4b3b-9db1-235898be671b"/>
Nov 15 08:16:25 user nova-compute[95467]:       <nova:ports>
Nov 15 08:16:25 user nova-compute[95467]:         <nova:port uuid="1033bb03-0ef8-48ae-9006-240ec7ab4d63">
Nov 15 08:16:25 user nova-compute[95467]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 08:16:25 user nova-compute[95467]:         </nova:port>
Nov 15 08:16:25 user nova-compute[95467]:       </nova:ports>
Nov 15 08:16:25 user nova-compute[95467]:     </nova:instance>
Nov 15 08:16:25 user nova-compute[95467]:   </metadata>
Nov 15 08:16:25 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:16:25 user nova-compute[95467]:     <system>
Nov 15 08:16:25 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:16:25 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:16:25 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:16:25 user nova-compute[95467]:       <entry name="serial">2765af98-917a-4f0f-95af-3393e0d50a52</entry>
Nov 15 08:16:25 user nova-compute[95467]:       <entry name="uuid">2765af98-917a-4f0f-95af-3393e0d50a52</entry>
Nov 15 08:16:25 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:16:25 user nova-compute[95467]:     </system>
Nov 15 08:16:25 user nova-compute[95467]:   </sysinfo>
Nov 15 08:16:25 user nova-compute[95467]:   <os>
Nov 15 08:16:25 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:16:25 user nova-compute[95467]:     <boot dev="hd"/>
Nov 15 08:16:25 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:16:25 user nova-compute[95467]:   </os>
Nov 15 08:16:25 user nova-compute[95467]:   <features>
Nov 15 08:16:25 user nova-compute[95467]:     <acpi/>
Nov 15 08:16:25 user nova-compute[95467]:     <apic/>
Nov 15 08:16:25 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:16:25 user nova-compute[95467]:   </features>
Nov 15 08:16:25 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:16:25 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:16:25 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:16:25 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:16:25 user nova-compute[95467]:   </clock>
Nov 15 08:16:25 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:16:25 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:16:25 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:16:25 user nova-compute[95467]:   </cpu>
Nov 15 08:16:25 user nova-compute[95467]:   <devices>
Nov 15 08:16:25 user nova-compute[95467]:     <disk type="file" device="disk">
Nov 15 08:16:25 user nova-compute[95467]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 08:16:25 user nova-compute[95467]:       <source file="/opt/stack/data/nova/instances/2765af98-917a-4f0f-95af-3393e0d50a52/disk"/>
Nov 15 08:16:25 user nova-compute[95467]:       <target dev="vda" bus="virtio"/>
Nov 15 08:16:25 user nova-compute[95467]:     </disk>
Nov 15 08:16:25 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:16:25 user nova-compute[95467]:       <mac address="fa:16:3e:4b:8a:91"/>
Nov 15 08:16:25 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:16:25 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:16:25 user nova-compute[95467]:       <target dev="tap1033bb03-0e"/>
Nov 15 08:16:25 user nova-compute[95467]:     </interface>
Nov 15 08:16:25 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:16:25 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/2765af98-917a-4f0f-95af-3393e0d50a52/console.log" append="off"/>
Nov 15 08:16:25 user nova-compute[95467]:     </serial>
Nov 15 08:16:25 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:16:25 user nova-compute[95467]:     <video>
Nov 15 08:16:25 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:16:25 user nova-compute[95467]:     </video>
Nov 15 08:16:25 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:16:25 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:16:25 user nova-compute[95467]:     </rng>
Nov 15 08:16:25 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:16:25 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:16:25 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:16:25 user nova-compute[95467]:     </memballoon>
Nov 15 08:16:25 user nova-compute[95467]:   </devices>
Nov 15 08:16:25 user nova-compute[95467]: </domain>
Nov 15 08:16:25 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:16:25 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:16:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1315317158',display_name='tempest-AttachVolumeNegativeTest-server-1315317158',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1315317158',id=26,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGbv8JeJz+7mWgEQpg3K6t3RS/zPBmL1s+k5vF27QtCf0pf9iHhis+PQNKAWg1oreYL73UumFeqTUgWx5oJHZUY8nAoislySkyRjbalQkY+/28lMpZBF4HjrsHz3mcnEcQ==',key_name='tempest-keypair-1798096385',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50e2fec6a90a41a5a586c6da227caacc',ramdisk_id='',reservation_id='r-cfmyfa8q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1750086293',owner_user_name='tempest-AttachVolumeNegativeTest-1750086293-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:16:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='acce273b07b64e44af6e062175afa92d',uuid=2765af98-917a-4f0f-95af-3393e0d50a52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1033bb03-0ef8-48ae-9006-240ec7ab4d63", "address": "fa:16:3e:4b:8a:91", "network": {"id": "27fd2b0f-65bd-4ae4-b5c8-dfca91668078", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1310727750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50e2fec6a90a41a5a586c6da227caacc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1033bb03-0e", "ovs_interfaceid": "1033bb03-0ef8-48ae-9006-240ec7ab4d63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:16:25 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Converting VIF {"id": "1033bb03-0ef8-48ae-9006-240ec7ab4d63", "address": "fa:16:3e:4b:8a:91", "network": {"id": "27fd2b0f-65bd-4ae4-b5c8-dfca91668078", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1310727750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50e2fec6a90a41a5a586c6da227caacc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1033bb03-0e", "ovs_interfaceid": "1033bb03-0ef8-48ae-9006-240ec7ab4d63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:16:25 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:8a:91,bridge_name='br-int',has_traffic_filtering=True,id=1033bb03-0ef8-48ae-9006-240ec7ab4d63,network=Network(27fd2b0f-65bd-4ae4-b5c8-dfca91668078),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1033bb03-0e') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:16:25 user nova-compute[95467]: DEBUG os_vif [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:8a:91,bridge_name='br-int',has_traffic_filtering=True,id=1033bb03-0ef8-48ae-9006-240ec7ab4d63,network=Network(27fd2b0f-65bd-4ae4-b5c8-dfca91668078),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1033bb03-0e') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:16:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:16:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:16:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd65643a2-f198-57da-85b0-855132788684', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:16:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:16:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1033bb03-0e, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:16:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1033bb03-0e, col_values=(('qos', UUID('e8e9efcc-f551-4173-a4b2-19df0acab8c8')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:16:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1033bb03-0e, col_values=(('external_ids', {'iface-id': '1033bb03-0ef8-48ae-9006-240ec7ab4d63', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:8a:91', 'vm-uuid': '2765af98-917a-4f0f-95af-3393e0d50a52'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:16:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:16:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:25 user nova-compute[95467]: INFO os_vif [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:8a:91,bridge_name='br-int',has_traffic_filtering=True,id=1033bb03-0ef8-48ae-9006-240ec7ab4d63,network=Network(27fd2b0f-65bd-4ae4-b5c8-dfca91668078),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1033bb03-0e')
Nov 15 08:16:25 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:16:25 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] No VIF found with MAC fa:16:3e:4b:8a:91, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:16:26 user nova-compute[95467]: DEBUG nova.compute.manager [req-264e474a-b4ba-4a58-9bb0-29aebf04c589 req-e6a3febf-8636-4348-be1e-326962bde3a1 service nova] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Received event network-vif-plugged-5b51bd20-90a5-4fb1-816c-3d8e8824cb41 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:16:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-264e474a-b4ba-4a58-9bb0-29aebf04c589 req-e6a3febf-8636-4348-be1e-326962bde3a1 service nova] Acquiring lock "36dccf43-d4a3-47aa-bd73-de9646e1020c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:16:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-264e474a-b4ba-4a58-9bb0-29aebf04c589 req-e6a3febf-8636-4348-be1e-326962bde3a1 service nova] Lock "36dccf43-d4a3-47aa-bd73-de9646e1020c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:16:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-264e474a-b4ba-4a58-9bb0-29aebf04c589 req-e6a3febf-8636-4348-be1e-326962bde3a1 service nova] Lock "36dccf43-d4a3-47aa-bd73-de9646e1020c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:16:26 user nova-compute[95467]: DEBUG nova.compute.manager [req-264e474a-b4ba-4a58-9bb0-29aebf04c589 req-e6a3febf-8636-4348-be1e-326962bde3a1 service nova] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] No waiting events found dispatching network-vif-plugged-5b51bd20-90a5-4fb1-816c-3d8e8824cb41 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:16:26 user nova-compute[95467]: WARNING nova.compute.manager [req-264e474a-b4ba-4a58-9bb0-29aebf04c589 req-e6a3febf-8636-4348-be1e-326962bde3a1 service nova] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Received unexpected event network-vif-plugged-5b51bd20-90a5-4fb1-816c-3d8e8824cb41 for instance with vm_state active and task_state deleting.
Nov 15 08:16:26 user nova-compute[95467]: DEBUG nova.compute.manager [req-264e474a-b4ba-4a58-9bb0-29aebf04c589 req-e6a3febf-8636-4348-be1e-326962bde3a1 service nova] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] Received event network-changed-1033bb03-0ef8-48ae-9006-240ec7ab4d63 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:16:26 user nova-compute[95467]: DEBUG nova.compute.manager [req-264e474a-b4ba-4a58-9bb0-29aebf04c589 req-e6a3febf-8636-4348-be1e-326962bde3a1 service nova] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] Refreshing instance network info cache due to event network-changed-1033bb03-0ef8-48ae-9006-240ec7ab4d63. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:16:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-264e474a-b4ba-4a58-9bb0-29aebf04c589 req-e6a3febf-8636-4348-be1e-326962bde3a1 service nova] Acquiring lock "refresh_cache-2765af98-917a-4f0f-95af-3393e0d50a52" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:16:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-264e474a-b4ba-4a58-9bb0-29aebf04c589 req-e6a3febf-8636-4348-be1e-326962bde3a1 service nova] Acquired lock "refresh_cache-2765af98-917a-4f0f-95af-3393e0d50a52" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:16:26 user nova-compute[95467]: DEBUG nova.network.neutron [req-264e474a-b4ba-4a58-9bb0-29aebf04c589 req-e6a3febf-8636-4348-be1e-326962bde3a1 service nova] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] Refreshing network info cache for port 1033bb03-0ef8-48ae-9006-240ec7ab4d63 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:16:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:26 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:16:26 user nova-compute[95467]: DEBUG nova.compute.manager [req-be660719-a482-4e0a-8578-e72e27562a93 req-a203eab9-db11-4a12-966d-bb20195aae4f service nova] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Received event network-vif-deleted-5b51bd20-90a5-4fb1-816c-3d8e8824cb41 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:16:26 user nova-compute[95467]: INFO nova.compute.manager [req-be660719-a482-4e0a-8578-e72e27562a93 req-a203eab9-db11-4a12-966d-bb20195aae4f service nova] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Neutron deleted interface 5b51bd20-90a5-4fb1-816c-3d8e8824cb41; detaching it from the instance and deleting it from the info cache
Nov 15 08:16:26 user nova-compute[95467]: DEBUG nova.network.neutron [req-be660719-a482-4e0a-8578-e72e27562a93 req-a203eab9-db11-4a12-966d-bb20195aae4f service nova] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:16:26 user nova-compute[95467]: INFO nova.compute.manager [-] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Took 1.61 seconds to deallocate network for instance.
Nov 15 08:16:26 user nova-compute[95467]: DEBUG nova.compute.manager [req-be660719-a482-4e0a-8578-e72e27562a93 req-a203eab9-db11-4a12-966d-bb20195aae4f service nova] [instance: 36dccf43-d4a3-47aa-bd73-de9646e1020c] Detach interface failed, port_id=5b51bd20-90a5-4fb1-816c-3d8e8824cb41, reason: Instance 36dccf43-d4a3-47aa-bd73-de9646e1020c could not be found. {{(pid=95467) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 08:16:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8a48be0d-5c28-44b8-a1e5-4f533e6262c0 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:16:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8a48be0d-5c28-44b8-a1e5-4f533e6262c0 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:16:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:27 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-8a48be0d-5c28-44b8-a1e5-4f533e6262c0 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:16:27 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-8a48be0d-5c28-44b8-a1e5-4f533e6262c0 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:16:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8a48be0d-5c28-44b8-a1e5-4f533e6262c0 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.586s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:16:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:27 user nova-compute[95467]: INFO nova.scheduler.client.report [None req-8a48be0d-5c28-44b8-a1e5-4f533e6262c0 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Deleted allocations for instance 36dccf43-d4a3-47aa-bd73-de9646e1020c
Nov 15 08:16:27 user nova-compute[95467]: DEBUG nova.network.neutron [req-264e474a-b4ba-4a58-9bb0-29aebf04c589 req-e6a3febf-8636-4348-be1e-326962bde3a1 service nova] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] Updated VIF entry in instance network info cache for port 1033bb03-0ef8-48ae-9006-240ec7ab4d63. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:16:27 user nova-compute[95467]: DEBUG nova.network.neutron [req-264e474a-b4ba-4a58-9bb0-29aebf04c589 req-e6a3febf-8636-4348-be1e-326962bde3a1 service nova] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] Updating instance_info_cache with network_info: [{"id": "1033bb03-0ef8-48ae-9006-240ec7ab4d63", "address": "fa:16:3e:4b:8a:91", "network": {"id": "27fd2b0f-65bd-4ae4-b5c8-dfca91668078", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1310727750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50e2fec6a90a41a5a586c6da227caacc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1033bb03-0e", "ovs_interfaceid": "1033bb03-0ef8-48ae-9006-240ec7ab4d63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:16:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-264e474a-b4ba-4a58-9bb0-29aebf04c589 req-e6a3febf-8636-4348-be1e-326962bde3a1 service nova] Releasing lock "refresh_cache-2765af98-917a-4f0f-95af-3393e0d50a52" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:16:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8a48be0d-5c28-44b8-a1e5-4f533e6262c0 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "36dccf43-d4a3-47aa-bd73-de9646e1020c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.480s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:16:28 user nova-compute[95467]: DEBUG nova.compute.manager [req-96ade90e-7532-4a2b-b907-e8d1e4c7eb8c req-6f56f06b-e551-459b-aa6b-6142c3a7c528 service nova] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] Received event network-vif-plugged-1033bb03-0ef8-48ae-9006-240ec7ab4d63 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:16:28 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-96ade90e-7532-4a2b-b907-e8d1e4c7eb8c req-6f56f06b-e551-459b-aa6b-6142c3a7c528 service nova] Acquiring lock "2765af98-917a-4f0f-95af-3393e0d50a52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:16:28 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-96ade90e-7532-4a2b-b907-e8d1e4c7eb8c req-6f56f06b-e551-459b-aa6b-6142c3a7c528 service nova] Lock "2765af98-917a-4f0f-95af-3393e0d50a52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:16:28 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-96ade90e-7532-4a2b-b907-e8d1e4c7eb8c req-6f56f06b-e551-459b-aa6b-6142c3a7c528 service nova] Lock "2765af98-917a-4f0f-95af-3393e0d50a52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:16:28 user nova-compute[95467]: DEBUG nova.compute.manager [req-96ade90e-7532-4a2b-b907-e8d1e4c7eb8c req-6f56f06b-e551-459b-aa6b-6142c3a7c528 service nova] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] No waiting events found dispatching network-vif-plugged-1033bb03-0ef8-48ae-9006-240ec7ab4d63 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:16:28 user nova-compute[95467]: WARNING nova.compute.manager [req-96ade90e-7532-4a2b-b907-e8d1e4c7eb8c req-6f56f06b-e551-459b-aa6b-6142c3a7c528 service nova] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] Received unexpected event network-vif-plugged-1033bb03-0ef8-48ae-9006-240ec7ab4d63 for instance with vm_state building and task_state spawning.
Nov 15 08:16:28 user nova-compute[95467]: DEBUG nova.compute.manager [req-96ade90e-7532-4a2b-b907-e8d1e4c7eb8c req-6f56f06b-e551-459b-aa6b-6142c3a7c528 service nova] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] Received event network-vif-plugged-1033bb03-0ef8-48ae-9006-240ec7ab4d63 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:16:28 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-96ade90e-7532-4a2b-b907-e8d1e4c7eb8c req-6f56f06b-e551-459b-aa6b-6142c3a7c528 service nova] Acquiring lock "2765af98-917a-4f0f-95af-3393e0d50a52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:16:28 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-96ade90e-7532-4a2b-b907-e8d1e4c7eb8c req-6f56f06b-e551-459b-aa6b-6142c3a7c528 service nova] Lock "2765af98-917a-4f0f-95af-3393e0d50a52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:16:28 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-96ade90e-7532-4a2b-b907-e8d1e4c7eb8c req-6f56f06b-e551-459b-aa6b-6142c3a7c528 service nova] Lock "2765af98-917a-4f0f-95af-3393e0d50a52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:16:28 user nova-compute[95467]: DEBUG nova.compute.manager [req-96ade90e-7532-4a2b-b907-e8d1e4c7eb8c req-6f56f06b-e551-459b-aa6b-6142c3a7c528 service nova] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] No waiting events found dispatching network-vif-plugged-1033bb03-0ef8-48ae-9006-240ec7ab4d63 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:16:28 user nova-compute[95467]: WARNING nova.compute.manager [req-96ade90e-7532-4a2b-b907-e8d1e4c7eb8c req-6f56f06b-e551-459b-aa6b-6142c3a7c528 service nova] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] Received unexpected event network-vif-plugged-1033bb03-0ef8-48ae-9006-240ec7ab4d63 for instance with vm_state building and task_state spawning.
Nov 15 08:16:29 user nova-compute[95467]: DEBUG nova.compute.manager [req-0134b8d9-d303-4c40-bf7f-af2526260947 req-79b293c9-748c-48ad-9852-48912fc7e2b5 service nova] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] Received event network-changed-86652dd5-39a8-410c-aed4-3664980165f3 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:16:29 user nova-compute[95467]: DEBUG nova.compute.manager [req-0134b8d9-d303-4c40-bf7f-af2526260947 req-79b293c9-748c-48ad-9852-48912fc7e2b5 service nova] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] Refreshing instance network info cache due to event network-changed-86652dd5-39a8-410c-aed4-3664980165f3. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:16:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-0134b8d9-d303-4c40-bf7f-af2526260947 req-79b293c9-748c-48ad-9852-48912fc7e2b5 service nova] Acquiring lock "refresh_cache-da9c7b9d-aad7-4d4f-b190-fda71735fde6" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:16:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-0134b8d9-d303-4c40-bf7f-af2526260947 req-79b293c9-748c-48ad-9852-48912fc7e2b5 service nova] Acquired lock "refresh_cache-da9c7b9d-aad7-4d4f-b190-fda71735fde6" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:16:29 user nova-compute[95467]: DEBUG nova.network.neutron [req-0134b8d9-d303-4c40-bf7f-af2526260947 req-79b293c9-748c-48ad-9852-48912fc7e2b5 service nova] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] Refreshing network info cache for port 86652dd5-39a8-410c-aed4-3664980165f3 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:16:29 user nova-compute[95467]: DEBUG nova.compute.manager [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] Instance event wait completed in 0 seconds for  {{(pid=95467) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 08:16:29 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] Guest created on hypervisor {{(pid=95467) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 08:16:29 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] Instance spawned successfully.
Nov 15 08:16:29 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 08:16:29 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] Found default for hw_cdrom_bus of ide {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:16:29 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] Found default for hw_disk_bus of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:16:29 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] Found default for hw_input_bus of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:16:29 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] Found default for hw_pointer_model of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:16:29 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] Found default for hw_video_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:16:29 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] Found default for hw_vif_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:16:29 user nova-compute[95467]: DEBUG nova.network.neutron [req-0134b8d9-d303-4c40-bf7f-af2526260947 req-79b293c9-748c-48ad-9852-48912fc7e2b5 service nova] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] Updated VIF entry in instance network info cache for port 86652dd5-39a8-410c-aed4-3664980165f3. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:16:29 user nova-compute[95467]: DEBUG nova.network.neutron [req-0134b8d9-d303-4c40-bf7f-af2526260947 req-79b293c9-748c-48ad-9852-48912fc7e2b5 service nova] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] Updating instance_info_cache with network_info: [{"id": "86652dd5-39a8-410c-aed4-3664980165f3", "address": "fa:16:3e:20:9d:69", "network": {"id": "99755f0a-da1b-4ec7-aa23-6801f4a0344c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-42152126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c37bcd8e333c4c2faf96b5d445319274", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86652dd5-39", "ovs_interfaceid": "86652dd5-39a8-410c-aed4-3664980165f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:16:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-0134b8d9-d303-4c40-bf7f-af2526260947 req-79b293c9-748c-48ad-9852-48912fc7e2b5 service nova] Releasing lock "refresh_cache-da9c7b9d-aad7-4d4f-b190-fda71735fde6" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:16:29 user nova-compute[95467]: INFO nova.compute.manager [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] Took 5.68 seconds to spawn the instance on the hypervisor.
Nov 15 08:16:29 user nova-compute[95467]: DEBUG nova.compute.manager [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:16:29 user nova-compute[95467]: INFO nova.compute.manager [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] Took 6.46 seconds to build instance.
Nov 15 08:16:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0f16bff8-cd19-4e8b-8190-82b40a58a887 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "2765af98-917a-4f0f-95af-3393e0d50a52" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.560s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:16:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e1ab14e7-9e3f-4e66-a42d-6f4a5a85482b tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Acquiring lock "da9c7b9d-aad7-4d4f-b190-fda71735fde6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:16:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e1ab14e7-9e3f-4e66-a42d-6f4a5a85482b tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Lock "da9c7b9d-aad7-4d4f-b190-fda71735fde6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:16:29 user nova-compute[95467]: DEBUG nova.objects.instance [None req-e1ab14e7-9e3f-4e66-a42d-6f4a5a85482b tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Lazy-loading 'flavor' on Instance uuid da9c7b9d-aad7-4d4f-b190-fda71735fde6 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:16:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e1ab14e7-9e3f-4e66-a42d-6f4a5a85482b tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Lock "da9c7b9d-aad7-4d4f-b190-fda71735fde6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:16:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e1ab14e7-9e3f-4e66-a42d-6f4a5a85482b tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Acquiring lock "da9c7b9d-aad7-4d4f-b190-fda71735fde6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:16:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e1ab14e7-9e3f-4e66-a42d-6f4a5a85482b tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Lock "da9c7b9d-aad7-4d4f-b190-fda71735fde6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:16:29 user nova-compute[95467]: INFO nova.compute.manager [None req-e1ab14e7-9e3f-4e66-a42d-6f4a5a85482b tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] Attaching volume 513c8487-b544-4188-881d-72fd4d002d85 to /dev/sdc
Nov 15 08:16:30 user nova-compute[95467]: DEBUG os_brick.utils [None req-e1ab14e7-9e3f-4e66-a42d-6f4a5a85482b tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:16:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:30 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[353b8baf-fbf5-41c5-8885-42194f90f874]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:882ae90641f\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:16:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:30 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad4f42d-1c2e-46e3-ac80-deed9935c364]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:16:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:30 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b511b8dc-134c-4ddb-a438-d2d0283e485e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:16:30 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f26cdc4-53ab-41a6-b913-92f0a10ba173]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:16:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-e1ab14e7-9e3f-4e66-a42d-6f4a5a85482b tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Running cmd (subprocess): nvme version {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-e1ab14e7-9e3f-4e66-a42d-6f4a5a85482b tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] 'nvme version' failed. Not Retrying. {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:16:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e1ab14e7-9e3f-4e66-a42d-6f4a5a85482b tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] nvme not present on system {{(pid=95467) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 08:16:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:16:30 user nova-compute[95467]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 08:16:30 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa13276f-5ef7-40a1-a76d-04d6bba9fead]: (4, '') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:16:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-e1ab14e7-9e3f-4e66-a42d-6f4a5a85482b tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=95467) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 08:16:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-e1ab14e7-9e3f-4e66-a42d-6f4a5a85482b tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 08:16:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-e1ab14e7-9e3f-4e66-a42d-6f4a5a85482b tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] LIGHTOS: no hostnqn found. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 08:16:30 user nova-compute[95467]: DEBUG os_brick.utils [None req-e1ab14e7-9e3f-4e66-a42d-6f4a5a85482b tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:882ae90641f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:16:30 user nova-compute[95467]: DEBUG nova.virt.block_device [None req-e1ab14e7-9e3f-4e66-a42d-6f4a5a85482b tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] Updating existing volume attachment record: 2dae9dcf-48b3-4940-b523-81fa5fef9ea4 {{(pid=95467) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 08:16:30 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:35 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1ab14e7-9e3f-4e66-a42d-6f4a5a85482b tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] Calling os-brick to attach iSCSI Volume {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 08:16:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ab14e7-9e3f-4e66-a42d-6f4a5a85482b tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:513c8487-b544-4188-881d-72fd4d002d85', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hUuxEYJH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:16:35 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-e1ab14e7-9e3f-4e66-a42d-6f4a5a85482b tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:16:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-e1ab14e7-9e3f-4e66-a42d-6f4a5a85482b tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:16:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-e1ab14e7-9e3f-4e66-a42d-6f4a5a85482b tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:16:35 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-e1ab14e7-9e3f-4e66-a42d-6f4a5a85482b tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:16:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-e1ab14e7-9e3f-4e66-a42d-6f4a5a85482b tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:513c8487-b544-4188-881d-72fd4d002d85" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:16:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-e1ab14e7-9e3f-4e66-a42d-6f4a5a85482b tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:513c8487-b544-4188-881d-72fd4d002d85" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:16:35 user nova-compute[95467]: INFO os_brick.initiator.connectors.iscsi [None req-e1ab14e7-9e3f-4e66-a42d-6f4a5a85482b tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 08:16:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:513c8487-b544-4188-881d-72fd4d002d85 -p 172.16.0.220:3260 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:513c8487-b544-4188-881d-72fd4d002d85 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:35 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[988dad9f-dd13-45b9-8f1f-d489e19c7f04]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:16:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ab14e7-9e3f-4e66-a42d-6f4a5a85482b tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 08:16:35 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:16:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:513c8487-b544-4188-881d-72fd4d002d85 -p 172.16.0.220:3260 --interface default --op new {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:513c8487-b544-4188-881d-72fd4d002d85 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:35 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c953eef1-f72f-4558-85fe-ba173fe4d333]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:513c8487-b544-4188-881d-72fd4d002d85] added\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:16:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ab14e7-9e3f-4e66-a42d-6f4a5a85482b tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:513c8487-b544-4188-881d-72fd4d002d85] added
Nov 15 08:16:35 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:16:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:513c8487-b544-4188-881d-72fd4d002d85 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:513c8487-b544-4188-881d-72fd4d002d85 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:35 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17feffc-b0a7-479e-b788-b06aa40ef87e]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:16:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ab14e7-9e3f-4e66-a42d-6f4a5a85482b tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:16:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:513c8487-b544-4188-881d-72fd4d002d85 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:513c8487-b544-4188-881d-72fd4d002d85 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:35 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a38278-251e-4cd6-9526-5a9ed9aa9aba]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:16:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ab14e7-9e3f-4e66-a42d-6f4a5a85482b tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:16:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:513c8487-b544-4188-881d-72fd4d002d85 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hUuxEYJH {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:513c8487-b544-4188-881d-72fd4d002d85 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hUuxEYJH" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:35 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[0894f1e0-5b55-4a04-b9cf-864624a6abac]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:16:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ab14e7-9e3f-4e66-a42d-6f4a5a85482b tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hUuxEYJH'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:16:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:513c8487-b544-4188-881d-72fd4d002d85 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:513c8487-b544-4188-881d-72fd4d002d85 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:35 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca320407-a825-4c10-a1cf-46209ce08f42]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:16:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ab14e7-9e3f-4e66-a42d-6f4a5a85482b tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:16:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:35 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[72fcdf2a-a327-4594-bc0a-51a046f5ef1b]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:16:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ab14e7-9e3f-4e66-a42d-6f4a5a85482b tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 (non-flash)
Nov 15 08:16:35 user nova-compute[95467]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:16:35 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:16:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ab14e7-9e3f-4e66-a42d-6f4a5a85482b tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 (non-flash)
Nov 15 08:16:35 user nova-compute[95467]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:16:35 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:16:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:513c8487-b544-4188-881d-72fd4d002d85 -p 172.16.0.220:3260 --login {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:513c8487-b544-4188-881d-72fd4d002d85 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:35 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9dc314-5aa1-4a5f-b22c-694c25d2b0da]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:513c8487-b544-4188-881d-72fd4d002d85, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:513c8487-b544-4188-881d-72fd4d002d85, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:16:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ab14e7-9e3f-4e66-a42d-6f4a5a85482b tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:513c8487-b544-4188-881d-72fd4d002d85, portal: 172.16.0.220,3260]
Nov 15 08:16:35 user nova-compute[95467]: Login to [iface: default, target: iqn.2010-10.org.openstack:513c8487-b544-4188-881d-72fd4d002d85, portal: 172.16.0.220,3260] successful.
Nov 15 08:16:35 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:16:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:513c8487-b544-4188-881d-72fd4d002d85 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:513c8487-b544-4188-881d-72fd4d002d85 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:35 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a878a60c-4853-4e4b-868d-51a0be9d81de]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:16:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ab14e7-9e3f-4e66-a42d-6f4a5a85482b tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:16:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:35 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[de459c2a-82be-46e2-9cab-e85ab156677b]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:513c8487-b544-4188-881d-72fd4d002d85 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:16:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ab14e7-9e3f-4e66-a42d-6f4a5a85482b tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 (non-flash)
Nov 15 08:16:35 user nova-compute[95467]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:16:35 user nova-compute[95467]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:513c8487-b544-4188-881d-72fd4d002d85 (non-flash)
Nov 15 08:16:35 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:16:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ab14e7-9e3f-4e66-a42d-6f4a5a85482b tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 (non-flash)
Nov 15 08:16:35 user nova-compute[95467]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:16:35 user nova-compute[95467]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:513c8487-b544-4188-881d-72fd4d002d85 (non-flash)
Nov 15 08:16:35 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:16:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-e1ab14e7-9e3f-4e66-a42d-6f4a5a85482b tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:513c8487-b544-4188-881d-72fd4d002d85" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:16:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ab14e7-9e3f-4e66-a42d-6f4a5a85482b tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Connected to 172.16.0.220:3260 {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 08:16:35 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-e1ab14e7-9e3f-4e66-a42d-6f4a5a85482b tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] HCTL ('35', '-', '-', 0) found on session 21 with lun 0 {{(pid=95467) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 08:16:35 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-e1ab14e7-9e3f-4e66-a42d-6f4a5a85482b tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=95467) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 08:16:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:35 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[21345970-4349-429e-a643-6fe38a49d956]: (4, ('- - 0', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:16:35 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-e1ab14e7-9e3f-4e66-a42d-6f4a5a85482b tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Searching for a device in session 21 and hctl ['35', '*', '*', 0] yield: None {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:16:35 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:36 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-e1ab14e7-9e3f-4e66-a42d-6f4a5a85482b tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Searching for a device in session 21 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:16:36 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ab14e7-9e3f-4e66-a42d-6f4a5a85482b tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:513c8487-b544-4188-881d-72fd4d002d85', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hUuxEYJH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 08:16:36 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-e1ab14e7-9e3f-4e66-a42d-6f4a5a85482b tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:16:36 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ab14e7-9e3f-4e66-a42d-6f4a5a85482b tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23864376533626434', 'path': '/dev/sdd'} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:16:36 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1ab14e7-9e3f-4e66-a42d-6f4a5a85482b tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864376533626434', 'path': '/dev/sdd'} {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 08:16:36 user nova-compute[95467]: DEBUG nova.objects.instance [None req-e1ab14e7-9e3f-4e66-a42d-6f4a5a85482b tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Lazy-loading 'flavor' on Instance uuid da9c7b9d-aad7-4d4f-b190-fda71735fde6 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:16:36 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-e1ab14e7-9e3f-4e66-a42d-6f4a5a85482b tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 08:16:36 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:16:36 user nova-compute[95467]:   <source dev="/dev/sdd"/>
Nov 15 08:16:36 user nova-compute[95467]:   <target dev="sdc" bus="scsi"/>
Nov 15 08:16:36 user nova-compute[95467]:   <serial>513c8487-b544-4188-881d-72fd4d002d85</serial>
Nov 15 08:16:36 user nova-compute[95467]:   <address type="drive" controller="0" unit="2"/>
Nov 15 08:16:36 user nova-compute[95467]: </disk>
Nov 15 08:16:36 user nova-compute[95467]:  {{(pid=95467) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 08:16:36 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:16:36 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=95467) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 08:16:36 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-e1ab14e7-9e3f-4e66-a42d-6f4a5a85482b tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] No BDM found with device name sda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:16:36 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-e1ab14e7-9e3f-4e66-a42d-6f4a5a85482b tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] No BDM found with device name sdb, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:16:36 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-e1ab14e7-9e3f-4e66-a42d-6f4a5a85482b tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] No BDM found with device name sdc, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:16:36 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-e1ab14e7-9e3f-4e66-a42d-6f4a5a85482b tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] No VIF found with MAC fa:16:3e:20:9d:69, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:16:37 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e1ab14e7-9e3f-4e66-a42d-6f4a5a85482b tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Lock "da9c7b9d-aad7-4d4f-b190-fda71735fde6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.074s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:16:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:37 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-01219bf2-865d-41ad-ab56-25a9384a5183 tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Acquiring lock "da9c7b9d-aad7-4d4f-b190-fda71735fde6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:16:37 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-01219bf2-865d-41ad-ab56-25a9384a5183 tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Lock "da9c7b9d-aad7-4d4f-b190-fda71735fde6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:16:37 user nova-compute[95467]: INFO nova.compute.manager [None req-01219bf2-865d-41ad-ab56-25a9384a5183 tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] Detaching volume 513c8487-b544-4188-881d-72fd4d002d85
Nov 15 08:16:38 user nova-compute[95467]: INFO nova.virt.block_device [None req-01219bf2-865d-41ad-ab56-25a9384a5183 tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] Attempting to driver detach volume 513c8487-b544-4188-881d-72fd4d002d85 from mountpoint /dev/sdc
Nov 15 08:16:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-01219bf2-865d-41ad-ab56-25a9384a5183 tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Attempting to detach device sdc from instance da9c7b9d-aad7-4d4f-b190-fda71735fde6 from the persistent domain config. {{(pid=95467) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 08:16:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-01219bf2-865d-41ad-ab56-25a9384a5183 tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 08:16:38 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:16:38 user nova-compute[95467]:   <source dev="/dev/sdd"/>
Nov 15 08:16:38 user nova-compute[95467]:   <target dev="sdc" bus="scsi"/>
Nov 15 08:16:38 user nova-compute[95467]:   <serial>513c8487-b544-4188-881d-72fd4d002d85</serial>
Nov 15 08:16:38 user nova-compute[95467]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 15 08:16:38 user nova-compute[95467]: </disk>
Nov 15 08:16:38 user nova-compute[95467]:  {{(pid=95467) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 08:16:38 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-01219bf2-865d-41ad-ab56-25a9384a5183 tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Successfully detached device sdc from instance da9c7b9d-aad7-4d4f-b190-fda71735fde6 from the persistent domain config.
Nov 15 08:16:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-01219bf2-865d-41ad-ab56-25a9384a5183 tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance da9c7b9d-aad7-4d4f-b190-fda71735fde6 from the live domain config. {{(pid=95467) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 08:16:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-01219bf2-865d-41ad-ab56-25a9384a5183 tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 08:16:38 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:16:38 user nova-compute[95467]:   <source dev="/dev/sdd"/>
Nov 15 08:16:38 user nova-compute[95467]:   <target dev="sdc" bus="scsi"/>
Nov 15 08:16:38 user nova-compute[95467]:   <serial>513c8487-b544-4188-881d-72fd4d002d85</serial>
Nov 15 08:16:38 user nova-compute[95467]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 15 08:16:38 user nova-compute[95467]: </disk>
Nov 15 08:16:38 user nova-compute[95467]:  {{(pid=95467) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 08:16:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-01219bf2-865d-41ad-ab56-25a9384a5183 tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance da9c7b9d-aad7-4d4f-b190-fda71735fde6 {{(pid=95467) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 08:16:39 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:16:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:40 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:16:40 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager.update_available_resource {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:16:40 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:16:40 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:16:40 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:16:40 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Auditing locally available compute resources for user (node: user) {{(pid=95467) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 08:16:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:41 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:16:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3711c883-ec5f-4a09-88f8-d4c0668ae570/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3711c883-ec5f-4a09-88f8-d4c0668ae570/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3711c883-ec5f-4a09-88f8-d4c0668ae570/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Acquiring lock "851d354c-7f20-4e72-bfd2-a781b929e8ba" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:16:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "851d354c-7f20-4e72-bfd2-a781b929e8ba" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:16:41 user nova-compute[95467]: DEBUG nova.compute.manager [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] Starting instance... {{(pid=95467) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 08:16:42 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:16:42 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:16:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3711c883-ec5f-4a09-88f8-d4c0668ae570/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:42 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:16:42 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=95467) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 08:16:42 user nova-compute[95467]: INFO nova.compute.claims [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] Claim successful on node user
Nov 15 08:16:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bee31898-4f12-4c68-a18b-a678f9f584aa/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bee31898-4f12-4c68-a18b-a678f9f584aa/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bee31898-4f12-4c68-a18b-a678f9f584aa/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bee31898-4f12-4c68-a18b-a678f9f584aa/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a35226-6b98-44ad-ab4d-e0e86b14ba9d/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:42 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:16:42 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:16:42 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.586s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:16:42 user nova-compute[95467]: DEBUG nova.compute.manager [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] Start building networks asynchronously for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 08:16:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a35226-6b98-44ad-ab4d-e0e86b14ba9d/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a35226-6b98-44ad-ab4d-e0e86b14ba9d/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:42 user nova-compute[95467]: DEBUG nova.compute.manager [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] Allocating IP information in the background. {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 08:16:42 user nova-compute[95467]: DEBUG nova.network.neutron [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] allocate_for_instance() {{(pid=95467) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 08:16:42 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 08:16:42 user nova-compute[95467]: DEBUG nova.compute.manager [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] Start building block device mappings for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 08:16:42 user nova-compute[95467]: DEBUG nova.policy [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '11bbbd3ef322402cb5dc60455a54319b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7791bd92c7c488aa72474ecde2e1155', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95467) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 08:16:42 user nova-compute[95467]: INFO nova.virt.block_device [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] Booting with volume 3ab9aa85-da9e-4f66-aef1-c0a3864a8149 at /dev/vda
Nov 15 08:16:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a35226-6b98-44ad-ab4d-e0e86b14ba9d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2765af98-917a-4f0f-95af-3393e0d50a52/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:42 user nova-compute[95467]: DEBUG os_brick.utils [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:16:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:42 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df8a14d-46c3-4497-b422-1313df2f6c51]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:882ae90641f\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:16:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:42 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f56ec0-70af-4040-8989-55cce15dce7f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:16:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:42 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[56734f76-213a-4da9-ad5e-750c7d40486f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:16:42 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[6076494b-fca8-4e09-a466-9c0cf6bc5de9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:16:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Running cmd (subprocess): nvme version {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] 'nvme version' failed. Not Retrying. {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:16:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] nvme not present on system {{(pid=95467) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 08:16:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:16:43 user nova-compute[95467]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 08:16:43 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34713d0-4479-433c-aec4-3ecb28d79c1f]: (4, '') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:16:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=95467) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 08:16:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 08:16:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] LIGHTOS: no hostnqn found. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 08:16:43 user nova-compute[95467]: DEBUG os_brick.utils [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:882ae90641f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:16:43 user nova-compute[95467]: DEBUG nova.virt.block_device [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] Updating existing volume attachment record: 6d6a3cc0-1418-404a-be1f-ce7d076f0870 {{(pid=95467) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 08:16:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2765af98-917a-4f0f-95af-3393e0d50a52/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2765af98-917a-4f0f-95af-3393e0d50a52/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2765af98-917a-4f0f-95af-3393e0d50a52/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:43 user nova-compute[95467]: DEBUG nova.network.neutron [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] Successfully created port: c9bd9bbe-8c0f-476d-978d-d7050876a1ab {{(pid=95467) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 08:16:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10968e11-51b2-46a4-87a5-bb85f938f489/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10968e11-51b2-46a4-87a5-bb85f938f489/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10968e11-51b2-46a4-87a5-bb85f938f489/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10968e11-51b2-46a4-87a5-bb85f938f489/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:44 user nova-compute[95467]: DEBUG nova.network.neutron [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] Successfully updated port: c9bd9bbe-8c0f-476d-978d-d7050876a1ab {{(pid=95467) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 08:16:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Acquiring lock "refresh_cache-851d354c-7f20-4e72-bfd2-a781b929e8ba" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:16:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Acquired lock "refresh_cache-851d354c-7f20-4e72-bfd2-a781b929e8ba" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:16:44 user nova-compute[95467]: DEBUG nova.network.neutron [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:16:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:44 user nova-compute[95467]: DEBUG nova.compute.manager [req-d20e1ddb-6329-4ab1-8ca8-2c053e5a8b16 req-9b8623c7-4619-4d62-8bdd-00efcd7378cf service nova] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] Received event network-changed-c9bd9bbe-8c0f-476d-978d-d7050876a1ab {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:16:44 user nova-compute[95467]: DEBUG nova.compute.manager [req-d20e1ddb-6329-4ab1-8ca8-2c053e5a8b16 req-9b8623c7-4619-4d62-8bdd-00efcd7378cf service nova] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] Refreshing instance network info cache due to event network-changed-c9bd9bbe-8c0f-476d-978d-d7050876a1ab. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:16:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-d20e1ddb-6329-4ab1-8ca8-2c053e5a8b16 req-9b8623c7-4619-4d62-8bdd-00efcd7378cf service nova] Acquiring lock "refresh_cache-851d354c-7f20-4e72-bfd2-a781b929e8ba" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:16:44 user nova-compute[95467]: DEBUG nova.network.neutron [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] Instance cache missing network info. {{(pid=95467) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 08:16:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2aa477-6786-483a-b088-d8ec204fe6aa/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:44 user nova-compute[95467]: DEBUG nova.network.neutron [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] Updating instance_info_cache with network_info: [{"id": "c9bd9bbe-8c0f-476d-978d-d7050876a1ab", "address": "fa:16:3e:c3:5d:b8", "network": {"id": "96d9262b-11fb-497d-8e38-fa46076c010f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2069167691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7791bd92c7c488aa72474ecde2e1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9bd9bbe-8c", "ovs_interfaceid": "c9bd9bbe-8c0f-476d-978d-d7050876a1ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:16:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Releasing lock "refresh_cache-851d354c-7f20-4e72-bfd2-a781b929e8ba" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:16:44 user nova-compute[95467]: DEBUG nova.compute.manager [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] Instance network_info: |[{"id": "c9bd9bbe-8c0f-476d-978d-d7050876a1ab", "address": "fa:16:3e:c3:5d:b8", "network": {"id": "96d9262b-11fb-497d-8e38-fa46076c010f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2069167691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7791bd92c7c488aa72474ecde2e1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9bd9bbe-8c", "ovs_interfaceid": "c9bd9bbe-8c0f-476d-978d-d7050876a1ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 08:16:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-d20e1ddb-6329-4ab1-8ca8-2c053e5a8b16 req-9b8623c7-4619-4d62-8bdd-00efcd7378cf service nova] Acquired lock "refresh_cache-851d354c-7f20-4e72-bfd2-a781b929e8ba" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:16:44 user nova-compute[95467]: DEBUG nova.network.neutron [req-d20e1ddb-6329-4ab1-8ca8-2c053e5a8b16 req-9b8623c7-4619-4d62-8bdd-00efcd7378cf service nova] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] Refreshing network info cache for port c9bd9bbe-8c0f-476d-978d-d7050876a1ab {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:16:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2aa477-6786-483a-b088-d8ec204fe6aa/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2aa477-6786-483a-b088-d8ec204fe6aa/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2aa477-6786-483a-b088-d8ec204fe6aa/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da9c7b9d-aad7-4d4f-b190-fda71735fde6/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da9c7b9d-aad7-4d4f-b190-fda71735fde6/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da9c7b9d-aad7-4d4f-b190-fda71735fde6/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:45 user nova-compute[95467]: DEBUG nova.network.neutron [req-d20e1ddb-6329-4ab1-8ca8-2c053e5a8b16 req-9b8623c7-4619-4d62-8bdd-00efcd7378cf service nova] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] Updated VIF entry in instance network info cache for port c9bd9bbe-8c0f-476d-978d-d7050876a1ab. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:16:45 user nova-compute[95467]: DEBUG nova.network.neutron [req-d20e1ddb-6329-4ab1-8ca8-2c053e5a8b16 req-9b8623c7-4619-4d62-8bdd-00efcd7378cf service nova] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] Updating instance_info_cache with network_info: [{"id": "c9bd9bbe-8c0f-476d-978d-d7050876a1ab", "address": "fa:16:3e:c3:5d:b8", "network": {"id": "96d9262b-11fb-497d-8e38-fa46076c010f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2069167691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7791bd92c7c488aa72474ecde2e1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9bd9bbe-8c", "ovs_interfaceid": "c9bd9bbe-8c0f-476d-978d-d7050876a1ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:16:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da9c7b9d-aad7-4d4f-b190-fda71735fde6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-d20e1ddb-6329-4ab1-8ca8-2c053e5a8b16 req-9b8623c7-4619-4d62-8bdd-00efcd7378cf service nova] Releasing lock "refresh_cache-851d354c-7f20-4e72-bfd2-a781b929e8ba" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:16:45 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:45 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:16:45 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:16:45 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Hypervisor/Node resource view: name=user free_ram=7196MB free_disk=25.251708984375GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=95467) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 08:16:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:16:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:16:45 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance ee2aa477-6786-483a-b088-d8ec204fe6aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:16:45 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 73fe8852-c47a-47ab-a56f-6864c8ed5479 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:16:45 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 21cf2ada-b15c-490d-ac37-96e9c87e9056 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:16:45 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 3711c883-ec5f-4a09-88f8-d4c0668ae570 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:16:45 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance bee31898-4f12-4c68-a18b-a678f9f584aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:16:45 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance da9c7b9d-aad7-4d4f-b190-fda71735fde6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:16:45 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:16:45 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 10d73b73-ca65-4192-8954-288dc1df9f24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:16:45 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance d5a35226-6b98-44ad-ab4d-e0e86b14ba9d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:16:45 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 3825a691-ac5c-4c06-b4a4-2a0b40c638c4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:16:45 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 10968e11-51b2-46a4-87a5-bb85f938f489 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:16:45 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 2765af98-917a-4f0f-95af-3393e0d50a52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:16:45 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 851d354c-7f20-4e72-bfd2-a781b929e8ba actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:16:45 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 08:16:45 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 08:16:46 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:16:46 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:16:46 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Compute_service record updated for user:user {{(pid=95467) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 08:16:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.495s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:16:47 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:47 user nova-compute[95467]: DEBUG nova.compute.manager [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] Start spawning the instance on the hypervisor. {{(pid=95467) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 08:16:47 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] Creating instance directory {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 08:16:47 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] Creating image(s)
Nov 15 08:16:47 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] Did not create local disks {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 08:16:47 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] Ensure instance console log exists: /opt/stack/data/nova/instances/851d354c-7f20-4e72-bfd2-a781b929e8ba/console.log {{(pid=95467) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 08:16:47 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:16:47 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:16:47 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:16:47 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] Start _get_guest_xml network_info=[{"id": "c9bd9bbe-8c0f-476d-978d-d7050876a1ab", "address": "fa:16:3e:c3:5d:b8", "network": {"id": "96d9262b-11fb-497d-8e38-fa46076c010f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2069167691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7791bd92c7c488aa72474ecde2e1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9bd9bbe-8c", "ovs_interfaceid": "c9bd9bbe-8c0f-476d-978d-d7050876a1ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '6d6a3cc0-1418-404a-be1f-ce7d076f0870', 'delete_on_termination': True, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bIqmePSh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '851d354c-7f20-4e72-bfd2-a781b929e8ba', 'attached_at': '', 'detached_at': '', 'volume_id': '3ab9aa85-da9e-4f66-aef1-c0a3864a8149', 'serial': '3ab9aa85-da9e-4f66-aef1-c0a3864a8149'}, 'volume_type': None} {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:16:47 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:16:47 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:16:47 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:16:47 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:16:47 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:16:47 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:16:47 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:16:47 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:16:47 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:16:47 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:16:47 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:16:47 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:16:47 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:16:47 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:16:47 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:16:47 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:16:47 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:16:47 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:16:47 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] Calling os-brick to attach iSCSI Volume {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 08:16:47 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bIqmePSh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:16:47 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:16:47 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:16:47 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:16:47 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:16:47 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:16:47 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:16:47 user nova-compute[95467]: INFO os_brick.initiator.connectors.iscsi [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 08:16:47 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 -p 172.16.0.220:3260 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:47 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcaab533-7197-483d-9ebb-50207b4af4eb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:16:47 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 08:16:47 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:16:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 -p 172.16.0.220:3260 --interface default --op new {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:48 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d442586a-f682-4591-8be5-3c84fc4cd4b1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149] added\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:16:48 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149] added
Nov 15 08:16:48 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:16:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:48 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c217be-774e-46e4-8e3f-204f75421c17]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:16:48 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:16:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:48 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bed2e0a-6c51-4df5-a203-5144e9365ce9]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:16:48 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:16:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bIqmePSh {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bIqmePSh" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:48 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a996046-e690-4888-a7a7-65812bf218f3]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:16:48 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bIqmePSh'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:16:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:48 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e6bc04-36b6-48e1-b4f9-adece954a362]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:16:48 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:16:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:48 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb69d19-3103-4891-905e-42b30c7eae16]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:513c8487-b544-4188-881d-72fd4d002d85 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:16:48 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 (non-flash)
Nov 15 08:16:48 user nova-compute[95467]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:16:48 user nova-compute[95467]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:513c8487-b544-4188-881d-72fd4d002d85 (non-flash)
Nov 15 08:16:48 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:16:48 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 (non-flash)
Nov 15 08:16:48 user nova-compute[95467]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:16:48 user nova-compute[95467]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:513c8487-b544-4188-881d-72fd4d002d85 (non-flash)
Nov 15 08:16:48 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:16:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 -p 172.16.0.220:3260 --login {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:48 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[56640470-d822-4cbd-928c-4d65954563a6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:16:48 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149, portal: 172.16.0.220,3260]
Nov 15 08:16:48 user nova-compute[95467]: Login to [iface: default, target: iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149, portal: 172.16.0.220,3260] successful.
Nov 15 08:16:48 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:16:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:48 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:16:48 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:16:48 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Starting heal instance info cache {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 08:16:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:48 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc946b0e-f59b-48e3-9c17-4ff8b86b78ff]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:16:48 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:16:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:48 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa12ba3-0d93-4e37-96cb-ef43c37aafee]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:513c8487-b544-4188-881d-72fd4d002d85 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:16:48 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 (non-flash)
Nov 15 08:16:48 user nova-compute[95467]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:16:48 user nova-compute[95467]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:513c8487-b544-4188-881d-72fd4d002d85 (non-flash)
Nov 15 08:16:48 user nova-compute[95467]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)
Nov 15 08:16:48 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:16:48 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 (non-flash)
Nov 15 08:16:48 user nova-compute[95467]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:16:48 user nova-compute[95467]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:513c8487-b544-4188-881d-72fd4d002d85 (non-flash)
Nov 15 08:16:48 user nova-compute[95467]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)
Nov 15 08:16:48 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:16:48 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:16:48 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Connected to 172.16.0.220:3260 {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 08:16:48 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] HCTL ('36', '-', '-', 0) found on session 22 with lun 0 {{(pid=95467) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 08:16:48 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=95467) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 08:16:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:48 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[92752d54-1b5e-46b1-a9a2-9a5a9f0c836c]: (4, ('- - 0', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:16:48 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Searching for a device in session 22 and hctl ['36', '*', '*', 0] yield: sde {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:16:48 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bIqmePSh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 08:16:48 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Didn't find any instances for network info cache update. {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 08:16:48 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:16:48 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:16:48 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:16:49 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:16:49 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '26334396365376330', 'path': '/dev/sde'} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:16:49 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26334396365376330', 'path': '/dev/sde'} {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 08:16:49 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:16:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1019745917',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1019745917',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1019745917',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOo4tu16UhZt/Wocs2ppNo9WrrX7m1ijk1oUGOQJ8WBXgkkffrV/FJQFgEm4bqalf7GptKJGuKIr8+PGpGYsPmEDx6TtDmRJLSsqhwW+LKCcGSjhNvUTuKiKWApWjDq3ZQ==',key_name='tempest-keypair-369125507',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7791bd92c7c488aa72474ecde2e1155',ramdisk_id='',reservation_id='r-at3b3ylg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-978207351',owner_user_name='tempest-TestVolumeBootPattern-978207351-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:16:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11bbbd3ef322402cb5dc60455a54319b',uuid=851d354c-7f20-4e72-bfd2-a781b929e8ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9bd9bbe-8c0f-476d-978d-d7050876a1ab", "address": "fa:16:3e:c3:5d:b8", "network": {"id": "96d9262b-11fb-497d-8e38-fa46076c010f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2069167691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7791bd92c7c488aa72474ecde2e1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9bd9bbe-8c", "ovs_interfaceid": "c9bd9bbe-8c0f-476d-978d-d7050876a1ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:16:49 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Converting VIF {"id": "c9bd9bbe-8c0f-476d-978d-d7050876a1ab", "address": "fa:16:3e:c3:5d:b8", "network": {"id": "96d9262b-11fb-497d-8e38-fa46076c010f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2069167691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7791bd92c7c488aa72474ecde2e1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9bd9bbe-8c", "ovs_interfaceid": "c9bd9bbe-8c0f-476d-978d-d7050876a1ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:16:49 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:5d:b8,bridge_name='br-int',has_traffic_filtering=True,id=c9bd9bbe-8c0f-476d-978d-d7050876a1ab,network=Network(96d9262b-11fb-497d-8e38-fa46076c010f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9bd9bbe-8c') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:16:49 user nova-compute[95467]: DEBUG nova.objects.instance [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lazy-loading 'pci_devices' on Instance uuid 851d354c-7f20-4e72-bfd2-a781b929e8ba {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:16:49 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:16:49 user nova-compute[95467]:   <uuid>851d354c-7f20-4e72-bfd2-a781b929e8ba</uuid>
Nov 15 08:16:49 user nova-compute[95467]:   <name>instance-0000001b</name>
Nov 15 08:16:49 user nova-compute[95467]:   <memory>524288</memory>
Nov 15 08:16:49 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:16:49 user nova-compute[95467]:   <metadata>
Nov 15 08:16:49 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:16:49 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:16:49 user nova-compute[95467]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1019745917</nova:name>
Nov 15 08:16:49 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:16:47</nova:creationTime>
Nov 15 08:16:49 user nova-compute[95467]:       <nova:flavor name="m1.tiny">
Nov 15 08:16:49 user nova-compute[95467]:         <nova:memory>512</nova:memory>
Nov 15 08:16:49 user nova-compute[95467]:         <nova:disk>1</nova:disk>
Nov 15 08:16:49 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:16:49 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:16:49 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:16:49 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:16:49 user nova-compute[95467]:       <nova:owner>
Nov 15 08:16:49 user nova-compute[95467]:         <nova:user uuid="11bbbd3ef322402cb5dc60455a54319b">tempest-TestVolumeBootPattern-978207351-project-member</nova:user>
Nov 15 08:16:49 user nova-compute[95467]:         <nova:project uuid="e7791bd92c7c488aa72474ecde2e1155">tempest-TestVolumeBootPattern-978207351</nova:project>
Nov 15 08:16:49 user nova-compute[95467]:       </nova:owner>
Nov 15 08:16:49 user nova-compute[95467]:       <nova:ports>
Nov 15 08:16:49 user nova-compute[95467]:         <nova:port uuid="c9bd9bbe-8c0f-476d-978d-d7050876a1ab">
Nov 15 08:16:49 user nova-compute[95467]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 08:16:49 user nova-compute[95467]:         </nova:port>
Nov 15 08:16:49 user nova-compute[95467]:       </nova:ports>
Nov 15 08:16:49 user nova-compute[95467]:     </nova:instance>
Nov 15 08:16:49 user nova-compute[95467]:   </metadata>
Nov 15 08:16:49 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:16:49 user nova-compute[95467]:     <system>
Nov 15 08:16:49 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:16:49 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:16:49 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:16:49 user nova-compute[95467]:       <entry name="serial">851d354c-7f20-4e72-bfd2-a781b929e8ba</entry>
Nov 15 08:16:49 user nova-compute[95467]:       <entry name="uuid">851d354c-7f20-4e72-bfd2-a781b929e8ba</entry>
Nov 15 08:16:49 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:16:49 user nova-compute[95467]:     </system>
Nov 15 08:16:49 user nova-compute[95467]:   </sysinfo>
Nov 15 08:16:49 user nova-compute[95467]:   <os>
Nov 15 08:16:49 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:16:49 user nova-compute[95467]:     <boot dev="hd"/>
Nov 15 08:16:49 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:16:49 user nova-compute[95467]:   </os>
Nov 15 08:16:49 user nova-compute[95467]:   <features>
Nov 15 08:16:49 user nova-compute[95467]:     <acpi/>
Nov 15 08:16:49 user nova-compute[95467]:     <apic/>
Nov 15 08:16:49 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:16:49 user nova-compute[95467]:   </features>
Nov 15 08:16:49 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:16:49 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:16:49 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:16:49 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:16:49 user nova-compute[95467]:   </clock>
Nov 15 08:16:49 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:16:49 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:16:49 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:16:49 user nova-compute[95467]:   </cpu>
Nov 15 08:16:49 user nova-compute[95467]:   <devices>
Nov 15 08:16:49 user nova-compute[95467]:     <disk type="block" device="disk">
Nov 15 08:16:49 user nova-compute[95467]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:16:49 user nova-compute[95467]:       <source dev="/dev/sde"/>
Nov 15 08:16:49 user nova-compute[95467]:       <target dev="vda" bus="virtio"/>
Nov 15 08:16:49 user nova-compute[95467]:       <serial>3ab9aa85-da9e-4f66-aef1-c0a3864a8149</serial>
Nov 15 08:16:49 user nova-compute[95467]:     </disk>
Nov 15 08:16:49 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:16:49 user nova-compute[95467]:       <mac address="fa:16:3e:c3:5d:b8"/>
Nov 15 08:16:49 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:16:49 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:16:49 user nova-compute[95467]:       <target dev="tapc9bd9bbe-8c"/>
Nov 15 08:16:49 user nova-compute[95467]:     </interface>
Nov 15 08:16:49 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:16:49 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/851d354c-7f20-4e72-bfd2-a781b929e8ba/console.log" append="off"/>
Nov 15 08:16:49 user nova-compute[95467]:     </serial>
Nov 15 08:16:49 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:16:49 user nova-compute[95467]:     <video>
Nov 15 08:16:49 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:16:49 user nova-compute[95467]:     </video>
Nov 15 08:16:49 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:16:49 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:16:49 user nova-compute[95467]:     </rng>
Nov 15 08:16:49 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:16:49 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:16:49 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:16:49 user nova-compute[95467]:     </memballoon>
Nov 15 08:16:49 user nova-compute[95467]:   </devices>
Nov 15 08:16:49 user nova-compute[95467]: </domain>
Nov 15 08:16:49 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:16:49 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:16:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1019745917',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1019745917',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1019745917',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOo4tu16UhZt/Wocs2ppNo9WrrX7m1ijk1oUGOQJ8WBXgkkffrV/FJQFgEm4bqalf7GptKJGuKIr8+PGpGYsPmEDx6TtDmRJLSsqhwW+LKCcGSjhNvUTuKiKWApWjDq3ZQ==',key_name='tempest-keypair-369125507',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7791bd92c7c488aa72474ecde2e1155',ramdisk_id='',reservation_id='r-at3b3ylg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-978207351',owner_user_name='tempest-TestVolumeBootPattern-978207351-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:16:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11bbbd3ef322402cb5dc60455a54319b',uuid=851d354c-7f20-4e72-bfd2-a781b929e8ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9bd9bbe-8c0f-476d-978d-d7050876a1ab", "address": "fa:16:3e:c3:5d:b8", "network": {"id": "96d9262b-11fb-497d-8e38-fa46076c010f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2069167691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7791bd92c7c488aa72474ecde2e1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9bd9bbe-8c", "ovs_interfaceid": "c9bd9bbe-8c0f-476d-978d-d7050876a1ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:16:49 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Converting VIF {"id": "c9bd9bbe-8c0f-476d-978d-d7050876a1ab", "address": "fa:16:3e:c3:5d:b8", "network": {"id": "96d9262b-11fb-497d-8e38-fa46076c010f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2069167691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7791bd92c7c488aa72474ecde2e1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9bd9bbe-8c", "ovs_interfaceid": "c9bd9bbe-8c0f-476d-978d-d7050876a1ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:16:49 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:5d:b8,bridge_name='br-int',has_traffic_filtering=True,id=c9bd9bbe-8c0f-476d-978d-d7050876a1ab,network=Network(96d9262b-11fb-497d-8e38-fa46076c010f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9bd9bbe-8c') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:16:49 user nova-compute[95467]: DEBUG os_vif [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:5d:b8,bridge_name='br-int',has_traffic_filtering=True,id=c9bd9bbe-8c0f-476d-978d-d7050876a1ab,network=Network(96d9262b-11fb-497d-8e38-fa46076c010f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9bd9bbe-8c') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:16:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:16:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:16:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '045aad2f-155a-547f-ad17-173f9fa3363b', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:16:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc9bd9bbe-8c, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:16:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc9bd9bbe-8c, col_values=(('qos', UUID('c8bb2941-26b1-4098-adb3-e5348d4c5272')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:16:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc9bd9bbe-8c, col_values=(('external_ids', {'iface-id': 'c9bd9bbe-8c0f-476d-978d-d7050876a1ab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:5d:b8', 'vm-uuid': '851d354c-7f20-4e72-bfd2-a781b929e8ba'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:16:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:16:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:49 user nova-compute[95467]: INFO os_vif [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:5d:b8,bridge_name='br-int',has_traffic_filtering=True,id=c9bd9bbe-8c0f-476d-978d-d7050876a1ab,network=Network(96d9262b-11fb-497d-8e38-fa46076c010f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9bd9bbe-8c')
Nov 15 08:16:49 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:16:49 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] No VIF found with MAC fa:16:3e:c3:5d:b8, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:16:50 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:50 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:50 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:50 user nova-compute[95467]: DEBUG nova.compute.manager [req-c5305b27-8f49-4973-8c42-898f30c0ad9f req-3d620786-2cb6-4f4b-b621-940837a6b4ef service nova] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] Received event network-vif-plugged-c9bd9bbe-8c0f-476d-978d-d7050876a1ab {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:16:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-c5305b27-8f49-4973-8c42-898f30c0ad9f req-3d620786-2cb6-4f4b-b621-940837a6b4ef service nova] Acquiring lock "851d354c-7f20-4e72-bfd2-a781b929e8ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:16:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-c5305b27-8f49-4973-8c42-898f30c0ad9f req-3d620786-2cb6-4f4b-b621-940837a6b4ef service nova] Lock "851d354c-7f20-4e72-bfd2-a781b929e8ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:16:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-c5305b27-8f49-4973-8c42-898f30c0ad9f req-3d620786-2cb6-4f4b-b621-940837a6b4ef service nova] Lock "851d354c-7f20-4e72-bfd2-a781b929e8ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:16:50 user nova-compute[95467]: DEBUG nova.compute.manager [req-c5305b27-8f49-4973-8c42-898f30c0ad9f req-3d620786-2cb6-4f4b-b621-940837a6b4ef service nova] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] No waiting events found dispatching network-vif-plugged-c9bd9bbe-8c0f-476d-978d-d7050876a1ab {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:16:50 user nova-compute[95467]: WARNING nova.compute.manager [req-c5305b27-8f49-4973-8c42-898f30c0ad9f req-3d620786-2cb6-4f4b-b621-940837a6b4ef service nova] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] Received unexpected event network-vif-plugged-c9bd9bbe-8c0f-476d-978d-d7050876a1ab for instance with vm_state building and task_state spawning.
Nov 15 08:16:51 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:51 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:51 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:51 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:52 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:52 user nova-compute[95467]: DEBUG nova.compute.manager [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] Instance event wait completed in 0 seconds for  {{(pid=95467) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 08:16:52 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] Guest created on hypervisor {{(pid=95467) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 08:16:52 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] Instance spawned successfully.
Nov 15 08:16:52 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 08:16:52 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] Found default for hw_cdrom_bus of ide {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:16:52 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] Found default for hw_disk_bus of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:16:52 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] Found default for hw_input_bus of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:16:52 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] Found default for hw_pointer_model of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:16:52 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] Found default for hw_video_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:16:52 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] Found default for hw_vif_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:16:52 user nova-compute[95467]: INFO nova.compute.manager [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] Took 4.99 seconds to spawn the instance on the hypervisor.
Nov 15 08:16:52 user nova-compute[95467]: DEBUG nova.compute.manager [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:16:52 user nova-compute[95467]: INFO nova.compute.manager [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] Took 10.99 seconds to build instance.
Nov 15 08:16:52 user nova-compute[95467]: DEBUG nova.compute.manager [req-67b20bcd-d27d-4192-ba6c-91901837e8e7 req-d2ce6890-954e-4a46-8f9b-45a4e38b2956 service nova] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] Received event network-vif-plugged-c9bd9bbe-8c0f-476d-978d-d7050876a1ab {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:16:53 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-67b20bcd-d27d-4192-ba6c-91901837e8e7 req-d2ce6890-954e-4a46-8f9b-45a4e38b2956 service nova] Acquiring lock "851d354c-7f20-4e72-bfd2-a781b929e8ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:16:53 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-67b20bcd-d27d-4192-ba6c-91901837e8e7 req-d2ce6890-954e-4a46-8f9b-45a4e38b2956 service nova] Lock "851d354c-7f20-4e72-bfd2-a781b929e8ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:16:53 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-67b20bcd-d27d-4192-ba6c-91901837e8e7 req-d2ce6890-954e-4a46-8f9b-45a4e38b2956 service nova] Lock "851d354c-7f20-4e72-bfd2-a781b929e8ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:16:53 user nova-compute[95467]: DEBUG nova.compute.manager [req-67b20bcd-d27d-4192-ba6c-91901837e8e7 req-d2ce6890-954e-4a46-8f9b-45a4e38b2956 service nova] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] No waiting events found dispatching network-vif-plugged-c9bd9bbe-8c0f-476d-978d-d7050876a1ab {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:16:53 user nova-compute[95467]: WARNING nova.compute.manager [req-67b20bcd-d27d-4192-ba6c-91901837e8e7 req-d2ce6890-954e-4a46-8f9b-45a4e38b2956 service nova] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] Received unexpected event network-vif-plugged-c9bd9bbe-8c0f-476d-978d-d7050876a1ab for instance with vm_state active and task_state None.
Nov 15 08:16:53 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-5af083a3-732f-4890-8719-a96241cd5abd tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "851d354c-7f20-4e72-bfd2-a781b929e8ba" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.119s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:16:53 user nova-compute[95467]: INFO nova.compute.manager [None req-4f4853b7-f813-431a-95f6-e802ca9e4386 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Rescuing
Nov 15 08:16:53 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4f4853b7-f813-431a-95f6-e802ca9e4386 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Acquiring lock "refresh_cache-10d73b73-ca65-4192-8954-288dc1df9f24" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:16:53 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4f4853b7-f813-431a-95f6-e802ca9e4386 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Acquired lock "refresh_cache-10d73b73-ca65-4192-8954-288dc1df9f24" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:16:53 user nova-compute[95467]: DEBUG nova.network.neutron [None req-4f4853b7-f813-431a-95f6-e802ca9e4386 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:16:54 user nova-compute[95467]: DEBUG nova.network.neutron [None req-4f4853b7-f813-431a-95f6-e802ca9e4386 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Updating instance_info_cache with network_info: [{"id": "b88ee27b-7174-45f5-a5a5-45db71caac08", "address": "fa:16:3e:a0:3b:16", "network": {"id": "369d2a6f-60b7-4c92-8b2d-1f3828f6698b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1491709218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd281be4e94a4d31a47a13267d51d9b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb88ee27b-71", "ovs_interfaceid": "b88ee27b-7174-45f5-a5a5-45db71caac08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:16:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4f4853b7-f813-431a-95f6-e802ca9e4386 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Releasing lock "refresh_cache-10d73b73-ca65-4192-8954-288dc1df9f24" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:16:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:55 user nova-compute[95467]: DEBUG nova.compute.manager [req-c78dab9e-aa86-4ced-9db6-e1956af8edcb req-c43015d2-363a-4a70-aba6-39a8b1bd08ea service nova] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Received event network-vif-unplugged-b88ee27b-7174-45f5-a5a5-45db71caac08 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:16:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-c78dab9e-aa86-4ced-9db6-e1956af8edcb req-c43015d2-363a-4a70-aba6-39a8b1bd08ea service nova] Acquiring lock "10d73b73-ca65-4192-8954-288dc1df9f24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:16:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-c78dab9e-aa86-4ced-9db6-e1956af8edcb req-c43015d2-363a-4a70-aba6-39a8b1bd08ea service nova] Lock "10d73b73-ca65-4192-8954-288dc1df9f24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:16:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-c78dab9e-aa86-4ced-9db6-e1956af8edcb req-c43015d2-363a-4a70-aba6-39a8b1bd08ea service nova] Lock "10d73b73-ca65-4192-8954-288dc1df9f24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:16:55 user nova-compute[95467]: DEBUG nova.compute.manager [req-c78dab9e-aa86-4ced-9db6-e1956af8edcb req-c43015d2-363a-4a70-aba6-39a8b1bd08ea service nova] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] No waiting events found dispatching network-vif-unplugged-b88ee27b-7174-45f5-a5a5-45db71caac08 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:16:55 user nova-compute[95467]: WARNING nova.compute.manager [req-c78dab9e-aa86-4ced-9db6-e1956af8edcb req-c43015d2-363a-4a70-aba6-39a8b1bd08ea service nova] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Received unexpected event network-vif-unplugged-b88ee27b-7174-45f5-a5a5-45db71caac08 for instance with vm_state active and task_state rescuing.
Nov 15 08:16:55 user nova-compute[95467]: DEBUG nova.compute.manager [req-c78dab9e-aa86-4ced-9db6-e1956af8edcb req-c43015d2-363a-4a70-aba6-39a8b1bd08ea service nova] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Received event network-vif-plugged-b88ee27b-7174-45f5-a5a5-45db71caac08 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:16:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-c78dab9e-aa86-4ced-9db6-e1956af8edcb req-c43015d2-363a-4a70-aba6-39a8b1bd08ea service nova] Acquiring lock "10d73b73-ca65-4192-8954-288dc1df9f24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:16:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-c78dab9e-aa86-4ced-9db6-e1956af8edcb req-c43015d2-363a-4a70-aba6-39a8b1bd08ea service nova] Lock "10d73b73-ca65-4192-8954-288dc1df9f24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:16:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-c78dab9e-aa86-4ced-9db6-e1956af8edcb req-c43015d2-363a-4a70-aba6-39a8b1bd08ea service nova] Lock "10d73b73-ca65-4192-8954-288dc1df9f24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:16:55 user nova-compute[95467]: DEBUG nova.compute.manager [req-c78dab9e-aa86-4ced-9db6-e1956af8edcb req-c43015d2-363a-4a70-aba6-39a8b1bd08ea service nova] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] No waiting events found dispatching network-vif-plugged-b88ee27b-7174-45f5-a5a5-45db71caac08 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:16:55 user nova-compute[95467]: WARNING nova.compute.manager [req-c78dab9e-aa86-4ced-9db6-e1956af8edcb req-c43015d2-363a-4a70-aba6-39a8b1bd08ea service nova] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Received unexpected event network-vif-plugged-b88ee27b-7174-45f5-a5a5-45db71caac08 for instance with vm_state active and task_state rescuing.
Nov 15 08:16:55 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Instance destroyed successfully.
Nov 15 08:16:55 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-4f4853b7-f813-431a-95f6-e802ca9e4386 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Attempting rescue
Nov 15 08:16:55 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-4f4853b7-f813-431a-95f6-e802ca9e4386 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=95467) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 08:16:55 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-4f4853b7-f813-431a-95f6-e802ca9e4386 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Instance directory exists: not creating {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 08:16:55 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-4f4853b7-f813-431a-95f6-e802ca9e4386 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Creating image(s)
Nov 15 08:16:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4f4853b7-f813-431a-95f6-e802ca9e4386 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Acquiring lock "/opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:16:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4f4853b7-f813-431a-95f6-e802ca9e4386 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "/opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:16:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4f4853b7-f813-431a-95f6-e802ca9e4386 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "/opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:16:55 user nova-compute[95467]: DEBUG nova.objects.instance [None req-4f4853b7-f813-431a-95f6-e802ca9e4386 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lazy-loading 'trusted_certs' on Instance uuid 10d73b73-ca65-4192-8954-288dc1df9f24 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:16:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4f4853b7-f813-431a-95f6-e802ca9e4386 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Acquiring lock "a3fcf60225fcefd310404971cd18ab9851c548dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:16:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4f4853b7-f813-431a-95f6-e802ca9e4386 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:16:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-4f4853b7-f813-431a-95f6-e802ca9e4386 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-4f4853b7-f813-431a-95f6-e802ca9e4386 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.177s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-4f4853b7-f813-431a-95f6-e802ca9e4386 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk.rescue {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-4f4853b7-f813-431a-95f6-e802ca9e4386 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk.rescue" returned: 0 in 0.066s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4f4853b7-f813-431a-95f6-e802ca9e4386 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:16:55 user nova-compute[95467]: DEBUG nova.objects.instance [None req-4f4853b7-f813-431a-95f6-e802ca9e4386 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lazy-loading 'migration_context' on Instance uuid 10d73b73-ca65-4192-8954-288dc1df9f24 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:16:55 user nova-compute[95467]: DEBUG nova.objects.base [None req-4f4853b7-f813-431a-95f6-e802ca9e4386 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Object Instance<10d73b73-ca65-4192-8954-288dc1df9f24> lazy-loaded attributes: trusted_certs,migration_context {{(pid=95467) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 08:16:55 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-4f4853b7-f813-431a-95f6-e802ca9e4386 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Created local disks {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 08:16:55 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-4f4853b7-f813-431a-95f6-e802ca9e4386 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Start _get_guest_xml network_info=[{"id": "b88ee27b-7174-45f5-a5a5-45db71caac08", "address": "fa:16:3e:a0:3b:16", "network": {"id": "369d2a6f-60b7-4c92-8b2d-1f3828f6698b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1491709218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1491709218-network", "vif_mac": "fa:16:3e:a0:3b:16"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd281be4e94a4d31a47a13267d51d9b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb88ee27b-71", "ovs_interfaceid": "b88ee27b-7174-45f5-a5a5-45db71caac08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ed9c48aa-ce73-4b3b-9db1-235898be671b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:16:55 user nova-compute[95467]: DEBUG nova.objects.instance [None req-4f4853b7-f813-431a-95f6-e802ca9e4386 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lazy-loading 'resources' on Instance uuid 10d73b73-ca65-4192-8954-288dc1df9f24 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:16:55 user nova-compute[95467]: DEBUG nova.objects.base [None req-4f4853b7-f813-431a-95f6-e802ca9e4386 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Object Instance<10d73b73-ca65-4192-8954-288dc1df9f24> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=95467) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 08:16:55 user nova-compute[95467]: DEBUG nova.objects.instance [None req-4f4853b7-f813-431a-95f6-e802ca9e4386 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lazy-loading 'numa_topology' on Instance uuid 10d73b73-ca65-4192-8954-288dc1df9f24 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:16:55 user nova-compute[95467]: DEBUG nova.objects.base [None req-4f4853b7-f813-431a-95f6-e802ca9e4386 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Object Instance<10d73b73-ca65-4192-8954-288dc1df9f24> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=95467) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 08:16:55 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-4f4853b7-f813-431a-95f6-e802ca9e4386 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:16:55 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-4f4853b7-f813-431a-95f6-e802ca9e4386 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:16:55 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-4f4853b7-f813-431a-95f6-e802ca9e4386 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:16:55 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-4f4853b7-f813-431a-95f6-e802ca9e4386 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:16:55 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-4f4853b7-f813-431a-95f6-e802ca9e4386 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:16:55 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-4f4853b7-f813-431a-95f6-e802ca9e4386 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:16:55 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-4f4853b7-f813-431a-95f6-e802ca9e4386 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:16:55 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-4f4853b7-f813-431a-95f6-e802ca9e4386 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:16:55 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-4f4853b7-f813-431a-95f6-e802ca9e4386 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:16:55 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-4f4853b7-f813-431a-95f6-e802ca9e4386 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:16:55 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-4f4853b7-f813-431a-95f6-e802ca9e4386 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:16:55 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-4f4853b7-f813-431a-95f6-e802ca9e4386 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:16:55 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-4f4853b7-f813-431a-95f6-e802ca9e4386 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:16:55 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-4f4853b7-f813-431a-95f6-e802ca9e4386 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:16:55 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-4f4853b7-f813-431a-95f6-e802ca9e4386 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:16:55 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-4f4853b7-f813-431a-95f6-e802ca9e4386 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:16:55 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-4f4853b7-f813-431a-95f6-e802ca9e4386 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:16:55 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-4f4853b7-f813-431a-95f6-e802ca9e4386 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:16:55 user nova-compute[95467]: DEBUG nova.objects.instance [None req-4f4853b7-f813-431a-95f6-e802ca9e4386 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lazy-loading 'vcpu_model' on Instance uuid 10d73b73-ca65-4192-8954-288dc1df9f24 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:16:55 user nova-compute[95467]: DEBUG nova.objects.base [None req-4f4853b7-f813-431a-95f6-e802ca9e4386 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Object Instance<10d73b73-ca65-4192-8954-288dc1df9f24> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=95467) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 08:16:55 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-4f4853b7-f813-431a-95f6-e802ca9e4386 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:15:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1288293325',display_name='tempest-ServerRescueNegativeTestJSON-server-1288293325',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1288293325',id=22,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:15:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bd281be4e94a4d31a47a13267d51d9b6',ramdisk_id='',reservation_id='r-egtjqjbc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1148442534',owner_user_name='tempest-ServerRescueNegativeTestJSON-1148442534-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:15:12Z,user_data=None,user_id='c07f8dbc38004ecd973f61bba63606d4',uuid=10d73b73-ca65-4192-8954-288dc1df9f24,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b88ee27b-7174-45f5-a5a5-45db71caac08", "address": "fa:16:3e:a0:3b:16", "network": {"id": "369d2a6f-60b7-4c92-8b2d-1f3828f6698b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1491709218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1491709218-network", "vif_mac": "fa:16:3e:a0:3b:16"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd281be4e94a4d31a47a13267d51d9b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb88ee27b-71", "ovs_interfaceid": "b88ee27b-7174-45f5-a5a5-45db71caac08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:16:55 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-4f4853b7-f813-431a-95f6-e802ca9e4386 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Converting VIF {"id": "b88ee27b-7174-45f5-a5a5-45db71caac08", "address": "fa:16:3e:a0:3b:16", "network": {"id": "369d2a6f-60b7-4c92-8b2d-1f3828f6698b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1491709218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1491709218-network", "vif_mac": "fa:16:3e:a0:3b:16"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd281be4e94a4d31a47a13267d51d9b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb88ee27b-71", "ovs_interfaceid": "b88ee27b-7174-45f5-a5a5-45db71caac08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:16:55 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-4f4853b7-f813-431a-95f6-e802ca9e4386 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a0:3b:16,bridge_name='br-int',has_traffic_filtering=True,id=b88ee27b-7174-45f5-a5a5-45db71caac08,network=Network(369d2a6f-60b7-4c92-8b2d-1f3828f6698b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb88ee27b-71') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:16:55 user nova-compute[95467]: DEBUG nova.objects.instance [None req-4f4853b7-f813-431a-95f6-e802ca9e4386 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lazy-loading 'pci_devices' on Instance uuid 10d73b73-ca65-4192-8954-288dc1df9f24 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:16:55 user nova-compute[95467]: DEBUG nova.objects.base [None req-4f4853b7-f813-431a-95f6-e802ca9e4386 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Object Instance<10d73b73-ca65-4192-8954-288dc1df9f24> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=95467) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 08:16:55 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-4f4853b7-f813-431a-95f6-e802ca9e4386 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:16:55 user nova-compute[95467]:   <uuid>10d73b73-ca65-4192-8954-288dc1df9f24</uuid>
Nov 15 08:16:55 user nova-compute[95467]:   <name>instance-00000016</name>
Nov 15 08:16:55 user nova-compute[95467]:   <memory>524288</memory>
Nov 15 08:16:55 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:16:55 user nova-compute[95467]:   <metadata>
Nov 15 08:16:55 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:16:55 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:16:55 user nova-compute[95467]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1288293325</nova:name>
Nov 15 08:16:55 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:16:55</nova:creationTime>
Nov 15 08:16:55 user nova-compute[95467]:       <nova:flavor name="m1.tiny">
Nov 15 08:16:55 user nova-compute[95467]:         <nova:memory>512</nova:memory>
Nov 15 08:16:55 user nova-compute[95467]:         <nova:disk>1</nova:disk>
Nov 15 08:16:55 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:16:55 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:16:55 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:16:55 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:16:55 user nova-compute[95467]:       <nova:owner>
Nov 15 08:16:55 user nova-compute[95467]:         <nova:user uuid="c07f8dbc38004ecd973f61bba63606d4">tempest-ServerRescueNegativeTestJSON-1148442534-project-member</nova:user>
Nov 15 08:16:55 user nova-compute[95467]:         <nova:project uuid="bd281be4e94a4d31a47a13267d51d9b6">tempest-ServerRescueNegativeTestJSON-1148442534</nova:project>
Nov 15 08:16:55 user nova-compute[95467]:       </nova:owner>
Nov 15 08:16:55 user nova-compute[95467]:       <nova:root type="image" uuid="ed9c48aa-ce73-4b3b-9db1-235898be671b"/>
Nov 15 08:16:55 user nova-compute[95467]:       <nova:ports>
Nov 15 08:16:55 user nova-compute[95467]:         <nova:port uuid="b88ee27b-7174-45f5-a5a5-45db71caac08">
Nov 15 08:16:55 user nova-compute[95467]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 08:16:55 user nova-compute[95467]:         </nova:port>
Nov 15 08:16:55 user nova-compute[95467]:       </nova:ports>
Nov 15 08:16:55 user nova-compute[95467]:     </nova:instance>
Nov 15 08:16:55 user nova-compute[95467]:   </metadata>
Nov 15 08:16:55 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:16:55 user nova-compute[95467]:     <system>
Nov 15 08:16:55 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:16:55 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:16:55 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:16:55 user nova-compute[95467]:       <entry name="serial">10d73b73-ca65-4192-8954-288dc1df9f24</entry>
Nov 15 08:16:55 user nova-compute[95467]:       <entry name="uuid">10d73b73-ca65-4192-8954-288dc1df9f24</entry>
Nov 15 08:16:55 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:16:55 user nova-compute[95467]:     </system>
Nov 15 08:16:55 user nova-compute[95467]:   </sysinfo>
Nov 15 08:16:55 user nova-compute[95467]:   <os>
Nov 15 08:16:55 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:16:55 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:16:55 user nova-compute[95467]:   </os>
Nov 15 08:16:55 user nova-compute[95467]:   <features>
Nov 15 08:16:55 user nova-compute[95467]:     <acpi/>
Nov 15 08:16:55 user nova-compute[95467]:     <apic/>
Nov 15 08:16:55 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:16:55 user nova-compute[95467]:   </features>
Nov 15 08:16:55 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:16:55 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:16:55 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:16:55 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:16:55 user nova-compute[95467]:   </clock>
Nov 15 08:16:55 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:16:55 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:16:55 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:16:55 user nova-compute[95467]:   </cpu>
Nov 15 08:16:55 user nova-compute[95467]:   <devices>
Nov 15 08:16:55 user nova-compute[95467]:     <disk type="file" device="disk">
Nov 15 08:16:55 user nova-compute[95467]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 08:16:55 user nova-compute[95467]:       <source file="/opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk.rescue"/>
Nov 15 08:16:55 user nova-compute[95467]:       <target dev="vda" bus="virtio"/>
Nov 15 08:16:55 user nova-compute[95467]:     </disk>
Nov 15 08:16:55 user nova-compute[95467]:     <disk type="file" device="disk">
Nov 15 08:16:55 user nova-compute[95467]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 08:16:55 user nova-compute[95467]:       <source file="/opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk"/>
Nov 15 08:16:55 user nova-compute[95467]:       <target dev="vdb" bus="virtio"/>
Nov 15 08:16:55 user nova-compute[95467]:     </disk>
Nov 15 08:16:55 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:16:55 user nova-compute[95467]:       <mac address="fa:16:3e:a0:3b:16"/>
Nov 15 08:16:55 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:16:55 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:16:55 user nova-compute[95467]:       <target dev="tapb88ee27b-71"/>
Nov 15 08:16:55 user nova-compute[95467]:     </interface>
Nov 15 08:16:55 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:16:55 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/console.log" append="off"/>
Nov 15 08:16:55 user nova-compute[95467]:     </serial>
Nov 15 08:16:55 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:16:55 user nova-compute[95467]:     <video>
Nov 15 08:16:55 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:16:55 user nova-compute[95467]:     </video>
Nov 15 08:16:55 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:16:55 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:16:55 user nova-compute[95467]:     </rng>
Nov 15 08:16:55 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:16:55 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:16:55 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:16:55 user nova-compute[95467]:     </memballoon>
Nov 15 08:16:55 user nova-compute[95467]:   </devices>
Nov 15 08:16:55 user nova-compute[95467]: </domain>
Nov 15 08:16:55 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:16:55 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Instance destroyed successfully.
Nov 15 08:16:55 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-4f4853b7-f813-431a-95f6-e802ca9e4386 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:16:55 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-4f4853b7-f813-431a-95f6-e802ca9e4386 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] No BDM found with device name vdb, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:16:55 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-4f4853b7-f813-431a-95f6-e802ca9e4386 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] No VIF found with MAC fa:16:3e:a0:3b:16, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:16:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:57 user nova-compute[95467]: DEBUG nova.compute.manager [req-ccecd485-5956-489f-bdbc-a33dd0d805f2 req-c404ae77-2203-4b5d-9ce2-8d42e86682b1 service nova] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Received event network-vif-plugged-b88ee27b-7174-45f5-a5a5-45db71caac08 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:16:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ccecd485-5956-489f-bdbc-a33dd0d805f2 req-c404ae77-2203-4b5d-9ce2-8d42e86682b1 service nova] Acquiring lock "10d73b73-ca65-4192-8954-288dc1df9f24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:16:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ccecd485-5956-489f-bdbc-a33dd0d805f2 req-c404ae77-2203-4b5d-9ce2-8d42e86682b1 service nova] Lock "10d73b73-ca65-4192-8954-288dc1df9f24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:16:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ccecd485-5956-489f-bdbc-a33dd0d805f2 req-c404ae77-2203-4b5d-9ce2-8d42e86682b1 service nova] Lock "10d73b73-ca65-4192-8954-288dc1df9f24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:16:57 user nova-compute[95467]: DEBUG nova.compute.manager [req-ccecd485-5956-489f-bdbc-a33dd0d805f2 req-c404ae77-2203-4b5d-9ce2-8d42e86682b1 service nova] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] No waiting events found dispatching network-vif-plugged-b88ee27b-7174-45f5-a5a5-45db71caac08 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:16:57 user nova-compute[95467]: WARNING nova.compute.manager [req-ccecd485-5956-489f-bdbc-a33dd0d805f2 req-c404ae77-2203-4b5d-9ce2-8d42e86682b1 service nova] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Received unexpected event network-vif-plugged-b88ee27b-7174-45f5-a5a5-45db71caac08 for instance with vm_state active and task_state rescuing.
Nov 15 08:16:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:58 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-01219bf2-865d-41ad-ab56-25a9384a5183 tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance da9c7b9d-aad7-4d4f-b190-fda71735fde6 is timed out.
Nov 15 08:16:58 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-01219bf2-865d-41ad-ab56-25a9384a5183 tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Successfully detached device sdc from instance da9c7b9d-aad7-4d4f-b190-fda71735fde6 from the live domain config.
Nov 15 08:16:58 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01219bf2-865d-41ad-ab56-25a9384a5183 tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] calling os-brick to detach iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 08:16:58 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-01219bf2-865d-41ad-ab56-25a9384a5183 tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, {'target_iqn': 'iqn.2010-10.org.openstack:513c8487-b544-4188-881d-72fd4d002d85', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hUuxEYJH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:16:58 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-01219bf2-865d-41ad-ab56-25a9384a5183 tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:16:58 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-01219bf2-865d-41ad-ab56-25a9384a5183 tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:16:58 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-01219bf2-865d-41ad-ab56-25a9384a5183 tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:16:58 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:58 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:58 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f05f7b00-c451-4903-aeba-bcc2cc869f7a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:513c8487-b544-4188-881d-72fd4d002d85\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:16:58 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-01219bf2-865d-41ad-ab56-25a9384a5183 tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 08:16:58 user nova-compute[95467]: No targets found.
Nov 15 08:16:58 user nova-compute[95467]: iSNS:
Nov 15 08:16:58 user nova-compute[95467]: No targets found.
Nov 15 08:16:58 user nova-compute[95467]: STATIC:
Nov 15 08:16:58 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:513c8487-b544-4188-881d-72fd4d002d85
Nov 15 08:16:58 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:16:58 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:16:58 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059
Nov 15 08:16:58 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:16:58 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:16:58 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e
Nov 15 08:16:58 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:16:58 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:16:58 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149
Nov 15 08:16:58 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:16:58 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:16:58 user nova-compute[95467]: FIRMWARE:
Nov 15 08:16:58 user nova-compute[95467]: No targets found.
Nov 15 08:16:58 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:16:58 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-01219bf2-865d-41ad-ab56-25a9384a5183 tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 08:16:58 user nova-compute[95467]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 08:16:58 user nova-compute[95467]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=95467) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 08:16:58 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-01219bf2-865d-41ad-ab56-25a9384a5183 tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:513c8487-b544-4188-881d-72fd4d002d85', 0)] {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 08:16:58 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:58 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:58 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9afb25d-0671-44cd-9426-5c9dad97300d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:513c8487-b544-4188-881d-72fd4d002d85\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:16:58 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:58 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:58 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f083ef1-cf2a-428f-9605-e6d4691a76d9]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:513c8487-b544-4188-881d-72fd4d002d85 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:16:58 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-01219bf2-865d-41ad-ab56-25a9384a5183 tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 (non-flash)
Nov 15 08:16:58 user nova-compute[95467]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:16:58 user nova-compute[95467]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:513c8487-b544-4188-881d-72fd4d002d85 (non-flash)
Nov 15 08:16:58 user nova-compute[95467]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)
Nov 15 08:16:58 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:16:58 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-01219bf2-865d-41ad-ab56-25a9384a5183 tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 (non-flash)
Nov 15 08:16:58 user nova-compute[95467]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:16:58 user nova-compute[95467]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:513c8487-b544-4188-881d-72fd4d002d85 (non-flash)
Nov 15 08:16:58 user nova-compute[95467]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)
Nov 15 08:16:58 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:16:58 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-01219bf2-865d-41ad-ab56-25a9384a5183 tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efed86888b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:513c8487-b544-4188-881d-72fd4d002d85'): ({'sdd'}, set())}) {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 08:16:58 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-01219bf2-865d-41ad-ab56-25a9384a5183 tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Removing single pathed devices sdd {{(pid=95467) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 08:16:58 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:58 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:58 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b043d3-6a75-4748-8942-c6123c2b95df]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:16:58 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:58 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:58 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[3484f303-8d6b-4730-8c56-f212d98bb68b]: (4, ('ok\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:16:58 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-01219bf2-865d-41ad-ab56-25a9384a5183 tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Flushing IO for device /dev/sdd {{(pid=95467) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 08:16:58 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:58 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:58 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f834ad-52f5-45ea-bafb-7b81c08d05b5]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:16:58 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-01219bf2-865d-41ad-ab56-25a9384a5183 tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=95467) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 08:16:58 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:58 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:58 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[5619f2dd-8dc5-4deb-94a6-282f2a5a6e6a]: (4, ('1', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:16:58 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-01219bf2-865d-41ad-ab56-25a9384a5183 tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 08:16:58 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-01219bf2-865d-41ad-ab56-25a9384a5183 tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] SCSI volumes sdd have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 08:16:58 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-01219bf2-865d-41ad-ab56-25a9384a5183 tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:513c8487-b544-4188-881d-72fd4d002d85')] {{(pid=95467) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 08:16:58 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:513c8487-b544-4188-881d-72fd4d002d85 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:58 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:513c8487-b544-4188-881d-72fd4d002d85 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:58 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4760423-0665-425f-870a-0605e7d961dc]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:16:58 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-01219bf2-865d-41ad-ab56-25a9384a5183 tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:16:58 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:513c8487-b544-4188-881d-72fd4d002d85 -p 172.16.0.220:3260 --logout {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:58 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:513c8487-b544-4188-881d-72fd4d002d85 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:58 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb219310-7586-474f-bc74-0b7a678e9b0a]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:513c8487-b544-4188-881d-72fd4d002d85, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:513c8487-b544-4188-881d-72fd4d002d85, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:16:58 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-01219bf2-865d-41ad-ab56-25a9384a5183 tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:513c8487-b544-4188-881d-72fd4d002d85, portal: 172.16.0.220,3260]
Nov 15 08:16:58 user nova-compute[95467]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:513c8487-b544-4188-881d-72fd4d002d85, portal: 172.16.0.220,3260] successful.
Nov 15 08:16:58 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:16:58 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:513c8487-b544-4188-881d-72fd4d002d85 -p 172.16.0.220:3260 --op delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:16:58 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:513c8487-b544-4188-881d-72fd4d002d85 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:16:58 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be67f2a-fbd1-4ffe-93da-4ee6771f8ea1]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:16:58 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-01219bf2-865d-41ad-ab56-25a9384a5183 tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:16:58 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-01219bf2-865d-41ad-ab56-25a9384a5183 tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:16:58 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-01219bf2-865d-41ad-ab56-25a9384a5183 tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] <== disconnect_volume: return (318ms) None {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:16:58 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01219bf2-865d-41ad-ab56-25a9384a5183 tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] Disconnected iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 08:16:59 user nova-compute[95467]: DEBUG nova.compute.manager [req-a8b04cf7-e7ac-4d1e-a0e9-c0972c5b9f35 req-3446bb11-c8c8-4dd1-afe8-a826e191cf15 service nova] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Received event network-vif-plugged-b88ee27b-7174-45f5-a5a5-45db71caac08 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:16:59 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-a8b04cf7-e7ac-4d1e-a0e9-c0972c5b9f35 req-3446bb11-c8c8-4dd1-afe8-a826e191cf15 service nova] Acquiring lock "10d73b73-ca65-4192-8954-288dc1df9f24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:16:59 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-a8b04cf7-e7ac-4d1e-a0e9-c0972c5b9f35 req-3446bb11-c8c8-4dd1-afe8-a826e191cf15 service nova] Lock "10d73b73-ca65-4192-8954-288dc1df9f24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:16:59 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-a8b04cf7-e7ac-4d1e-a0e9-c0972c5b9f35 req-3446bb11-c8c8-4dd1-afe8-a826e191cf15 service nova] Lock "10d73b73-ca65-4192-8954-288dc1df9f24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:16:59 user nova-compute[95467]: DEBUG nova.compute.manager [req-a8b04cf7-e7ac-4d1e-a0e9-c0972c5b9f35 req-3446bb11-c8c8-4dd1-afe8-a826e191cf15 service nova] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] No waiting events found dispatching network-vif-plugged-b88ee27b-7174-45f5-a5a5-45db71caac08 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:16:59 user nova-compute[95467]: WARNING nova.compute.manager [req-a8b04cf7-e7ac-4d1e-a0e9-c0972c5b9f35 req-3446bb11-c8c8-4dd1-afe8-a826e191cf15 service nova] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Received unexpected event network-vif-plugged-b88ee27b-7174-45f5-a5a5-45db71caac08 for instance with vm_state active and task_state rescuing.
Nov 15 08:16:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:16:59 user nova-compute[95467]: DEBUG nova.compute.manager [None req-4f4853b7-f813-431a-95f6-e802ca9e4386 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:16:59 user nova-compute[95467]: DEBUG nova.objects.instance [None req-01219bf2-865d-41ad-ab56-25a9384a5183 tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Lazy-loading 'flavor' on Instance uuid da9c7b9d-aad7-4d4f-b190-fda71735fde6 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:16:59 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-01219bf2-865d-41ad-ab56-25a9384a5183 tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Lock "da9c7b9d-aad7-4d4f-b190-fda71735fde6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.683s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:17:00 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a4a2051b-e928-4b09-8be4-aac82acc7603 tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Acquiring lock "da9c7b9d-aad7-4d4f-b190-fda71735fde6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:17:00 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a4a2051b-e928-4b09-8be4-aac82acc7603 tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Lock "da9c7b9d-aad7-4d4f-b190-fda71735fde6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:17:00 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a4a2051b-e928-4b09-8be4-aac82acc7603 tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Acquiring lock "da9c7b9d-aad7-4d4f-b190-fda71735fde6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:17:00 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a4a2051b-e928-4b09-8be4-aac82acc7603 tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Lock "da9c7b9d-aad7-4d4f-b190-fda71735fde6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:17:00 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a4a2051b-e928-4b09-8be4-aac82acc7603 tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Lock "da9c7b9d-aad7-4d4f-b190-fda71735fde6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.005s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:17:00 user nova-compute[95467]: INFO nova.compute.manager [None req-a4a2051b-e928-4b09-8be4-aac82acc7603 tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] Terminating instance
Nov 15 08:17:00 user nova-compute[95467]: DEBUG nova.compute.manager [None req-a4a2051b-e928-4b09-8be4-aac82acc7603 tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] Start destroying the instance on the hypervisor. {{(pid=95467) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 08:17:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:01 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:01 user nova-compute[95467]: DEBUG nova.compute.manager [req-97909670-56df-4f1a-a654-7e2d495ef665 req-c8d67e23-e302-4c76-9432-a6c490b65e10 service nova] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] Received event network-vif-unplugged-86652dd5-39a8-410c-aed4-3664980165f3 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:17:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-97909670-56df-4f1a-a654-7e2d495ef665 req-c8d67e23-e302-4c76-9432-a6c490b65e10 service nova] Acquiring lock "da9c7b9d-aad7-4d4f-b190-fda71735fde6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:17:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-97909670-56df-4f1a-a654-7e2d495ef665 req-c8d67e23-e302-4c76-9432-a6c490b65e10 service nova] Lock "da9c7b9d-aad7-4d4f-b190-fda71735fde6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:17:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-97909670-56df-4f1a-a654-7e2d495ef665 req-c8d67e23-e302-4c76-9432-a6c490b65e10 service nova] Lock "da9c7b9d-aad7-4d4f-b190-fda71735fde6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:17:01 user nova-compute[95467]: DEBUG nova.compute.manager [req-97909670-56df-4f1a-a654-7e2d495ef665 req-c8d67e23-e302-4c76-9432-a6c490b65e10 service nova] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] No waiting events found dispatching network-vif-unplugged-86652dd5-39a8-410c-aed4-3664980165f3 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:17:01 user nova-compute[95467]: DEBUG nova.compute.manager [req-97909670-56df-4f1a-a654-7e2d495ef665 req-c8d67e23-e302-4c76-9432-a6c490b65e10 service nova] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] Received event network-vif-unplugged-86652dd5-39a8-410c-aed4-3664980165f3 for instance with task_state deleting. {{(pid=95467) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 08:17:01 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] Instance destroyed successfully.
Nov 15 08:17:01 user nova-compute[95467]: DEBUG nova.objects.instance [None req-a4a2051b-e928-4b09-8be4-aac82acc7603 tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Lazy-loading 'resources' on Instance uuid da9c7b9d-aad7-4d4f-b190-fda71735fde6 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:17:01 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-a4a2051b-e928-4b09-8be4-aac82acc7603 tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T08:14:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1290853586',display_name='tempest-AttachSCSIVolumeTestJSON-server-1290853586',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1290853586',id=20,image_ref='4c8406cc-4745-436b-966f-bdfe4fda5eb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA5wG/b9pTRHKevGZCl4td4AgKNUrmCvyAeB5m6ljfHeoguIysTVFuo9qKYG80EdlXoGcjG3G//ZuZ3U4lIK0mVFpcudiYtUs45EoiPvLqdfByZQWj4BMjOggZ45JRIiSA==',key_name='tempest-keypair-1343666369',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:14:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c37bcd8e333c4c2faf96b5d445319274',ramdisk_id='',reservation_id='r-j3hbdk20',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4c8406cc-4745-436b-966f-bdfe4fda5eb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-876730663',owner_user_name='tempest-AttachSCSIVolumeTestJSON-876730663-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:14:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad8085ad83aa4adf841f2dba2554f409',uuid=da9c7b9d-aad7-4d4f-b190-fda71735fde6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "86652dd5-39a8-410c-aed4-3664980165f3", "address": "fa:16:3e:20:9d:69", "network": {"id": "99755f0a-da1b-4ec7-aa23-6801f4a0344c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-42152126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c37bcd8e333c4c2faf96b5d445319274", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86652dd5-39", "ovs_interfaceid": "86652dd5-39a8-410c-aed4-3664980165f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:17:01 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-a4a2051b-e928-4b09-8be4-aac82acc7603 tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Converting VIF {"id": "86652dd5-39a8-410c-aed4-3664980165f3", "address": "fa:16:3e:20:9d:69", "network": {"id": "99755f0a-da1b-4ec7-aa23-6801f4a0344c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-42152126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c37bcd8e333c4c2faf96b5d445319274", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86652dd5-39", "ovs_interfaceid": "86652dd5-39a8-410c-aed4-3664980165f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:17:01 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-a4a2051b-e928-4b09-8be4-aac82acc7603 tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:20:9d:69,bridge_name='br-int',has_traffic_filtering=True,id=86652dd5-39a8-410c-aed4-3664980165f3,network=Network(99755f0a-da1b-4ec7-aa23-6801f4a0344c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86652dd5-39') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:17:01 user nova-compute[95467]: DEBUG os_vif [None req-a4a2051b-e928-4b09-8be4-aac82acc7603 tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:9d:69,bridge_name='br-int',has_traffic_filtering=True,id=86652dd5-39a8-410c-aed4-3664980165f3,network=Network(99755f0a-da1b-4ec7-aa23-6801f4a0344c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86652dd5-39') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:17:01 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:01 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap86652dd5-39, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:17:01 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:01 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:17:01 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:01 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f827d0a4-1b3f-471e-bf11-dc9d91b6ac38) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:17:01 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:01 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:17:01 user nova-compute[95467]: INFO os_vif [None req-a4a2051b-e928-4b09-8be4-aac82acc7603 tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:9d:69,bridge_name='br-int',has_traffic_filtering=True,id=86652dd5-39a8-410c-aed4-3664980165f3,network=Network(99755f0a-da1b-4ec7-aa23-6801f4a0344c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86652dd5-39')
Nov 15 08:17:01 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-a4a2051b-e928-4b09-8be4-aac82acc7603 tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] Deleting instance files /opt/stack/data/nova/instances/da9c7b9d-aad7-4d4f-b190-fda71735fde6_del
Nov 15 08:17:01 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-a4a2051b-e928-4b09-8be4-aac82acc7603 tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] Deletion of /opt/stack/data/nova/instances/da9c7b9d-aad7-4d4f-b190-fda71735fde6_del complete
Nov 15 08:17:01 user nova-compute[95467]: INFO nova.compute.manager [None req-a4a2051b-e928-4b09-8be4-aac82acc7603 tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 15 08:17:01 user nova-compute[95467]: DEBUG oslo.service.loopingcall [None req-a4a2051b-e928-4b09-8be4-aac82acc7603 tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=95467) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 08:17:01 user nova-compute[95467]: DEBUG nova.compute.manager [-] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] Deallocating network for instance {{(pid=95467) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 08:17:01 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] deallocate_for_instance() {{(pid=95467) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 08:17:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:02 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:17:02 user nova-compute[95467]: INFO nova.compute.manager [-] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] Took 1.05 seconds to deallocate network for instance.
Nov 15 08:17:02 user nova-compute[95467]: DEBUG nova.compute.manager [req-209cf0a9-bc7f-4d2f-938c-57689aea2712 req-6ffb7b4b-29ec-45ac-bc3b-3aca030f3451 service nova] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] Received event network-vif-deleted-86652dd5-39a8-410c-aed4-3664980165f3 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:17:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a4a2051b-e928-4b09-8be4-aac82acc7603 tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:17:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a4a2051b-e928-4b09-8be4-aac82acc7603 tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:17:03 user nova-compute[95467]: DEBUG nova.compute.manager [req-4f56cb16-4234-4d08-96f3-8d991994f8d3 req-361bb34f-3ac0-460d-8f81-e476e96896a9 service nova] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] Received event network-vif-plugged-86652dd5-39a8-410c-aed4-3664980165f3 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:17:03 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-4f56cb16-4234-4d08-96f3-8d991994f8d3 req-361bb34f-3ac0-460d-8f81-e476e96896a9 service nova] Acquiring lock "da9c7b9d-aad7-4d4f-b190-fda71735fde6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:17:03 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-4f56cb16-4234-4d08-96f3-8d991994f8d3 req-361bb34f-3ac0-460d-8f81-e476e96896a9 service nova] Lock "da9c7b9d-aad7-4d4f-b190-fda71735fde6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:17:03 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-4f56cb16-4234-4d08-96f3-8d991994f8d3 req-361bb34f-3ac0-460d-8f81-e476e96896a9 service nova] Lock "da9c7b9d-aad7-4d4f-b190-fda71735fde6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:17:03 user nova-compute[95467]: DEBUG nova.compute.manager [req-4f56cb16-4234-4d08-96f3-8d991994f8d3 req-361bb34f-3ac0-460d-8f81-e476e96896a9 service nova] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] No waiting events found dispatching network-vif-plugged-86652dd5-39a8-410c-aed4-3664980165f3 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:17:03 user nova-compute[95467]: WARNING nova.compute.manager [req-4f56cb16-4234-4d08-96f3-8d991994f8d3 req-361bb34f-3ac0-460d-8f81-e476e96896a9 service nova] [instance: da9c7b9d-aad7-4d4f-b190-fda71735fde6] Received unexpected event network-vif-plugged-86652dd5-39a8-410c-aed4-3664980165f3 for instance with vm_state deleted and task_state None.
Nov 15 08:17:03 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-a4a2051b-e928-4b09-8be4-aac82acc7603 tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:17:03 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-a4a2051b-e928-4b09-8be4-aac82acc7603 tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:17:03 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a4a2051b-e928-4b09-8be4-aac82acc7603 tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.455s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:17:03 user nova-compute[95467]: INFO nova.scheduler.client.report [None req-a4a2051b-e928-4b09-8be4-aac82acc7603 tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Deleted allocations for instance da9c7b9d-aad7-4d4f-b190-fda71735fde6
Nov 15 08:17:03 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a4a2051b-e928-4b09-8be4-aac82acc7603 tempest-AttachSCSIVolumeTestJSON-876730663 tempest-AttachSCSIVolumeTestJSON-876730663-project-member] Lock "da9c7b9d-aad7-4d4f-b190-fda71735fde6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.645s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:17:06 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:11 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:16 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:17 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:18 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Acquiring lock "e7805e5c-1777-4b0c-95c7-b232be66528c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:17:18 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "e7805e5c-1777-4b0c-95c7-b232be66528c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:17:18 user nova-compute[95467]: DEBUG nova.compute.manager [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Starting instance... {{(pid=95467) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 08:17:18 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:17:18 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:17:18 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=95467) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 08:17:18 user nova-compute[95467]: INFO nova.compute.claims [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Claim successful on node user
Nov 15 08:17:18 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:17:18 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:17:18 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.462s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:17:18 user nova-compute[95467]: DEBUG nova.compute.manager [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Start building networks asynchronously for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 08:17:18 user nova-compute[95467]: DEBUG nova.compute.manager [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Allocating IP information in the background. {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 08:17:18 user nova-compute[95467]: DEBUG nova.network.neutron [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] allocate_for_instance() {{(pid=95467) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 08:17:18 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 08:17:18 user nova-compute[95467]: DEBUG nova.compute.manager [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Start building block device mappings for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 08:17:18 user nova-compute[95467]: DEBUG nova.policy [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b03564d022e84f5cb133b9771e76bae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b04c448c61451d8d46ebc7a61a5e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95467) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 08:17:19 user nova-compute[95467]: DEBUG nova.compute.manager [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Start spawning the instance on the hypervisor. {{(pid=95467) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 08:17:19 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Creating instance directory {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 08:17:19 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Creating image(s)
Nov 15 08:17:19 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Acquiring lock "/opt/stack/data/nova/instances/e7805e5c-1777-4b0c-95c7-b232be66528c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:17:19 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "/opt/stack/data/nova/instances/e7805e5c-1777-4b0c-95c7-b232be66528c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:17:19 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "/opt/stack/data/nova/instances/e7805e5c-1777-4b0c-95c7-b232be66528c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:17:19 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:19 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.184s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:19 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Acquiring lock "a3fcf60225fcefd310404971cd18ab9851c548dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:17:19 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:17:19 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:19 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.171s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:19 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/e7805e5c-1777-4b0c-95c7-b232be66528c/disk 1073741824 {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:19 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/e7805e5c-1777-4b0c-95c7-b232be66528c/disk 1073741824" returned: 0 in 0.065s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:19 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:17:19 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:19 user nova-compute[95467]: DEBUG nova.network.neutron [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Successfully created port: 7f8e69fc-628f-4a31-9ba0-db0b320dff09 {{(pid=95467) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 08:17:19 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.208s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:19 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e7805e5c-1777-4b0c-95c7-b232be66528c/disk. size=1073741824 {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 08:17:19 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7805e5c-1777-4b0c-95c7-b232be66528c/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:19 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-57a066da-2a20-4860-bd73-fbfe763984a8 tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] Acquiring lock "d5a35226-6b98-44ad-ab4d-e0e86b14ba9d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:17:19 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-57a066da-2a20-4860-bd73-fbfe763984a8 tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] Lock "d5a35226-6b98-44ad-ab4d-e0e86b14ba9d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:17:19 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-57a066da-2a20-4860-bd73-fbfe763984a8 tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] Acquiring lock "d5a35226-6b98-44ad-ab4d-e0e86b14ba9d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:17:19 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-57a066da-2a20-4860-bd73-fbfe763984a8 tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] Lock "d5a35226-6b98-44ad-ab4d-e0e86b14ba9d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:17:19 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-57a066da-2a20-4860-bd73-fbfe763984a8 tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] Lock "d5a35226-6b98-44ad-ab4d-e0e86b14ba9d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:17:19 user nova-compute[95467]: INFO nova.compute.manager [None req-57a066da-2a20-4860-bd73-fbfe763984a8 tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] [instance: d5a35226-6b98-44ad-ab4d-e0e86b14ba9d] Terminating instance
Nov 15 08:17:19 user nova-compute[95467]: DEBUG nova.compute.manager [None req-57a066da-2a20-4860-bd73-fbfe763984a8 tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] [instance: d5a35226-6b98-44ad-ab4d-e0e86b14ba9d] Start destroying the instance on the hypervisor. {{(pid=95467) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 08:17:19 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:20 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7805e5c-1777-4b0c-95c7-b232be66528c/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:20 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Cannot resize image /opt/stack/data/nova/instances/e7805e5c-1777-4b0c-95c7-b232be66528c/disk to a smaller size. {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 08:17:20 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Created local disks {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 08:17:20 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Ensure instance console log exists: /opt/stack/data/nova/instances/e7805e5c-1777-4b0c-95c7-b232be66528c/console.log {{(pid=95467) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 08:17:20 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:17:20 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:17:20 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:17:20 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:20 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:20 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:20 user nova-compute[95467]: DEBUG nova.compute.manager [req-ed33fff9-de33-409e-b9a2-e69db81fb024 req-c0d3523b-a1e2-42c3-a58a-6edf24222539 service nova] [instance: d5a35226-6b98-44ad-ab4d-e0e86b14ba9d] Received event network-vif-unplugged-54ecf559-43dd-428e-af76-0966723dbaf6 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:17:20 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ed33fff9-de33-409e-b9a2-e69db81fb024 req-c0d3523b-a1e2-42c3-a58a-6edf24222539 service nova] Acquiring lock "d5a35226-6b98-44ad-ab4d-e0e86b14ba9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:17:20 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ed33fff9-de33-409e-b9a2-e69db81fb024 req-c0d3523b-a1e2-42c3-a58a-6edf24222539 service nova] Lock "d5a35226-6b98-44ad-ab4d-e0e86b14ba9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:17:20 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ed33fff9-de33-409e-b9a2-e69db81fb024 req-c0d3523b-a1e2-42c3-a58a-6edf24222539 service nova] Lock "d5a35226-6b98-44ad-ab4d-e0e86b14ba9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:17:20 user nova-compute[95467]: DEBUG nova.compute.manager [req-ed33fff9-de33-409e-b9a2-e69db81fb024 req-c0d3523b-a1e2-42c3-a58a-6edf24222539 service nova] [instance: d5a35226-6b98-44ad-ab4d-e0e86b14ba9d] No waiting events found dispatching network-vif-unplugged-54ecf559-43dd-428e-af76-0966723dbaf6 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:17:20 user nova-compute[95467]: DEBUG nova.compute.manager [req-ed33fff9-de33-409e-b9a2-e69db81fb024 req-c0d3523b-a1e2-42c3-a58a-6edf24222539 service nova] [instance: d5a35226-6b98-44ad-ab4d-e0e86b14ba9d] Received event network-vif-unplugged-54ecf559-43dd-428e-af76-0966723dbaf6 for instance with task_state deleting. {{(pid=95467) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 08:17:20 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: d5a35226-6b98-44ad-ab4d-e0e86b14ba9d] Instance destroyed successfully.
Nov 15 08:17:20 user nova-compute[95467]: DEBUG nova.objects.instance [None req-57a066da-2a20-4860-bd73-fbfe763984a8 tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] Lazy-loading 'resources' on Instance uuid d5a35226-6b98-44ad-ab4d-e0e86b14ba9d {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:17:20 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-57a066da-2a20-4860-bd73-fbfe763984a8 tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:15:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-543357104',display_name='tempest-VolumesActionsTest-instance-543357104',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-543357104',id=23,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:15:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c5bcf0714bf348ecb7a99388dcdd98dc',ramdisk_id='',reservation_id='r-n3o00if9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1609645107',owner_user_name='tempest-VolumesActionsTest-1609645107-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:15:32Z,user_data=None,user_id='a5c053bb80724bc2a2e117c9994a92b3',uuid=d5a35226-6b98-44ad-ab4d-e0e86b14ba9d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "54ecf559-43dd-428e-af76-0966723dbaf6", "address": "fa:16:3e:a7:15:c9", "network": {"id": "7f71e1f3-188f-4e92-87a3-b1e11c44e727", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2039589401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5bcf0714bf348ecb7a99388dcdd98dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ecf559-43", "ovs_interfaceid": "54ecf559-43dd-428e-af76-0966723dbaf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:17:20 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-57a066da-2a20-4860-bd73-fbfe763984a8 tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] Converting VIF {"id": "54ecf559-43dd-428e-af76-0966723dbaf6", "address": "fa:16:3e:a7:15:c9", "network": {"id": "7f71e1f3-188f-4e92-87a3-b1e11c44e727", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2039589401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5bcf0714bf348ecb7a99388dcdd98dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ecf559-43", "ovs_interfaceid": "54ecf559-43dd-428e-af76-0966723dbaf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:17:20 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-57a066da-2a20-4860-bd73-fbfe763984a8 tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:15:c9,bridge_name='br-int',has_traffic_filtering=True,id=54ecf559-43dd-428e-af76-0966723dbaf6,network=Network(7f71e1f3-188f-4e92-87a3-b1e11c44e727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54ecf559-43') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:17:20 user nova-compute[95467]: DEBUG os_vif [None req-57a066da-2a20-4860-bd73-fbfe763984a8 tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:15:c9,bridge_name='br-int',has_traffic_filtering=True,id=54ecf559-43dd-428e-af76-0966723dbaf6,network=Network(7f71e1f3-188f-4e92-87a3-b1e11c44e727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54ecf559-43') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:17:20 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:20 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap54ecf559-43, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:17:20 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:20 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:20 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:20 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=794291e0-6e1a-4656-beff-faf15c657bef) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:17:20 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:20 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:17:20 user nova-compute[95467]: INFO os_vif [None req-57a066da-2a20-4860-bd73-fbfe763984a8 tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:15:c9,bridge_name='br-int',has_traffic_filtering=True,id=54ecf559-43dd-428e-af76-0966723dbaf6,network=Network(7f71e1f3-188f-4e92-87a3-b1e11c44e727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54ecf559-43')
Nov 15 08:17:20 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-57a066da-2a20-4860-bd73-fbfe763984a8 tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] [instance: d5a35226-6b98-44ad-ab4d-e0e86b14ba9d] Deleting instance files /opt/stack/data/nova/instances/d5a35226-6b98-44ad-ab4d-e0e86b14ba9d_del
Nov 15 08:17:20 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-57a066da-2a20-4860-bd73-fbfe763984a8 tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] [instance: d5a35226-6b98-44ad-ab4d-e0e86b14ba9d] Deletion of /opt/stack/data/nova/instances/d5a35226-6b98-44ad-ab4d-e0e86b14ba9d_del complete
Nov 15 08:17:20 user nova-compute[95467]: INFO nova.compute.manager [None req-57a066da-2a20-4860-bd73-fbfe763984a8 tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] [instance: d5a35226-6b98-44ad-ab4d-e0e86b14ba9d] Took 0.78 seconds to destroy the instance on the hypervisor.
Nov 15 08:17:20 user nova-compute[95467]: DEBUG oslo.service.loopingcall [None req-57a066da-2a20-4860-bd73-fbfe763984a8 tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=95467) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 08:17:20 user nova-compute[95467]: DEBUG nova.compute.manager [-] [instance: d5a35226-6b98-44ad-ab4d-e0e86b14ba9d] Deallocating network for instance {{(pid=95467) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 08:17:20 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: d5a35226-6b98-44ad-ab4d-e0e86b14ba9d] deallocate_for_instance() {{(pid=95467) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 08:17:20 user nova-compute[95467]: DEBUG nova.network.neutron [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Successfully updated port: 7f8e69fc-628f-4a31-9ba0-db0b320dff09 {{(pid=95467) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 08:17:20 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Acquiring lock "refresh_cache-e7805e5c-1777-4b0c-95c7-b232be66528c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:17:20 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Acquired lock "refresh_cache-e7805e5c-1777-4b0c-95c7-b232be66528c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:17:20 user nova-compute[95467]: DEBUG nova.network.neutron [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:17:20 user nova-compute[95467]: DEBUG nova.compute.manager [req-fe2b7682-c2ff-48d9-a416-b106fd688dfa req-7a24c37f-945a-4b5e-b76f-6dd9521d6587 service nova] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Received event network-changed-7f8e69fc-628f-4a31-9ba0-db0b320dff09 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:17:20 user nova-compute[95467]: DEBUG nova.compute.manager [req-fe2b7682-c2ff-48d9-a416-b106fd688dfa req-7a24c37f-945a-4b5e-b76f-6dd9521d6587 service nova] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Refreshing instance network info cache due to event network-changed-7f8e69fc-628f-4a31-9ba0-db0b320dff09. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:17:20 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-fe2b7682-c2ff-48d9-a416-b106fd688dfa req-7a24c37f-945a-4b5e-b76f-6dd9521d6587 service nova] Acquiring lock "refresh_cache-e7805e5c-1777-4b0c-95c7-b232be66528c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:17:20 user nova-compute[95467]: DEBUG nova.network.neutron [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Instance cache missing network info. {{(pid=95467) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 08:17:21 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: d5a35226-6b98-44ad-ab4d-e0e86b14ba9d] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:17:21 user nova-compute[95467]: INFO nova.compute.manager [-] [instance: d5a35226-6b98-44ad-ab4d-e0e86b14ba9d] Took 0.59 seconds to deallocate network for instance.
Nov 15 08:17:21 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-57a066da-2a20-4860-bd73-fbfe763984a8 tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:17:21 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-57a066da-2a20-4860-bd73-fbfe763984a8 tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:17:21 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-57a066da-2a20-4860-bd73-fbfe763984a8 tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:17:21 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-57a066da-2a20-4860-bd73-fbfe763984a8 tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:17:21 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-57a066da-2a20-4860-bd73-fbfe763984a8 tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.471s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:17:21 user nova-compute[95467]: INFO nova.scheduler.client.report [None req-57a066da-2a20-4860-bd73-fbfe763984a8 tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] Deleted allocations for instance d5a35226-6b98-44ad-ab4d-e0e86b14ba9d
Nov 15 08:17:21 user nova-compute[95467]: DEBUG nova.network.neutron [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Updating instance_info_cache with network_info: [{"id": "7f8e69fc-628f-4a31-9ba0-db0b320dff09", "address": "fa:16:3e:46:f0:15", "network": {"id": "f7871b75-73b3-4f0a-8e6c-814bc61ebd6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-945672014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b04c448c61451d8d46ebc7a61a5e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f8e69fc-62", "ovs_interfaceid": "7f8e69fc-628f-4a31-9ba0-db0b320dff09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:17:21 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Releasing lock "refresh_cache-e7805e5c-1777-4b0c-95c7-b232be66528c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:17:21 user nova-compute[95467]: DEBUG nova.compute.manager [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Instance network_info: |[{"id": "7f8e69fc-628f-4a31-9ba0-db0b320dff09", "address": "fa:16:3e:46:f0:15", "network": {"id": "f7871b75-73b3-4f0a-8e6c-814bc61ebd6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-945672014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b04c448c61451d8d46ebc7a61a5e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f8e69fc-62", "ovs_interfaceid": "7f8e69fc-628f-4a31-9ba0-db0b320dff09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 08:17:21 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-fe2b7682-c2ff-48d9-a416-b106fd688dfa req-7a24c37f-945a-4b5e-b76f-6dd9521d6587 service nova] Acquired lock "refresh_cache-e7805e5c-1777-4b0c-95c7-b232be66528c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:17:21 user nova-compute[95467]: DEBUG nova.network.neutron [req-fe2b7682-c2ff-48d9-a416-b106fd688dfa req-7a24c37f-945a-4b5e-b76f-6dd9521d6587 service nova] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Refreshing network info cache for port 7f8e69fc-628f-4a31-9ba0-db0b320dff09 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:17:21 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Start _get_guest_xml network_info=[{"id": "7f8e69fc-628f-4a31-9ba0-db0b320dff09", "address": "fa:16:3e:46:f0:15", "network": {"id": "f7871b75-73b3-4f0a-8e6c-814bc61ebd6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-945672014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b04c448c61451d8d46ebc7a61a5e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f8e69fc-62", "ovs_interfaceid": "7f8e69fc-628f-4a31-9ba0-db0b320dff09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'ed9c48aa-ce73-4b3b-9db1-235898be671b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:17:21 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-57a066da-2a20-4860-bd73-fbfe763984a8 tempest-VolumesActionsTest-1609645107 tempest-VolumesActionsTest-1609645107-project-member] Lock "d5a35226-6b98-44ad-ab4d-e0e86b14ba9d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.063s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:17:21 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:17:21 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:17:21 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:17:21 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:17:21 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:17:21 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:17:21 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:17:21 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:17:21 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:17:21 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:17:21 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:17:21 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:17:21 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:17:21 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:17:21 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:17:21 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:17:21 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:17:21 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:17:22 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:17:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2096143899',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2096143899',id=28,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBJ4d3/P/W4IM4c/SDFdf9+rwPXC3NZ0eghDPz0brXh+NeL91puTUjJZ6Wd0+WEV7wlTz3Y4+T858B8rzcbTbkNawWiCCL5nZHqbWqmnXBZ63bY9/9J2fUPSgv/Bhxp1g==',key_name='tempest-keypair-559293739',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94b04c448c61451d8d46ebc7a61a5e6e',ramdisk_id='',reservation_id='r-1r9tzmt8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1251988905',owner_user_name='tempest-AttachVolumeShelveTestJSON-1251988905-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:17:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b03564d022e84f5cb133b9771e76bae8',uuid=e7805e5c-1777-4b0c-95c7-b232be66528c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f8e69fc-628f-4a31-9ba0-db0b320dff09", "address": "fa:16:3e:46:f0:15", "network": {"id": "f7871b75-73b3-4f0a-8e6c-814bc61ebd6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-945672014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b04c448c61451d8d46ebc7a61a5e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f8e69fc-62", "ovs_interfaceid": "7f8e69fc-628f-4a31-9ba0-db0b320dff09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:17:22 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Converting VIF {"id": "7f8e69fc-628f-4a31-9ba0-db0b320dff09", "address": "fa:16:3e:46:f0:15", "network": {"id": "f7871b75-73b3-4f0a-8e6c-814bc61ebd6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-945672014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b04c448c61451d8d46ebc7a61a5e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f8e69fc-62", "ovs_interfaceid": "7f8e69fc-628f-4a31-9ba0-db0b320dff09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:17:22 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:f0:15,bridge_name='br-int',has_traffic_filtering=True,id=7f8e69fc-628f-4a31-9ba0-db0b320dff09,network=Network(f7871b75-73b3-4f0a-8e6c-814bc61ebd6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f8e69fc-62') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:17:22 user nova-compute[95467]: DEBUG nova.objects.instance [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lazy-loading 'pci_devices' on Instance uuid e7805e5c-1777-4b0c-95c7-b232be66528c {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:17:22 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:17:22 user nova-compute[95467]:   <uuid>e7805e5c-1777-4b0c-95c7-b232be66528c</uuid>
Nov 15 08:17:22 user nova-compute[95467]:   <name>instance-0000001c</name>
Nov 15 08:17:22 user nova-compute[95467]:   <memory>524288</memory>
Nov 15 08:17:22 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:17:22 user nova-compute[95467]:   <metadata>
Nov 15 08:17:22 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:17:22 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:17:22 user nova-compute[95467]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-2096143899</nova:name>
Nov 15 08:17:22 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:17:21</nova:creationTime>
Nov 15 08:17:22 user nova-compute[95467]:       <nova:flavor name="m1.tiny">
Nov 15 08:17:22 user nova-compute[95467]:         <nova:memory>512</nova:memory>
Nov 15 08:17:22 user nova-compute[95467]:         <nova:disk>1</nova:disk>
Nov 15 08:17:22 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:17:22 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:17:22 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:17:22 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:17:22 user nova-compute[95467]:       <nova:owner>
Nov 15 08:17:22 user nova-compute[95467]:         <nova:user uuid="b03564d022e84f5cb133b9771e76bae8">tempest-AttachVolumeShelveTestJSON-1251988905-project-member</nova:user>
Nov 15 08:17:22 user nova-compute[95467]:         <nova:project uuid="94b04c448c61451d8d46ebc7a61a5e6e">tempest-AttachVolumeShelveTestJSON-1251988905</nova:project>
Nov 15 08:17:22 user nova-compute[95467]:       </nova:owner>
Nov 15 08:17:22 user nova-compute[95467]:       <nova:root type="image" uuid="ed9c48aa-ce73-4b3b-9db1-235898be671b"/>
Nov 15 08:17:22 user nova-compute[95467]:       <nova:ports>
Nov 15 08:17:22 user nova-compute[95467]:         <nova:port uuid="7f8e69fc-628f-4a31-9ba0-db0b320dff09">
Nov 15 08:17:22 user nova-compute[95467]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 08:17:22 user nova-compute[95467]:         </nova:port>
Nov 15 08:17:22 user nova-compute[95467]:       </nova:ports>
Nov 15 08:17:22 user nova-compute[95467]:     </nova:instance>
Nov 15 08:17:22 user nova-compute[95467]:   </metadata>
Nov 15 08:17:22 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:17:22 user nova-compute[95467]:     <system>
Nov 15 08:17:22 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:17:22 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:17:22 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:17:22 user nova-compute[95467]:       <entry name="serial">e7805e5c-1777-4b0c-95c7-b232be66528c</entry>
Nov 15 08:17:22 user nova-compute[95467]:       <entry name="uuid">e7805e5c-1777-4b0c-95c7-b232be66528c</entry>
Nov 15 08:17:22 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:17:22 user nova-compute[95467]:     </system>
Nov 15 08:17:22 user nova-compute[95467]:   </sysinfo>
Nov 15 08:17:22 user nova-compute[95467]:   <os>
Nov 15 08:17:22 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:17:22 user nova-compute[95467]:     <boot dev="hd"/>
Nov 15 08:17:22 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:17:22 user nova-compute[95467]:   </os>
Nov 15 08:17:22 user nova-compute[95467]:   <features>
Nov 15 08:17:22 user nova-compute[95467]:     <acpi/>
Nov 15 08:17:22 user nova-compute[95467]:     <apic/>
Nov 15 08:17:22 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:17:22 user nova-compute[95467]:   </features>
Nov 15 08:17:22 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:17:22 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:17:22 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:17:22 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:17:22 user nova-compute[95467]:   </clock>
Nov 15 08:17:22 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:17:22 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:17:22 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:17:22 user nova-compute[95467]:   </cpu>
Nov 15 08:17:22 user nova-compute[95467]:   <devices>
Nov 15 08:17:22 user nova-compute[95467]:     <disk type="file" device="disk">
Nov 15 08:17:22 user nova-compute[95467]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 08:17:22 user nova-compute[95467]:       <source file="/opt/stack/data/nova/instances/e7805e5c-1777-4b0c-95c7-b232be66528c/disk"/>
Nov 15 08:17:22 user nova-compute[95467]:       <target dev="vda" bus="virtio"/>
Nov 15 08:17:22 user nova-compute[95467]:     </disk>
Nov 15 08:17:22 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:17:22 user nova-compute[95467]:       <mac address="fa:16:3e:46:f0:15"/>
Nov 15 08:17:22 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:17:22 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:17:22 user nova-compute[95467]:       <target dev="tap7f8e69fc-62"/>
Nov 15 08:17:22 user nova-compute[95467]:     </interface>
Nov 15 08:17:22 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:17:22 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/e7805e5c-1777-4b0c-95c7-b232be66528c/console.log" append="off"/>
Nov 15 08:17:22 user nova-compute[95467]:     </serial>
Nov 15 08:17:22 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:17:22 user nova-compute[95467]:     <video>
Nov 15 08:17:22 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:17:22 user nova-compute[95467]:     </video>
Nov 15 08:17:22 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:17:22 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:17:22 user nova-compute[95467]:     </rng>
Nov 15 08:17:22 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:17:22 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:17:22 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:17:22 user nova-compute[95467]:     </memballoon>
Nov 15 08:17:22 user nova-compute[95467]:   </devices>
Nov 15 08:17:22 user nova-compute[95467]: </domain>
Nov 15 08:17:22 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:17:22 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:17:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2096143899',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2096143899',id=28,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBJ4d3/P/W4IM4c/SDFdf9+rwPXC3NZ0eghDPz0brXh+NeL91puTUjJZ6Wd0+WEV7wlTz3Y4+T858B8rzcbTbkNawWiCCL5nZHqbWqmnXBZ63bY9/9J2fUPSgv/Bhxp1g==',key_name='tempest-keypair-559293739',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94b04c448c61451d8d46ebc7a61a5e6e',ramdisk_id='',reservation_id='r-1r9tzmt8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1251988905',owner_user_name='tempest-AttachVolumeShelveTestJSON-1251988905-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:17:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b03564d022e84f5cb133b9771e76bae8',uuid=e7805e5c-1777-4b0c-95c7-b232be66528c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f8e69fc-628f-4a31-9ba0-db0b320dff09", "address": "fa:16:3e:46:f0:15", "network": {"id": "f7871b75-73b3-4f0a-8e6c-814bc61ebd6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-945672014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b04c448c61451d8d46ebc7a61a5e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f8e69fc-62", "ovs_interfaceid": "7f8e69fc-628f-4a31-9ba0-db0b320dff09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:17:22 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Converting VIF {"id": "7f8e69fc-628f-4a31-9ba0-db0b320dff09", "address": "fa:16:3e:46:f0:15", "network": {"id": "f7871b75-73b3-4f0a-8e6c-814bc61ebd6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-945672014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b04c448c61451d8d46ebc7a61a5e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f8e69fc-62", "ovs_interfaceid": "7f8e69fc-628f-4a31-9ba0-db0b320dff09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:17:22 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:f0:15,bridge_name='br-int',has_traffic_filtering=True,id=7f8e69fc-628f-4a31-9ba0-db0b320dff09,network=Network(f7871b75-73b3-4f0a-8e6c-814bc61ebd6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f8e69fc-62') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:17:22 user nova-compute[95467]: DEBUG os_vif [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:f0:15,bridge_name='br-int',has_traffic_filtering=True,id=7f8e69fc-628f-4a31-9ba0-db0b320dff09,network=Network(f7871b75-73b3-4f0a-8e6c-814bc61ebd6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f8e69fc-62') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:17:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:17:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:17:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '132db885-4fe2-5e16-8179-09b8a8751bfb', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:17:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7f8e69fc-62, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:17:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7f8e69fc-62, col_values=(('qos', UUID('dc83cd40-aacd-40e3-b96f-7e45382763ea')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:17:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7f8e69fc-62, col_values=(('external_ids', {'iface-id': '7f8e69fc-628f-4a31-9ba0-db0b320dff09', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:f0:15', 'vm-uuid': 'e7805e5c-1777-4b0c-95c7-b232be66528c'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:17:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:17:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:22 user nova-compute[95467]: INFO os_vif [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:f0:15,bridge_name='br-int',has_traffic_filtering=True,id=7f8e69fc-628f-4a31-9ba0-db0b320dff09,network=Network(f7871b75-73b3-4f0a-8e6c-814bc61ebd6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f8e69fc-62')
Nov 15 08:17:22 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:17:22 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] No VIF found with MAC fa:16:3e:46:f0:15, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:17:22 user nova-compute[95467]: DEBUG nova.compute.manager [req-e6f77f27-89ef-49f0-bb54-59626080552e req-f5428f65-5acd-4647-92a2-e020e2c4ef1f service nova] [instance: d5a35226-6b98-44ad-ab4d-e0e86b14ba9d] Received event network-vif-plugged-54ecf559-43dd-428e-af76-0966723dbaf6 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:17:22 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-e6f77f27-89ef-49f0-bb54-59626080552e req-f5428f65-5acd-4647-92a2-e020e2c4ef1f service nova] Acquiring lock "d5a35226-6b98-44ad-ab4d-e0e86b14ba9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:17:22 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-e6f77f27-89ef-49f0-bb54-59626080552e req-f5428f65-5acd-4647-92a2-e020e2c4ef1f service nova] Lock "d5a35226-6b98-44ad-ab4d-e0e86b14ba9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:17:22 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-e6f77f27-89ef-49f0-bb54-59626080552e req-f5428f65-5acd-4647-92a2-e020e2c4ef1f service nova] Lock "d5a35226-6b98-44ad-ab4d-e0e86b14ba9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:17:22 user nova-compute[95467]: DEBUG nova.compute.manager [req-e6f77f27-89ef-49f0-bb54-59626080552e req-f5428f65-5acd-4647-92a2-e020e2c4ef1f service nova] [instance: d5a35226-6b98-44ad-ab4d-e0e86b14ba9d] No waiting events found dispatching network-vif-plugged-54ecf559-43dd-428e-af76-0966723dbaf6 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:17:22 user nova-compute[95467]: WARNING nova.compute.manager [req-e6f77f27-89ef-49f0-bb54-59626080552e req-f5428f65-5acd-4647-92a2-e020e2c4ef1f service nova] [instance: d5a35226-6b98-44ad-ab4d-e0e86b14ba9d] Received unexpected event network-vif-plugged-54ecf559-43dd-428e-af76-0966723dbaf6 for instance with vm_state deleted and task_state None.
Nov 15 08:17:22 user nova-compute[95467]: DEBUG nova.compute.manager [req-e6f77f27-89ef-49f0-bb54-59626080552e req-f5428f65-5acd-4647-92a2-e020e2c4ef1f service nova] [instance: d5a35226-6b98-44ad-ab4d-e0e86b14ba9d] Received event network-vif-deleted-54ecf559-43dd-428e-af76-0966723dbaf6 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:17:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:22 user nova-compute[95467]: DEBUG nova.network.neutron [req-fe2b7682-c2ff-48d9-a416-b106fd688dfa req-7a24c37f-945a-4b5e-b76f-6dd9521d6587 service nova] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Updated VIF entry in instance network info cache for port 7f8e69fc-628f-4a31-9ba0-db0b320dff09. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:17:22 user nova-compute[95467]: DEBUG nova.network.neutron [req-fe2b7682-c2ff-48d9-a416-b106fd688dfa req-7a24c37f-945a-4b5e-b76f-6dd9521d6587 service nova] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Updating instance_info_cache with network_info: [{"id": "7f8e69fc-628f-4a31-9ba0-db0b320dff09", "address": "fa:16:3e:46:f0:15", "network": {"id": "f7871b75-73b3-4f0a-8e6c-814bc61ebd6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-945672014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b04c448c61451d8d46ebc7a61a5e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f8e69fc-62", "ovs_interfaceid": "7f8e69fc-628f-4a31-9ba0-db0b320dff09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:17:22 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-fe2b7682-c2ff-48d9-a416-b106fd688dfa req-7a24c37f-945a-4b5e-b76f-6dd9521d6587 service nova] Releasing lock "refresh_cache-e7805e5c-1777-4b0c-95c7-b232be66528c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:17:23 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:23 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:23 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:23 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:23 user nova-compute[95467]: DEBUG nova.compute.manager [req-1d5c7f12-c493-48f9-b85a-ab090f391ccf req-9fe6422f-ac6b-42d9-9f4d-37ecbfbab45c service nova] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Received event network-vif-plugged-7f8e69fc-628f-4a31-9ba0-db0b320dff09 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:17:23 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-1d5c7f12-c493-48f9-b85a-ab090f391ccf req-9fe6422f-ac6b-42d9-9f4d-37ecbfbab45c service nova] Acquiring lock "e7805e5c-1777-4b0c-95c7-b232be66528c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:17:23 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-1d5c7f12-c493-48f9-b85a-ab090f391ccf req-9fe6422f-ac6b-42d9-9f4d-37ecbfbab45c service nova] Lock "e7805e5c-1777-4b0c-95c7-b232be66528c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:17:23 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-1d5c7f12-c493-48f9-b85a-ab090f391ccf req-9fe6422f-ac6b-42d9-9f4d-37ecbfbab45c service nova] Lock "e7805e5c-1777-4b0c-95c7-b232be66528c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:17:23 user nova-compute[95467]: DEBUG nova.compute.manager [req-1d5c7f12-c493-48f9-b85a-ab090f391ccf req-9fe6422f-ac6b-42d9-9f4d-37ecbfbab45c service nova] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] No waiting events found dispatching network-vif-plugged-7f8e69fc-628f-4a31-9ba0-db0b320dff09 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:17:23 user nova-compute[95467]: WARNING nova.compute.manager [req-1d5c7f12-c493-48f9-b85a-ab090f391ccf req-9fe6422f-ac6b-42d9-9f4d-37ecbfbab45c service nova] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Received unexpected event network-vif-plugged-7f8e69fc-628f-4a31-9ba0-db0b320dff09 for instance with vm_state building and task_state spawning.
Nov 15 08:17:24 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:24 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:24 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:25 user nova-compute[95467]: DEBUG nova.compute.manager [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Instance event wait completed in 0 seconds for  {{(pid=95467) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 08:17:25 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Guest created on hypervisor {{(pid=95467) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 08:17:25 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Instance spawned successfully.
Nov 15 08:17:25 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 08:17:25 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Found default for hw_cdrom_bus of ide {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:17:25 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Found default for hw_disk_bus of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:17:25 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Found default for hw_input_bus of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:17:25 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Found default for hw_pointer_model of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:17:25 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Found default for hw_video_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:17:25 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Found default for hw_vif_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:17:25 user nova-compute[95467]: INFO nova.compute.manager [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Took 6.52 seconds to spawn the instance on the hypervisor.
Nov 15 08:17:25 user nova-compute[95467]: DEBUG nova.compute.manager [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:17:25 user nova-compute[95467]: INFO nova.compute.manager [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Took 7.40 seconds to build instance.
Nov 15 08:17:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-98cdccc3-f54a-402a-873d-5e3c6e200a90 tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "e7805e5c-1777-4b0c-95c7-b232be66528c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.503s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:17:25 user nova-compute[95467]: DEBUG nova.compute.manager [req-4df4f00a-a44b-43ed-9eec-0130cd0b0c7b req-4a6c999a-1878-40cc-9b56-011489904f61 service nova] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Received event network-vif-plugged-7f8e69fc-628f-4a31-9ba0-db0b320dff09 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:17:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-4df4f00a-a44b-43ed-9eec-0130cd0b0c7b req-4a6c999a-1878-40cc-9b56-011489904f61 service nova] Acquiring lock "e7805e5c-1777-4b0c-95c7-b232be66528c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:17:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-4df4f00a-a44b-43ed-9eec-0130cd0b0c7b req-4a6c999a-1878-40cc-9b56-011489904f61 service nova] Lock "e7805e5c-1777-4b0c-95c7-b232be66528c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:17:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-4df4f00a-a44b-43ed-9eec-0130cd0b0c7b req-4a6c999a-1878-40cc-9b56-011489904f61 service nova] Lock "e7805e5c-1777-4b0c-95c7-b232be66528c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:17:25 user nova-compute[95467]: DEBUG nova.compute.manager [req-4df4f00a-a44b-43ed-9eec-0130cd0b0c7b req-4a6c999a-1878-40cc-9b56-011489904f61 service nova] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] No waiting events found dispatching network-vif-plugged-7f8e69fc-628f-4a31-9ba0-db0b320dff09 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:17:25 user nova-compute[95467]: WARNING nova.compute.manager [req-4df4f00a-a44b-43ed-9eec-0130cd0b0c7b req-4a6c999a-1878-40cc-9b56-011489904f61 service nova] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Received unexpected event network-vif-plugged-7f8e69fc-628f-4a31-9ba0-db0b320dff09 for instance with vm_state active and task_state None.
Nov 15 08:17:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-878843da-96f8-4534-b0b4-6ba714ec211a tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Acquiring lock "bee31898-4f12-4c68-a18b-a678f9f584aa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:17:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-878843da-96f8-4534-b0b4-6ba714ec211a tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Lock "bee31898-4f12-4c68-a18b-a678f9f584aa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:17:29 user nova-compute[95467]: DEBUG nova.objects.instance [None req-878843da-96f8-4534-b0b4-6ba714ec211a tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Lazy-loading 'flavor' on Instance uuid bee31898-4f12-4c68-a18b-a678f9f584aa {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:17:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-878843da-96f8-4534-b0b4-6ba714ec211a tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Lock "bee31898-4f12-4c68-a18b-a678f9f584aa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:17:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-878843da-96f8-4534-b0b4-6ba714ec211a tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Acquiring lock "bee31898-4f12-4c68-a18b-a678f9f584aa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:17:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-878843da-96f8-4534-b0b4-6ba714ec211a tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Lock "bee31898-4f12-4c68-a18b-a678f9f584aa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:17:29 user nova-compute[95467]: INFO nova.compute.manager [None req-878843da-96f8-4534-b0b4-6ba714ec211a tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Attaching volume 37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 to /dev/vdb
Nov 15 08:17:29 user nova-compute[95467]: DEBUG os_brick.utils [None req-878843da-96f8-4534-b0b4-6ba714ec211a tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:17:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:29 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e8231b-97be-435b-ab7c-d0945f3250d7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:882ae90641f\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:17:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:29 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[858e741d-c5c2-45c6-8e39-3c28bd3a5016]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:17:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:29 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c58b9e7-5aed-43cd-be73-df48b244205f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:17:29 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f6f54d-b8a7-4185-9b83-b3c383427c1e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:17:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-878843da-96f8-4534-b0b4-6ba714ec211a tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Running cmd (subprocess): nvme version {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-878843da-96f8-4534-b0b4-6ba714ec211a tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] 'nvme version' failed. Not Retrying. {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:17:29 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.nvmeof [None req-878843da-96f8-4534-b0b4-6ba714ec211a tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] nvme not present on system {{(pid=95467) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 08:17:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:17:29 user nova-compute[95467]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 08:17:29 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e1cfc0-5069-4577-94ca-65b5224d3c6a]: (4, '') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:17:29 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-878843da-96f8-4534-b0b4-6ba714ec211a tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=95467) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 08:17:29 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-878843da-96f8-4534-b0b4-6ba714ec211a tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 08:17:29 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-878843da-96f8-4534-b0b4-6ba714ec211a tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] LIGHTOS: no hostnqn found. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 08:17:29 user nova-compute[95467]: DEBUG os_brick.utils [None req-878843da-96f8-4534-b0b4-6ba714ec211a tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:882ae90641f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:17:29 user nova-compute[95467]: DEBUG nova.virt.block_device [None req-878843da-96f8-4534-b0b4-6ba714ec211a tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Updating existing volume attachment record: 0c1b08ec-6cc3-4621-b589-0e6db12af052 {{(pid=95467) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 08:17:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:35 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-878843da-96f8-4534-b0b4-6ba714ec211a tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Calling os-brick to attach iSCSI Volume {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 08:17:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-878843da-96f8-4534-b0b4-6ba714ec211a tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IFUhnXyo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:17:35 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-878843da-96f8-4534-b0b4-6ba714ec211a tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:17:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-878843da-96f8-4534-b0b4-6ba714ec211a tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:17:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-878843da-96f8-4534-b0b4-6ba714ec211a tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:17:35 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-878843da-96f8-4534-b0b4-6ba714ec211a tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:17:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-878843da-96f8-4534-b0b4-6ba714ec211a tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:17:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-878843da-96f8-4534-b0b4-6ba714ec211a tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:17:35 user nova-compute[95467]: INFO os_brick.initiator.connectors.iscsi [None req-878843da-96f8-4534-b0b4-6ba714ec211a tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 08:17:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 -p 172.16.0.220:3260 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:35 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[4167c18a-4b03-4523-b72e-a5a7a3dfd557]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:17:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-878843da-96f8-4534-b0b4-6ba714ec211a tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 08:17:35 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:17:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 -p 172.16.0.220:3260 --interface default --op new {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:35 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae37e4e-f5c4-4531-9a4c-c6b379f87b5a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81] added\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:17:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-878843da-96f8-4534-b0b4-6ba714ec211a tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81] added
Nov 15 08:17:35 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:17:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:35 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97bbad8-759f-4396-b9a2-55f0aab155bb]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:17:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-878843da-96f8-4534-b0b4-6ba714ec211a tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:17:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:35 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c0003b-2a7b-4d6c-b454-47922e2a1517]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:17:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-878843da-96f8-4534-b0b4-6ba714ec211a tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:17:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IFUhnXyo {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IFUhnXyo" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:35 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7bf6f38-951d-495c-8e4f-bb8d0853cffa]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:17:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-878843da-96f8-4534-b0b4-6ba714ec211a tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IFUhnXyo'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:17:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:35 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[405d00cb-77a2-42eb-be24-000507efe907]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:17:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-878843da-96f8-4534-b0b4-6ba714ec211a tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:17:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:35 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[616916e6-67de-4d0e-9e34-234597b1d1fa]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc70e373-38d7-4fac-98ef-9560050b2968 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:17:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-878843da-96f8-4534-b0b4-6ba714ec211a tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 (non-flash)
Nov 15 08:17:35 user nova-compute[95467]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:17:35 user nova-compute[95467]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)
Nov 15 08:17:35 user nova-compute[95467]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc70e373-38d7-4fac-98ef-9560050b2968 (non-flash)
Nov 15 08:17:35 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:17:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-878843da-96f8-4534-b0b4-6ba714ec211a tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 (non-flash)
Nov 15 08:17:35 user nova-compute[95467]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:17:35 user nova-compute[95467]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)
Nov 15 08:17:35 user nova-compute[95467]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc70e373-38d7-4fac-98ef-9560050b2968 (non-flash)
Nov 15 08:17:35 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:17:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 -p 172.16.0.220:3260 --login {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:35 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1589a5-98c0-469d-95af-c7b6286f25fb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:17:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-878843da-96f8-4534-b0b4-6ba714ec211a tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81, portal: 172.16.0.220,3260]
Nov 15 08:17:35 user nova-compute[95467]: Login to [iface: default, target: iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81, portal: 172.16.0.220,3260] successful.
Nov 15 08:17:35 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:17:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:35 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd58d98e-c8a1-45b0-8e16-bbf3c2e0239a]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:17:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-878843da-96f8-4534-b0b4-6ba714ec211a tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:17:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:35 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c1a30f-6b97-4a18-af2c-b9731167238a]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc70e373-38d7-4fac-98ef-9560050b2968 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:17:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-878843da-96f8-4534-b0b4-6ba714ec211a tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 (non-flash)
Nov 15 08:17:35 user nova-compute[95467]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:17:35 user nova-compute[95467]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)
Nov 15 08:17:35 user nova-compute[95467]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc70e373-38d7-4fac-98ef-9560050b2968 (non-flash)
Nov 15 08:17:35 user nova-compute[95467]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 (non-flash)
Nov 15 08:17:35 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:17:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-878843da-96f8-4534-b0b4-6ba714ec211a tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 (non-flash)
Nov 15 08:17:35 user nova-compute[95467]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:17:35 user nova-compute[95467]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)
Nov 15 08:17:35 user nova-compute[95467]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc70e373-38d7-4fac-98ef-9560050b2968 (non-flash)
Nov 15 08:17:35 user nova-compute[95467]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 (non-flash)
Nov 15 08:17:35 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:17:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-878843da-96f8-4534-b0b4-6ba714ec211a tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:17:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-878843da-96f8-4534-b0b4-6ba714ec211a tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Connected to 172.16.0.220:3260 {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 08:17:35 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-878843da-96f8-4534-b0b4-6ba714ec211a tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] HCTL ('37', '-', '-', 0) found on session 24 with lun 0 {{(pid=95467) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 08:17:35 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-878843da-96f8-4534-b0b4-6ba714ec211a tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=95467) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 08:17:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:35 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[79fd2d3f-ecb0-4b26-989c-e72318ab6814]: (4, ('- - 0', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:17:35 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-878843da-96f8-4534-b0b4-6ba714ec211a tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Searching for a device in session 24 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:17:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-878843da-96f8-4534-b0b4-6ba714ec211a tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IFUhnXyo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 08:17:36 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-878843da-96f8-4534-b0b4-6ba714ec211a tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.373s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:17:36 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-878843da-96f8-4534-b0b4-6ba714ec211a tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] <== connect_volume: return (1376ms) {'type': 'block', 'scsi_wwn': '23136353063663338', 'path': '/dev/sdf'} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:17:36 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-878843da-96f8-4534-b0b4-6ba714ec211a tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23136353063663338', 'path': '/dev/sdf'} {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 08:17:36 user nova-compute[95467]: DEBUG nova.objects.instance [None req-878843da-96f8-4534-b0b4-6ba714ec211a tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Lazy-loading 'flavor' on Instance uuid bee31898-4f12-4c68-a18b-a678f9f584aa {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:17:36 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-878843da-96f8-4534-b0b4-6ba714ec211a tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 08:17:36 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:17:36 user nova-compute[95467]:   <source dev="/dev/sdf"/>
Nov 15 08:17:36 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:17:36 user nova-compute[95467]:   <serial>37d2cbbd-2252-4dbb-b8c7-f8e74995fb81</serial>
Nov 15 08:17:36 user nova-compute[95467]: </disk>
Nov 15 08:17:36 user nova-compute[95467]:  {{(pid=95467) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 08:17:36 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-878843da-96f8-4534-b0b4-6ba714ec211a tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:17:36 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-878843da-96f8-4534-b0b4-6ba714ec211a tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] No BDM found with device name vdb, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:17:36 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-878843da-96f8-4534-b0b4-6ba714ec211a tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] No VIF found with MAC fa:16:3e:b4:e9:ab, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:17:37 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-878843da-96f8-4534-b0b4-6ba714ec211a tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Lock "bee31898-4f12-4c68-a18b-a678f9f584aa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.241s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:17:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:37 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:17:37 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=95467) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 08:17:37 user nova-compute[95467]: INFO nova.compute.manager [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Rescuing
Nov 15 08:17:37 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Acquiring lock "refresh_cache-bee31898-4f12-4c68-a18b-a678f9f584aa" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:17:37 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Acquired lock "refresh_cache-bee31898-4f12-4c68-a18b-a678f9f584aa" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:17:37 user nova-compute[95467]: DEBUG nova.network.neutron [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:17:38 user nova-compute[95467]: DEBUG nova.network.neutron [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Updating instance_info_cache with network_info: [{"id": "eea925f5-c956-40d3-99a5-b45573318378", "address": "fa:16:3e:b4:e9:ab", "network": {"id": "dcbc2304-8d20-4589-b81e-a75a22ef7114", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-333949369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6f7599b8526444a8276cac35f0a1500", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeea925f5-c9", "ovs_interfaceid": "eea925f5-c956-40d3-99a5-b45573318378", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:17:38 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Releasing lock "refresh_cache-bee31898-4f12-4c68-a18b-a678f9f584aa" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:17:38 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:38 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:38 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:38 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:38 user nova-compute[95467]: DEBUG nova.compute.manager [req-8f35ea1a-b25b-43ba-82c5-57785b494a09 req-241d53e2-410a-4c2c-ba56-2b90dc0ef9f9 service nova] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Received event network-vif-unplugged-eea925f5-c956-40d3-99a5-b45573318378 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:17:38 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-8f35ea1a-b25b-43ba-82c5-57785b494a09 req-241d53e2-410a-4c2c-ba56-2b90dc0ef9f9 service nova] Acquiring lock "bee31898-4f12-4c68-a18b-a678f9f584aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:17:38 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-8f35ea1a-b25b-43ba-82c5-57785b494a09 req-241d53e2-410a-4c2c-ba56-2b90dc0ef9f9 service nova] Lock "bee31898-4f12-4c68-a18b-a678f9f584aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:17:38 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-8f35ea1a-b25b-43ba-82c5-57785b494a09 req-241d53e2-410a-4c2c-ba56-2b90dc0ef9f9 service nova] Lock "bee31898-4f12-4c68-a18b-a678f9f584aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:17:38 user nova-compute[95467]: DEBUG nova.compute.manager [req-8f35ea1a-b25b-43ba-82c5-57785b494a09 req-241d53e2-410a-4c2c-ba56-2b90dc0ef9f9 service nova] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] No waiting events found dispatching network-vif-unplugged-eea925f5-c956-40d3-99a5-b45573318378 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:17:38 user nova-compute[95467]: WARNING nova.compute.manager [req-8f35ea1a-b25b-43ba-82c5-57785b494a09 req-241d53e2-410a-4c2c-ba56-2b90dc0ef9f9 service nova] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Received unexpected event network-vif-unplugged-eea925f5-c956-40d3-99a5-b45573318378 for instance with vm_state active and task_state rescuing.
Nov 15 08:17:38 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Instance destroyed successfully.
Nov 15 08:17:38 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Attempting a stable device rescue
Nov 15 08:17:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=95467) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 08:17:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Instance directory exists: not creating {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 08:17:38 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Creating image(s)
Nov 15 08:17:38 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Acquiring lock "/opt/stack/data/nova/instances/bee31898-4f12-4c68-a18b-a678f9f584aa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:17:38 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Lock "/opt/stack/data/nova/instances/bee31898-4f12-4c68-a18b-a678f9f584aa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:17:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Lock "/opt/stack/data/nova/instances/bee31898-4f12-4c68-a18b-a678f9f584aa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:17:39 user nova-compute[95467]: DEBUG nova.objects.instance [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Lazy-loading 'trusted_certs' on Instance uuid bee31898-4f12-4c68-a18b-a678f9f584aa {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:17:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Acquiring lock "a115bd1f411fe5a5744cec26eb779067173ad965" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:17:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Lock "a115bd1f411fe5a5744cec26eb779067173ad965" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:17:39 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a115bd1f411fe5a5744cec26eb779067173ad965.part --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a115bd1f411fe5a5744cec26eb779067173ad965.part --force-share --output=json" returned: 0 in 0.194s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:40 user nova-compute[95467]: DEBUG nova.virt.images [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] a8cf36e5-a3af-42e6-bb6f-a099896245d7 was qcow2, converting to raw {{(pid=95467) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 08:17:40 user nova-compute[95467]: DEBUG nova.privsep.utils [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=95467) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 08:17:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a115bd1f411fe5a5744cec26eb779067173ad965.part /opt/stack/data/nova/instances/_base/a115bd1f411fe5a5744cec26eb779067173ad965.converted {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a115bd1f411fe5a5744cec26eb779067173ad965.part /opt/stack/data/nova/instances/_base/a115bd1f411fe5a5744cec26eb779067173ad965.converted" returned: 0 in 0.437s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a115bd1f411fe5a5744cec26eb779067173ad965.converted --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:40 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:17:40 user nova-compute[95467]: DEBUG nova.compute.manager [req-2b9202db-0409-49b2-914e-d5f76f1ccf05 req-0c447f56-14f9-4522-8a66-afde7d1c1ff7 service nova] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Received event network-vif-plugged-eea925f5-c956-40d3-99a5-b45573318378 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:17:40 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-2b9202db-0409-49b2-914e-d5f76f1ccf05 req-0c447f56-14f9-4522-8a66-afde7d1c1ff7 service nova] Acquiring lock "bee31898-4f12-4c68-a18b-a678f9f584aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:17:40 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-2b9202db-0409-49b2-914e-d5f76f1ccf05 req-0c447f56-14f9-4522-8a66-afde7d1c1ff7 service nova] Lock "bee31898-4f12-4c68-a18b-a678f9f584aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:17:40 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-2b9202db-0409-49b2-914e-d5f76f1ccf05 req-0c447f56-14f9-4522-8a66-afde7d1c1ff7 service nova] Lock "bee31898-4f12-4c68-a18b-a678f9f584aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:17:40 user nova-compute[95467]: DEBUG nova.compute.manager [req-2b9202db-0409-49b2-914e-d5f76f1ccf05 req-0c447f56-14f9-4522-8a66-afde7d1c1ff7 service nova] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] No waiting events found dispatching network-vif-plugged-eea925f5-c956-40d3-99a5-b45573318378 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:17:40 user nova-compute[95467]: WARNING nova.compute.manager [req-2b9202db-0409-49b2-914e-d5f76f1ccf05 req-0c447f56-14f9-4522-8a66-afde7d1c1ff7 service nova] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Received unexpected event network-vif-plugged-eea925f5-c956-40d3-99a5-b45573318378 for instance with vm_state active and task_state rescuing.
Nov 15 08:17:40 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:17:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a115bd1f411fe5a5744cec26eb779067173ad965.converted --force-share --output=json" returned: 0 in 0.180s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:40 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Lock "a115bd1f411fe5a5744cec26eb779067173ad965" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.789s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:17:40 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Acquiring lock "a115bd1f411fe5a5744cec26eb779067173ad965" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:17:40 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Lock "a115bd1f411fe5a5744cec26eb779067173ad965" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:17:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a115bd1f411fe5a5744cec26eb779067173ad965 --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a115bd1f411fe5a5744cec26eb779067173ad965 --force-share --output=json" returned: 0 in 0.172s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a115bd1f411fe5a5744cec26eb779067173ad965,backing_fmt=raw /opt/stack/data/nova/instances/bee31898-4f12-4c68-a18b-a678f9f584aa/disk.rescue {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a115bd1f411fe5a5744cec26eb779067173ad965,backing_fmt=raw /opt/stack/data/nova/instances/bee31898-4f12-4c68-a18b-a678f9f584aa/disk.rescue" returned: 0 in 0.058s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Lock "a115bd1f411fe5a5744cec26eb779067173ad965" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG nova.objects.instance [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Lazy-loading 'migration_context' on Instance uuid bee31898-4f12-4c68-a18b-a678f9f584aa {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG nova.objects.base [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Object Instance<bee31898-4f12-4c68-a18b-a678f9f584aa> lazy-loaded attributes: trusted_certs,migration_context {{(pid=95467) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Created local disks {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Start _get_guest_xml network_info=[{"id": "eea925f5-c956-40d3-99a5-b45573318378", "address": "fa:16:3e:b4:e9:ab", "network": {"id": "dcbc2304-8d20-4589-b81e-a75a22ef7114", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-333949369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-333949369-network", "vif_mac": "fa:16:3e:b4:e9:ab"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6f7599b8526444a8276cac35f0a1500", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeea925f5-c9", "ovs_interfaceid": "eea925f5-c956-40d3-99a5-b45573318378", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a8cf36e5-a3af-42e6-bb6f-a099896245d7', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'ed9c48aa-ce73-4b3b-9db1-235898be671b'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '0c1b08ec-6cc3-4621-b589-0e6db12af052', 'delete_on_termination': False, 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IFUhnXyo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'bee31898-4f12-4c68-a18b-a678f9f584aa', 'attached_at': '', 'detached_at': '', 'volume_id': '37d2cbbd-2252-4dbb-b8c7-f8e74995fb81', 'serial': '37d2cbbd-2252-4dbb-b8c7-f8e74995fb81'}, 'volume_type': None} {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG nova.objects.instance [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Lazy-loading 'resources' on Instance uuid bee31898-4f12-4c68-a18b-a678f9f584aa {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG nova.objects.base [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Object Instance<bee31898-4f12-4c68-a18b-a678f9f584aa> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=95467) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG nova.objects.instance [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Lazy-loading 'numa_topology' on Instance uuid bee31898-4f12-4c68-a18b-a678f9f584aa {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG nova.objects.base [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Object Instance<bee31898-4f12-4c68-a18b-a678f9f584aa> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=95467) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 08:17:41 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:17:41 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:17:41 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG nova.objects.instance [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Lazy-loading 'vcpu_model' on Instance uuid bee31898-4f12-4c68-a18b-a678f9f584aa {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG nova.objects.base [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Object Instance<bee31898-4f12-4c68-a18b-a678f9f584aa> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=95467) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Calling os-brick to attach iSCSI Volume {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IFUhnXyo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:17:41 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:17:41 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:17:41 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:17:41 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:17:41 user nova-compute[95467]: INFO os_brick.initiator.connectors.iscsi [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 08:17:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 -p 172.16.0.220:3260 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d408061b-5ea4-4339-862c-4a04b83e67a2]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = IFUhnXyo\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 15 08:17:41 user nova-compute[95467]: node.name = iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81
Nov 15 08:17:41 user nova-compute[95467]: node.tpgt = -1
Nov 15 08:17:41 user nova-compute[95467]: node.startup = automatic
Nov 15 08:17:41 user nova-compute[95467]: node.leading_login = No
Nov 15 08:17:41 user nova-compute[95467]: iface.iscsi_ifacename = default
Nov 15 08:17:41 user nova-compute[95467]: iface.net_ifacename = <empty>
Nov 15 08:17:41 user nova-compute[95467]: iface.ipaddress = <empty>
Nov 15 08:17:41 user nova-compute[95467]: iface.prefix_len = 0
Nov 15 08:17:41 user nova-compute[95467]: iface.hwaddress = <empty>
Nov 15 08:17:41 user nova-compute[95467]: iface.transport_name = tcp
Nov 15 08:17:41 user nova-compute[95467]: iface.initiatorname = <empty>
Nov 15 08:17:41 user nova-compute[95467]: iface.state = <empty>
Nov 15 08:17:41 user nova-compute[95467]: iface.vlan_id = 0
Nov 15 08:17:41 user nova-compute[95467]: iface.vlan_priority = 0
Nov 15 08:17:41 user nova-compute[95467]: iface.vlan_state = <empty>
Nov 15 08:17:41 user nova-compute[95467]: iface.iface_num = 0
Nov 15 08:17:41 user nova-compute[95467]: iface.mtu = 0
Nov 15 08:17:41 user nova-compute[95467]: iface.port = 0
Nov 15 08:17:41 user nova-compute[95467]: iface.bootproto = <empty>
Nov 15 08:17:41 user nova-compute[95467]: iface.subnet_mask = <empty>
Nov 15 08:17:41 user nova-compute[95467]: iface.gateway = <empty>
Nov 15 08:17:41 user nova-compute[95467]: iface.dhcp_alt_client_id_state = <empty>
Nov 15 08:17:41 user nova-compute[95467]: iface.dhcp_alt_client_id = <empty>
Nov 15 08:17:41 user nova-compute[95467]: iface.dhcp_dns = <empty>
Nov 15 08:17:41 user nova-compute[95467]: iface.dhcp_learn_iqn = <empty>
Nov 15 08:17:41 user nova-compute[95467]: iface.dhcp_req_vendor_id_state = <empty>
Nov 15 08:17:41 user nova-compute[95467]: iface.dhcp_vendor_id_state = <empty>
Nov 15 08:17:41 user nova-compute[95467]: iface.dhcp_vendor_id = <empty>
Nov 15 08:17:41 user nova-compute[95467]: iface.dhcp_slp_da = <empty>
Nov 15 08:17:41 user nova-compute[95467]: iface.fragmentation = <empty>
Nov 15 08:17:41 user nova-compute[95467]: iface.gratuitous_arp = <empty>
Nov 15 08:17:41 user nova-compute[95467]: iface.incoming_forwarding = <empty>
Nov 15 08:17:41 user nova-compute[95467]: iface.tos_state = <empty>
Nov 15 08:17:41 user nova-compute[95467]: iface.tos = 0
Nov 15 08:17:41 user nova-compute[95467]: iface.ttl = 0
Nov 15 08:17:41 user nova-compute[95467]: iface.delayed_ack = <empty>
Nov 15 08:17:41 user nova-compute[95467]: iface.tcp_nagle = <empty>
Nov 15 08:17:41 user nova-compute[95467]: iface.tcp_wsf_state = <empty>
Nov 15 08:17:41 user nova-compute[95467]: iface.tcp_wsf = 0
Nov 15 08:17:41 user nova-compute[95467]: iface.tcp_timer_scale = 0
Nov 15 08:17:41 user nova-compute[95467]: iface.tcp_timestamp = <empty>
Nov 15 08:17:41 user nova-compute[95467]: iface.redirect = <empty>
Nov 15 08:17:41 user nova-compute[95467]: iface.def_task_mgmt_timeout = 0
Nov 15 08:17:41 user nova-compute[95467]: iface.header_digest = <empty>
Nov 15 08:17:41 user nova-compute[95467]: iface.data_digest = <empty>
Nov 15 08:17:41 user nova-compute[95467]: iface.immediate_data = <empty>
Nov 15 08:17:41 user nova-compute[95467]: iface.initial_r2t = <empty>
Nov 15 08:17:41 user nova-compute[95467]: iface.data_seq_inorder = <empty>
Nov 15 08:17:41 user nova-compute[95467]: iface.data_pdu_inorder = <empty>
Nov 15 08:17:41 user nova-compute[95467]: iface.erl = 0
Nov 15 08:17:41 user nova-compute[95467]: iface.max_receive_data_len = 0
Nov 15 08:17:41 user nova-compute[95467]: iface.first_burst_len = 0
Nov 15 08:17:41 user nova-compute[95467]: iface.max_outstanding_r2t = 0
Nov 15 08:17:41 user nova-compute[95467]: iface.max_burst_len = 0
Nov 15 08:17:41 user nova-compute[95467]: iface.chap_auth = <empty>
Nov 15 08:17:41 user nova-compute[95467]: iface.bidi_chap = <empty>
Nov 15 08:17:41 user nova-compute[95467]: iface.strict_login_compliance = <empty>
Nov 15 08:17:41 user nova-compute[95467]: iface.discovery_auth = <empty>
Nov 15 08:17:41 user nova-compute[95467]: iface.discovery_logout = <empty>
Nov 15 08:17:41 user nova-compute[95467]: node.discovery_address = <empty>
Nov 15 08:17:41 user nova-compute[95467]: node.discovery_port = 0
Nov 15 08:17:41 user nova-compute[95467]: node.discovery_type = static
Nov 15 08:17:41 user nova-compute[95467]: node.session.initial_cmdsn = 0
Nov 15 08:17:41 user nova-compute[95467]: node.session.initial_login_retry_max = 8
Nov 15 08:17:41 user nova-compute[95467]: node.session.xmit_thread_priority = -20
Nov 15 08:17:41 user nova-compute[95467]: node.session.cmds_max = 128
Nov 15 08:17:41 user nova-compute[95467]: node.session.queue_depth = 32
Nov 15 08:17:41 user nova-compute[95467]: node.session.nr_sessions = 1
Nov 15 08:17:41 user nova-compute[95467]: node.session.auth.authmethod = CHAP
Nov 15 08:17:41 user nova-compute[95467]: node.session.auth.username = IFUhnXyo
Nov 15 08:17:41 user nova-compute[95467]: node.session.auth.password = ***
Nov 15 08:17:41 user nova-compute[95467]: node.session.auth.username_in = <empty>
Nov 15 08:17:41 user nova-compute[95467]: node.session.auth.password_in = <empty>
Nov 15 08:17:41 user nova-compute[95467]: node.session.auth.chap_algs = MD5
Nov 15 08:17:41 user nova-compute[95467]: node.session.timeo.replacement_timeout = 120
Nov 15 08:17:41 user nova-compute[95467]: node.session.err_timeo.abort_timeout = 15
Nov 15 08:17:41 user nova-compute[95467]: node.session.err_timeo.lu_reset_timeout = 30
Nov 15 08:17:41 user nova-compute[95467]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 15 08:17:41 user nova-compute[95467]: node.session.err_timeo.host_reset_timeout = 60
Nov 15 08:17:41 user nova-compute[95467]: node.session.iscsi.FastAbort = Yes
Nov 15 08:17:41 user nova-compute[95467]: node.session.iscsi.InitialR2T = No
Nov 15 08:17:41 user nova-compute[95467]: node.session.iscsi.ImmediateData = Yes
Nov 15 08:17:41 user nova-compute[95467]: node.session.iscsi.FirstBurstLength = 262144
Nov 15 08:17:41 user nova-compute[95467]: node.session.iscsi.MaxBurstLength = 16776192
Nov 15 08:17:41 user nova-compute[95467]: node.session.iscsi.DefaultTime2Retain = 0
Nov 15 08:17:41 user nova-compute[95467]: node.session.iscsi.DefaultTime2Wait = 2
Nov 15 08:17:41 user nova-compute[95467]: node.session.iscsi.MaxConnections = 1
Nov 15 08:17:41 user nova-compute[95467]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 15 08:17:41 user nova-compute[95467]: node.session.iscsi.ERL = 0
Nov 15 08:17:41 user nova-compute[95467]: node.session.scan = manual
Nov 15 08:17:41 user nova-compute[95467]: node.session.reopen_max = 0
Nov 15 08:17:41 user nova-compute[95467]: node.conn[0].address = 172.16.0.220
Nov 15 08:17:41 user nova-compute[95467]: node.conn[0].port = 3260
Nov 15 08:17:41 user nova-compute[95467]: node.conn[0].startup = manual
Nov 15 08:17:41 user nova-compute[95467]: node.conn[0].tcp.window_size = 524288
Nov 15 08:17:41 user nova-compute[95467]: node.conn[0].tcp.type_of_service = 0
Nov 15 08:17:41 user nova-compute[95467]: node.conn[0].timeo.logout_timeout = 15
Nov 15 08:17:41 user nova-compute[95467]: node.conn[0].timeo.login_timeout = 15
Nov 15 08:17:41 user nova-compute[95467]: node.conn[0].timeo.auth_timeout = 45
Nov 15 08:17:41 user nova-compute[95467]: node.conn[0].timeo.noop_out_interval = 5
Nov 15 08:17:41 user nova-compute[95467]: node.conn[0].timeo.noop_out_timeout = 5
Nov 15 08:17:41 user nova-compute[95467]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 15 08:17:41 user nova-compute[95467]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 15 08:17:41 user nova-compute[95467]: node.conn[0].iscsi.HeaderDigest = None
Nov 15 08:17:41 user nova-compute[95467]: node.conn[0].iscsi.DataDigest = None
Nov 15 08:17:41 user nova-compute[95467]: node.conn[0].iscsi.IFMarker = No
Nov 15 08:17:41 user nova-compute[95467]: node.conn[0].iscsi.OFMarker = No
Nov 15 08:17:41 user nova-compute[95467]: # END RECORD
Nov 15 08:17:41 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b88c20-6b11-49f2-b51b-31399f301a57]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[93146904-19c1-479b-9113-24e3ce5f96c8]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IFUhnXyo {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IFUhnXyo" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce59cba-2ceb-427d-ab03-b987ec6d5a48]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IFUhnXyo'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9cc918e-c3f3-4318-b475-adb1b9d32289]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39327fa-6d83-43ce-beb3-ec13043e8126]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 (non-flash)
Nov 15 08:17:41 user nova-compute[95467]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:17:41 user nova-compute[95467]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)
Nov 15 08:17:41 user nova-compute[95467]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 (non-flash)
Nov 15 08:17:41 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 (non-flash)
Nov 15 08:17:41 user nova-compute[95467]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:17:41 user nova-compute[95467]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)
Nov 15 08:17:41 user nova-compute[95467]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 (non-flash)
Nov 15 08:17:41 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.146s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Connected to 172.16.0.220:3260 {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] HCTL ('37', '0', '0', 0) found on session 24 with lun 0 {{(pid=95467) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=95467) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.013s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[aebac8c3-c1de-4ef9-975b-e312fff35110]: (4, ('0 0 0', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Searching for a device in session 24 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IFUhnXyo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.168s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] <== connect_volume: return (169ms) {'type': 'block', 'scsi_wwn': '23136353063663338', 'path': '/dev/sdf'} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23136353063663338', 'path': '/dev/sdf'} {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:13:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1122164487',display_name='tempest-ServerStableDeviceRescueTest-server-1122164487',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1122164487',id=18,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC73Es7i1dvV3LCl2zYhULAGR03vami/IaiKmQSVJ68TybZ572m0/Ot5YFz5r9uOo9phDDYCr9s7SvGnvG3a6hG2FKLwECxJAhXmm41agKdBv9qR6a3hPpbXRn0iKH8nfg==',key_name='tempest-keypair-1738856651',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:13:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b6f7599b8526444a8276cac35f0a1500',ramdisk_id='',reservation_id='r-1fnevzzw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1999795038',owner_user_name='tempest-ServerStableDeviceRescueTest-1999795038-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:15:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd652210088a41839fcca0be41322dad',uuid=bee31898-4f12-4c68-a18b-a678f9f584aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eea925f5-c956-40d3-99a5-b45573318378", "address": "fa:16:3e:b4:e9:ab", "network": {"id": "dcbc2304-8d20-4589-b81e-a75a22ef7114", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-333949369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-333949369-network", "vif_mac": "fa:16:3e:b4:e9:ab"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6f7599b8526444a8276cac35f0a1500", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeea925f5-c9", "ovs_interfaceid": "eea925f5-c956-40d3-99a5-b45573318378", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Converting VIF {"id": "eea925f5-c956-40d3-99a5-b45573318378", "address": "fa:16:3e:b4:e9:ab", "network": {"id": "dcbc2304-8d20-4589-b81e-a75a22ef7114", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-333949369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-333949369-network", "vif_mac": "fa:16:3e:b4:e9:ab"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6f7599b8526444a8276cac35f0a1500", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeea925f5-c9", "ovs_interfaceid": "eea925f5-c956-40d3-99a5-b45573318378", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:e9:ab,bridge_name='br-int',has_traffic_filtering=True,id=eea925f5-c956-40d3-99a5-b45573318378,network=Network(dcbc2304-8d20-4589-b81e-a75a22ef7114),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeea925f5-c9') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG nova.objects.instance [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Lazy-loading 'pci_devices' on Instance uuid bee31898-4f12-4c68-a18b-a678f9f584aa {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG nova.objects.base [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Object Instance<bee31898-4f12-4c68-a18b-a678f9f584aa> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=95467) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:17:41 user nova-compute[95467]:   <uuid>bee31898-4f12-4c68-a18b-a678f9f584aa</uuid>
Nov 15 08:17:41 user nova-compute[95467]:   <name>instance-00000012</name>
Nov 15 08:17:41 user nova-compute[95467]:   <memory>524288</memory>
Nov 15 08:17:41 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:17:41 user nova-compute[95467]:   <metadata>
Nov 15 08:17:41 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:17:41 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:17:41 user nova-compute[95467]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1122164487</nova:name>
Nov 15 08:17:41 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:17:41</nova:creationTime>
Nov 15 08:17:41 user nova-compute[95467]:       <nova:flavor name="m1.tiny">
Nov 15 08:17:41 user nova-compute[95467]:         <nova:memory>512</nova:memory>
Nov 15 08:17:41 user nova-compute[95467]:         <nova:disk>1</nova:disk>
Nov 15 08:17:41 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:17:41 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:17:41 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:17:41 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:17:41 user nova-compute[95467]:       <nova:owner>
Nov 15 08:17:41 user nova-compute[95467]:         <nova:user uuid="fd652210088a41839fcca0be41322dad">tempest-ServerStableDeviceRescueTest-1999795038-project-member</nova:user>
Nov 15 08:17:41 user nova-compute[95467]:         <nova:project uuid="b6f7599b8526444a8276cac35f0a1500">tempest-ServerStableDeviceRescueTest-1999795038</nova:project>
Nov 15 08:17:41 user nova-compute[95467]:       </nova:owner>
Nov 15 08:17:41 user nova-compute[95467]:       <nova:root type="image" uuid="ed9c48aa-ce73-4b3b-9db1-235898be671b"/>
Nov 15 08:17:41 user nova-compute[95467]:       <nova:ports>
Nov 15 08:17:41 user nova-compute[95467]:         <nova:port uuid="eea925f5-c956-40d3-99a5-b45573318378">
Nov 15 08:17:41 user nova-compute[95467]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 08:17:41 user nova-compute[95467]:         </nova:port>
Nov 15 08:17:41 user nova-compute[95467]:       </nova:ports>
Nov 15 08:17:41 user nova-compute[95467]:     </nova:instance>
Nov 15 08:17:41 user nova-compute[95467]:   </metadata>
Nov 15 08:17:41 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:17:41 user nova-compute[95467]:     <system>
Nov 15 08:17:41 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:17:41 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:17:41 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:17:41 user nova-compute[95467]:       <entry name="serial">bee31898-4f12-4c68-a18b-a678f9f584aa</entry>
Nov 15 08:17:41 user nova-compute[95467]:       <entry name="uuid">bee31898-4f12-4c68-a18b-a678f9f584aa</entry>
Nov 15 08:17:41 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:17:41 user nova-compute[95467]:     </system>
Nov 15 08:17:41 user nova-compute[95467]:   </sysinfo>
Nov 15 08:17:41 user nova-compute[95467]:   <os>
Nov 15 08:17:41 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:17:41 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:17:41 user nova-compute[95467]:   </os>
Nov 15 08:17:41 user nova-compute[95467]:   <features>
Nov 15 08:17:41 user nova-compute[95467]:     <acpi/>
Nov 15 08:17:41 user nova-compute[95467]:     <apic/>
Nov 15 08:17:41 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:17:41 user nova-compute[95467]:   </features>
Nov 15 08:17:41 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:17:41 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:17:41 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:17:41 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:17:41 user nova-compute[95467]:   </clock>
Nov 15 08:17:41 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:17:41 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:17:41 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:17:41 user nova-compute[95467]:   </cpu>
Nov 15 08:17:41 user nova-compute[95467]:   <devices>
Nov 15 08:17:41 user nova-compute[95467]:     <disk type="file" device="disk">
Nov 15 08:17:41 user nova-compute[95467]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 08:17:41 user nova-compute[95467]:       <source file="/opt/stack/data/nova/instances/bee31898-4f12-4c68-a18b-a678f9f584aa/disk"/>
Nov 15 08:17:41 user nova-compute[95467]:       <target dev="vda" bus="virtio"/>
Nov 15 08:17:41 user nova-compute[95467]:     </disk>
Nov 15 08:17:41 user nova-compute[95467]:     <disk type="block" device="disk">
Nov 15 08:17:41 user nova-compute[95467]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:17:41 user nova-compute[95467]:       <source dev="/dev/sdf"/>
Nov 15 08:17:41 user nova-compute[95467]:       <target dev="vdb" bus="virtio"/>
Nov 15 08:17:41 user nova-compute[95467]:       <serial>37d2cbbd-2252-4dbb-b8c7-f8e74995fb81</serial>
Nov 15 08:17:41 user nova-compute[95467]:     </disk>
Nov 15 08:17:41 user nova-compute[95467]:     <disk type="file" device="disk">
Nov 15 08:17:41 user nova-compute[95467]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 08:17:41 user nova-compute[95467]:       <source file="/opt/stack/data/nova/instances/bee31898-4f12-4c68-a18b-a678f9f584aa/disk.rescue"/>
Nov 15 08:17:41 user nova-compute[95467]:       <target dev="vdc" bus="virtio"/>
Nov 15 08:17:41 user nova-compute[95467]:       <boot order="1"/>
Nov 15 08:17:41 user nova-compute[95467]:     </disk>
Nov 15 08:17:41 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:17:41 user nova-compute[95467]:       <mac address="fa:16:3e:b4:e9:ab"/>
Nov 15 08:17:41 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:17:41 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:17:41 user nova-compute[95467]:       <target dev="tapeea925f5-c9"/>
Nov 15 08:17:41 user nova-compute[95467]:     </interface>
Nov 15 08:17:41 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:17:41 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/bee31898-4f12-4c68-a18b-a678f9f584aa/console.log" append="off"/>
Nov 15 08:17:41 user nova-compute[95467]:     </serial>
Nov 15 08:17:41 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:17:41 user nova-compute[95467]:     <video>
Nov 15 08:17:41 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:17:41 user nova-compute[95467]:     </video>
Nov 15 08:17:41 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:17:41 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:17:41 user nova-compute[95467]:     </rng>
Nov 15 08:17:41 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:17:41 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:17:41 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:17:41 user nova-compute[95467]:     </memballoon>
Nov 15 08:17:41 user nova-compute[95467]:   </devices>
Nov 15 08:17:41 user nova-compute[95467]: </domain>
Nov 15 08:17:41 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:17:41 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Instance destroyed successfully.
Nov 15 08:17:41 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] No BDM found with device name vdb, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] No BDM found with device name vdc, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] No VIF found with MAC fa:16:3e:b4:e9:ab, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager.update_available_resource {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:17:41 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Auditing locally available compute resources for user (node: user) {{(pid=95467) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 08:17:42 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:42 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:42 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:42 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:42 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:42 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:43 user nova-compute[95467]: DEBUG nova.compute.manager [req-357ee6f6-8b84-4bc7-9b64-71f251c532b6 req-4af482ba-1d7b-4ed8-a369-2056cdf610c7 service nova] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Received event network-vif-plugged-eea925f5-c956-40d3-99a5-b45573318378 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:17:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-357ee6f6-8b84-4bc7-9b64-71f251c532b6 req-4af482ba-1d7b-4ed8-a369-2056cdf610c7 service nova] Acquiring lock "bee31898-4f12-4c68-a18b-a678f9f584aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:17:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-357ee6f6-8b84-4bc7-9b64-71f251c532b6 req-4af482ba-1d7b-4ed8-a369-2056cdf610c7 service nova] Lock "bee31898-4f12-4c68-a18b-a678f9f584aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:17:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-357ee6f6-8b84-4bc7-9b64-71f251c532b6 req-4af482ba-1d7b-4ed8-a369-2056cdf610c7 service nova] Lock "bee31898-4f12-4c68-a18b-a678f9f584aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:17:43 user nova-compute[95467]: DEBUG nova.compute.manager [req-357ee6f6-8b84-4bc7-9b64-71f251c532b6 req-4af482ba-1d7b-4ed8-a369-2056cdf610c7 service nova] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] No waiting events found dispatching network-vif-plugged-eea925f5-c956-40d3-99a5-b45573318378 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:17:43 user nova-compute[95467]: WARNING nova.compute.manager [req-357ee6f6-8b84-4bc7-9b64-71f251c532b6 req-4af482ba-1d7b-4ed8-a369-2056cdf610c7 service nova] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Received unexpected event network-vif-plugged-eea925f5-c956-40d3-99a5-b45573318378 for instance with vm_state active and task_state rescuing.
Nov 15 08:17:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:43 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:17:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3711c883-ec5f-4a09-88f8-d4c0668ae570/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3711c883-ec5f-4a09-88f8-d4c0668ae570/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3711c883-ec5f-4a09-88f8-d4c0668ae570/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3711c883-ec5f-4a09-88f8-d4c0668ae570/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:44 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:17:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bee31898-4f12-4c68-a18b-a678f9f584aa/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bee31898-4f12-4c68-a18b-a678f9f584aa/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bee31898-4f12-4c68-a18b-a678f9f584aa/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bee31898-4f12-4c68-a18b-a678f9f584aa/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:44 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:17:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bee31898-4f12-4c68-a18b-a678f9f584aa/disk.rescue --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bee31898-4f12-4c68-a18b-a678f9f584aa/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bee31898-4f12-4c68-a18b-a678f9f584aa/disk.rescue --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:45 user nova-compute[95467]: DEBUG nova.compute.manager [req-fb73cd56-725a-4e4b-b6d6-2bf537953ebe req-0f662336-a1d6-41be-bcd0-8c4a3ba467dd service nova] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Received event network-vif-plugged-eea925f5-c956-40d3-99a5-b45573318378 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:17:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-fb73cd56-725a-4e4b-b6d6-2bf537953ebe req-0f662336-a1d6-41be-bcd0-8c4a3ba467dd service nova] Acquiring lock "bee31898-4f12-4c68-a18b-a678f9f584aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:17:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-fb73cd56-725a-4e4b-b6d6-2bf537953ebe req-0f662336-a1d6-41be-bcd0-8c4a3ba467dd service nova] Lock "bee31898-4f12-4c68-a18b-a678f9f584aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:17:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-fb73cd56-725a-4e4b-b6d6-2bf537953ebe req-0f662336-a1d6-41be-bcd0-8c4a3ba467dd service nova] Lock "bee31898-4f12-4c68-a18b-a678f9f584aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:17:45 user nova-compute[95467]: DEBUG nova.compute.manager [req-fb73cd56-725a-4e4b-b6d6-2bf537953ebe req-0f662336-a1d6-41be-bcd0-8c4a3ba467dd service nova] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] No waiting events found dispatching network-vif-plugged-eea925f5-c956-40d3-99a5-b45573318378 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:17:45 user nova-compute[95467]: WARNING nova.compute.manager [req-fb73cd56-725a-4e4b-b6d6-2bf537953ebe req-0f662336-a1d6-41be-bcd0-8c4a3ba467dd service nova] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Received unexpected event network-vif-plugged-eea925f5-c956-40d3-99a5-b45573318378 for instance with vm_state active and task_state rescuing.
Nov 15 08:17:45 user nova-compute[95467]: DEBUG nova.compute.manager [None req-dd2e2674-aebe-4a2c-931d-51153a70154c tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:17:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bee31898-4f12-4c68-a18b-a678f9f584aa/disk.rescue --force-share --output=json" returned: 0 in 0.212s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2765af98-917a-4f0f-95af-3393e0d50a52/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2765af98-917a-4f0f-95af-3393e0d50a52/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2765af98-917a-4f0f-95af-3393e0d50a52/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2765af98-917a-4f0f-95af-3393e0d50a52/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10968e11-51b2-46a4-87a5-bb85f938f489/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:46 user nova-compute[95467]: INFO nova.compute.manager [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Rescuing
Nov 15 08:17:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Acquiring lock "refresh_cache-3825a691-ac5c-4c06-b4a4-2a0b40c638c4" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:17:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Acquired lock "refresh_cache-3825a691-ac5c-4c06-b4a4-2a0b40c638c4" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:17:46 user nova-compute[95467]: DEBUG nova.network.neutron [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:17:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10968e11-51b2-46a4-87a5-bb85f938f489/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10968e11-51b2-46a4-87a5-bb85f938f489/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10968e11-51b2-46a4-87a5-bb85f938f489/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk.rescue --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk.rescue --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:46 user nova-compute[95467]: DEBUG nova.network.neutron [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Updating instance_info_cache with network_info: [{"id": "3fddc7dd-48af-4964-bc1a-a54623453f62", "address": "fa:16:3e:c6:49:ac", "network": {"id": "ac9a381d-25fe-4419-b151-f03333413813", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1183680999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34d65a8000347feb2b3966b7ce0d785", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fddc7dd-48", "ovs_interfaceid": "3fddc7dd-48af-4964-bc1a-a54623453f62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:17:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Releasing lock "refresh_cache-3825a691-ac5c-4c06-b4a4-2a0b40c638c4" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:17:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:47 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:47 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:47 user nova-compute[95467]: DEBUG nova.compute.manager [req-02289b70-fa7d-4936-ae21-40a4def1b4e0 req-52dcc072-4374-42f2-a9a6-bb0e4ee38fa0 service nova] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Received event network-vif-unplugged-3fddc7dd-48af-4964-bc1a-a54623453f62 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:17:47 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-02289b70-fa7d-4936-ae21-40a4def1b4e0 req-52dcc072-4374-42f2-a9a6-bb0e4ee38fa0 service nova] Acquiring lock "3825a691-ac5c-4c06-b4a4-2a0b40c638c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:17:47 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-02289b70-fa7d-4936-ae21-40a4def1b4e0 req-52dcc072-4374-42f2-a9a6-bb0e4ee38fa0 service nova] Lock "3825a691-ac5c-4c06-b4a4-2a0b40c638c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:17:47 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-02289b70-fa7d-4936-ae21-40a4def1b4e0 req-52dcc072-4374-42f2-a9a6-bb0e4ee38fa0 service nova] Lock "3825a691-ac5c-4c06-b4a4-2a0b40c638c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:17:47 user nova-compute[95467]: DEBUG nova.compute.manager [req-02289b70-fa7d-4936-ae21-40a4def1b4e0 req-52dcc072-4374-42f2-a9a6-bb0e4ee38fa0 service nova] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] No waiting events found dispatching network-vif-unplugged-3fddc7dd-48af-4964-bc1a-a54623453f62 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:17:47 user nova-compute[95467]: WARNING nova.compute.manager [req-02289b70-fa7d-4936-ae21-40a4def1b4e0 req-52dcc072-4374-42f2-a9a6-bb0e4ee38fa0 service nova] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Received unexpected event network-vif-unplugged-3fddc7dd-48af-4964-bc1a-a54623453f62 for instance with vm_state active and task_state rescuing.
Nov 15 08:17:47 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:47 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:47 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2aa477-6786-483a-b088-d8ec204fe6aa/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:47 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Instance destroyed successfully.
Nov 15 08:17:47 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Attempting a stable device rescue
Nov 15 08:17:47 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=95467) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 08:17:47 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Instance directory exists: not creating {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 08:17:47 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Creating image(s)
Nov 15 08:17:47 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Acquiring lock "/opt/stack/data/nova/instances/3825a691-ac5c-4c06-b4a4-2a0b40c638c4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:17:47 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "/opt/stack/data/nova/instances/3825a691-ac5c-4c06-b4a4-2a0b40c638c4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:17:47 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "/opt/stack/data/nova/instances/3825a691-ac5c-4c06-b4a4-2a0b40c638c4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:17:47 user nova-compute[95467]: DEBUG nova.objects.instance [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3825a691-ac5c-4c06-b4a4-2a0b40c638c4 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:17:47 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Acquiring lock "c1041976da7a9681b9314cc7dafbcbef8130d952" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:17:47 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "c1041976da7a9681b9314cc7dafbcbef8130d952" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:17:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2aa477-6786-483a-b088-d8ec204fe6aa/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2aa477-6786-483a-b088-d8ec204fe6aa/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1041976da7a9681b9314cc7dafbcbef8130d952.part --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:48 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:48 user nova-compute[95467]: DEBUG nova.compute.manager [req-a080a1a8-f051-4b2d-a2e8-25fff7d25e36 req-fb01154e-bb04-4647-9bc8-77ec3c11fb75 service nova] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] Received event network-changed-4ec7d55d-9178-4dbc-8c24-d3ecf46398bc {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:17:48 user nova-compute[95467]: DEBUG nova.compute.manager [req-a080a1a8-f051-4b2d-a2e8-25fff7d25e36 req-fb01154e-bb04-4647-9bc8-77ec3c11fb75 service nova] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] Refreshing instance network info cache due to event network-changed-4ec7d55d-9178-4dbc-8c24-d3ecf46398bc. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:17:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-a080a1a8-f051-4b2d-a2e8-25fff7d25e36 req-fb01154e-bb04-4647-9bc8-77ec3c11fb75 service nova] Acquiring lock "refresh_cache-10968e11-51b2-46a4-87a5-bb85f938f489" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:17:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-a080a1a8-f051-4b2d-a2e8-25fff7d25e36 req-fb01154e-bb04-4647-9bc8-77ec3c11fb75 service nova] Acquired lock "refresh_cache-10968e11-51b2-46a4-87a5-bb85f938f489" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:17:48 user nova-compute[95467]: DEBUG nova.network.neutron [req-a080a1a8-f051-4b2d-a2e8-25fff7d25e36 req-fb01154e-bb04-4647-9bc8-77ec3c11fb75 service nova] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] Refreshing network info cache for port 4ec7d55d-9178-4dbc-8c24-d3ecf46398bc {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:17:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2aa477-6786-483a-b088-d8ec204fe6aa/disk --force-share --output=json" returned: 0 in 1.010s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3fa51bf7-b9a1-492d-a316-96338238052d tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Acquiring lock "10968e11-51b2-46a4-87a5-bb85f938f489" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:17:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3fa51bf7-b9a1-492d-a316-96338238052d tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lock "10968e11-51b2-46a4-87a5-bb85f938f489" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:17:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7805e5c-1777-4b0c-95c7-b232be66528c/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:48 user nova-compute[95467]: DEBUG nova.objects.instance [None req-3fa51bf7-b9a1-492d-a316-96338238052d tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lazy-loading 'flavor' on Instance uuid 10968e11-51b2-46a4-87a5-bb85f938f489 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:17:48 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-3fa51bf7-b9a1-492d-a316-96338238052d tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] Ignoring supplied device name: /dev/vdb
Nov 15 08:17:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3fa51bf7-b9a1-492d-a316-96338238052d tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lock "10968e11-51b2-46a4-87a5-bb85f938f489" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.115s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:17:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1041976da7a9681b9314cc7dafbcbef8130d952.part --force-share --output=json" returned: 0 in 0.222s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:48 user nova-compute[95467]: DEBUG nova.virt.images [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] dc045f4f-191a-4ec7-be96-200c9e80ae60 was qcow2, converting to raw {{(pid=95467) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 08:17:48 user nova-compute[95467]: DEBUG nova.privsep.utils [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=95467) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 08:17:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c1041976da7a9681b9314cc7dafbcbef8130d952.part /opt/stack/data/nova/instances/_base/c1041976da7a9681b9314cc7dafbcbef8130d952.converted {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7805e5c-1777-4b0c-95c7-b232be66528c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7805e5c-1777-4b0c-95c7-b232be66528c/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7805e5c-1777-4b0c-95c7-b232be66528c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:49 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:17:49 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3fa51bf7-b9a1-492d-a316-96338238052d tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Acquiring lock "10968e11-51b2-46a4-87a5-bb85f938f489" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:17:49 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3fa51bf7-b9a1-492d-a316-96338238052d tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lock "10968e11-51b2-46a4-87a5-bb85f938f489" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:17:49 user nova-compute[95467]: INFO nova.compute.manager [None req-3fa51bf7-b9a1-492d-a316-96338238052d tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] Attaching volume 2d9a1fe3-4aeb-41c3-a14d-493360b49f14 to /dev/vdb
Nov 15 08:17:49 user nova-compute[95467]: DEBUG os_brick.utils [None req-3fa51bf7-b9a1-492d-a316-96338238052d tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:17:49 user nova-compute[95467]: DEBUG nova.network.neutron [req-a080a1a8-f051-4b2d-a2e8-25fff7d25e36 req-fb01154e-bb04-4647-9bc8-77ec3c11fb75 service nova] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] Updated VIF entry in instance network info cache for port 4ec7d55d-9178-4dbc-8c24-d3ecf46398bc. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:17:49 user nova-compute[95467]: DEBUG nova.network.neutron [req-a080a1a8-f051-4b2d-a2e8-25fff7d25e36 req-fb01154e-bb04-4647-9bc8-77ec3c11fb75 service nova] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] Updating instance_info_cache with network_info: [{"id": "4ec7d55d-9178-4dbc-8c24-d3ecf46398bc", "address": "fa:16:3e:89:59:c1", "network": {"id": "8220309c-e09f-4c20-8f74-abdf4688fe64", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-160547739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b1fa68347914efe87ae8edd3901e11a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ec7d55d-91", "ovs_interfaceid": "4ec7d55d-9178-4dbc-8c24-d3ecf46398bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:17:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c1041976da7a9681b9314cc7dafbcbef8130d952.part /opt/stack/data/nova/instances/_base/c1041976da7a9681b9314cc7dafbcbef8130d952.converted" returned: 0 in 0.764s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:49 user nova-compute[95467]: DEBUG nova.compute.manager [req-36e1edc5-6de6-4a05-8f9f-1520025b4c97 req-f03ca672-919c-4d43-9b00-b59c98037479 service nova] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Received event network-vif-plugged-3fddc7dd-48af-4964-bc1a-a54623453f62 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:17:49 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-36e1edc5-6de6-4a05-8f9f-1520025b4c97 req-f03ca672-919c-4d43-9b00-b59c98037479 service nova] Acquiring lock "3825a691-ac5c-4c06-b4a4-2a0b40c638c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:17:49 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-36e1edc5-6de6-4a05-8f9f-1520025b4c97 req-f03ca672-919c-4d43-9b00-b59c98037479 service nova] Lock "3825a691-ac5c-4c06-b4a4-2a0b40c638c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:17:49 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-36e1edc5-6de6-4a05-8f9f-1520025b4c97 req-f03ca672-919c-4d43-9b00-b59c98037479 service nova] Lock "3825a691-ac5c-4c06-b4a4-2a0b40c638c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:17:49 user nova-compute[95467]: DEBUG nova.compute.manager [req-36e1edc5-6de6-4a05-8f9f-1520025b4c97 req-f03ca672-919c-4d43-9b00-b59c98037479 service nova] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] No waiting events found dispatching network-vif-plugged-3fddc7dd-48af-4964-bc1a-a54623453f62 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:17:49 user nova-compute[95467]: WARNING nova.compute.manager [req-36e1edc5-6de6-4a05-8f9f-1520025b4c97 req-f03ca672-919c-4d43-9b00-b59c98037479 service nova] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Received unexpected event network-vif-plugged-3fddc7dd-48af-4964-bc1a-a54623453f62 for instance with vm_state active and task_state rescuing.
Nov 15 08:17:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1041976da7a9681b9314cc7dafbcbef8130d952.converted --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:49 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d434c777-e780-4558-84c6-bfdcecc39048]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:882ae90641f\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:17:49 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-a080a1a8-f051-4b2d-a2e8-25fff7d25e36 req-fb01154e-bb04-4647-9bc8-77ec3c11fb75 service nova] Releasing lock "refresh_cache-10968e11-51b2-46a4-87a5-bb85f938f489" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:17:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:49 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:17:49 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:17:49 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Hypervisor/Node resource view: name=user free_ram=7171MB free_disk=25.14419937133789GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=95467) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 08:17:49 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:17:49 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:17:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:49 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbea81cb-2048-4482-89be-247c25809785]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:17:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:49 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[debd4440-d0f2-4c2a-af66-5907a9f4091f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:17:49 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb53f698-15be-497b-b926-488d389c3f62]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:17:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3fa51bf7-b9a1-492d-a316-96338238052d tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Running cmd (subprocess): nvme version {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3fa51bf7-b9a1-492d-a316-96338238052d tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] 'nvme version' failed. Not Retrying. {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:17:49 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3fa51bf7-b9a1-492d-a316-96338238052d tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] nvme not present on system {{(pid=95467) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 08:17:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:17:49 user nova-compute[95467]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 08:17:49 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4d34ad-9270-4195-8c92-94640961d97e]: (4, '') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:17:49 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-3fa51bf7-b9a1-492d-a316-96338238052d tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=95467) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 08:17:49 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-3fa51bf7-b9a1-492d-a316-96338238052d tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 08:17:49 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-3fa51bf7-b9a1-492d-a316-96338238052d tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] LIGHTOS: no hostnqn found. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 08:17:49 user nova-compute[95467]: DEBUG os_brick.utils [None req-3fa51bf7-b9a1-492d-a316-96338238052d tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] <== get_connector_properties: return (206ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:882ae90641f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:17:49 user nova-compute[95467]: DEBUG nova.virt.block_device [None req-3fa51bf7-b9a1-492d-a316-96338238052d tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] Updating existing volume attachment record: 62775479-c665-4d3c-9e6b-fbd7e0492e77 {{(pid=95467) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 08:17:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1041976da7a9681b9314cc7dafbcbef8130d952.converted --force-share --output=json" returned: 0 in 0.193s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:49 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "c1041976da7a9681b9314cc7dafbcbef8130d952" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.167s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:17:49 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Acquiring lock "c1041976da7a9681b9314cc7dafbcbef8130d952" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:17:49 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "c1041976da7a9681b9314cc7dafbcbef8130d952" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:17:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1041976da7a9681b9314cc7dafbcbef8130d952 --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:49 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance ee2aa477-6786-483a-b088-d8ec204fe6aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:17:49 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 73fe8852-c47a-47ab-a56f-6864c8ed5479 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:17:49 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 21cf2ada-b15c-490d-ac37-96e9c87e9056 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:17:49 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 3711c883-ec5f-4a09-88f8-d4c0668ae570 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:17:49 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance bee31898-4f12-4c68-a18b-a678f9f584aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:17:49 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:17:49 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 10d73b73-ca65-4192-8954-288dc1df9f24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:17:49 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 3825a691-ac5c-4c06-b4a4-2a0b40c638c4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:17:49 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 10968e11-51b2-46a4-87a5-bb85f938f489 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:17:49 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 2765af98-917a-4f0f-95af-3393e0d50a52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:17:49 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 851d354c-7f20-4e72-bfd2-a781b929e8ba actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:17:49 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance e7805e5c-1777-4b0c-95c7-b232be66528c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:17:49 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 08:17:49 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 08:17:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1041976da7a9681b9314cc7dafbcbef8130d952 --force-share --output=json" returned: 0 in 0.192s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1041976da7a9681b9314cc7dafbcbef8130d952,backing_fmt=raw /opt/stack/data/nova/instances/3825a691-ac5c-4c06-b4a4-2a0b40c638c4/disk.rescue {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1041976da7a9681b9314cc7dafbcbef8130d952,backing_fmt=raw /opt/stack/data/nova/instances/3825a691-ac5c-4c06-b4a4-2a0b40c638c4/disk.rescue" returned: 0 in 0.058s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "c1041976da7a9681b9314cc7dafbcbef8130d952" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG nova.objects.instance [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lazy-loading 'migration_context' on Instance uuid 3825a691-ac5c-4c06-b4a4-2a0b40c638c4 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG nova.objects.base [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Object Instance<3825a691-ac5c-4c06-b4a4-2a0b40c638c4> lazy-loaded attributes: trusted_certs,migration_context {{(pid=95467) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Created local disks {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Start _get_guest_xml network_info=[{"id": "3fddc7dd-48af-4964-bc1a-a54623453f62", "address": "fa:16:3e:c6:49:ac", "network": {"id": "ac9a381d-25fe-4419-b151-f03333413813", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1183680999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1183680999-network", "vif_mac": "fa:16:3e:c6:49:ac"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34d65a8000347feb2b3966b7ce0d785", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fddc7dd-48", "ovs_interfaceid": "3fddc7dd-48af-4964-bc1a-a54623453f62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'dc045f4f-191a-4ec7-be96-200c9e80ae60', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '99d3e8d0-ffed-4b42-a370-625b29836bc1', 'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HFkTLjDm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '3825a691-ac5c-4c06-b4a4-2a0b40c638c4', 'attached_at': '', 'detached_at': '', 'volume_id': 'b3089133-4789-4c57-b24a-05d2c0ac013e', 'serial': 'b3089133-4789-4c57-b24a-05d2c0ac013e'}, 'volume_type': None} {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG nova.objects.instance [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lazy-loading 'resources' on Instance uuid 3825a691-ac5c-4c06-b4a4-2a0b40c638c4 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG nova.objects.base [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Object Instance<3825a691-ac5c-4c06-b4a4-2a0b40c638c4> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=95467) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG nova.objects.instance [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lazy-loading 'numa_topology' on Instance uuid 3825a691-ac5c-4c06-b4a4-2a0b40c638c4 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG nova.objects.base [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Object Instance<3825a691-ac5c-4c06-b4a4-2a0b40c638c4> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=95467) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 08:17:50 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:17:50 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:17:50 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG nova.objects.instance [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3825a691-ac5c-4c06-b4a4-2a0b40c638c4 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG nova.objects.base [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Object Instance<3825a691-ac5c-4c06-b4a4-2a0b40c638c4> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=95467) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Calling os-brick to attach iSCSI Volume {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HFkTLjDm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:17:50 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:17:50 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:17:50 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:17:50 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:17:50 user nova-compute[95467]: INFO os_brick.initiator.connectors.iscsi [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 08:17:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e -p 172.16.0.220:3260 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[e449bb19-3780-4036-a92c-f39fb23ffae7]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = HFkTLjDm\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 15 08:17:50 user nova-compute[95467]: node.name = iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e
Nov 15 08:17:50 user nova-compute[95467]: node.tpgt = -1
Nov 15 08:17:50 user nova-compute[95467]: node.startup = automatic
Nov 15 08:17:50 user nova-compute[95467]: node.leading_login = No
Nov 15 08:17:50 user nova-compute[95467]: iface.iscsi_ifacename = default
Nov 15 08:17:50 user nova-compute[95467]: iface.net_ifacename = <empty>
Nov 15 08:17:50 user nova-compute[95467]: iface.ipaddress = <empty>
Nov 15 08:17:50 user nova-compute[95467]: iface.prefix_len = 0
Nov 15 08:17:50 user nova-compute[95467]: iface.hwaddress = <empty>
Nov 15 08:17:50 user nova-compute[95467]: iface.transport_name = tcp
Nov 15 08:17:50 user nova-compute[95467]: iface.initiatorname = <empty>
Nov 15 08:17:50 user nova-compute[95467]: iface.state = <empty>
Nov 15 08:17:50 user nova-compute[95467]: iface.vlan_id = 0
Nov 15 08:17:50 user nova-compute[95467]: iface.vlan_priority = 0
Nov 15 08:17:50 user nova-compute[95467]: iface.vlan_state = <empty>
Nov 15 08:17:50 user nova-compute[95467]: iface.iface_num = 0
Nov 15 08:17:50 user nova-compute[95467]: iface.mtu = 0
Nov 15 08:17:50 user nova-compute[95467]: iface.port = 0
Nov 15 08:17:50 user nova-compute[95467]: iface.bootproto = <empty>
Nov 15 08:17:50 user nova-compute[95467]: iface.subnet_mask = <empty>
Nov 15 08:17:50 user nova-compute[95467]: iface.gateway = <empty>
Nov 15 08:17:50 user nova-compute[95467]: iface.dhcp_alt_client_id_state = <empty>
Nov 15 08:17:50 user nova-compute[95467]: iface.dhcp_alt_client_id = <empty>
Nov 15 08:17:50 user nova-compute[95467]: iface.dhcp_dns = <empty>
Nov 15 08:17:50 user nova-compute[95467]: iface.dhcp_learn_iqn = <empty>
Nov 15 08:17:50 user nova-compute[95467]: iface.dhcp_req_vendor_id_state = <empty>
Nov 15 08:17:50 user nova-compute[95467]: iface.dhcp_vendor_id_state = <empty>
Nov 15 08:17:50 user nova-compute[95467]: iface.dhcp_vendor_id = <empty>
Nov 15 08:17:50 user nova-compute[95467]: iface.dhcp_slp_da = <empty>
Nov 15 08:17:50 user nova-compute[95467]: iface.fragmentation = <empty>
Nov 15 08:17:50 user nova-compute[95467]: iface.gratuitous_arp = <empty>
Nov 15 08:17:50 user nova-compute[95467]: iface.incoming_forwarding = <empty>
Nov 15 08:17:50 user nova-compute[95467]: iface.tos_state = <empty>
Nov 15 08:17:50 user nova-compute[95467]: iface.tos = 0
Nov 15 08:17:50 user nova-compute[95467]: iface.ttl = 0
Nov 15 08:17:50 user nova-compute[95467]: iface.delayed_ack = <empty>
Nov 15 08:17:50 user nova-compute[95467]: iface.tcp_nagle = <empty>
Nov 15 08:17:50 user nova-compute[95467]: iface.tcp_wsf_state = <empty>
Nov 15 08:17:50 user nova-compute[95467]: iface.tcp_wsf = 0
Nov 15 08:17:50 user nova-compute[95467]: iface.tcp_timer_scale = 0
Nov 15 08:17:50 user nova-compute[95467]: iface.tcp_timestamp = <empty>
Nov 15 08:17:50 user nova-compute[95467]: iface.redirect = <empty>
Nov 15 08:17:50 user nova-compute[95467]: iface.def_task_mgmt_timeout = 0
Nov 15 08:17:50 user nova-compute[95467]: iface.header_digest = <empty>
Nov 15 08:17:50 user nova-compute[95467]: iface.data_digest = <empty>
Nov 15 08:17:50 user nova-compute[95467]: iface.immediate_data = <empty>
Nov 15 08:17:50 user nova-compute[95467]: iface.initial_r2t = <empty>
Nov 15 08:17:50 user nova-compute[95467]: iface.data_seq_inorder = <empty>
Nov 15 08:17:50 user nova-compute[95467]: iface.data_pdu_inorder = <empty>
Nov 15 08:17:50 user nova-compute[95467]: iface.erl = 0
Nov 15 08:17:50 user nova-compute[95467]: iface.max_receive_data_len = 0
Nov 15 08:17:50 user nova-compute[95467]: iface.first_burst_len = 0
Nov 15 08:17:50 user nova-compute[95467]: iface.max_outstanding_r2t = 0
Nov 15 08:17:50 user nova-compute[95467]: iface.max_burst_len = 0
Nov 15 08:17:50 user nova-compute[95467]: iface.chap_auth = <empty>
Nov 15 08:17:50 user nova-compute[95467]: iface.bidi_chap = <empty>
Nov 15 08:17:50 user nova-compute[95467]: iface.strict_login_compliance = <empty>
Nov 15 08:17:50 user nova-compute[95467]: iface.discovery_auth = <empty>
Nov 15 08:17:50 user nova-compute[95467]: iface.discovery_logout = <empty>
Nov 15 08:17:50 user nova-compute[95467]: node.discovery_address = <empty>
Nov 15 08:17:50 user nova-compute[95467]: node.discovery_port = 0
Nov 15 08:17:50 user nova-compute[95467]: node.discovery_type = static
Nov 15 08:17:50 user nova-compute[95467]: node.session.initial_cmdsn = 0
Nov 15 08:17:50 user nova-compute[95467]: node.session.initial_login_retry_max = 8
Nov 15 08:17:50 user nova-compute[95467]: node.session.xmit_thread_priority = -20
Nov 15 08:17:50 user nova-compute[95467]: node.session.cmds_max = 128
Nov 15 08:17:50 user nova-compute[95467]: node.session.queue_depth = 32
Nov 15 08:17:50 user nova-compute[95467]: node.session.nr_sessions = 1
Nov 15 08:17:50 user nova-compute[95467]: node.session.auth.authmethod = CHAP
Nov 15 08:17:50 user nova-compute[95467]: node.session.auth.username = HFkTLjDm
Nov 15 08:17:50 user nova-compute[95467]: node.session.auth.password = ***
Nov 15 08:17:50 user nova-compute[95467]: node.session.auth.username_in = <empty>
Nov 15 08:17:50 user nova-compute[95467]: node.session.auth.password_in = <empty>
Nov 15 08:17:50 user nova-compute[95467]: node.session.auth.chap_algs = MD5
Nov 15 08:17:50 user nova-compute[95467]: node.session.timeo.replacement_timeout = 120
Nov 15 08:17:50 user nova-compute[95467]: node.session.err_timeo.abort_timeout = 15
Nov 15 08:17:50 user nova-compute[95467]: node.session.err_timeo.lu_reset_timeout = 30
Nov 15 08:17:50 user nova-compute[95467]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 15 08:17:50 user nova-compute[95467]: node.session.err_timeo.host_reset_timeout = 60
Nov 15 08:17:50 user nova-compute[95467]: node.session.iscsi.FastAbort = Yes
Nov 15 08:17:50 user nova-compute[95467]: node.session.iscsi.InitialR2T = No
Nov 15 08:17:50 user nova-compute[95467]: node.session.iscsi.ImmediateData = Yes
Nov 15 08:17:50 user nova-compute[95467]: node.session.iscsi.FirstBurstLength = 262144
Nov 15 08:17:50 user nova-compute[95467]: node.session.iscsi.MaxBurstLength = 16776192
Nov 15 08:17:50 user nova-compute[95467]: node.session.iscsi.DefaultTime2Retain = 0
Nov 15 08:17:50 user nova-compute[95467]: node.session.iscsi.DefaultTime2Wait = 2
Nov 15 08:17:50 user nova-compute[95467]: node.session.iscsi.MaxConnections = 1
Nov 15 08:17:50 user nova-compute[95467]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 15 08:17:50 user nova-compute[95467]: node.session.iscsi.ERL = 0
Nov 15 08:17:50 user nova-compute[95467]: node.session.scan = manual
Nov 15 08:17:50 user nova-compute[95467]: node.session.reopen_max = 0
Nov 15 08:17:50 user nova-compute[95467]: node.conn[0].address = 172.16.0.220
Nov 15 08:17:50 user nova-compute[95467]: node.conn[0].port = 3260
Nov 15 08:17:50 user nova-compute[95467]: node.conn[0].startup = manual
Nov 15 08:17:50 user nova-compute[95467]: node.conn[0].tcp.window_size = 524288
Nov 15 08:17:50 user nova-compute[95467]: node.conn[0].tcp.type_of_service = 0
Nov 15 08:17:50 user nova-compute[95467]: node.conn[0].timeo.logout_timeout = 15
Nov 15 08:17:50 user nova-compute[95467]: node.conn[0].timeo.login_timeout = 15
Nov 15 08:17:50 user nova-compute[95467]: node.conn[0].timeo.auth_timeout = 45
Nov 15 08:17:50 user nova-compute[95467]: node.conn[0].timeo.noop_out_interval = 5
Nov 15 08:17:50 user nova-compute[95467]: node.conn[0].timeo.noop_out_timeout = 5
Nov 15 08:17:50 user nova-compute[95467]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 15 08:17:50 user nova-compute[95467]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 15 08:17:50 user nova-compute[95467]: node.conn[0].iscsi.HeaderDigest = None
Nov 15 08:17:50 user nova-compute[95467]: node.conn[0].iscsi.DataDigest = None
Nov 15 08:17:50 user nova-compute[95467]: node.conn[0].iscsi.IFMarker = No
Nov 15 08:17:50 user nova-compute[95467]: node.conn[0].iscsi.OFMarker = No
Nov 15 08:17:50 user nova-compute[95467]: # END RECORD
Nov 15 08:17:50 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb11ced-6c58-47c8-b98d-62eff116ec20]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a3509e-bb05-4792-88a8-d38b52f89aab]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HFkTLjDm {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HFkTLjDm" returned: 0 in 0.024s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc068dc-d4aa-47a2-907a-ef6e76a30db1]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HFkTLjDm'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e71d595-ec6c-474f-9d14-8651016e97ff]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09dee88-b23d-45c3-913c-5fbf9075c4b9]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 (non-flash)
Nov 15 08:17:50 user nova-compute[95467]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:17:50 user nova-compute[95467]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)
Nov 15 08:17:50 user nova-compute[95467]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 (non-flash)
Nov 15 08:17:50 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 (non-flash)
Nov 15 08:17:50 user nova-compute[95467]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:17:50 user nova-compute[95467]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)
Nov 15 08:17:50 user nova-compute[95467]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 (non-flash)
Nov 15 08:17:50 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.179s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Connected to 172.16.0.220:3260 {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] HCTL ('33', '0', '0', 0) found on session 20 with lun 0 {{(pid=95467) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=95467) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.014s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e668f2a-487a-4656-909b-c0bb5d0f61e0]: (4, ('0 0 0', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Searching for a device in session 20 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HFkTLjDm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.206s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] <== connect_volume: return (209ms) {'type': 'block', 'scsi_wwn': '23338656630333839', 'path': '/dev/sdb'} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23338656630333839', 'path': '/dev/sdb'} {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Compute_service record updated for user:user {{(pid=95467) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.766s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:15:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-483246753',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-483246753',id=24,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:16:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c34d65a8000347feb2b3966b7ce0d785',ramdisk_id='',reservation_id='r-qiiyu7bw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1903830225',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:16:12Z,user_data=None,user_id='6971581ab2604353aeb0c45c5252b4fb',uuid=3825a691-ac5c-4c06-b4a4-2a0b40c638c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3fddc7dd-48af-4964-bc1a-a54623453f62", "address": "fa:16:3e:c6:49:ac", "network": {"id": "ac9a381d-25fe-4419-b151-f03333413813", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1183680999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1183680999-network", "vif_mac": "fa:16:3e:c6:49:ac"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34d65a8000347feb2b3966b7ce0d785", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fddc7dd-48", "ovs_interfaceid": "3fddc7dd-48af-4964-bc1a-a54623453f62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Converting VIF {"id": "3fddc7dd-48af-4964-bc1a-a54623453f62", "address": "fa:16:3e:c6:49:ac", "network": {"id": "ac9a381d-25fe-4419-b151-f03333413813", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1183680999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1183680999-network", "vif_mac": "fa:16:3e:c6:49:ac"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34d65a8000347feb2b3966b7ce0d785", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fddc7dd-48", "ovs_interfaceid": "3fddc7dd-48af-4964-bc1a-a54623453f62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:49:ac,bridge_name='br-int',has_traffic_filtering=True,id=3fddc7dd-48af-4964-bc1a-a54623453f62,network=Network(ac9a381d-25fe-4419-b151-f03333413813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fddc7dd-48') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG nova.objects.instance [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lazy-loading 'pci_devices' on Instance uuid 3825a691-ac5c-4c06-b4a4-2a0b40c638c4 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG nova.objects.base [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Object Instance<3825a691-ac5c-4c06-b4a4-2a0b40c638c4> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=95467) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:17:50 user nova-compute[95467]:   <uuid>3825a691-ac5c-4c06-b4a4-2a0b40c638c4</uuid>
Nov 15 08:17:50 user nova-compute[95467]:   <name>instance-00000018</name>
Nov 15 08:17:50 user nova-compute[95467]:   <memory>524288</memory>
Nov 15 08:17:50 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:17:50 user nova-compute[95467]:   <metadata>
Nov 15 08:17:50 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:17:50 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:17:50 user nova-compute[95467]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-483246753</nova:name>
Nov 15 08:17:50 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:17:50</nova:creationTime>
Nov 15 08:17:50 user nova-compute[95467]:       <nova:flavor name="m1.tiny">
Nov 15 08:17:50 user nova-compute[95467]:         <nova:memory>512</nova:memory>
Nov 15 08:17:50 user nova-compute[95467]:         <nova:disk>1</nova:disk>
Nov 15 08:17:50 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:17:50 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:17:50 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:17:50 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:17:50 user nova-compute[95467]:       <nova:owner>
Nov 15 08:17:50 user nova-compute[95467]:         <nova:user uuid="6971581ab2604353aeb0c45c5252b4fb">tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member</nova:user>
Nov 15 08:17:50 user nova-compute[95467]:         <nova:project uuid="c34d65a8000347feb2b3966b7ce0d785">tempest-ServerBootFromVolumeStableRescueTest-1903830225</nova:project>
Nov 15 08:17:50 user nova-compute[95467]:       </nova:owner>
Nov 15 08:17:50 user nova-compute[95467]:       <nova:root type="image" uuid="ed9c48aa-ce73-4b3b-9db1-235898be671b"/>
Nov 15 08:17:50 user nova-compute[95467]:       <nova:ports>
Nov 15 08:17:50 user nova-compute[95467]:         <nova:port uuid="3fddc7dd-48af-4964-bc1a-a54623453f62">
Nov 15 08:17:50 user nova-compute[95467]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 08:17:50 user nova-compute[95467]:         </nova:port>
Nov 15 08:17:50 user nova-compute[95467]:       </nova:ports>
Nov 15 08:17:50 user nova-compute[95467]:     </nova:instance>
Nov 15 08:17:50 user nova-compute[95467]:   </metadata>
Nov 15 08:17:50 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:17:50 user nova-compute[95467]:     <system>
Nov 15 08:17:50 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:17:50 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:17:50 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:17:50 user nova-compute[95467]:       <entry name="serial">3825a691-ac5c-4c06-b4a4-2a0b40c638c4</entry>
Nov 15 08:17:50 user nova-compute[95467]:       <entry name="uuid">3825a691-ac5c-4c06-b4a4-2a0b40c638c4</entry>
Nov 15 08:17:50 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:17:50 user nova-compute[95467]:     </system>
Nov 15 08:17:50 user nova-compute[95467]:   </sysinfo>
Nov 15 08:17:50 user nova-compute[95467]:   <os>
Nov 15 08:17:50 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:17:50 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:17:50 user nova-compute[95467]:   </os>
Nov 15 08:17:50 user nova-compute[95467]:   <features>
Nov 15 08:17:50 user nova-compute[95467]:     <acpi/>
Nov 15 08:17:50 user nova-compute[95467]:     <apic/>
Nov 15 08:17:50 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:17:50 user nova-compute[95467]:   </features>
Nov 15 08:17:50 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:17:50 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:17:50 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:17:50 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:17:50 user nova-compute[95467]:   </clock>
Nov 15 08:17:50 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:17:50 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:17:50 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:17:50 user nova-compute[95467]:   </cpu>
Nov 15 08:17:50 user nova-compute[95467]:   <devices>
Nov 15 08:17:50 user nova-compute[95467]:     <disk type="block" device="disk">
Nov 15 08:17:50 user nova-compute[95467]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:17:50 user nova-compute[95467]:       <source dev="/dev/sdb"/>
Nov 15 08:17:50 user nova-compute[95467]:       <target dev="vda" bus="virtio"/>
Nov 15 08:17:50 user nova-compute[95467]:       <serial>b3089133-4789-4c57-b24a-05d2c0ac013e</serial>
Nov 15 08:17:50 user nova-compute[95467]:     </disk>
Nov 15 08:17:50 user nova-compute[95467]:     <disk type="file" device="disk">
Nov 15 08:17:50 user nova-compute[95467]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 08:17:50 user nova-compute[95467]:       <source file="/opt/stack/data/nova/instances/3825a691-ac5c-4c06-b4a4-2a0b40c638c4/disk.rescue"/>
Nov 15 08:17:50 user nova-compute[95467]:       <target dev="vdb" bus="virtio"/>
Nov 15 08:17:50 user nova-compute[95467]:       <boot order="1"/>
Nov 15 08:17:50 user nova-compute[95467]:     </disk>
Nov 15 08:17:50 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:17:50 user nova-compute[95467]:       <mac address="fa:16:3e:c6:49:ac"/>
Nov 15 08:17:50 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:17:50 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:17:50 user nova-compute[95467]:       <target dev="tap3fddc7dd-48"/>
Nov 15 08:17:50 user nova-compute[95467]:     </interface>
Nov 15 08:17:50 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:17:50 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/3825a691-ac5c-4c06-b4a4-2a0b40c638c4/console.log" append="off"/>
Nov 15 08:17:50 user nova-compute[95467]:     </serial>
Nov 15 08:17:50 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:17:50 user nova-compute[95467]:     <video>
Nov 15 08:17:50 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:17:50 user nova-compute[95467]:     </video>
Nov 15 08:17:50 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:17:50 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:17:50 user nova-compute[95467]:     </rng>
Nov 15 08:17:50 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:17:50 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:17:50 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:17:50 user nova-compute[95467]:     </memballoon>
Nov 15 08:17:50 user nova-compute[95467]:   </devices>
Nov 15 08:17:50 user nova-compute[95467]: </domain>
Nov 15 08:17:50 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:17:50 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Instance destroyed successfully.
Nov 15 08:17:50 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] No BDM found with device name vdb, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:17:50 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] No VIF found with MAC fa:16:3e:c6:49:ac, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:17:51 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:17:51 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:17:51 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Starting heal instance info cache {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 08:17:51 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Rebuilding the list of instances to heal {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 08:17:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "refresh_cache-ee2aa477-6786-483a-b088-d8ec204fe6aa" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:17:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquired lock "refresh_cache-ee2aa477-6786-483a-b088-d8ec204fe6aa" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:17:51 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: ee2aa477-6786-483a-b088-d8ec204fe6aa] Forcefully refreshing network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 08:17:51 user nova-compute[95467]: DEBUG nova.objects.instance [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lazy-loading 'info_cache' on Instance uuid ee2aa477-6786-483a-b088-d8ec204fe6aa {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:17:51 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:51 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:51 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:52 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:52 user nova-compute[95467]: DEBUG nova.compute.manager [req-81847775-ff8d-48ba-888b-c3b583a0e4c6 req-4fbc490f-d548-45a1-8c40-36c5da569ce2 service nova] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Received event network-vif-plugged-3fddc7dd-48af-4964-bc1a-a54623453f62 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:17:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-81847775-ff8d-48ba-888b-c3b583a0e4c6 req-4fbc490f-d548-45a1-8c40-36c5da569ce2 service nova] Acquiring lock "3825a691-ac5c-4c06-b4a4-2a0b40c638c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:17:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-81847775-ff8d-48ba-888b-c3b583a0e4c6 req-4fbc490f-d548-45a1-8c40-36c5da569ce2 service nova] Lock "3825a691-ac5c-4c06-b4a4-2a0b40c638c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:17:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-81847775-ff8d-48ba-888b-c3b583a0e4c6 req-4fbc490f-d548-45a1-8c40-36c5da569ce2 service nova] Lock "3825a691-ac5c-4c06-b4a4-2a0b40c638c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:17:52 user nova-compute[95467]: DEBUG nova.compute.manager [req-81847775-ff8d-48ba-888b-c3b583a0e4c6 req-4fbc490f-d548-45a1-8c40-36c5da569ce2 service nova] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] No waiting events found dispatching network-vif-plugged-3fddc7dd-48af-4964-bc1a-a54623453f62 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:17:52 user nova-compute[95467]: WARNING nova.compute.manager [req-81847775-ff8d-48ba-888b-c3b583a0e4c6 req-4fbc490f-d548-45a1-8c40-36c5da569ce2 service nova] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Received unexpected event network-vif-plugged-3fddc7dd-48af-4964-bc1a-a54623453f62 for instance with vm_state active and task_state rescuing.
Nov 15 08:17:52 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:52 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:52 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:52 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: ee2aa477-6786-483a-b088-d8ec204fe6aa] Updating instance_info_cache with network_info: [{"id": "5e362799-1ab1-48d5-9ef2-1a90ce83cd80", "address": "fa:16:3e:2e:62:d2", "network": {"id": "9fc550b3-b517-4f14-93cd-f1c2866d1b29", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1976605572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1312e86f799549eb8adb4c846576262c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e362799-1a", "ovs_interfaceid": "5e362799-1ab1-48d5-9ef2-1a90ce83cd80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:17:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Releasing lock "refresh_cache-ee2aa477-6786-483a-b088-d8ec204fe6aa" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:17:52 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: ee2aa477-6786-483a-b088-d8ec204fe6aa] Updated the network info_cache for instance {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 08:17:52 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:17:52 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:17:52 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:17:52 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:17:54 user nova-compute[95467]: DEBUG nova.compute.manager [None req-a583ec52-4fb6-44fc-b42c-943adc124f12 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:17:54 user nova-compute[95467]: DEBUG nova.compute.manager [req-776689e4-5715-43f5-9779-0ff261b5acb6 req-69ed22b4-9055-4daa-99fc-236e432dc75d service nova] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Received event network-vif-plugged-3fddc7dd-48af-4964-bc1a-a54623453f62 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:17:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-776689e4-5715-43f5-9779-0ff261b5acb6 req-69ed22b4-9055-4daa-99fc-236e432dc75d service nova] Acquiring lock "3825a691-ac5c-4c06-b4a4-2a0b40c638c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:17:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-776689e4-5715-43f5-9779-0ff261b5acb6 req-69ed22b4-9055-4daa-99fc-236e432dc75d service nova] Lock "3825a691-ac5c-4c06-b4a4-2a0b40c638c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:17:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-776689e4-5715-43f5-9779-0ff261b5acb6 req-69ed22b4-9055-4daa-99fc-236e432dc75d service nova] Lock "3825a691-ac5c-4c06-b4a4-2a0b40c638c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:17:54 user nova-compute[95467]: DEBUG nova.compute.manager [req-776689e4-5715-43f5-9779-0ff261b5acb6 req-69ed22b4-9055-4daa-99fc-236e432dc75d service nova] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] No waiting events found dispatching network-vif-plugged-3fddc7dd-48af-4964-bc1a-a54623453f62 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:17:54 user nova-compute[95467]: WARNING nova.compute.manager [req-776689e4-5715-43f5-9779-0ff261b5acb6 req-69ed22b4-9055-4daa-99fc-236e432dc75d service nova] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Received unexpected event network-vif-plugged-3fddc7dd-48af-4964-bc1a-a54623453f62 for instance with vm_state active and task_state rescuing.
Nov 15 08:17:55 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fa51bf7-b9a1-492d-a316-96338238052d tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] Calling os-brick to attach iSCSI Volume {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 08:17:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa51bf7-b9a1-492d-a316-96338238052d tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2d9a1fe3-4aeb-41c3-a14d-493360b49f14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dFxViQLz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:17:55 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-3fa51bf7-b9a1-492d-a316-96338238052d tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:17:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-3fa51bf7-b9a1-492d-a316-96338238052d tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:17:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-3fa51bf7-b9a1-492d-a316-96338238052d tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:17:55 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-3fa51bf7-b9a1-492d-a316-96338238052d tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:17:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-3fa51bf7-b9a1-492d-a316-96338238052d tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d9a1fe3-4aeb-41c3-a14d-493360b49f14" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:17:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-3fa51bf7-b9a1-492d-a316-96338238052d tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d9a1fe3-4aeb-41c3-a14d-493360b49f14" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:17:55 user nova-compute[95467]: INFO os_brick.initiator.connectors.iscsi [None req-3fa51bf7-b9a1-492d-a316-96338238052d tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 08:17:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d9a1fe3-4aeb-41c3-a14d-493360b49f14 -p 172.16.0.220:3260 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d9a1fe3-4aeb-41c3-a14d-493360b49f14 -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:55 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c7f617-1850-4b33-806a-ec82fd8adc74]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:17:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa51bf7-b9a1-492d-a316-96338238052d tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 08:17:55 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:17:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d9a1fe3-4aeb-41c3-a14d-493360b49f14 -p 172.16.0.220:3260 --interface default --op new {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d9a1fe3-4aeb-41c3-a14d-493360b49f14 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:55 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bddec17-eeea-4b6d-8b83-b9b93deef0f2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d9a1fe3-4aeb-41c3-a14d-493360b49f14] added\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:17:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa51bf7-b9a1-492d-a316-96338238052d tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d9a1fe3-4aeb-41c3-a14d-493360b49f14] added
Nov 15 08:17:55 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:17:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d9a1fe3-4aeb-41c3-a14d-493360b49f14 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d9a1fe3-4aeb-41c3-a14d-493360b49f14 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:55 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c18257a2-e6ff-4e7f-8f17-603e87b11f20]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:17:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa51bf7-b9a1-492d-a316-96338238052d tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:17:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d9a1fe3-4aeb-41c3-a14d-493360b49f14 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d9a1fe3-4aeb-41c3-a14d-493360b49f14 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:55 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8483cac-37d6-4977-afde-877b539d06a2]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:17:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa51bf7-b9a1-492d-a316-96338238052d tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:17:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d9a1fe3-4aeb-41c3-a14d-493360b49f14 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dFxViQLz {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d9a1fe3-4aeb-41c3-a14d-493360b49f14 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dFxViQLz" returned: 0 in 0.022s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:55 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[4779c627-441f-4f9a-b80a-40e0f5a0a50b]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:17:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa51bf7-b9a1-492d-a316-96338238052d tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dFxViQLz'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:17:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d9a1fe3-4aeb-41c3-a14d-493360b49f14 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d9a1fe3-4aeb-41c3-a14d-493360b49f14 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:55 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e4daf3-5abd-4088-88d8-fabef060c677]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:17:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa51bf7-b9a1-492d-a316-96338238052d tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:17:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:55 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2f4a3a-adc4-4078-9dad-3d6939bfde80]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:17:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa51bf7-b9a1-492d-a316-96338238052d tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 (non-flash)
Nov 15 08:17:55 user nova-compute[95467]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:17:55 user nova-compute[95467]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)
Nov 15 08:17:55 user nova-compute[95467]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 (non-flash)
Nov 15 08:17:55 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:17:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa51bf7-b9a1-492d-a316-96338238052d tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 (non-flash)
Nov 15 08:17:55 user nova-compute[95467]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:17:55 user nova-compute[95467]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)
Nov 15 08:17:55 user nova-compute[95467]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 (non-flash)
Nov 15 08:17:55 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:17:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d9a1fe3-4aeb-41c3-a14d-493360b49f14 -p 172.16.0.220:3260 --login {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d9a1fe3-4aeb-41c3-a14d-493360b49f14 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:55 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f62df4-2cb4-4dc5-bc39-9df0590dd36d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d9a1fe3-4aeb-41c3-a14d-493360b49f14, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2d9a1fe3-4aeb-41c3-a14d-493360b49f14, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:17:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa51bf7-b9a1-492d-a316-96338238052d tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d9a1fe3-4aeb-41c3-a14d-493360b49f14, portal: 172.16.0.220,3260]
Nov 15 08:17:55 user nova-compute[95467]: Login to [iface: default, target: iqn.2010-10.org.openstack:2d9a1fe3-4aeb-41c3-a14d-493360b49f14, portal: 172.16.0.220,3260] successful.
Nov 15 08:17:55 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:17:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d9a1fe3-4aeb-41c3-a14d-493360b49f14 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d9a1fe3-4aeb-41c3-a14d-493360b49f14 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:55 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f74772-fd50-4416-be5f-54ceddeaa7b6]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:17:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa51bf7-b9a1-492d-a316-96338238052d tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:17:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:55 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e50e4b-5735-42d3-a77a-62fd5db16349]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d9a1fe3-4aeb-41c3-a14d-493360b49f14 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:17:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa51bf7-b9a1-492d-a316-96338238052d tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 (non-flash)
Nov 15 08:17:55 user nova-compute[95467]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:17:55 user nova-compute[95467]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)
Nov 15 08:17:55 user nova-compute[95467]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 (non-flash)
Nov 15 08:17:55 user nova-compute[95467]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d9a1fe3-4aeb-41c3-a14d-493360b49f14 (non-flash)
Nov 15 08:17:55 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:17:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa51bf7-b9a1-492d-a316-96338238052d tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 (non-flash)
Nov 15 08:17:55 user nova-compute[95467]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:17:55 user nova-compute[95467]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)
Nov 15 08:17:55 user nova-compute[95467]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 (non-flash)
Nov 15 08:17:55 user nova-compute[95467]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d9a1fe3-4aeb-41c3-a14d-493360b49f14 (non-flash)
Nov 15 08:17:55 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:17:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-3fa51bf7-b9a1-492d-a316-96338238052d tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d9a1fe3-4aeb-41c3-a14d-493360b49f14" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.357s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:17:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa51bf7-b9a1-492d-a316-96338238052d tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Connected to 172.16.0.220:3260 {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 08:17:55 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-3fa51bf7-b9a1-492d-a316-96338238052d tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] HCTL ('35', '-', '-', 0) found on session 25 with lun 0 {{(pid=95467) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 08:17:55 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-3fa51bf7-b9a1-492d-a316-96338238052d tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=95467) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 08:17:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:17:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:17:55 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[23780899-c1bc-497f-a07a-fc75345b5a2b]: (4, ('- - 0', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:17:55 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-3fa51bf7-b9a1-492d-a316-96338238052d tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Searching for a device in session 25 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:17:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa51bf7-b9a1-492d-a316-96338238052d tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:2d9a1fe3-4aeb-41c3-a14d-493360b49f14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dFxViQLz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 08:17:56 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-3fa51bf7-b9a1-492d-a316-96338238052d tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.402s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:17:56 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa51bf7-b9a1-492d-a316-96338238052d tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] <== connect_volume: return (1403ms) {'type': 'block', 'scsi_wwn': '23239356465383230', 'path': '/dev/sdd'} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:17:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fa51bf7-b9a1-492d-a316-96338238052d tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23239356465383230', 'path': '/dev/sdd'} {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 08:17:56 user nova-compute[95467]: DEBUG nova.objects.instance [None req-3fa51bf7-b9a1-492d-a316-96338238052d tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lazy-loading 'flavor' on Instance uuid 10968e11-51b2-46a4-87a5-bb85f938f489 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:17:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-3fa51bf7-b9a1-492d-a316-96338238052d tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 08:17:56 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:17:56 user nova-compute[95467]:   <source dev="/dev/sdd"/>
Nov 15 08:17:56 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:17:56 user nova-compute[95467]:   <serial>2d9a1fe3-4aeb-41c3-a14d-493360b49f14</serial>
Nov 15 08:17:56 user nova-compute[95467]: </disk>
Nov 15 08:17:56 user nova-compute[95467]:  {{(pid=95467) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 08:17:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3fa51bf7-b9a1-492d-a316-96338238052d tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:17:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3fa51bf7-b9a1-492d-a316-96338238052d tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] No BDM found with device name vdb, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:17:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3fa51bf7-b9a1-492d-a316-96338238052d tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] No VIF found with MAC fa:16:3e:89:59:c1, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:17:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3fa51bf7-b9a1-492d-a316-96338238052d tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lock "10968e11-51b2-46a4-87a5-bb85f938f489" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.026s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:17:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:17:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:18:01 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:18:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:18:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:18:07 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:18:07 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:18:07 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:18:10 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:18:11 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-ff09b995-b6b3-4236-97be-24be09274ae4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Acquiring lock "10968e11-51b2-46a4-87a5-bb85f938f489" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:18:11 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-ff09b995-b6b3-4236-97be-24be09274ae4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lock "10968e11-51b2-46a4-87a5-bb85f938f489" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:18:11 user nova-compute[95467]: INFO nova.compute.manager [None req-ff09b995-b6b3-4236-97be-24be09274ae4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] Detaching volume 2d9a1fe3-4aeb-41c3-a14d-493360b49f14
Nov 15 08:18:11 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e69a581c-fc6f-4eea-a92d-0a4f3149d806 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Acquiring lock "10968e11-51b2-46a4-87a5-bb85f938f489" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:18:11 user nova-compute[95467]: INFO nova.virt.block_device [None req-ff09b995-b6b3-4236-97be-24be09274ae4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] Attempting to driver detach volume 2d9a1fe3-4aeb-41c3-a14d-493360b49f14 from mountpoint /dev/vdb
Nov 15 08:18:11 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-ff09b995-b6b3-4236-97be-24be09274ae4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Attempting to detach device vdb from instance 10968e11-51b2-46a4-87a5-bb85f938f489 from the persistent domain config. {{(pid=95467) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 08:18:11 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-ff09b995-b6b3-4236-97be-24be09274ae4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 08:18:11 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:18:11 user nova-compute[95467]:   <source dev="/dev/sdd"/>
Nov 15 08:18:11 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:18:11 user nova-compute[95467]:   <serial>2d9a1fe3-4aeb-41c3-a14d-493360b49f14</serial>
Nov 15 08:18:11 user nova-compute[95467]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 08:18:11 user nova-compute[95467]: </disk>
Nov 15 08:18:11 user nova-compute[95467]:  {{(pid=95467) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 08:18:11 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-ff09b995-b6b3-4236-97be-24be09274ae4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Successfully detached device vdb from instance 10968e11-51b2-46a4-87a5-bb85f938f489 from the persistent domain config.
Nov 15 08:18:11 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-ff09b995-b6b3-4236-97be-24be09274ae4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 10968e11-51b2-46a4-87a5-bb85f938f489 from the live domain config. {{(pid=95467) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 08:18:11 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-ff09b995-b6b3-4236-97be-24be09274ae4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 08:18:11 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:18:11 user nova-compute[95467]:   <source dev="/dev/sdd"/>
Nov 15 08:18:11 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:18:11 user nova-compute[95467]:   <serial>2d9a1fe3-4aeb-41c3-a14d-493360b49f14</serial>
Nov 15 08:18:11 user nova-compute[95467]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 08:18:11 user nova-compute[95467]: </disk>
Nov 15 08:18:11 user nova-compute[95467]:  {{(pid=95467) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 08:18:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:18:12 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-ff09b995-b6b3-4236-97be-24be09274ae4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 10968e11-51b2-46a4-87a5-bb85f938f489 {{(pid=95467) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 08:18:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:18:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:18:14 user nova-compute[95467]: DEBUG nova.compute.manager [req-38badda5-0b8e-4961-92c6-7a82892fa2c0 req-1ee2f5be-ba27-45ad-a4a2-414be034b997 service nova] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] Received event network-changed-1033bb03-0ef8-48ae-9006-240ec7ab4d63 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:18:14 user nova-compute[95467]: DEBUG nova.compute.manager [req-38badda5-0b8e-4961-92c6-7a82892fa2c0 req-1ee2f5be-ba27-45ad-a4a2-414be034b997 service nova] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] Refreshing instance network info cache due to event network-changed-1033bb03-0ef8-48ae-9006-240ec7ab4d63. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:18:14 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-38badda5-0b8e-4961-92c6-7a82892fa2c0 req-1ee2f5be-ba27-45ad-a4a2-414be034b997 service nova] Acquiring lock "refresh_cache-2765af98-917a-4f0f-95af-3393e0d50a52" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:18:14 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-38badda5-0b8e-4961-92c6-7a82892fa2c0 req-1ee2f5be-ba27-45ad-a4a2-414be034b997 service nova] Acquired lock "refresh_cache-2765af98-917a-4f0f-95af-3393e0d50a52" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:18:14 user nova-compute[95467]: DEBUG nova.network.neutron [req-38badda5-0b8e-4961-92c6-7a82892fa2c0 req-1ee2f5be-ba27-45ad-a4a2-414be034b997 service nova] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] Refreshing network info cache for port 1033bb03-0ef8-48ae-9006-240ec7ab4d63 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:18:14 user nova-compute[95467]: DEBUG nova.network.neutron [req-38badda5-0b8e-4961-92c6-7a82892fa2c0 req-1ee2f5be-ba27-45ad-a4a2-414be034b997 service nova] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] Updated VIF entry in instance network info cache for port 1033bb03-0ef8-48ae-9006-240ec7ab4d63. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:18:14 user nova-compute[95467]: DEBUG nova.network.neutron [req-38badda5-0b8e-4961-92c6-7a82892fa2c0 req-1ee2f5be-ba27-45ad-a4a2-414be034b997 service nova] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] Updating instance_info_cache with network_info: [{"id": "1033bb03-0ef8-48ae-9006-240ec7ab4d63", "address": "fa:16:3e:4b:8a:91", "network": {"id": "27fd2b0f-65bd-4ae4-b5c8-dfca91668078", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1310727750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50e2fec6a90a41a5a586c6da227caacc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1033bb03-0e", "ovs_interfaceid": "1033bb03-0ef8-48ae-9006-240ec7ab4d63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:18:14 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-38badda5-0b8e-4961-92c6-7a82892fa2c0 req-1ee2f5be-ba27-45ad-a4a2-414be034b997 service nova] Releasing lock "refresh_cache-2765af98-917a-4f0f-95af-3393e0d50a52" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:18:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f9f5f174-8ea3-48d8-9e79-7c44276075f0 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Acquiring lock "2765af98-917a-4f0f-95af-3393e0d50a52" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:18:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f9f5f174-8ea3-48d8-9e79-7c44276075f0 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "2765af98-917a-4f0f-95af-3393e0d50a52" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:18:15 user nova-compute[95467]: DEBUG nova.objects.instance [None req-f9f5f174-8ea3-48d8-9e79-7c44276075f0 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lazy-loading 'flavor' on Instance uuid 2765af98-917a-4f0f-95af-3393e0d50a52 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:18:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f9f5f174-8ea3-48d8-9e79-7c44276075f0 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "2765af98-917a-4f0f-95af-3393e0d50a52" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:18:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f9f5f174-8ea3-48d8-9e79-7c44276075f0 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Acquiring lock "2765af98-917a-4f0f-95af-3393e0d50a52" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:18:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f9f5f174-8ea3-48d8-9e79-7c44276075f0 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "2765af98-917a-4f0f-95af-3393e0d50a52" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:18:15 user nova-compute[95467]: INFO nova.compute.manager [None req-f9f5f174-8ea3-48d8-9e79-7c44276075f0 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] Attaching volume be86dcd5-b5b8-45a5-84ee-f14d3baa8506 to /dev/vdb
Nov 15 08:18:16 user nova-compute[95467]: DEBUG os_brick.utils [None req-f9f5f174-8ea3-48d8-9e79-7c44276075f0 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:18:16 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:16 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:16 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb6a142-df20-46b6-aee8-c2f98fd67cf5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:882ae90641f\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:16 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:16 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:16 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d72b10-f28e-4dd1-ab6e-cedbe1ecbf9c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:16 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:16 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:16 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1517351-ee11-4dd9-a46f-72074ed49ca3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:16 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef26bb4d-f9b7-4176-8d32-32669b2944f5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:16 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-f9f5f174-8ea3-48d8-9e79-7c44276075f0 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Running cmd (subprocess): nvme version {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:16 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-f9f5f174-8ea3-48d8-9e79-7c44276075f0 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] 'nvme version' failed. Not Retrying. {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:18:16 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f9f5f174-8ea3-48d8-9e79-7c44276075f0 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] nvme not present on system {{(pid=95467) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 08:18:16 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:16 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:18:16 user nova-compute[95467]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 08:18:16 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[17934e6e-3ada-4380-a6e7-debe0e75dde6]: (4, '') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:16 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-f9f5f174-8ea3-48d8-9e79-7c44276075f0 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=95467) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 08:18:16 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-f9f5f174-8ea3-48d8-9e79-7c44276075f0 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 08:18:16 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-f9f5f174-8ea3-48d8-9e79-7c44276075f0 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] LIGHTOS: no hostnqn found. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 08:18:16 user nova-compute[95467]: DEBUG os_brick.utils [None req-f9f5f174-8ea3-48d8-9e79-7c44276075f0 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:882ae90641f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:18:16 user nova-compute[95467]: DEBUG nova.virt.block_device [None req-f9f5f174-8ea3-48d8-9e79-7c44276075f0 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] Updating existing volume attachment record: 0d54854d-a6f8-4164-b605-b1ed39795105 {{(pid=95467) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 08:18:16 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:18:17 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:18:17 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:18:21 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9f5f174-8ea3-48d8-9e79-7c44276075f0 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] Calling os-brick to attach iSCSI Volume {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 08:18:21 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f5f174-8ea3-48d8-9e79-7c44276075f0 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:be86dcd5-b5b8-45a5-84ee-f14d3baa8506', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EcUzKgVr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:18:21 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-f9f5f174-8ea3-48d8-9e79-7c44276075f0 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:18:21 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-f9f5f174-8ea3-48d8-9e79-7c44276075f0 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:18:21 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-f9f5f174-8ea3-48d8-9e79-7c44276075f0 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:18:21 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-f9f5f174-8ea3-48d8-9e79-7c44276075f0 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:18:21 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-f9f5f174-8ea3-48d8-9e79-7c44276075f0 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be86dcd5-b5b8-45a5-84ee-f14d3baa8506" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:18:21 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-f9f5f174-8ea3-48d8-9e79-7c44276075f0 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be86dcd5-b5b8-45a5-84ee-f14d3baa8506" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:18:21 user nova-compute[95467]: INFO os_brick.initiator.connectors.iscsi [None req-f9f5f174-8ea3-48d8-9e79-7c44276075f0 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 08:18:21 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be86dcd5-b5b8-45a5-84ee-f14d3baa8506 -p 172.16.0.220:3260 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:21 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be86dcd5-b5b8-45a5-84ee-f14d3baa8506 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:21 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[128b9fa1-aa72-4fa2-97f0-545f1fce746d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:21 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f5f174-8ea3-48d8-9e79-7c44276075f0 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 08:18:21 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:18:21 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be86dcd5-b5b8-45a5-84ee-f14d3baa8506 -p 172.16.0.220:3260 --interface default --op new {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:21 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be86dcd5-b5b8-45a5-84ee-f14d3baa8506 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:21 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd5edaa-e6c6-48b4-a6e9-e664561aee7c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be86dcd5-b5b8-45a5-84ee-f14d3baa8506] added\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:21 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f5f174-8ea3-48d8-9e79-7c44276075f0 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be86dcd5-b5b8-45a5-84ee-f14d3baa8506] added
Nov 15 08:18:21 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:18:21 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be86dcd5-b5b8-45a5-84ee-f14d3baa8506 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:21 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be86dcd5-b5b8-45a5-84ee-f14d3baa8506 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:21 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac017b91-5fa3-468d-a246-d356fc62c2b2]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:21 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f5f174-8ea3-48d8-9e79-7c44276075f0 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:18:21 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be86dcd5-b5b8-45a5-84ee-f14d3baa8506 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:21 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be86dcd5-b5b8-45a5-84ee-f14d3baa8506 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:21 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd5f12c-4089-4cf9-9bab-608e9f202cd9]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:21 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f5f174-8ea3-48d8-9e79-7c44276075f0 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:18:21 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be86dcd5-b5b8-45a5-84ee-f14d3baa8506 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EcUzKgVr {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:21 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be86dcd5-b5b8-45a5-84ee-f14d3baa8506 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EcUzKgVr" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:21 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f7b8c1-65ea-400c-8c44-355b59f77f53]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:21 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f5f174-8ea3-48d8-9e79-7c44276075f0 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EcUzKgVr'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:18:21 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be86dcd5-b5b8-45a5-84ee-f14d3baa8506 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:21 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be86dcd5-b5b8-45a5-84ee-f14d3baa8506 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:21 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c497d4-a0a9-40ae-ac3f-d70289e68d2c]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:21 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f5f174-8ea3-48d8-9e79-7c44276075f0 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:18:21 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:21 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:21 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42908ea-9ef2-457d-b90a-b0c732be19c0]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d9a1fe3-4aeb-41c3-a14d-493360b49f14 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:21 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f5f174-8ea3-48d8-9e79-7c44276075f0 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 (non-flash)
Nov 15 08:18:21 user nova-compute[95467]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:18:21 user nova-compute[95467]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)
Nov 15 08:18:21 user nova-compute[95467]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 (non-flash)
Nov 15 08:18:21 user nova-compute[95467]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d9a1fe3-4aeb-41c3-a14d-493360b49f14 (non-flash)
Nov 15 08:18:21 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:18:21 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f5f174-8ea3-48d8-9e79-7c44276075f0 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 (non-flash)
Nov 15 08:18:21 user nova-compute[95467]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:18:21 user nova-compute[95467]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)
Nov 15 08:18:21 user nova-compute[95467]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 (non-flash)
Nov 15 08:18:21 user nova-compute[95467]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d9a1fe3-4aeb-41c3-a14d-493360b49f14 (non-flash)
Nov 15 08:18:21 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:18:21 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be86dcd5-b5b8-45a5-84ee-f14d3baa8506 -p 172.16.0.220:3260 --login {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:21 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be86dcd5-b5b8-45a5-84ee-f14d3baa8506 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:21 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a8ef90-c37b-4cee-b7a6-ade36539a060]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:be86dcd5-b5b8-45a5-84ee-f14d3baa8506, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:be86dcd5-b5b8-45a5-84ee-f14d3baa8506, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:21 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f5f174-8ea3-48d8-9e79-7c44276075f0 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:be86dcd5-b5b8-45a5-84ee-f14d3baa8506, portal: 172.16.0.220,3260]
Nov 15 08:18:21 user nova-compute[95467]: Login to [iface: default, target: iqn.2010-10.org.openstack:be86dcd5-b5b8-45a5-84ee-f14d3baa8506, portal: 172.16.0.220,3260] successful.
Nov 15 08:18:21 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:18:21 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be86dcd5-b5b8-45a5-84ee-f14d3baa8506 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:21 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be86dcd5-b5b8-45a5-84ee-f14d3baa8506 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:21 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[69532f2a-1f20-4e09-86d8-855a0ee3c5c5]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:21 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f5f174-8ea3-48d8-9e79-7c44276075f0 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:18:21 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:21 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:21 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7be7764-db39-4241-926b-05f32dbf15e8]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d9a1fe3-4aeb-41c3-a14d-493360b49f14 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be86dcd5-b5b8-45a5-84ee-f14d3baa8506 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:21 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f5f174-8ea3-48d8-9e79-7c44276075f0 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 (non-flash)
Nov 15 08:18:21 user nova-compute[95467]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:18:21 user nova-compute[95467]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)
Nov 15 08:18:21 user nova-compute[95467]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 (non-flash)
Nov 15 08:18:21 user nova-compute[95467]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d9a1fe3-4aeb-41c3-a14d-493360b49f14 (non-flash)
Nov 15 08:18:21 user nova-compute[95467]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be86dcd5-b5b8-45a5-84ee-f14d3baa8506 (non-flash)
Nov 15 08:18:21 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:18:21 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f5f174-8ea3-48d8-9e79-7c44276075f0 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 (non-flash)
Nov 15 08:18:21 user nova-compute[95467]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:18:21 user nova-compute[95467]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)
Nov 15 08:18:21 user nova-compute[95467]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 (non-flash)
Nov 15 08:18:21 user nova-compute[95467]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d9a1fe3-4aeb-41c3-a14d-493360b49f14 (non-flash)
Nov 15 08:18:21 user nova-compute[95467]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be86dcd5-b5b8-45a5-84ee-f14d3baa8506 (non-flash)
Nov 15 08:18:21 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:18:21 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-f9f5f174-8ea3-48d8-9e79-7c44276075f0 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be86dcd5-b5b8-45a5-84ee-f14d3baa8506" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:18:21 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f5f174-8ea3-48d8-9e79-7c44276075f0 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Connected to 172.16.0.220:3260 {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 08:18:21 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-f9f5f174-8ea3-48d8-9e79-7c44276075f0 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] HCTL ('38', '-', '-', 0) found on session 26 with lun 0 {{(pid=95467) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 08:18:21 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-f9f5f174-8ea3-48d8-9e79-7c44276075f0 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=95467) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 08:18:21 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:21 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.015s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:21 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a2075e-67f3-4a31-b0a2-91dc919a4a30]: (4, ('- - 0', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:21 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-f9f5f174-8ea3-48d8-9e79-7c44276075f0 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Searching for a device in session 26 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:18:21 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f5f174-8ea3-48d8-9e79-7c44276075f0 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:be86dcd5-b5b8-45a5-84ee-f14d3baa8506', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EcUzKgVr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 08:18:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:18:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:18:22 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-f9f5f174-8ea3-48d8-9e79-7c44276075f0 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:18:22 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f5f174-8ea3-48d8-9e79-7c44276075f0 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '23661353837373736', 'path': '/dev/sdg'} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:18:22 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9f5f174-8ea3-48d8-9e79-7c44276075f0 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661353837373736', 'path': '/dev/sdg'} {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 08:18:22 user nova-compute[95467]: DEBUG nova.objects.instance [None req-f9f5f174-8ea3-48d8-9e79-7c44276075f0 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lazy-loading 'flavor' on Instance uuid 2765af98-917a-4f0f-95af-3393e0d50a52 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:18:22 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-f9f5f174-8ea3-48d8-9e79-7c44276075f0 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 08:18:22 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:18:22 user nova-compute[95467]:   <source dev="/dev/sdg"/>
Nov 15 08:18:22 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:18:22 user nova-compute[95467]:   <serial>be86dcd5-b5b8-45a5-84ee-f14d3baa8506</serial>
Nov 15 08:18:22 user nova-compute[95467]: </disk>
Nov 15 08:18:22 user nova-compute[95467]:  {{(pid=95467) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 08:18:23 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-f9f5f174-8ea3-48d8-9e79-7c44276075f0 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:18:23 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-f9f5f174-8ea3-48d8-9e79-7c44276075f0 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] No BDM found with device name vdb, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:18:23 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-f9f5f174-8ea3-48d8-9e79-7c44276075f0 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] No VIF found with MAC fa:16:3e:4b:8a:91, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:18:23 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f9f5f174-8ea3-48d8-9e79-7c44276075f0 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "2765af98-917a-4f0f-95af-3393e0d50a52" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.583s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:18:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-c4c2b11a-1709-470b-a6a2-3eb36e7001fe tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Acquiring lock "2765af98-917a-4f0f-95af-3393e0d50a52" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:18:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-c4c2b11a-1709-470b-a6a2-3eb36e7001fe tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "2765af98-917a-4f0f-95af-3393e0d50a52" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:18:25 user nova-compute[95467]: INFO nova.compute.manager [None req-c4c2b11a-1709-470b-a6a2-3eb36e7001fe tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] Detaching volume be86dcd5-b5b8-45a5-84ee-f14d3baa8506
Nov 15 08:18:25 user nova-compute[95467]: INFO nova.virt.block_device [None req-c4c2b11a-1709-470b-a6a2-3eb36e7001fe tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] Attempting to driver detach volume be86dcd5-b5b8-45a5-84ee-f14d3baa8506 from mountpoint /dev/vdb
Nov 15 08:18:25 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-c4c2b11a-1709-470b-a6a2-3eb36e7001fe tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Attempting to detach device vdb from instance 2765af98-917a-4f0f-95af-3393e0d50a52 from the persistent domain config. {{(pid=95467) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 08:18:25 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-c4c2b11a-1709-470b-a6a2-3eb36e7001fe tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 08:18:25 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:18:25 user nova-compute[95467]:   <source dev="/dev/sdg"/>
Nov 15 08:18:25 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:18:25 user nova-compute[95467]:   <serial>be86dcd5-b5b8-45a5-84ee-f14d3baa8506</serial>
Nov 15 08:18:25 user nova-compute[95467]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 08:18:25 user nova-compute[95467]: </disk>
Nov 15 08:18:25 user nova-compute[95467]:  {{(pid=95467) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 08:18:25 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-c4c2b11a-1709-470b-a6a2-3eb36e7001fe tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Successfully detached device vdb from instance 2765af98-917a-4f0f-95af-3393e0d50a52 from the persistent domain config.
Nov 15 08:18:25 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-c4c2b11a-1709-470b-a6a2-3eb36e7001fe tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2765af98-917a-4f0f-95af-3393e0d50a52 from the live domain config. {{(pid=95467) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 08:18:25 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-c4c2b11a-1709-470b-a6a2-3eb36e7001fe tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 08:18:25 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:18:25 user nova-compute[95467]:   <source dev="/dev/sdg"/>
Nov 15 08:18:25 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:18:25 user nova-compute[95467]:   <serial>be86dcd5-b5b8-45a5-84ee-f14d3baa8506</serial>
Nov 15 08:18:25 user nova-compute[95467]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 08:18:25 user nova-compute[95467]: </disk>
Nov 15 08:18:25 user nova-compute[95467]:  {{(pid=95467) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 08:18:25 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-c4c2b11a-1709-470b-a6a2-3eb36e7001fe tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2765af98-917a-4f0f-95af-3393e0d50a52 {{(pid=95467) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 08:18:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f34dacfa-7b82-44ee-ac94-81418d5caa7a tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Acquiring lock "ee2aa477-6786-483a-b088-d8ec204fe6aa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:18:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f34dacfa-7b82-44ee-ac94-81418d5caa7a tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Lock "ee2aa477-6786-483a-b088-d8ec204fe6aa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:18:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f34dacfa-7b82-44ee-ac94-81418d5caa7a tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Acquiring lock "ee2aa477-6786-483a-b088-d8ec204fe6aa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:18:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f34dacfa-7b82-44ee-ac94-81418d5caa7a tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Lock "ee2aa477-6786-483a-b088-d8ec204fe6aa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:18:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f34dacfa-7b82-44ee-ac94-81418d5caa7a tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Lock "ee2aa477-6786-483a-b088-d8ec204fe6aa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:18:27 user nova-compute[95467]: INFO nova.compute.manager [None req-f34dacfa-7b82-44ee-ac94-81418d5caa7a tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: ee2aa477-6786-483a-b088-d8ec204fe6aa] Terminating instance
Nov 15 08:18:27 user nova-compute[95467]: DEBUG nova.compute.manager [None req-f34dacfa-7b82-44ee-ac94-81418d5caa7a tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: ee2aa477-6786-483a-b088-d8ec204fe6aa] Start destroying the instance on the hypervisor. {{(pid=95467) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 08:18:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:18:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:18:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:18:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:18:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:18:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:18:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:18:27 user nova-compute[95467]: DEBUG nova.compute.manager [req-182192e4-6a56-4fc0-9bdc-11e257043b9c req-22e16fed-c463-4d05-bdca-baf536089541 service nova] [instance: ee2aa477-6786-483a-b088-d8ec204fe6aa] Received event network-vif-unplugged-5e362799-1ab1-48d5-9ef2-1a90ce83cd80 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:18:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-182192e4-6a56-4fc0-9bdc-11e257043b9c req-22e16fed-c463-4d05-bdca-baf536089541 service nova] Acquiring lock "ee2aa477-6786-483a-b088-d8ec204fe6aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:18:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-182192e4-6a56-4fc0-9bdc-11e257043b9c req-22e16fed-c463-4d05-bdca-baf536089541 service nova] Lock "ee2aa477-6786-483a-b088-d8ec204fe6aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:18:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-182192e4-6a56-4fc0-9bdc-11e257043b9c req-22e16fed-c463-4d05-bdca-baf536089541 service nova] Lock "ee2aa477-6786-483a-b088-d8ec204fe6aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:18:27 user nova-compute[95467]: DEBUG nova.compute.manager [req-182192e4-6a56-4fc0-9bdc-11e257043b9c req-22e16fed-c463-4d05-bdca-baf536089541 service nova] [instance: ee2aa477-6786-483a-b088-d8ec204fe6aa] No waiting events found dispatching network-vif-unplugged-5e362799-1ab1-48d5-9ef2-1a90ce83cd80 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:18:27 user nova-compute[95467]: DEBUG nova.compute.manager [req-182192e4-6a56-4fc0-9bdc-11e257043b9c req-22e16fed-c463-4d05-bdca-baf536089541 service nova] [instance: ee2aa477-6786-483a-b088-d8ec204fe6aa] Received event network-vif-unplugged-5e362799-1ab1-48d5-9ef2-1a90ce83cd80 for instance with task_state deleting. {{(pid=95467) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 08:18:27 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: ee2aa477-6786-483a-b088-d8ec204fe6aa] Instance destroyed successfully.
Nov 15 08:18:27 user nova-compute[95467]: DEBUG nova.objects.instance [None req-f34dacfa-7b82-44ee-ac94-81418d5caa7a tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Lazy-loading 'resources' on Instance uuid ee2aa477-6786-483a-b088-d8ec204fe6aa {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:18:27 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-f34dacfa-7b82-44ee-ac94-81418d5caa7a tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:09:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-631948657',display_name='tempest-ServersNegativeTestJSON-server-631948657',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-631948657',id=1,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:10:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1312e86f799549eb8adb4c846576262c',ramdisk_id='',reservation_id='r-6au0mqkc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-146474397',owner_user_name='tempest-ServersNegativeTestJSON-146474397-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:10:06Z,user_data=None,user_id='1b2841a0788845f79ea0fccef74eda25',uuid=ee2aa477-6786-483a-b088-d8ec204fe6aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e362799-1ab1-48d5-9ef2-1a90ce83cd80", "address": "fa:16:3e:2e:62:d2", "network": {"id": "9fc550b3-b517-4f14-93cd-f1c2866d1b29", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1976605572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1312e86f799549eb8adb4c846576262c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e362799-1a", "ovs_interfaceid": "5e362799-1ab1-48d5-9ef2-1a90ce83cd80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:18:27 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-f34dacfa-7b82-44ee-ac94-81418d5caa7a tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Converting VIF {"id": "5e362799-1ab1-48d5-9ef2-1a90ce83cd80", "address": "fa:16:3e:2e:62:d2", "network": {"id": "9fc550b3-b517-4f14-93cd-f1c2866d1b29", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1976605572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1312e86f799549eb8adb4c846576262c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e362799-1a", "ovs_interfaceid": "5e362799-1ab1-48d5-9ef2-1a90ce83cd80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:18:27 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-f34dacfa-7b82-44ee-ac94-81418d5caa7a tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:62:d2,bridge_name='br-int',has_traffic_filtering=True,id=5e362799-1ab1-48d5-9ef2-1a90ce83cd80,network=Network(9fc550b3-b517-4f14-93cd-f1c2866d1b29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e362799-1a') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:18:27 user nova-compute[95467]: DEBUG os_vif [None req-f34dacfa-7b82-44ee-ac94-81418d5caa7a tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:62:d2,bridge_name='br-int',has_traffic_filtering=True,id=5e362799-1ab1-48d5-9ef2-1a90ce83cd80,network=Network(9fc550b3-b517-4f14-93cd-f1c2866d1b29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e362799-1a') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:18:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:18:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5e362799-1a, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:18:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:18:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:18:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:18:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=611c0d1b-99bc-4175-9a56-c22503c88b08) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:18:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:18:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:18:27 user nova-compute[95467]: INFO os_vif [None req-f34dacfa-7b82-44ee-ac94-81418d5caa7a tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:62:d2,bridge_name='br-int',has_traffic_filtering=True,id=5e362799-1ab1-48d5-9ef2-1a90ce83cd80,network=Network(9fc550b3-b517-4f14-93cd-f1c2866d1b29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e362799-1a')
Nov 15 08:18:27 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-f34dacfa-7b82-44ee-ac94-81418d5caa7a tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: ee2aa477-6786-483a-b088-d8ec204fe6aa] Deleting instance files /opt/stack/data/nova/instances/ee2aa477-6786-483a-b088-d8ec204fe6aa_del
Nov 15 08:18:27 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-f34dacfa-7b82-44ee-ac94-81418d5caa7a tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: ee2aa477-6786-483a-b088-d8ec204fe6aa] Deletion of /opt/stack/data/nova/instances/ee2aa477-6786-483a-b088-d8ec204fe6aa_del complete
Nov 15 08:18:28 user nova-compute[95467]: INFO nova.compute.manager [None req-f34dacfa-7b82-44ee-ac94-81418d5caa7a tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] [instance: ee2aa477-6786-483a-b088-d8ec204fe6aa] Took 1.03 seconds to destroy the instance on the hypervisor.
Nov 15 08:18:28 user nova-compute[95467]: DEBUG oslo.service.loopingcall [None req-f34dacfa-7b82-44ee-ac94-81418d5caa7a tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=95467) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 08:18:28 user nova-compute[95467]: DEBUG nova.compute.manager [-] [instance: ee2aa477-6786-483a-b088-d8ec204fe6aa] Deallocating network for instance {{(pid=95467) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 08:18:28 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: ee2aa477-6786-483a-b088-d8ec204fe6aa] deallocate_for_instance() {{(pid=95467) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 08:18:28 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: ee2aa477-6786-483a-b088-d8ec204fe6aa] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:18:28 user nova-compute[95467]: INFO nova.compute.manager [-] [instance: ee2aa477-6786-483a-b088-d8ec204fe6aa] Took 0.53 seconds to deallocate network for instance.
Nov 15 08:18:28 user nova-compute[95467]: DEBUG nova.compute.manager [req-8fda3f51-0fda-41bc-bd1a-e78bc4ba2bcb req-77f33374-ce6c-4ace-9f63-9c079446c5e5 service nova] [instance: ee2aa477-6786-483a-b088-d8ec204fe6aa] Received event network-vif-deleted-5e362799-1ab1-48d5-9ef2-1a90ce83cd80 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:18:28 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f34dacfa-7b82-44ee-ac94-81418d5caa7a tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:18:28 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f34dacfa-7b82-44ee-ac94-81418d5caa7a tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:18:29 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-f34dacfa-7b82-44ee-ac94-81418d5caa7a tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:18:29 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-f34dacfa-7b82-44ee-ac94-81418d5caa7a tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:18:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f34dacfa-7b82-44ee-ac94-81418d5caa7a tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.449s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:18:29 user nova-compute[95467]: INFO nova.scheduler.client.report [None req-f34dacfa-7b82-44ee-ac94-81418d5caa7a tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Deleted allocations for instance ee2aa477-6786-483a-b088-d8ec204fe6aa
Nov 15 08:18:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f34dacfa-7b82-44ee-ac94-81418d5caa7a tempest-ServersNegativeTestJSON-146474397 tempest-ServersNegativeTestJSON-146474397-project-member] Lock "ee2aa477-6786-483a-b088-d8ec204fe6aa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.218s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:18:29 user nova-compute[95467]: DEBUG nova.compute.manager [req-4cb04f46-aad7-4213-9d0e-1ade9c97ea39 req-7e04a142-3154-419e-bf81-734e1723d2fd service nova] [instance: ee2aa477-6786-483a-b088-d8ec204fe6aa] Received event network-vif-plugged-5e362799-1ab1-48d5-9ef2-1a90ce83cd80 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:18:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-4cb04f46-aad7-4213-9d0e-1ade9c97ea39 req-7e04a142-3154-419e-bf81-734e1723d2fd service nova] Acquiring lock "ee2aa477-6786-483a-b088-d8ec204fe6aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:18:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-4cb04f46-aad7-4213-9d0e-1ade9c97ea39 req-7e04a142-3154-419e-bf81-734e1723d2fd service nova] Lock "ee2aa477-6786-483a-b088-d8ec204fe6aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:18:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-4cb04f46-aad7-4213-9d0e-1ade9c97ea39 req-7e04a142-3154-419e-bf81-734e1723d2fd service nova] Lock "ee2aa477-6786-483a-b088-d8ec204fe6aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:18:29 user nova-compute[95467]: DEBUG nova.compute.manager [req-4cb04f46-aad7-4213-9d0e-1ade9c97ea39 req-7e04a142-3154-419e-bf81-734e1723d2fd service nova] [instance: ee2aa477-6786-483a-b088-d8ec204fe6aa] No waiting events found dispatching network-vif-plugged-5e362799-1ab1-48d5-9ef2-1a90ce83cd80 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:18:29 user nova-compute[95467]: WARNING nova.compute.manager [req-4cb04f46-aad7-4213-9d0e-1ade9c97ea39 req-7e04a142-3154-419e-bf81-734e1723d2fd service nova] [instance: ee2aa477-6786-483a-b088-d8ec204fe6aa] Received unexpected event network-vif-plugged-5e362799-1ab1-48d5-9ef2-1a90ce83cd80 for instance with vm_state deleted and task_state None.
Nov 15 08:18:31 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-fc334b07-9808-412d-8b8c-0250707f54cf tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Acquiring lock "3711c883-ec5f-4a09-88f8-d4c0668ae570" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:18:31 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-fc334b07-9808-412d-8b8c-0250707f54cf tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "3711c883-ec5f-4a09-88f8-d4c0668ae570" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:18:31 user nova-compute[95467]: INFO nova.compute.manager [None req-fc334b07-9808-412d-8b8c-0250707f54cf tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Detaching volume 60b831aa-76f1-46c0-9c6c-6f3de448b059
Nov 15 08:18:31 user nova-compute[95467]: INFO nova.virt.block_device [None req-fc334b07-9808-412d-8b8c-0250707f54cf tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Attempting to driver detach volume 60b831aa-76f1-46c0-9c6c-6f3de448b059 from mountpoint /dev/vdb
Nov 15 08:18:31 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-fc334b07-9808-412d-8b8c-0250707f54cf tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Attempting to detach device vdb from instance 3711c883-ec5f-4a09-88f8-d4c0668ae570 from the persistent domain config. {{(pid=95467) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 08:18:31 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-fc334b07-9808-412d-8b8c-0250707f54cf tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 08:18:31 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:18:31 user nova-compute[95467]:   <source dev="/dev/sdc"/>
Nov 15 08:18:31 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:18:31 user nova-compute[95467]:   <serial>60b831aa-76f1-46c0-9c6c-6f3de448b059</serial>
Nov 15 08:18:31 user nova-compute[95467]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 08:18:31 user nova-compute[95467]: </disk>
Nov 15 08:18:31 user nova-compute[95467]:  {{(pid=95467) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 08:18:31 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-fc334b07-9808-412d-8b8c-0250707f54cf tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Successfully detached device vdb from instance 3711c883-ec5f-4a09-88f8-d4c0668ae570 from the persistent domain config.
Nov 15 08:18:31 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-fc334b07-9808-412d-8b8c-0250707f54cf tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3711c883-ec5f-4a09-88f8-d4c0668ae570 from the live domain config. {{(pid=95467) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 08:18:31 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-fc334b07-9808-412d-8b8c-0250707f54cf tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 08:18:31 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:18:31 user nova-compute[95467]:   <source dev="/dev/sdc"/>
Nov 15 08:18:31 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:18:31 user nova-compute[95467]:   <serial>60b831aa-76f1-46c0-9c6c-6f3de448b059</serial>
Nov 15 08:18:31 user nova-compute[95467]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 08:18:31 user nova-compute[95467]: </disk>
Nov 15 08:18:31 user nova-compute[95467]:  {{(pid=95467) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 08:18:31 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Acquiring lock "1c438a54-5528-4354-9836-f1a198532c9b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:18:31 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Lock "1c438a54-5528-4354-9836-f1a198532c9b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:18:31 user nova-compute[95467]: DEBUG nova.compute.manager [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Starting instance... {{(pid=95467) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 08:18:31 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:18:31 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:18:31 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=95467) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 08:18:31 user nova-compute[95467]: INFO nova.compute.claims [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Claim successful on node user
Nov 15 08:18:32 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-ff09b995-b6b3-4236-97be-24be09274ae4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 10968e11-51b2-46a4-87a5-bb85f938f489 is timed out.
Nov 15 08:18:32 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-ff09b995-b6b3-4236-97be-24be09274ae4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Successfully detached device vdb from instance 10968e11-51b2-46a4-87a5-bb85f938f489 from the live domain config.
Nov 15 08:18:32 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff09b995-b6b3-4236-97be-24be09274ae4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] calling os-brick to detach iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff09b995-b6b3-4236-97be-24be09274ae4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, {'target_iqn': 'iqn.2010-10.org.openstack:2d9a1fe3-4aeb-41c3-a14d-493360b49f14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dFxViQLz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:18:32 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-ff09b995-b6b3-4236-97be-24be09274ae4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:18:32 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-ff09b995-b6b3-4236-97be-24be09274ae4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-ff09b995-b6b3-4236-97be-24be09274ae4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[9966e207-7ffe-44d2-b336-3000210db41b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:be86dcd5-b5b8-45a5-84ee-f14d3baa8506\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2d9a1fe3-4aeb-41c3-a14d-493360b49f14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff09b995-b6b3-4236-97be-24be09274ae4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 08:18:32 user nova-compute[95467]: No targets found.
Nov 15 08:18:32 user nova-compute[95467]: iSNS:
Nov 15 08:18:32 user nova-compute[95467]: No targets found.
Nov 15 08:18:32 user nova-compute[95467]: STATIC:
Nov 15 08:18:32 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:be86dcd5-b5b8-45a5-84ee-f14d3baa8506
Nov 15 08:18:32 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:18:32 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:18:32 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:2d9a1fe3-4aeb-41c3-a14d-493360b49f14
Nov 15 08:18:32 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:18:32 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:18:32 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059
Nov 15 08:18:32 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:18:32 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:18:32 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e
Nov 15 08:18:32 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:18:32 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:18:32 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149
Nov 15 08:18:32 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:18:32 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:18:32 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81
Nov 15 08:18:32 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:18:32 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:18:32 user nova-compute[95467]: FIRMWARE:
Nov 15 08:18:32 user nova-compute[95467]: No targets found.
Nov 15 08:18:32 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff09b995-b6b3-4236-97be-24be09274ae4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 08:18:32 user nova-compute[95467]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 08:18:32 user nova-compute[95467]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=95467) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff09b995-b6b3-4236-97be-24be09274ae4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d9a1fe3-4aeb-41c3-a14d-493360b49f14', 0)] {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-fc334b07-9808-412d-8b8c-0250707f54cf tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3711c883-ec5f-4a09-88f8-d4c0668ae570 {{(pid=95467) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa92c3a-ebf9-4f70-8c3a-c3bbfb54adf5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d9a1fe3-4aeb-41c3-a14d-493360b49f14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be86dcd5-b5b8-45a5-84ee-f14d3baa8506\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[4781c536-d44d-401a-9d70-46e701ad534d]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d9a1fe3-4aeb-41c3-a14d-493360b49f14 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be86dcd5-b5b8-45a5-84ee-f14d3baa8506 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff09b995-b6b3-4236-97be-24be09274ae4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 (non-flash)
Nov 15 08:18:32 user nova-compute[95467]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:18:32 user nova-compute[95467]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)
Nov 15 08:18:32 user nova-compute[95467]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 (non-flash)
Nov 15 08:18:32 user nova-compute[95467]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d9a1fe3-4aeb-41c3-a14d-493360b49f14 (non-flash)
Nov 15 08:18:32 user nova-compute[95467]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be86dcd5-b5b8-45a5-84ee-f14d3baa8506 (non-flash)
Nov 15 08:18:32 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff09b995-b6b3-4236-97be-24be09274ae4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 (non-flash)
Nov 15 08:18:32 user nova-compute[95467]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:18:32 user nova-compute[95467]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)
Nov 15 08:18:32 user nova-compute[95467]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 (non-flash)
Nov 15 08:18:32 user nova-compute[95467]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d9a1fe3-4aeb-41c3-a14d-493360b49f14 (non-flash)
Nov 15 08:18:32 user nova-compute[95467]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be86dcd5-b5b8-45a5-84ee-f14d3baa8506 (non-flash)
Nov 15 08:18:32 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff09b995-b6b3-4236-97be-24be09274ae4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efec836db40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d9a1fe3-4aeb-41c3-a14d-493360b49f14'): ({'sdd'}, set())}) {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-ff09b995-b6b3-4236-97be-24be09274ae4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Removing single pathed devices sdd {{(pid=95467) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[6430d429-e3a6-4e3b-bfb1-908637db274b]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45661c3-a389-498b-95f5-0e37944a9619]: (4, ('ok\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-ff09b995-b6b3-4236-97be-24be09274ae4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Flushing IO for device /dev/sdd {{(pid=95467) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[11be800a-90b1-4dba-a9c4-17842dad7b25]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-ff09b995-b6b3-4236-97be-24be09274ae4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=95467) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c38203f-85ee-49fb-b5dc-212e641a2332]: (4, ('1', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-ff09b995-b6b3-4236-97be-24be09274ae4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-ff09b995-b6b3-4236-97be-24be09274ae4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] SCSI volumes sdd have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff09b995-b6b3-4236-97be-24be09274ae4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d9a1fe3-4aeb-41c3-a14d-493360b49f14')] {{(pid=95467) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d9a1fe3-4aeb-41c3-a14d-493360b49f14 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.486s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG nova.compute.manager [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Start building networks asynchronously for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d9a1fe3-4aeb-41c3-a14d-493360b49f14 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63b22e8-5f51-47ad-a548-4e282d866e05]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff09b995-b6b3-4236-97be-24be09274ae4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d9a1fe3-4aeb-41c3-a14d-493360b49f14 -p 172.16.0.220:3260 --logout {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG nova.compute.manager [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Allocating IP information in the background. {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG nova.network.neutron [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] allocate_for_instance() {{(pid=95467) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d9a1fe3-4aeb-41c3-a14d-493360b49f14 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[7edc0161-b8ec-4f14-9902-5cfa0099c230]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:2d9a1fe3-4aeb-41c3-a14d-493360b49f14, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:2d9a1fe3-4aeb-41c3-a14d-493360b49f14, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff09b995-b6b3-4236-97be-24be09274ae4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:2d9a1fe3-4aeb-41c3-a14d-493360b49f14, portal: 172.16.0.220,3260]
Nov 15 08:18:32 user nova-compute[95467]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:2d9a1fe3-4aeb-41c3-a14d-493360b49f14, portal: 172.16.0.220,3260] successful.
Nov 15 08:18:32 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d9a1fe3-4aeb-41c3-a14d-493360b49f14 -p 172.16.0.220:3260 --op delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:32 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 08:18:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d9a1fe3-4aeb-41c3-a14d-493360b49f14 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8e3ed6-0926-4c87-ad7d-82f158cdecc1]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff09b995-b6b3-4236-97be-24be09274ae4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-ff09b995-b6b3-4236-97be-24be09274ae4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff09b995-b6b3-4236-97be-24be09274ae4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] <== disconnect_volume: return (348ms) None {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff09b995-b6b3-4236-97be-24be09274ae4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] Disconnected iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG nova.compute.manager [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Start building block device mappings for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 08:18:32 user nova-compute[95467]: INFO nova.virt.block_device [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Booting with volume 74097ec0-88f6-4b8c-b01f-3be5fdbdf87b at /dev/vda
Nov 15 08:18:32 user nova-compute[95467]: DEBUG os_brick.utils [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9562474-a7a1-48c3-a0aa-169041b74915]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:882ae90641f\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5bbacdc-235a-489a-a97d-ef5261eca89b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[03df6442-39bf-4aa6-be17-5bae7e0087e0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd81a68-48eb-4e72-92e8-51ba73400cca]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Running cmd (subprocess): nvme version {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] 'nvme version' failed. Not Retrying. {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] nvme not present on system {{(pid=95467) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:18:32 user nova-compute[95467]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 08:18:32 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[80265ff2-fd07-4b14-9c49-780ab7a8770e]: (4, '') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=95467) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] LIGHTOS: no hostnqn found. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG os_brick.utils [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:882ae90641f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG nova.virt.block_device [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Updating existing volume attachment record: 0eb3ad85-d3ac-4fdb-9dcd-dd6c7bdbc721 {{(pid=95467) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 08:18:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:18:33 user nova-compute[95467]: DEBUG nova.policy [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2da4703cb9454345a21adb41812a37ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e501e472d742539ef6a4d9c5175d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95467) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 08:18:33 user nova-compute[95467]: DEBUG nova.objects.instance [None req-ff09b995-b6b3-4236-97be-24be09274ae4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lazy-loading 'flavor' on Instance uuid 10968e11-51b2-46a4-87a5-bb85f938f489 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:18:33 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-ff09b995-b6b3-4236-97be-24be09274ae4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lock "10968e11-51b2-46a4-87a5-bb85f938f489" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.843s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:18:33 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e69a581c-fc6f-4eea-a92d-0a4f3149d806 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lock "10968e11-51b2-46a4-87a5-bb85f938f489" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.729s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:18:33 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e69a581c-fc6f-4eea-a92d-0a4f3149d806 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Acquiring lock "10968e11-51b2-46a4-87a5-bb85f938f489-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:18:33 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e69a581c-fc6f-4eea-a92d-0a4f3149d806 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lock "10968e11-51b2-46a4-87a5-bb85f938f489-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.004s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:18:33 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e69a581c-fc6f-4eea-a92d-0a4f3149d806 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lock "10968e11-51b2-46a4-87a5-bb85f938f489-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:18:33 user nova-compute[95467]: INFO nova.compute.manager [None req-e69a581c-fc6f-4eea-a92d-0a4f3149d806 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] Terminating instance
Nov 15 08:18:33 user nova-compute[95467]: DEBUG nova.compute.manager [None req-e69a581c-fc6f-4eea-a92d-0a4f3149d806 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] Start destroying the instance on the hypervisor. {{(pid=95467) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 08:18:33 user nova-compute[95467]: DEBUG nova.compute.manager [req-f3e8e975-a02e-4cc7-8f50-abb53dfb1c7e req-e5b24632-9bba-4fbc-be26-695abe59b7c1 service nova] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] Received event network-changed-c9bd9bbe-8c0f-476d-978d-d7050876a1ab {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:18:33 user nova-compute[95467]: DEBUG nova.compute.manager [req-f3e8e975-a02e-4cc7-8f50-abb53dfb1c7e req-e5b24632-9bba-4fbc-be26-695abe59b7c1 service nova] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] Refreshing instance network info cache due to event network-changed-c9bd9bbe-8c0f-476d-978d-d7050876a1ab. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:18:33 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-f3e8e975-a02e-4cc7-8f50-abb53dfb1c7e req-e5b24632-9bba-4fbc-be26-695abe59b7c1 service nova] Acquiring lock "refresh_cache-851d354c-7f20-4e72-bfd2-a781b929e8ba" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:18:33 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-f3e8e975-a02e-4cc7-8f50-abb53dfb1c7e req-e5b24632-9bba-4fbc-be26-695abe59b7c1 service nova] Acquired lock "refresh_cache-851d354c-7f20-4e72-bfd2-a781b929e8ba" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:18:33 user nova-compute[95467]: DEBUG nova.network.neutron [req-f3e8e975-a02e-4cc7-8f50-abb53dfb1c7e req-e5b24632-9bba-4fbc-be26-695abe59b7c1 service nova] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] Refreshing network info cache for port c9bd9bbe-8c0f-476d-978d-d7050876a1ab {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:18:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:18:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:18:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:18:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:18:33 user nova-compute[95467]: DEBUG nova.network.neutron [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Successfully created port: 5cab4329-e3d7-4d50-9a27-c1291f6f4b4a {{(pid=95467) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 08:18:34 user nova-compute[95467]: DEBUG nova.compute.manager [req-7c708c1f-3f7b-4f33-bb5f-a5d944625c55 req-02dda882-ace8-4b1d-91ca-d564f47c798f service nova] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] Received event network-vif-unplugged-4ec7d55d-9178-4dbc-8c24-d3ecf46398bc {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:18:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-7c708c1f-3f7b-4f33-bb5f-a5d944625c55 req-02dda882-ace8-4b1d-91ca-d564f47c798f service nova] Acquiring lock "10968e11-51b2-46a4-87a5-bb85f938f489-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:18:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-7c708c1f-3f7b-4f33-bb5f-a5d944625c55 req-02dda882-ace8-4b1d-91ca-d564f47c798f service nova] Lock "10968e11-51b2-46a4-87a5-bb85f938f489-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:18:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-7c708c1f-3f7b-4f33-bb5f-a5d944625c55 req-02dda882-ace8-4b1d-91ca-d564f47c798f service nova] Lock "10968e11-51b2-46a4-87a5-bb85f938f489-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:18:34 user nova-compute[95467]: DEBUG nova.compute.manager [req-7c708c1f-3f7b-4f33-bb5f-a5d944625c55 req-02dda882-ace8-4b1d-91ca-d564f47c798f service nova] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] No waiting events found dispatching network-vif-unplugged-4ec7d55d-9178-4dbc-8c24-d3ecf46398bc {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:18:34 user nova-compute[95467]: DEBUG nova.compute.manager [req-7c708c1f-3f7b-4f33-bb5f-a5d944625c55 req-02dda882-ace8-4b1d-91ca-d564f47c798f service nova] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] Received event network-vif-unplugged-4ec7d55d-9178-4dbc-8c24-d3ecf46398bc for instance with task_state deleting. {{(pid=95467) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 08:18:34 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] Instance destroyed successfully.
Nov 15 08:18:34 user nova-compute[95467]: DEBUG nova.objects.instance [None req-e69a581c-fc6f-4eea-a92d-0a4f3149d806 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lazy-loading 'resources' on Instance uuid 10968e11-51b2-46a4-87a5-bb85f938f489 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:18:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-e69a581c-fc6f-4eea-a92d-0a4f3149d806 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:15:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1101118524',display_name='tempest-VolumesSnapshotTestJSON-instance-1101118524',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1101118524',id=25,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjxpbQgsiXxNlI5Ae92vX4yzSpRlM5HGPj1s+fXD7KhgNK2evFVwMx9fAfKTljspB/RcERr/qJ4LJs6vCEQwvrxlhVWWmi21Z5MRmr1omty+++gF1iEdx2zBj6D9D7tzg==',key_name='tempest-keypair-1053291466',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:16:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b1fa68347914efe87ae8edd3901e11a',ramdisk_id='',reservation_id='r-u0kwk6qq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-151902651',owner_user_name='tempest-VolumesSnapshotTestJSON-151902651-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:16:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='993622d17e1848a0980fd759e248edda',uuid=10968e11-51b2-46a4-87a5-bb85f938f489,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ec7d55d-9178-4dbc-8c24-d3ecf46398bc", "address": "fa:16:3e:89:59:c1", "network": {"id": "8220309c-e09f-4c20-8f74-abdf4688fe64", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-160547739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b1fa68347914efe87ae8edd3901e11a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ec7d55d-91", "ovs_interfaceid": "4ec7d55d-9178-4dbc-8c24-d3ecf46398bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:18:34 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-e69a581c-fc6f-4eea-a92d-0a4f3149d806 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Converting VIF {"id": "4ec7d55d-9178-4dbc-8c24-d3ecf46398bc", "address": "fa:16:3e:89:59:c1", "network": {"id": "8220309c-e09f-4c20-8f74-abdf4688fe64", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-160547739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b1fa68347914efe87ae8edd3901e11a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ec7d55d-91", "ovs_interfaceid": "4ec7d55d-9178-4dbc-8c24-d3ecf46398bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:18:34 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-e69a581c-fc6f-4eea-a92d-0a4f3149d806 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:89:59:c1,bridge_name='br-int',has_traffic_filtering=True,id=4ec7d55d-9178-4dbc-8c24-d3ecf46398bc,network=Network(8220309c-e09f-4c20-8f74-abdf4688fe64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ec7d55d-91') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:18:34 user nova-compute[95467]: DEBUG os_vif [None req-e69a581c-fc6f-4eea-a92d-0a4f3149d806 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:59:c1,bridge_name='br-int',has_traffic_filtering=True,id=4ec7d55d-9178-4dbc-8c24-d3ecf46398bc,network=Network(8220309c-e09f-4c20-8f74-abdf4688fe64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ec7d55d-91') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:18:34 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:18:34 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4ec7d55d-91, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:18:34 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:18:34 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:18:34 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:18:34 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=65a0dbcf-dcd8-4217-a2b6-03d62c873e6f) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:18:34 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:18:34 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:18:34 user nova-compute[95467]: INFO os_vif [None req-e69a581c-fc6f-4eea-a92d-0a4f3149d806 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:59:c1,bridge_name='br-int',has_traffic_filtering=True,id=4ec7d55d-9178-4dbc-8c24-d3ecf46398bc,network=Network(8220309c-e09f-4c20-8f74-abdf4688fe64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ec7d55d-91')
Nov 15 08:18:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e69a581c-fc6f-4eea-a92d-0a4f3149d806 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] calling os-brick to detach iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 08:18:34 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69a581c-fc6f-4eea-a92d-0a4f3149d806 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, {'target_iqn': 'iqn.2010-10.org.openstack:2d9a1fe3-4aeb-41c3-a14d-493360b49f14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dFxViQLz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:18:34 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-e69a581c-fc6f-4eea-a92d-0a4f3149d806 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:18:34 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-e69a581c-fc6f-4eea-a92d-0a4f3149d806 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:18:34 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-e69a581c-fc6f-4eea-a92d-0a4f3149d806 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:18:34 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:34 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:34 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[782872c2-dcea-45cd-90ca-551cf532f772]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:be86dcd5-b5b8-45a5-84ee-f14d3baa8506\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:34 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69a581c-fc6f-4eea-a92d-0a4f3149d806 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 08:18:34 user nova-compute[95467]: No targets found.
Nov 15 08:18:34 user nova-compute[95467]: iSNS:
Nov 15 08:18:34 user nova-compute[95467]: No targets found.
Nov 15 08:18:34 user nova-compute[95467]: STATIC:
Nov 15 08:18:34 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:be86dcd5-b5b8-45a5-84ee-f14d3baa8506
Nov 15 08:18:34 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:18:34 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:18:34 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059
Nov 15 08:18:34 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:18:34 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:18:34 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e
Nov 15 08:18:34 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:18:34 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:18:34 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149
Nov 15 08:18:34 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:18:34 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:18:34 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81
Nov 15 08:18:34 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:18:34 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:18:34 user nova-compute[95467]: FIRMWARE:
Nov 15 08:18:34 user nova-compute[95467]: No targets found.
Nov 15 08:18:34 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:18:34 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69a581c-fc6f-4eea-a92d-0a4f3149d806 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 08:18:34 user nova-compute[95467]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 08:18:34 user nova-compute[95467]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=95467) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 08:18:34 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69a581c-fc6f-4eea-a92d-0a4f3149d806 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d9a1fe3-4aeb-41c3-a14d-493360b49f14', 0)] {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 08:18:34 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:34 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:34 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[703211e4-c0c0-47f9-b71f-65b319c41d1e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be86dcd5-b5b8-45a5-84ee-f14d3baa8506\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:34 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:34 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:34 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca96845-d491-4322-948d-c659071472cb]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be86dcd5-b5b8-45a5-84ee-f14d3baa8506 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:34 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69a581c-fc6f-4eea-a92d-0a4f3149d806 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 (non-flash)
Nov 15 08:18:34 user nova-compute[95467]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:18:34 user nova-compute[95467]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)
Nov 15 08:18:34 user nova-compute[95467]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 (non-flash)
Nov 15 08:18:34 user nova-compute[95467]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be86dcd5-b5b8-45a5-84ee-f14d3baa8506 (non-flash)
Nov 15 08:18:34 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:18:34 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69a581c-fc6f-4eea-a92d-0a4f3149d806 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 (non-flash)
Nov 15 08:18:34 user nova-compute[95467]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:18:34 user nova-compute[95467]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)
Nov 15 08:18:34 user nova-compute[95467]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 (non-flash)
Nov 15 08:18:34 user nova-compute[95467]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be86dcd5-b5b8-45a5-84ee-f14d3baa8506 (non-flash)
Nov 15 08:18:34 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:18:34 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69a581c-fc6f-4eea-a92d-0a4f3149d806 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efed80c2320>, {}) {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 08:18:34 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69a581c-fc6f-4eea-a92d-0a4f3149d806 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Disconnecting from: [] {{(pid=95467) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 08:18:34 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-e69a581c-fc6f-4eea-a92d-0a4f3149d806 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.078s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:18:34 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69a581c-fc6f-4eea-a92d-0a4f3149d806 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] <== disconnect_volume: return (79ms) None {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:18:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e69a581c-fc6f-4eea-a92d-0a4f3149d806 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] Disconnected iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 08:18:34 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-e69a581c-fc6f-4eea-a92d-0a4f3149d806 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] Deleting instance files /opt/stack/data/nova/instances/10968e11-51b2-46a4-87a5-bb85f938f489_del
Nov 15 08:18:34 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-e69a581c-fc6f-4eea-a92d-0a4f3149d806 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] Deletion of /opt/stack/data/nova/instances/10968e11-51b2-46a4-87a5-bb85f938f489_del complete
Nov 15 08:18:34 user nova-compute[95467]: INFO nova.compute.manager [None req-e69a581c-fc6f-4eea-a92d-0a4f3149d806 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 15 08:18:34 user nova-compute[95467]: DEBUG oslo.service.loopingcall [None req-e69a581c-fc6f-4eea-a92d-0a4f3149d806 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=95467) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 08:18:34 user nova-compute[95467]: DEBUG nova.compute.manager [-] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] Deallocating network for instance {{(pid=95467) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 08:18:34 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] deallocate_for_instance() {{(pid=95467) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 08:18:34 user nova-compute[95467]: DEBUG nova.network.neutron [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Successfully created port: 79b592a8-b5f9-48e6-ae2d-d535ded922b1 {{(pid=95467) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 08:18:34 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:18:35 user nova-compute[95467]: DEBUG nova.network.neutron [req-f3e8e975-a02e-4cc7-8f50-abb53dfb1c7e req-e5b24632-9bba-4fbc-be26-695abe59b7c1 service nova] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] Updated VIF entry in instance network info cache for port c9bd9bbe-8c0f-476d-978d-d7050876a1ab. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:18:35 user nova-compute[95467]: DEBUG nova.network.neutron [req-f3e8e975-a02e-4cc7-8f50-abb53dfb1c7e req-e5b24632-9bba-4fbc-be26-695abe59b7c1 service nova] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] Updating instance_info_cache with network_info: [{"id": "c9bd9bbe-8c0f-476d-978d-d7050876a1ab", "address": "fa:16:3e:c3:5d:b8", "network": {"id": "96d9262b-11fb-497d-8e38-fa46076c010f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2069167691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7791bd92c7c488aa72474ecde2e1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9bd9bbe-8c", "ovs_interfaceid": "c9bd9bbe-8c0f-476d-978d-d7050876a1ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:18:35 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-f3e8e975-a02e-4cc7-8f50-abb53dfb1c7e req-e5b24632-9bba-4fbc-be26-695abe59b7c1 service nova] Releasing lock "refresh_cache-851d354c-7f20-4e72-bfd2-a781b929e8ba" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:18:35 user nova-compute[95467]: DEBUG nova.network.neutron [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Successfully created port: 71b2b3bf-8597-40e5-803d-be98308390b7 {{(pid=95467) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 08:18:35 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:18:35 user nova-compute[95467]: INFO nova.compute.manager [-] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] Took 1.28 seconds to deallocate network for instance.
Nov 15 08:18:35 user nova-compute[95467]: WARNING nova.volume.cinder [None req-e69a581c-fc6f-4eea-a92d-0a4f3149d806 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Attachment 62775479-c665-4d3c-9e6b-fbd7e0492e77 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 62775479-c665-4d3c-9e6b-fbd7e0492e77. (HTTP 404) (Request-ID: req-0f96f27c-d066-44b4-83be-dc3713dbdb97)
Nov 15 08:18:35 user nova-compute[95467]: INFO nova.compute.manager [None req-e69a581c-fc6f-4eea-a92d-0a4f3149d806 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] Took 0.04 seconds to detach 1 volumes for instance.
Nov 15 08:18:35 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e69a581c-fc6f-4eea-a92d-0a4f3149d806 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:18:35 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e69a581c-fc6f-4eea-a92d-0a4f3149d806 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:18:36 user nova-compute[95467]: DEBUG nova.compute.manager [req-98ac2e9c-1259-41df-a045-95be4dc46272 req-d7fae852-3074-45b1-82d7-ecbd3ed96e37 service nova] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] Received event network-vif-plugged-4ec7d55d-9178-4dbc-8c24-d3ecf46398bc {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:18:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-98ac2e9c-1259-41df-a045-95be4dc46272 req-d7fae852-3074-45b1-82d7-ecbd3ed96e37 service nova] Acquiring lock "10968e11-51b2-46a4-87a5-bb85f938f489-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:18:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-98ac2e9c-1259-41df-a045-95be4dc46272 req-d7fae852-3074-45b1-82d7-ecbd3ed96e37 service nova] Lock "10968e11-51b2-46a4-87a5-bb85f938f489-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:18:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-98ac2e9c-1259-41df-a045-95be4dc46272 req-d7fae852-3074-45b1-82d7-ecbd3ed96e37 service nova] Lock "10968e11-51b2-46a4-87a5-bb85f938f489-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:18:36 user nova-compute[95467]: DEBUG nova.compute.manager [req-98ac2e9c-1259-41df-a045-95be4dc46272 req-d7fae852-3074-45b1-82d7-ecbd3ed96e37 service nova] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] No waiting events found dispatching network-vif-plugged-4ec7d55d-9178-4dbc-8c24-d3ecf46398bc {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:18:36 user nova-compute[95467]: WARNING nova.compute.manager [req-98ac2e9c-1259-41df-a045-95be4dc46272 req-d7fae852-3074-45b1-82d7-ecbd3ed96e37 service nova] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] Received unexpected event network-vif-plugged-4ec7d55d-9178-4dbc-8c24-d3ecf46398bc for instance with vm_state deleted and task_state None.
Nov 15 08:18:36 user nova-compute[95467]: DEBUG nova.compute.manager [req-98ac2e9c-1259-41df-a045-95be4dc46272 req-d7fae852-3074-45b1-82d7-ecbd3ed96e37 service nova] [instance: 10968e11-51b2-46a4-87a5-bb85f938f489] Received event network-vif-deleted-4ec7d55d-9178-4dbc-8c24-d3ecf46398bc {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:18:36 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-e69a581c-fc6f-4eea-a92d-0a4f3149d806 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:18:36 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-e69a581c-fc6f-4eea-a92d-0a4f3149d806 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:18:36 user nova-compute[95467]: DEBUG nova.network.neutron [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Successfully created port: ffab8636-a06b-43fc-9aa8-fcec46b2426d {{(pid=95467) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 08:18:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e69a581c-fc6f-4eea-a92d-0a4f3149d806 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.453s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:18:36 user nova-compute[95467]: INFO nova.scheduler.client.report [None req-e69a581c-fc6f-4eea-a92d-0a4f3149d806 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Deleted allocations for instance 10968e11-51b2-46a4-87a5-bb85f938f489
Nov 15 08:18:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e69a581c-fc6f-4eea-a92d-0a4f3149d806 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lock "10968e11-51b2-46a4-87a5-bb85f938f489" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.969s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:18:36 user nova-compute[95467]: DEBUG nova.network.neutron [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Successfully created port: 27370ddc-29be-446e-8205-a50379d200d7 {{(pid=95467) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 08:18:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:18:37 user nova-compute[95467]: DEBUG nova.network.neutron [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Successfully updated port: 5cab4329-e3d7-4d50-9a27-c1291f6f4b4a {{(pid=95467) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 08:18:37 user nova-compute[95467]: DEBUG nova.compute.manager [req-81125168-46e9-4b31-85b8-f7a3fe046a92 req-2e5878d7-b04d-4cf1-93fc-ad25309949b3 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Received event network-changed-5cab4329-e3d7-4d50-9a27-c1291f6f4b4a {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:18:37 user nova-compute[95467]: DEBUG nova.compute.manager [req-81125168-46e9-4b31-85b8-f7a3fe046a92 req-2e5878d7-b04d-4cf1-93fc-ad25309949b3 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Refreshing instance network info cache due to event network-changed-5cab4329-e3d7-4d50-9a27-c1291f6f4b4a. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:18:37 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-81125168-46e9-4b31-85b8-f7a3fe046a92 req-2e5878d7-b04d-4cf1-93fc-ad25309949b3 service nova] Acquiring lock "refresh_cache-1c438a54-5528-4354-9836-f1a198532c9b" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:18:37 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-81125168-46e9-4b31-85b8-f7a3fe046a92 req-2e5878d7-b04d-4cf1-93fc-ad25309949b3 service nova] Acquired lock "refresh_cache-1c438a54-5528-4354-9836-f1a198532c9b" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:18:37 user nova-compute[95467]: DEBUG nova.network.neutron [req-81125168-46e9-4b31-85b8-f7a3fe046a92 req-2e5878d7-b04d-4cf1-93fc-ad25309949b3 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Refreshing network info cache for port 5cab4329-e3d7-4d50-9a27-c1291f6f4b4a {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:18:37 user nova-compute[95467]: DEBUG nova.network.neutron [req-81125168-46e9-4b31-85b8-f7a3fe046a92 req-2e5878d7-b04d-4cf1-93fc-ad25309949b3 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Instance cache missing network info. {{(pid=95467) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 08:18:37 user nova-compute[95467]: DEBUG nova.network.neutron [req-81125168-46e9-4b31-85b8-f7a3fe046a92 req-2e5878d7-b04d-4cf1-93fc-ad25309949b3 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:18:37 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-81125168-46e9-4b31-85b8-f7a3fe046a92 req-2e5878d7-b04d-4cf1-93fc-ad25309949b3 service nova] Releasing lock "refresh_cache-1c438a54-5528-4354-9836-f1a198532c9b" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:18:38 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:18:38 user nova-compute[95467]: INFO nova.virt.block_device [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Booting with volume bef17724-2105-4964-a1f3-57663bf01612 at /dev/vdb
Nov 15 08:18:38 user nova-compute[95467]: DEBUG os_brick.utils [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:18:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:38 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb009bc1-21c2-4e86-a010-f1951c25b3f1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:882ae90641f\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:38 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36e8244-77ea-4de4-bc68-1dbbda882d23]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:38 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff6eed9-a707-46c0-b2fc-099b036e919e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:38 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[085b29ac-9f94-4d70-a119-c5ed8b3d5d2f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Running cmd (subprocess): nvme version {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] 'nvme version' failed. Not Retrying. {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:18:38 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] nvme not present on system {{(pid=95467) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 08:18:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:18:38 user nova-compute[95467]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 08:18:38 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc89e6f4-6a40-4a7b-8a7c-cbe76d2af39d]: (4, '') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:38 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=95467) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 08:18:38 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 08:18:38 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] LIGHTOS: no hostnqn found. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 08:18:38 user nova-compute[95467]: DEBUG os_brick.utils [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:882ae90641f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:18:38 user nova-compute[95467]: DEBUG nova.virt.block_device [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Updating existing volume attachment record: 52c8f620-1fdd-42b3-9761-1a6937a27970 {{(pid=95467) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 08:18:38 user nova-compute[95467]: DEBUG nova.network.neutron [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Successfully updated port: d6c4a108-4733-4daa-935a-56424ed362e9 {{(pid=95467) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 08:18:38 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:18:38 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=95467) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 08:18:39 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:18:39 user nova-compute[95467]: DEBUG nova.network.neutron [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Successfully updated port: 68127374-b841-456d-b9eb-29e96bd43dc6 {{(pid=95467) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 08:18:39 user nova-compute[95467]: DEBUG nova.compute.manager [req-9082279b-4152-4a65-927d-ad71a276925c req-bbf31a52-1d00-48a9-93be-d0402a26fd5a service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Received event network-changed-d6c4a108-4733-4daa-935a-56424ed362e9 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:18:39 user nova-compute[95467]: DEBUG nova.compute.manager [req-9082279b-4152-4a65-927d-ad71a276925c req-bbf31a52-1d00-48a9-93be-d0402a26fd5a service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Refreshing instance network info cache due to event network-changed-d6c4a108-4733-4daa-935a-56424ed362e9. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:18:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-9082279b-4152-4a65-927d-ad71a276925c req-bbf31a52-1d00-48a9-93be-d0402a26fd5a service nova] Acquiring lock "refresh_cache-1c438a54-5528-4354-9836-f1a198532c9b" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:18:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-9082279b-4152-4a65-927d-ad71a276925c req-bbf31a52-1d00-48a9-93be-d0402a26fd5a service nova] Acquired lock "refresh_cache-1c438a54-5528-4354-9836-f1a198532c9b" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:18:39 user nova-compute[95467]: DEBUG nova.network.neutron [req-9082279b-4152-4a65-927d-ad71a276925c req-bbf31a52-1d00-48a9-93be-d0402a26fd5a service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Refreshing network info cache for port d6c4a108-4733-4daa-935a-56424ed362e9 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:18:39 user nova-compute[95467]: DEBUG nova.network.neutron [req-9082279b-4152-4a65-927d-ad71a276925c req-bbf31a52-1d00-48a9-93be-d0402a26fd5a service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Instance cache missing network info. {{(pid=95467) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 08:18:39 user nova-compute[95467]: DEBUG nova.network.neutron [req-9082279b-4152-4a65-927d-ad71a276925c req-bbf31a52-1d00-48a9-93be-d0402a26fd5a service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:18:40 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-9082279b-4152-4a65-927d-ad71a276925c req-bbf31a52-1d00-48a9-93be-d0402a26fd5a service nova] Releasing lock "refresh_cache-1c438a54-5528-4354-9836-f1a198532c9b" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:18:40 user nova-compute[95467]: DEBUG nova.compute.manager [req-9082279b-4152-4a65-927d-ad71a276925c req-bbf31a52-1d00-48a9-93be-d0402a26fd5a service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Received event network-changed-68127374-b841-456d-b9eb-29e96bd43dc6 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:18:40 user nova-compute[95467]: DEBUG nova.compute.manager [req-9082279b-4152-4a65-927d-ad71a276925c req-bbf31a52-1d00-48a9-93be-d0402a26fd5a service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Refreshing instance network info cache due to event network-changed-68127374-b841-456d-b9eb-29e96bd43dc6. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:18:40 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-9082279b-4152-4a65-927d-ad71a276925c req-bbf31a52-1d00-48a9-93be-d0402a26fd5a service nova] Acquiring lock "refresh_cache-1c438a54-5528-4354-9836-f1a198532c9b" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:18:40 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-9082279b-4152-4a65-927d-ad71a276925c req-bbf31a52-1d00-48a9-93be-d0402a26fd5a service nova] Acquired lock "refresh_cache-1c438a54-5528-4354-9836-f1a198532c9b" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:18:40 user nova-compute[95467]: DEBUG nova.network.neutron [req-9082279b-4152-4a65-927d-ad71a276925c req-bbf31a52-1d00-48a9-93be-d0402a26fd5a service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Refreshing network info cache for port 68127374-b841-456d-b9eb-29e96bd43dc6 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:18:40 user nova-compute[95467]: DEBUG nova.network.neutron [req-9082279b-4152-4a65-927d-ad71a276925c req-bbf31a52-1d00-48a9-93be-d0402a26fd5a service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Instance cache missing network info. {{(pid=95467) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 08:18:40 user nova-compute[95467]: DEBUG nova.network.neutron [req-9082279b-4152-4a65-927d-ad71a276925c req-bbf31a52-1d00-48a9-93be-d0402a26fd5a service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:18:40 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-9082279b-4152-4a65-927d-ad71a276925c req-bbf31a52-1d00-48a9-93be-d0402a26fd5a service nova] Releasing lock "refresh_cache-1c438a54-5528-4354-9836-f1a198532c9b" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:18:40 user nova-compute[95467]: DEBUG nova.network.neutron [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Successfully updated port: 79b592a8-b5f9-48e6-ae2d-d535ded922b1 {{(pid=95467) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 08:18:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Acquiring lock "13957136-17e4-4d38-aba3-37453e1fb878" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:18:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "13957136-17e4-4d38-aba3-37453e1fb878" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:18:41 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] Starting instance... {{(pid=95467) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 08:18:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:18:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:18:41 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=95467) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 08:18:41 user nova-compute[95467]: INFO nova.compute.claims [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] Claim successful on node user
Nov 15 08:18:41 user nova-compute[95467]: DEBUG nova.network.neutron [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Successfully updated port: 71b2b3bf-8597-40e5-803d-be98308390b7 {{(pid=95467) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 08:18:41 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:18:41 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager.update_available_resource {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:18:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:18:41 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:18:41 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:18:41 user nova-compute[95467]: DEBUG nova.compute.manager [req-d81d13a0-5940-4188-aa6f-30ebf3d2807e req-2b84bbc7-98bd-4232-b2aa-b154628b9465 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Received event network-changed-79b592a8-b5f9-48e6-ae2d-d535ded922b1 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:18:41 user nova-compute[95467]: DEBUG nova.compute.manager [req-d81d13a0-5940-4188-aa6f-30ebf3d2807e req-2b84bbc7-98bd-4232-b2aa-b154628b9465 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Refreshing instance network info cache due to event network-changed-79b592a8-b5f9-48e6-ae2d-d535ded922b1. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:18:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-d81d13a0-5940-4188-aa6f-30ebf3d2807e req-2b84bbc7-98bd-4232-b2aa-b154628b9465 service nova] Acquiring lock "refresh_cache-1c438a54-5528-4354-9836-f1a198532c9b" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:18:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-d81d13a0-5940-4188-aa6f-30ebf3d2807e req-2b84bbc7-98bd-4232-b2aa-b154628b9465 service nova] Acquired lock "refresh_cache-1c438a54-5528-4354-9836-f1a198532c9b" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:18:41 user nova-compute[95467]: DEBUG nova.network.neutron [req-d81d13a0-5940-4188-aa6f-30ebf3d2807e req-2b84bbc7-98bd-4232-b2aa-b154628b9465 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Refreshing network info cache for port 79b592a8-b5f9-48e6-ae2d-d535ded922b1 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:18:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.503s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:18:41 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] Start building networks asynchronously for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 08:18:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.129s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:18:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:18:41 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Auditing locally available compute resources for user (node: user) {{(pid=95467) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 08:18:41 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 08:18:41 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] Allocating IP information in the background. {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 08:18:41 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] allocate_for_instance() {{(pid=95467) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 08:18:41 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] Start building block device mappings for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 08:18:41 user nova-compute[95467]: DEBUG nova.network.neutron [req-d81d13a0-5940-4188-aa6f-30ebf3d2807e req-2b84bbc7-98bd-4232-b2aa-b154628b9465 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Instance cache missing network info. {{(pid=95467) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 08:18:41 user nova-compute[95467]: INFO nova.virt.block_device [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] Booting with volume snapshot 592e74a2-6002-4b27-bda1-2a86d411b574 at /dev/vda
Nov 15 08:18:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:42 user nova-compute[95467]: DEBUG nova.policy [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '11bbbd3ef322402cb5dc60455a54319b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7791bd92c7c488aa72474ecde2e1155', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95467) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 08:18:42 user nova-compute[95467]: DEBUG nova.network.neutron [req-d81d13a0-5940-4188-aa6f-30ebf3d2807e req-2b84bbc7-98bd-4232-b2aa-b154628b9465 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:18:42 user nova-compute[95467]: DEBUG nova.network.neutron [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Successfully updated port: ffab8636-a06b-43fc-9aa8-fcec46b2426d {{(pid=95467) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 08:18:42 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-d81d13a0-5940-4188-aa6f-30ebf3d2807e req-2b84bbc7-98bd-4232-b2aa-b154628b9465 service nova] Releasing lock "refresh_cache-1c438a54-5528-4354-9836-f1a198532c9b" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:18:42 user nova-compute[95467]: DEBUG nova.compute.manager [req-d81d13a0-5940-4188-aa6f-30ebf3d2807e req-2b84bbc7-98bd-4232-b2aa-b154628b9465 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Received event network-changed-71b2b3bf-8597-40e5-803d-be98308390b7 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:18:42 user nova-compute[95467]: DEBUG nova.compute.manager [req-d81d13a0-5940-4188-aa6f-30ebf3d2807e req-2b84bbc7-98bd-4232-b2aa-b154628b9465 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Refreshing instance network info cache due to event network-changed-71b2b3bf-8597-40e5-803d-be98308390b7. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:18:42 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-d81d13a0-5940-4188-aa6f-30ebf3d2807e req-2b84bbc7-98bd-4232-b2aa-b154628b9465 service nova] Acquiring lock "refresh_cache-1c438a54-5528-4354-9836-f1a198532c9b" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:18:42 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-d81d13a0-5940-4188-aa6f-30ebf3d2807e req-2b84bbc7-98bd-4232-b2aa-b154628b9465 service nova] Acquired lock "refresh_cache-1c438a54-5528-4354-9836-f1a198532c9b" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:18:42 user nova-compute[95467]: DEBUG nova.network.neutron [req-d81d13a0-5940-4188-aa6f-30ebf3d2807e req-2b84bbc7-98bd-4232-b2aa-b154628b9465 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Refreshing network info cache for port 71b2b3bf-8597-40e5-803d-be98308390b7 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:18:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:42 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:18:42 user nova-compute[95467]: DEBUG nova.network.neutron [req-d81d13a0-5940-4188-aa6f-30ebf3d2807e req-2b84bbc7-98bd-4232-b2aa-b154628b9465 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Instance cache missing network info. {{(pid=95467) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 08:18:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:42 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:18:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3825a691-ac5c-4c06-b4a4-2a0b40c638c4/disk.rescue --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:42 user nova-compute[95467]: DEBUG nova.network.neutron [req-d81d13a0-5940-4188-aa6f-30ebf3d2807e req-2b84bbc7-98bd-4232-b2aa-b154628b9465 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:18:42 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-d81d13a0-5940-4188-aa6f-30ebf3d2807e req-2b84bbc7-98bd-4232-b2aa-b154628b9465 service nova] Releasing lock "refresh_cache-1c438a54-5528-4354-9836-f1a198532c9b" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:18:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3825a691-ac5c-4c06-b4a4-2a0b40c638c4/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3825a691-ac5c-4c06-b4a4-2a0b40c638c4/disk.rescue --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3825a691-ac5c-4c06-b4a4-2a0b40c638c4/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3711c883-ec5f-4a09-88f8-d4c0668ae570/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:43 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] Successfully created port: fb6b8f05-83f8-4ee0-9e3b-1efc13a335fb {{(pid=95467) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 08:18:43 user nova-compute[95467]: DEBUG nova.network.neutron [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Successfully updated port: 27370ddc-29be-446e-8205-a50379d200d7 {{(pid=95467) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 08:18:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Acquiring lock "refresh_cache-1c438a54-5528-4354-9836-f1a198532c9b" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:18:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Acquired lock "refresh_cache-1c438a54-5528-4354-9836-f1a198532c9b" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:18:43 user nova-compute[95467]: DEBUG nova.network.neutron [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:18:43 user nova-compute[95467]: DEBUG nova.compute.manager [req-5e1c4fc6-d535-4ea4-a6ec-b197cf88cf68 req-3301b447-8701-4a0e-a33b-002f44690925 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Received event network-changed-27370ddc-29be-446e-8205-a50379d200d7 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:18:43 user nova-compute[95467]: DEBUG nova.compute.manager [req-5e1c4fc6-d535-4ea4-a6ec-b197cf88cf68 req-3301b447-8701-4a0e-a33b-002f44690925 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Refreshing instance network info cache due to event network-changed-27370ddc-29be-446e-8205-a50379d200d7. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:18:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-5e1c4fc6-d535-4ea4-a6ec-b197cf88cf68 req-3301b447-8701-4a0e-a33b-002f44690925 service nova] Acquiring lock "refresh_cache-1c438a54-5528-4354-9836-f1a198532c9b" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:18:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3711c883-ec5f-4a09-88f8-d4c0668ae570/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3711c883-ec5f-4a09-88f8-d4c0668ae570/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:43 user nova-compute[95467]: DEBUG nova.network.neutron [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Instance cache missing network info. {{(pid=95467) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 08:18:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3711c883-ec5f-4a09-88f8-d4c0668ae570/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bee31898-4f12-4c68-a18b-a678f9f584aa/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:43 user nova-compute[95467]: DEBUG nova.compute.manager [req-52640739-7be2-47e1-be66-9c3165b57c68 req-da0e88b2-cf11-4493-bb03-6af819729f69 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Received event network-changed-ffab8636-a06b-43fc-9aa8-fcec46b2426d {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:18:43 user nova-compute[95467]: DEBUG nova.compute.manager [req-52640739-7be2-47e1-be66-9c3165b57c68 req-da0e88b2-cf11-4493-bb03-6af819729f69 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Refreshing instance network info cache due to event network-changed-ffab8636-a06b-43fc-9aa8-fcec46b2426d. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:18:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-52640739-7be2-47e1-be66-9c3165b57c68 req-da0e88b2-cf11-4493-bb03-6af819729f69 service nova] Acquiring lock "refresh_cache-1c438a54-5528-4354-9836-f1a198532c9b" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:18:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bee31898-4f12-4c68-a18b-a678f9f584aa/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bee31898-4f12-4c68-a18b-a678f9f584aa/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bee31898-4f12-4c68-a18b-a678f9f584aa/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:44 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:18:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bee31898-4f12-4c68-a18b-a678f9f584aa/disk.rescue --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:18:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bee31898-4f12-4c68-a18b-a678f9f584aa/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bee31898-4f12-4c68-a18b-a678f9f584aa/disk.rescue --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bee31898-4f12-4c68-a18b-a678f9f584aa/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2765af98-917a-4f0f-95af-3393e0d50a52/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2765af98-917a-4f0f-95af-3393e0d50a52/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2765af98-917a-4f0f-95af-3393e0d50a52/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:44 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] Successfully updated port: fb6b8f05-83f8-4ee0-9e3b-1efc13a335fb {{(pid=95467) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 08:18:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Acquiring lock "refresh_cache-13957136-17e4-4d38-aba3-37453e1fb878" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:18:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Acquired lock "refresh_cache-13957136-17e4-4d38-aba3-37453e1fb878" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:18:44 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:18:44 user nova-compute[95467]: INFO nova.virt.block_device [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Booting with volume e8e174af-7109-499d-8142-127fae825551 at /dev/vdc
Nov 15 08:18:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2765af98-917a-4f0f-95af-3393e0d50a52/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:44 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] Instance cache missing network info. {{(pid=95467) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 08:18:44 user nova-compute[95467]: DEBUG os_brick.utils [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:18:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:44 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9b103f-a4a7-41ba-a41a-54cf212ea727]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:882ae90641f\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:44 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[9758f0ce-9e8d-460b-94c8-9cc39c58247d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:44 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f875d5-cda1-44c0-9380-e46df2ac4f05]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:44 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60bc1f3-ce9d-4fd2-9768-b97620019afa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Running cmd (subprocess): nvme version {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] 'nvme version' failed. Not Retrying. {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] nvme not present on system {{(pid=95467) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:18:45 user nova-compute[95467]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 08:18:45 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ae1f15-f8f2-4941-a4c2-3b8eb1bc1af0]: (4, '') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=95467) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] LIGHTOS: no hostnqn found. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG os_brick.utils [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] <== get_connector_properties: return (207ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:882ae90641f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG nova.virt.block_device [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Updating existing volume attachment record: 05cf418e-e2a5-4e71-8438-1cfcc1aaaec5 {{(pid=95467) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk.rescue --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] Updating instance_info_cache with network_info: [{"id": "fb6b8f05-83f8-4ee0-9e3b-1efc13a335fb", "address": "fa:16:3e:c3:96:a0", "network": {"id": "96d9262b-11fb-497d-8e38-fa46076c010f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2069167691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7791bd92c7c488aa72474ecde2e1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb6b8f05-83", "ovs_interfaceid": "fb6b8f05-83f8-4ee0-9e3b-1efc13a335fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG nova.compute.manager [req-2b9ceeb0-825c-48f0-942b-53549e1e77f9 req-cb240409-bef7-42b9-93c4-cbb90276c49f service nova] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] Received event network-changed-fb6b8f05-83f8-4ee0-9e3b-1efc13a335fb {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG nova.compute.manager [req-2b9ceeb0-825c-48f0-942b-53549e1e77f9 req-cb240409-bef7-42b9-93c4-cbb90276c49f service nova] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] Refreshing instance network info cache due to event network-changed-fb6b8f05-83f8-4ee0-9e3b-1efc13a335fb. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-2b9ceeb0-825c-48f0-942b-53549e1e77f9 req-cb240409-bef7-42b9-93c4-cbb90276c49f service nova] Acquiring lock "refresh_cache-13957136-17e4-4d38-aba3-37453e1fb878" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk.rescue --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Releasing lock "refresh_cache-13957136-17e4-4d38-aba3-37453e1fb878" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] Instance network_info: |[{"id": "fb6b8f05-83f8-4ee0-9e3b-1efc13a335fb", "address": "fa:16:3e:c3:96:a0", "network": {"id": "96d9262b-11fb-497d-8e38-fa46076c010f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2069167691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7791bd92c7c488aa72474ecde2e1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb6b8f05-83", "ovs_interfaceid": "fb6b8f05-83f8-4ee0-9e3b-1efc13a335fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-2b9ceeb0-825c-48f0-942b-53549e1e77f9 req-cb240409-bef7-42b9-93c4-cbb90276c49f service nova] Acquired lock "refresh_cache-13957136-17e4-4d38-aba3-37453e1fb878" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG nova.network.neutron [req-2b9ceeb0-825c-48f0-942b-53549e1e77f9 req-cb240409-bef7-42b9-93c4-cbb90276c49f service nova] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] Refreshing network info cache for port fb6b8f05-83f8-4ee0-9e3b-1efc13a335fb {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:18:45 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-c4c2b11a-1709-470b-a6a2-3eb36e7001fe tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2765af98-917a-4f0f-95af-3393e0d50a52 is timed out.
Nov 15 08:18:45 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-c4c2b11a-1709-470b-a6a2-3eb36e7001fe tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Successfully detached device vdb from instance 2765af98-917a-4f0f-95af-3393e0d50a52 from the live domain config.
Nov 15 08:18:45 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4c2b11a-1709-470b-a6a2-3eb36e7001fe tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] calling os-brick to detach iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c2b11a-1709-470b-a6a2-3eb36e7001fe tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, {'target_iqn': 'iqn.2010-10.org.openstack:be86dcd5-b5b8-45a5-84ee-f14d3baa8506', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EcUzKgVr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:18:45 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-c4c2b11a-1709-470b-a6a2-3eb36e7001fe tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:18:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-c4c2b11a-1709-470b-a6a2-3eb36e7001fe tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-c4c2b11a-1709-470b-a6a2-3eb36e7001fe tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56c974c-a2f9-47c8-b032-4b22652eb274]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:be86dcd5-b5b8-45a5-84ee-f14d3baa8506\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c2b11a-1709-470b-a6a2-3eb36e7001fe tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 08:18:45 user nova-compute[95467]: No targets found.
Nov 15 08:18:45 user nova-compute[95467]: iSNS:
Nov 15 08:18:45 user nova-compute[95467]: No targets found.
Nov 15 08:18:45 user nova-compute[95467]: STATIC:
Nov 15 08:18:45 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:be86dcd5-b5b8-45a5-84ee-f14d3baa8506
Nov 15 08:18:45 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:18:45 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:18:45 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059
Nov 15 08:18:45 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:18:45 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:18:45 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e
Nov 15 08:18:45 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:18:45 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:18:45 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149
Nov 15 08:18:45 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:18:45 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:18:45 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81
Nov 15 08:18:45 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:18:45 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:18:45 user nova-compute[95467]: FIRMWARE:
Nov 15 08:18:45 user nova-compute[95467]: No targets found.
Nov 15 08:18:45 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c2b11a-1709-470b-a6a2-3eb36e7001fe tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 08:18:45 user nova-compute[95467]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 08:18:45 user nova-compute[95467]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=95467) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c2b11a-1709-470b-a6a2-3eb36e7001fe tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be86dcd5-b5b8-45a5-84ee-f14d3baa8506', 0)] {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[64809071-b922-4d17-bd3e-cd2ba958d71f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be86dcd5-b5b8-45a5-84ee-f14d3baa8506\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[978cd7c8-66e3-4c71-a070-da792ed60e43]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be86dcd5-b5b8-45a5-84ee-f14d3baa8506 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c2b11a-1709-470b-a6a2-3eb36e7001fe tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 (non-flash)
Nov 15 08:18:45 user nova-compute[95467]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:18:45 user nova-compute[95467]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)
Nov 15 08:18:45 user nova-compute[95467]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 (non-flash)
Nov 15 08:18:45 user nova-compute[95467]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be86dcd5-b5b8-45a5-84ee-f14d3baa8506 (non-flash)
Nov 15 08:18:45 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c2b11a-1709-470b-a6a2-3eb36e7001fe tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 (non-flash)
Nov 15 08:18:45 user nova-compute[95467]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:18:45 user nova-compute[95467]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)
Nov 15 08:18:45 user nova-compute[95467]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 (non-flash)
Nov 15 08:18:45 user nova-compute[95467]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be86dcd5-b5b8-45a5-84ee-f14d3baa8506 (non-flash)
Nov 15 08:18:45 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c2b11a-1709-470b-a6a2-3eb36e7001fe tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efec85713f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be86dcd5-b5b8-45a5-84ee-f14d3baa8506'): ({'sdg'}, set())}) {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-c4c2b11a-1709-470b-a6a2-3eb36e7001fe tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Removing single pathed devices sdg {{(pid=95467) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f371ac-3238-4c13-91b7-7e7f6ae13e0b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba518ab-8a68-4c2d-9faf-6e6ccfc365c8]: (4, ('ok\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-c4c2b11a-1709-470b-a6a2-3eb36e7001fe tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Flushing IO for device /dev/sdg {{(pid=95467) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a50efa1-6ef5-495a-949e-d393fc61de2c]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-c4c2b11a-1709-470b-a6a2-3eb36e7001fe tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=95467) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.040s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ca6c3e-41b8-47b4-8f68-3453968bbfbf]: (4, ('1', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-c4c2b11a-1709-470b-a6a2-3eb36e7001fe tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-c4c2b11a-1709-470b-a6a2-3eb36e7001fe tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] SCSI volumes sdg have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c2b11a-1709-470b-a6a2-3eb36e7001fe tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be86dcd5-b5b8-45a5-84ee-f14d3baa8506')] {{(pid=95467) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be86dcd5-b5b8-45a5-84ee-f14d3baa8506 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be86dcd5-b5b8-45a5-84ee-f14d3baa8506 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dbaa6a4-4c54-4a45-9ed7-034a73528301]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c2b11a-1709-470b-a6a2-3eb36e7001fe tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be86dcd5-b5b8-45a5-84ee-f14d3baa8506 -p 172.16.0.220:3260 --logout {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be86dcd5-b5b8-45a5-84ee-f14d3baa8506 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3de6592-a205-4fe5-83d1-5929d7e67596]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:be86dcd5-b5b8-45a5-84ee-f14d3baa8506, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:be86dcd5-b5b8-45a5-84ee-f14d3baa8506, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c2b11a-1709-470b-a6a2-3eb36e7001fe tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:be86dcd5-b5b8-45a5-84ee-f14d3baa8506, portal: 172.16.0.220,3260]
Nov 15 08:18:45 user nova-compute[95467]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:be86dcd5-b5b8-45a5-84ee-f14d3baa8506, portal: 172.16.0.220,3260] successful.
Nov 15 08:18:45 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be86dcd5-b5b8-45a5-84ee-f14d3baa8506 -p 172.16.0.220:3260 --op delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be86dcd5-b5b8-45a5-84ee-f14d3baa8506 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94ed50b-99c7-47d8-bcc8-27469d9cd441]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c2b11a-1709-470b-a6a2-3eb36e7001fe tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-c4c2b11a-1709-470b-a6a2-3eb36e7001fe tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c2b11a-1709-470b-a6a2-3eb36e7001fe tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] <== disconnect_volume: return (358ms) None {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:18:45 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4c2b11a-1709-470b-a6a2-3eb36e7001fe tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] Disconnected iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 08:18:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7805e5c-1777-4b0c-95c7-b232be66528c/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:46 user nova-compute[95467]: DEBUG nova.network.neutron [req-2b9ceeb0-825c-48f0-942b-53549e1e77f9 req-cb240409-bef7-42b9-93c4-cbb90276c49f service nova] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] Updated VIF entry in instance network info cache for port fb6b8f05-83f8-4ee0-9e3b-1efc13a335fb. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:18:46 user nova-compute[95467]: DEBUG nova.network.neutron [req-2b9ceeb0-825c-48f0-942b-53549e1e77f9 req-cb240409-bef7-42b9-93c4-cbb90276c49f service nova] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] Updating instance_info_cache with network_info: [{"id": "fb6b8f05-83f8-4ee0-9e3b-1efc13a335fb", "address": "fa:16:3e:c3:96:a0", "network": {"id": "96d9262b-11fb-497d-8e38-fa46076c010f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2069167691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7791bd92c7c488aa72474ecde2e1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb6b8f05-83", "ovs_interfaceid": "fb6b8f05-83f8-4ee0-9e3b-1efc13a335fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:18:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7805e5c-1777-4b0c-95c7-b232be66528c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7805e5c-1777-4b0c-95c7-b232be66528c/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-2b9ceeb0-825c-48f0-942b-53549e1e77f9 req-cb240409-bef7-42b9-93c4-cbb90276c49f service nova] Releasing lock "refresh_cache-13957136-17e4-4d38-aba3-37453e1fb878" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:18:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7805e5c-1777-4b0c-95c7-b232be66528c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:46 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:18:46 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:18:46 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:18:46 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Hypervisor/Node resource view: name=user free_ram=7359MB free_disk=25.116806030273438GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=95467) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 08:18:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:18:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:18:47 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 73fe8852-c47a-47ab-a56f-6864c8ed5479 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:18:47 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 21cf2ada-b15c-490d-ac37-96e9c87e9056 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:18:47 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 3711c883-ec5f-4a09-88f8-d4c0668ae570 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:18:47 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance bee31898-4f12-4c68-a18b-a678f9f584aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:18:47 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:18:47 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 10d73b73-ca65-4192-8954-288dc1df9f24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:18:47 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 3825a691-ac5c-4c06-b4a4-2a0b40c638c4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:18:47 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 2765af98-917a-4f0f-95af-3393e0d50a52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:18:47 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 851d354c-7f20-4e72-bfd2-a781b929e8ba actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:18:47 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance e7805e5c-1777-4b0c-95c7-b232be66528c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:18:47 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 1c438a54-5528-4354-9836-f1a198532c9b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:18:47 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 13957136-17e4-4d38-aba3-37453e1fb878 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:18:47 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 08:18:47 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 08:18:47 user nova-compute[95467]: DEBUG nova.network.neutron [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Updating instance_info_cache with network_info: [{"id": "5cab4329-e3d7-4d50-9a27-c1291f6f4b4a", "address": "fa:16:3e:52:67:fa", "network": {"id": "ca364f10-9c7d-4574-ae0a-76a1a2a3116d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-497069669-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cab4329-e3", "ovs_interfaceid": "5cab4329-e3d7-4d50-9a27-c1291f6f4b4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d6c4a108-4733-4daa-935a-56424ed362e9", "address": "fa:16:3e:d7:91:0a", "network": {"id": "fd06ef46-be25-4b52-8c3b-cda8a4ec8124", "bridge": "br-int", "label": "tempest-device-tagging-net1-887816556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c4a108-47", "ovs_interfaceid": "d6c4a108-4733-4daa-935a-56424ed362e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "68127374-b841-456d-b9eb-29e96bd43dc6", "address": "fa:16:3e:0c:8b:29", "network": {"id": "fd06ef46-be25-4b52-8c3b-cda8a4ec8124", "bridge": "br-int", "label": "tempest-device-tagging-net1-887816556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68127374-b8", "ovs_interfaceid": "68127374-b841-456d-b9eb-29e96bd43dc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "79b592a8-b5f9-48e6-ae2d-d535ded922b1", "address": "fa:16:3e:f8:e1:13", "network": {"id": "fd06ef46-be25-4b52-8c3b-cda8a4ec8124", "bridge": "br-int", "label": "tempest-device-tagging-net1-887816556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79b592a8-b5", "ovs_interfaceid": "79b592a8-b5f9-48e6-ae2d-d535ded922b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "71b2b3bf-8597-40e5-803d-be98308390b7", "address": "fa:16:3e:97:58:f0", "network": {"id": "fd06ef46-be25-4b52-8c3b-cda8a4ec8124", "bridge": "br-int", "label": "tempest-device-tagging-net1-887816556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71b2b3bf-85", "ovs_interfaceid": "71b2b3bf-8597-40e5-803d-be98308390b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ffab8636-a06b-43fc-9aa8-fcec46b2426d", "address": "fa:16:3e:60:ba:2c", "network": {"id": "eee7a16a-db60-4993-aaae-5142fa17ff37", "bridge": "br-int", "label": "tempest-device-tagging-net2-2138433061", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffab8636-a0", "ovs_interfaceid": "ffab8636-a06b-43fc-9aa8-fcec46b2426d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "27370ddc-29be-446e-8205-a50379d200d7", "address": "fa:16:3e:36:19:6a", "network": {"id": "eee7a16a-db60-4993-aaae-5142fa17ff37", "bridge": "br-int", "label": "tempest-device-tagging-net2-2138433061", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27370ddc-29", "ovs_interfaceid": "27370ddc-29be-446e-8205-a50379d200d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:18:47 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Releasing lock "refresh_cache-1c438a54-5528-4354-9836-f1a198532c9b" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:18:47 user nova-compute[95467]: DEBUG nova.compute.manager [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Instance network_info: |[{"id": "5cab4329-e3d7-4d50-9a27-c1291f6f4b4a", "address": "fa:16:3e:52:67:fa", "network": {"id": "ca364f10-9c7d-4574-ae0a-76a1a2a3116d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-497069669-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cab4329-e3", "ovs_interfaceid": "5cab4329-e3d7-4d50-9a27-c1291f6f4b4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d6c4a108-4733-4daa-935a-56424ed362e9", "address": "fa:16:3e:d7:91:0a", "network": {"id": "fd06ef46-be25-4b52-8c3b-cda8a4ec8124", "bridge": "br-int", "label": "tempest-device-tagging-net1-887816556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c4a108-47", "ovs_interfaceid": "d6c4a108-4733-4daa-935a-56424ed362e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "68127374-b841-456d-b9eb-29e96bd43dc6", "address": "fa:16:3e:0c:8b:29", "network": {"id": "fd06ef46-be25-4b52-8c3b-cda8a4ec8124", "bridge": "br-int", "label": "tempest-device-tagging-net1-887816556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68127374-b8", "ovs_interfaceid": "68127374-b841-456d-b9eb-29e96bd43dc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "79b592a8-b5f9-48e6-ae2d-d535ded922b1", "address": "fa:16:3e:f8:e1:13", "network": {"id": "fd06ef46-be25-4b52-8c3b-cda8a4ec8124", "bridge": "br-int", "label": "tempest-device-tagging-net1-887816556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79b592a8-b5", "ovs_interfaceid": "79b592a8-b5f9-48e6-ae2d-d535ded922b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "71b2b3bf-8597-40e5-803d-be98308390b7", "address": "fa:16:3e:97:58:f0", "network": {"id": "fd06ef46-be25-4b52-8c3b-cda8a4ec8124", "bridge": "br-int", "label": "tempest-device-tagging-net1-887816556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71b2b3bf-85", "ovs_interfaceid": "71b2b3bf-8597-40e5-803d-be98308390b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ffab8636-a06b-43fc-9aa8-fcec46b2426d", "address": "fa:16:3e:60:ba:2c", "network": {"id": "eee7a16a-db60-4993-aaae-5142fa17ff37", "bridge": "br-int", "label": "tempest-device-tagging-net2-2138433061", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffab8636-a0", "ovs_interfaceid": "ffab8636-a06b-43fc-9aa8-fcec46b2426d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "27370ddc-29be-446e-8205-a50379d200d7", "address": "fa:16:3e:36:19:6a", "network": {"id": "eee7a16a-db60-4993-aaae-5142fa17ff37", "bridge": "br-int", "label": "tempest-device-tagging-net2-2138433061", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27370ddc-29", "ovs_interfaceid": "27370ddc-29be-446e-8205-a50379d200d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 08:18:47 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-5e1c4fc6-d535-4ea4-a6ec-b197cf88cf68 req-3301b447-8701-4a0e-a33b-002f44690925 service nova] Acquired lock "refresh_cache-1c438a54-5528-4354-9836-f1a198532c9b" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:18:47 user nova-compute[95467]: DEBUG nova.network.neutron [req-5e1c4fc6-d535-4ea4-a6ec-b197cf88cf68 req-3301b447-8701-4a0e-a33b-002f44690925 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Refreshing network info cache for port 27370ddc-29be-446e-8205-a50379d200d7 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:18:47 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:18:47 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:18:47 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:18:47 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Compute_service record updated for user:user {{(pid=95467) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 08:18:47 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.551s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:18:47 user nova-compute[95467]: DEBUG nova.network.neutron [req-5e1c4fc6-d535-4ea4-a6ec-b197cf88cf68 req-3301b447-8701-4a0e-a33b-002f44690925 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Updated VIF entry in instance network info cache for port 27370ddc-29be-446e-8205-a50379d200d7. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:18:47 user nova-compute[95467]: DEBUG nova.network.neutron [req-5e1c4fc6-d535-4ea4-a6ec-b197cf88cf68 req-3301b447-8701-4a0e-a33b-002f44690925 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Updating instance_info_cache with network_info: [{"id": "5cab4329-e3d7-4d50-9a27-c1291f6f4b4a", "address": "fa:16:3e:52:67:fa", "network": {"id": "ca364f10-9c7d-4574-ae0a-76a1a2a3116d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-497069669-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cab4329-e3", "ovs_interfaceid": "5cab4329-e3d7-4d50-9a27-c1291f6f4b4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d6c4a108-4733-4daa-935a-56424ed362e9", "address": "fa:16:3e:d7:91:0a", "network": {"id": "fd06ef46-be25-4b52-8c3b-cda8a4ec8124", "bridge": "br-int", "label": "tempest-device-tagging-net1-887816556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c4a108-47", "ovs_interfaceid": "d6c4a108-4733-4daa-935a-56424ed362e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "68127374-b841-456d-b9eb-29e96bd43dc6", "address": "fa:16:3e:0c:8b:29", "network": {"id": "fd06ef46-be25-4b52-8c3b-cda8a4ec8124", "bridge": "br-int", "label": "tempest-device-tagging-net1-887816556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68127374-b8", "ovs_interfaceid": "68127374-b841-456d-b9eb-29e96bd43dc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "79b592a8-b5f9-48e6-ae2d-d535ded922b1", "address": "fa:16:3e:f8:e1:13", "network": {"id": "fd06ef46-be25-4b52-8c3b-cda8a4ec8124", "bridge": "br-int", "label": "tempest-device-tagging-net1-887816556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79b592a8-b5", "ovs_interfaceid": "79b592a8-b5f9-48e6-ae2d-d535ded922b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "71b2b3bf-8597-40e5-803d-be98308390b7", "address": "fa:16:3e:97:58:f0", "network": {"id": "fd06ef46-be25-4b52-8c3b-cda8a4ec8124", "bridge": "br-int", "label": "tempest-device-tagging-net1-887816556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71b2b3bf-85", "ovs_interfaceid": "71b2b3bf-8597-40e5-803d-be98308390b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ffab8636-a06b-43fc-9aa8-fcec46b2426d", "address": "fa:16:3e:60:ba:2c", "network": {"id": "eee7a16a-db60-4993-aaae-5142fa17ff37", "bridge": "br-int", "label": "tempest-device-tagging-net2-2138433061", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffab8636-a0", "ovs_interfaceid": "ffab8636-a06b-43fc-9aa8-fcec46b2426d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "27370ddc-29be-446e-8205-a50379d200d7", "address": "fa:16:3e:36:19:6a", "network": {"id": "eee7a16a-db60-4993-aaae-5142fa17ff37", "bridge": "br-int", "label": "tempest-device-tagging-net2-2138433061", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27370ddc-29", "ovs_interfaceid": "27370ddc-29be-446e-8205-a50379d200d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:18:47 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-5e1c4fc6-d535-4ea4-a6ec-b197cf88cf68 req-3301b447-8701-4a0e-a33b-002f44690925 service nova] Releasing lock "refresh_cache-1c438a54-5528-4354-9836-f1a198532c9b" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:18:47 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-52640739-7be2-47e1-be66-9c3165b57c68 req-da0e88b2-cf11-4493-bb03-6af819729f69 service nova] Acquired lock "refresh_cache-1c438a54-5528-4354-9836-f1a198532c9b" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:18:47 user nova-compute[95467]: DEBUG nova.network.neutron [req-52640739-7be2-47e1-be66-9c3165b57c68 req-da0e88b2-cf11-4493-bb03-6af819729f69 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Refreshing network info cache for port ffab8636-a06b-43fc-9aa8-fcec46b2426d {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:18:47 user nova-compute[95467]: DEBUG os_brick.utils [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:18:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:47 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a4a987-6e02-4b7c-a8a0-89f0e884807f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:882ae90641f\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:48 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe635be-c812-4526-b688-6f5db53e5347]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:48 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc200a6-1b55-4fe2-ba53-508a9a0f255b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:48 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb38e66-a3bd-4801-ad22-b0b8715cac5e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Running cmd (subprocess): nvme version {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] 'nvme version' failed. Not Retrying. {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:18:48 user nova-compute[95467]: DEBUG nova.network.neutron [req-52640739-7be2-47e1-be66-9c3165b57c68 req-da0e88b2-cf11-4493-bb03-6af819729f69 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Updated VIF entry in instance network info cache for port ffab8636-a06b-43fc-9aa8-fcec46b2426d. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:18:48 user nova-compute[95467]: DEBUG nova.network.neutron [req-52640739-7be2-47e1-be66-9c3165b57c68 req-da0e88b2-cf11-4493-bb03-6af819729f69 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Updating instance_info_cache with network_info: [{"id": "5cab4329-e3d7-4d50-9a27-c1291f6f4b4a", "address": "fa:16:3e:52:67:fa", "network": {"id": "ca364f10-9c7d-4574-ae0a-76a1a2a3116d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-497069669-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cab4329-e3", "ovs_interfaceid": "5cab4329-e3d7-4d50-9a27-c1291f6f4b4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d6c4a108-4733-4daa-935a-56424ed362e9", "address": "fa:16:3e:d7:91:0a", "network": {"id": "fd06ef46-be25-4b52-8c3b-cda8a4ec8124", "bridge": "br-int", "label": "tempest-device-tagging-net1-887816556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c4a108-47", "ovs_interfaceid": "d6c4a108-4733-4daa-935a-56424ed362e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "68127374-b841-456d-b9eb-29e96bd43dc6", "address": "fa:16:3e:0c:8b:29", "network": {"id": "fd06ef46-be25-4b52-8c3b-cda8a4ec8124", "bridge": "br-int", "label": "tempest-device-tagging-net1-887816556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68127374-b8", "ovs_interfaceid": "68127374-b841-456d-b9eb-29e96bd43dc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "79b592a8-b5f9-48e6-ae2d-d535ded922b1", "address": "fa:16:3e:f8:e1:13", "network": {"id": "fd06ef46-be25-4b52-8c3b-cda8a4ec8124", "bridge": "br-int", "label": "tempest-device-tagging-net1-887816556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79b592a8-b5", "ovs_interfaceid": "79b592a8-b5f9-48e6-ae2d-d535ded922b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "71b2b3bf-8597-40e5-803d-be98308390b7", "address": "fa:16:3e:97:58:f0", "network": {"id": "fd06ef46-be25-4b52-8c3b-cda8a4ec8124", "bridge": "br-int", "label": "tempest-device-tagging-net1-887816556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71b2b3bf-85", "ovs_interfaceid": "71b2b3bf-8597-40e5-803d-be98308390b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ffab8636-a06b-43fc-9aa8-fcec46b2426d", "address": "fa:16:3e:60:ba:2c", "network": {"id": "eee7a16a-db60-4993-aaae-5142fa17ff37", "bridge": "br-int", "label": "tempest-device-tagging-net2-2138433061", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffab8636-a0", "ovs_interfaceid": "ffab8636-a06b-43fc-9aa8-fcec46b2426d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "27370ddc-29be-446e-8205-a50379d200d7", "address": "fa:16:3e:36:19:6a", "network": {"id": "eee7a16a-db60-4993-aaae-5142fa17ff37", "bridge": "br-int", "label": "tempest-device-tagging-net2-2138433061", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27370ddc-29", "ovs_interfaceid": "27370ddc-29be-446e-8205-a50379d200d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:18:48 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] nvme not present on system {{(pid=95467) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 08:18:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-52640739-7be2-47e1-be66-9c3165b57c68 req-da0e88b2-cf11-4493-bb03-6af819729f69 service nova] Releasing lock "refresh_cache-1c438a54-5528-4354-9836-f1a198532c9b" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:18:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:18:48 user nova-compute[95467]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 08:18:48 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6eb6ce-28b1-4add-ac78-821f2911fb59]: (4, '') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:48 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=95467) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 08:18:48 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 08:18:48 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] LIGHTOS: no hostnqn found. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 08:18:48 user nova-compute[95467]: DEBUG os_brick.utils [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:882ae90641f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:18:48 user nova-compute[95467]: DEBUG nova.virt.block_device [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] Updating existing volume attachment record: e1829709-49e3-455c-a5f2-03bfb886f69a {{(pid=95467) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 08:18:48 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:18:48 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:18:48 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Starting heal instance info cache {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 08:18:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "refresh_cache-73fe8852-c47a-47ab-a56f-6864c8ed5479" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:18:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquired lock "refresh_cache-73fe8852-c47a-47ab-a56f-6864c8ed5479" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:18:48 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] Forcefully refreshing network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 08:18:48 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] Updating instance_info_cache with network_info: [{"id": "d7e5ca44-eee3-4452-9649-5fcbfe5ed5ad", "address": "fa:16:3e:e5:16:8b", "network": {"id": "d8a362dc-0dc8-49dd-b2da-0e0749d5edca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-256373617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a1aa4f562c64545a94157d4aaf8d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7e5ca44-ee", "ovs_interfaceid": "d7e5ca44-eee3-4452-9649-5fcbfe5ed5ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:18:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Releasing lock "refresh_cache-73fe8852-c47a-47ab-a56f-6864c8ed5479" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:18:48 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] Updated the network info_cache for instance {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 08:18:48 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:18:48 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:18:48 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:18:48 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:18:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:18:49 user nova-compute[95467]: DEBUG nova.objects.instance [None req-c4c2b11a-1709-470b-a6a2-3eb36e7001fe tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lazy-loading 'flavor' on Instance uuid 2765af98-917a-4f0f-95af-3393e0d50a52 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:18:49 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-c4c2b11a-1709-470b-a6a2-3eb36e7001fe tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "2765af98-917a-4f0f-95af-3393e0d50a52" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.650s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:18:52 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-fc334b07-9808-412d-8b8c-0250707f54cf tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3711c883-ec5f-4a09-88f8-d4c0668ae570 is timed out.
Nov 15 08:18:52 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-fc334b07-9808-412d-8b8c-0250707f54cf tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Successfully detached device vdb from instance 3711c883-ec5f-4a09-88f8-d4c0668ae570 from the live domain config.
Nov 15 08:18:52 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc334b07-9808-412d-8b8c-0250707f54cf tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] calling os-brick to detach iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 08:18:52 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc334b07-9808-412d-8b8c-0250707f54cf tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, {'target_iqn': 'iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FrEomLTX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:18:52 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-fc334b07-9808-412d-8b8c-0250707f54cf tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:18:52 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-fc334b07-9808-412d-8b8c-0250707f54cf tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:18:52 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-fc334b07-9808-412d-8b8c-0250707f54cf tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:18:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:52 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4db2f5-07dd-4095-8659-86283c11f850]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:52 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc334b07-9808-412d-8b8c-0250707f54cf tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 08:18:52 user nova-compute[95467]: No targets found.
Nov 15 08:18:52 user nova-compute[95467]: iSNS:
Nov 15 08:18:52 user nova-compute[95467]: No targets found.
Nov 15 08:18:52 user nova-compute[95467]: STATIC:
Nov 15 08:18:52 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059
Nov 15 08:18:52 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:18:52 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:18:52 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e
Nov 15 08:18:52 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:18:52 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:18:52 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149
Nov 15 08:18:52 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:18:52 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:18:52 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81
Nov 15 08:18:52 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:18:52 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:18:52 user nova-compute[95467]: FIRMWARE:
Nov 15 08:18:52 user nova-compute[95467]: No targets found.
Nov 15 08:18:52 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:18:52 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc334b07-9808-412d-8b8c-0250707f54cf tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 08:18:52 user nova-compute[95467]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 08:18:52 user nova-compute[95467]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=95467) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 08:18:52 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc334b07-9808-412d-8b8c-0250707f54cf tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059', 0)] {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 08:18:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:52 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d1d92b-1a64-43f5-a13d-792a7ab992fc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:52 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5b2e8a-b8bc-416b-b782-18c71a1f28e9]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:52 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc334b07-9808-412d-8b8c-0250707f54cf tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 (non-flash)
Nov 15 08:18:52 user nova-compute[95467]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:18:52 user nova-compute[95467]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)
Nov 15 08:18:52 user nova-compute[95467]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 (non-flash)
Nov 15 08:18:52 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:18:52 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc334b07-9808-412d-8b8c-0250707f54cf tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 (non-flash)
Nov 15 08:18:52 user nova-compute[95467]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:18:52 user nova-compute[95467]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)
Nov 15 08:18:52 user nova-compute[95467]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 (non-flash)
Nov 15 08:18:52 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:18:52 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc334b07-9808-412d-8b8c-0250707f54cf tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efec836dbd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059'): ({'sdc'}, set())}) {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 08:18:52 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-fc334b07-9808-412d-8b8c-0250707f54cf tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Removing single pathed devices sdc {{(pid=95467) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 08:18:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:52 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c07655-41f6-494a-bbb7-d79b51e35cec]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:52 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:18:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:52 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f0dc86-ed61-452c-9680-7b756a304fd8]: (4, ('ok\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:52 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-fc334b07-9808-412d-8b8c-0250707f54cf tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Flushing IO for device /dev/sdc {{(pid=95467) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 08:18:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:52 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf1d49a-70af-4ec9-9ef3-161b430dc48f]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:52 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-fc334b07-9808-412d-8b8c-0250707f54cf tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=95467) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 08:18:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:52 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[82796819-53bf-4348-bf6f-d8cfab6c149c]: (4, ('1', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:52 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-fc334b07-9808-412d-8b8c-0250707f54cf tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 08:18:52 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-fc334b07-9808-412d-8b8c-0250707f54cf tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] SCSI volumes sdc have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 08:18:52 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc334b07-9808-412d-8b8c-0250707f54cf tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059')] {{(pid=95467) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 08:18:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:52 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f96ae8-aaa1-4dea-8804-875e53e58748]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:52 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc334b07-9808-412d-8b8c-0250707f54cf tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:18:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 -p 172.16.0.220:3260 --logout {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:52 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e62fa48-b6f0-4828-a8dc-924d01112c71]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:52 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc334b07-9808-412d-8b8c-0250707f54cf tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059, portal: 172.16.0.220,3260]
Nov 15 08:18:52 user nova-compute[95467]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059, portal: 172.16.0.220,3260] successful.
Nov 15 08:18:52 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:18:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 -p 172.16.0.220:3260 --op delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b831aa-76f1-46c0-9c6c-6f3de448b059 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:52 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f180c7-478c-488b-b76a-67689b157855]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:52 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc334b07-9808-412d-8b8c-0250707f54cf tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:18:52 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-fc334b07-9808-412d-8b8c-0250707f54cf tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:18:52 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc334b07-9808-412d-8b8c-0250707f54cf tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] <== disconnect_volume: return (292ms) None {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:18:52 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc334b07-9808-412d-8b8c-0250707f54cf tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Disconnected iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 08:18:53 user nova-compute[95467]: DEBUG nova.objects.instance [None req-fc334b07-9808-412d-8b8c-0250707f54cf tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lazy-loading 'flavor' on Instance uuid 3711c883-ec5f-4a09-88f8-d4c0668ae570 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:18:53 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-fc334b07-9808-412d-8b8c-0250707f54cf tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "3711c883-ec5f-4a09-88f8-d4c0668ae570" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.611s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:18:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG nova.compute.manager [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Start spawning the instance on the hypervisor. {{(pid=95467) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Creating instance directory {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 08:18:57 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Creating image(s)
Nov 15 08:18:57 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Did not create local disks {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Ensure instance console log exists: /opt/stack/data/nova/instances/1c438a54-5528-4354-9836-f1a198532c9b/console.log {{(pid=95467) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Start _get_guest_xml network_info=[{"id": "5cab4329-e3d7-4d50-9a27-c1291f6f4b4a", "address": "fa:16:3e:52:67:fa", "network": {"id": "ca364f10-9c7d-4574-ae0a-76a1a2a3116d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-497069669-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cab4329-e3", "ovs_interfaceid": "5cab4329-e3d7-4d50-9a27-c1291f6f4b4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d6c4a108-4733-4daa-935a-56424ed362e9", "address": "fa:16:3e:d7:91:0a", "network": {"id": "fd06ef46-be25-4b52-8c3b-cda8a4ec8124", "bridge": "br-int", "label": "tempest-device-tagging-net1-887816556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c4a108-47", "ovs_interfaceid": "d6c4a108-4733-4daa-935a-56424ed362e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "68127374-b841-456d-b9eb-29e96bd43dc6", "address": "fa:16:3e:0c:8b:29", "network": {"id": "fd06ef46-be25-4b52-8c3b-cda8a4ec8124", "bridge": "br-int", "label": "tempest-device-tagging-net1-887816556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68127374-b8", "ovs_interfaceid": "68127374-b841-456d-b9eb-29e96bd43dc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "79b592a8-b5f9-48e6-ae2d-d535ded922b1", "address": "fa:16:3e:f8:e1:13", "network": {"id": "fd06ef46-be25-4b52-8c3b-cda8a4ec8124", "bridge": "br-int", "label": "tempest-device-tagging-net1-887816556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79b592a8-b5", "ovs_interfaceid": "79b592a8-b5f9-48e6-ae2d-d535ded922b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "71b2b3bf-8597-40e5-803d-be98308390b7", "address": "fa:16:3e:97:58:f0", "network": {"id": "fd06ef46-be25-4b52-8c3b-cda8a4ec8124", "bridge": "br-int", "label": "tempest-device-tagging-net1-887816556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71b2b3bf-85", "ovs_interfaceid": "71b2b3bf-8597-40e5-803d-be98308390b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ffab8636-a06b-43fc-9aa8-fcec46b2426d", "address": "fa:16:3e:60:ba:2c", "network": {"id": "eee7a16a-db60-4993-aaae-5142fa17ff37", "bridge": "br-int", "label": "tempest-device-tagging-net2-2138433061", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffab8636-a0", "ovs_interfaceid": "ffab8636-a06b-43fc-9aa8-fcec46b2426d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "27370ddc-29be-446e-8205-a50379d200d7", "address": "fa:16:3e:36:19:6a", "network": {"id": "eee7a16a-db60-4993-aaae-5142fa17ff37", "bridge": "br-int", "label": "tempest-device-tagging-net2-2138433061", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27370ddc-29", "ovs_interfaceid": "27370ddc-29be-446e-8205-a50379d200d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '0eb3ad85-d3ac-4fdb-9dcd-dd6c7bdbc721', 'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CVtZzOqD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1c438a54-5528-4354-9836-f1a198532c9b', 'attached_at': '', 'detached_at': '', 'volume_id': '74097ec0-88f6-4b8c-b01f-3be5fdbdf87b', 'serial': '74097ec0-88f6-4b8c-b01f-3be5fdbdf87b'}, 'volume_type': None}, {'attachment_id': '52c8f620-1fdd-42b3-9761-1a6937a27970', 'delete_on_termination': False, 'boot_index': 1, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oflqFjBz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1c438a54-5528-4354-9836-f1a198532c9b', 'attached_at': '', 'detached_at': '', 'volume_id': 'bef17724-2105-4964-a1f3-57663bf01612', 'serial': 'bef17724-2105-4964-a1f3-57663bf01612'}, 'volume_type': None}, {'attachment_id': '05cf418e-e2a5-4e71-8438-1cfcc1aaaec5', 'delete_on_termination': False, 'boot_index': 2, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yImUtSeO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1c438a54-5528-4354-9836-f1a198532c9b', 'attached_at': '', 'detached_at': '', 'volume_id': 'e8e174af-7109-499d-8142-127fae825551', 'serial': 'e8e174af-7109-499d-8142-127fae825551'}, 'volume_type': None} {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:18:57 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:18:57 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:18:57 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Calling os-brick to attach iSCSI Volume {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CVtZzOqD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:18:57 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:18:57 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:18:57 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:18:57 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:18:57 user nova-compute[95467]: INFO os_brick.initiator.connectors.iscsi [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 08:18:57 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] Start spawning the instance on the hypervisor. {{(pid=95467) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] Creating instance directory {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 08:18:57 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] Creating image(s)
Nov 15 08:18:57 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] Did not create local disks {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] Ensure instance console log exists: /opt/stack/data/nova/instances/13957136-17e4-4d38-aba3-37453e1fb878/console.log {{(pid=95467) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] Start _get_guest_xml network_info=[{"id": "fb6b8f05-83f8-4ee0-9e3b-1efc13a335fb", "address": "fa:16:3e:c3:96:a0", "network": {"id": "96d9262b-11fb-497d-8e38-fa46076c010f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2069167691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7791bd92c7c488aa72474ecde2e1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb6b8f05-83", "ovs_interfaceid": "fb6b8f05-83f8-4ee0-9e3b-1efc13a335fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-15T08:18:36Z,direct_url=<?>,disk_format='qcow2',id=5f4b45b8-26f5-436f-bfae-87ad013c9492,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1604506464',owner='e7791bd92c7c488aa72474ecde2e1155',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-15T08:18:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'e1829709-49e3-455c-a5f2-03bfb886f69a', 'delete_on_termination': True, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SiQnKfkJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '13957136-17e4-4d38-aba3-37453e1fb878', 'attached_at': '', 'detached_at': '', 'volume_id': '45d4eaa4-4485-488d-88b5-068a6e58d5e7', 'serial': '45d4eaa4-4485-488d-88b5-068a6e58d5e7'}, 'volume_type': None} {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b -p 172.16.0.220:3260 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:57 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:18:57 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:18:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cbfdee1-cb45-4ae1-bb28-dddfe2a1967b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 08:18:57 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b -p 172.16.0.220:3260 --interface default --op new {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-15T08:18:36Z,direct_url=<?>,disk_format='qcow2',id=5f4b45b8-26f5-436f-bfae-87ad013c9492,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1604506464',owner='e7791bd92c7c488aa72474ecde2e1155',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-15T08:18:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] Calling os-brick to attach iSCSI Volume {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SiQnKfkJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:18:57 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:18:57 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[6547af8e-98dc-464a-94e9-3a2cc703e81a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b] added\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b] added
Nov 15 08:18:57 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[01454e85-214c-441d-9a93-5db0b4b817ae]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a5f0b6-83ce-4a44-81b5-1449f58ff6d7]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CVtZzOqD {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CVtZzOqD" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f2b8b0-42c0-422f-be44-f47e82c5c786]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CVtZzOqD'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c80be37-a6d6-4934-8592-015fef514abc]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c8e43c-76f7-49f3-b8ad-f040f3279390]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:18:57 user nova-compute[95467]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)
Nov 15 08:18:57 user nova-compute[95467]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 (non-flash)
Nov 15 08:18:57 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:18:57 user nova-compute[95467]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)
Nov 15 08:18:57 user nova-compute[95467]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 (non-flash)
Nov 15 08:18:57 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b -p 172.16.0.220:3260 --login {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de1f040-09a1-4376-92c1-3e0e2c063f35]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b, portal: 172.16.0.220,3260]
Nov 15 08:18:57 user nova-compute[95467]: Login to [iface: default, target: iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b, portal: 172.16.0.220,3260] successful.
Nov 15 08:18:57 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[865cb7f0-130d-46b0-9a65-2d320d2c4794]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0436f66-3556-47fd-90fe-c710c628d0ff]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:18:57 user nova-compute[95467]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)
Nov 15 08:18:57 user nova-compute[95467]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 (non-flash)
Nov 15 08:18:57 user nova-compute[95467]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b (non-flash)
Nov 15 08:18:57 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:18:57 user nova-compute[95467]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)
Nov 15 08:18:57 user nova-compute[95467]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 (non-flash)
Nov 15 08:18:57 user nova-compute[95467]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b (non-flash)
Nov 15 08:18:57 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Connected to 172.16.0.220:3260 {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] HCTL ('34', '-', '-', 0) found on session 27 with lun 0 {{(pid=95467) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=95467) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 08:18:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:58 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:58 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3538b63-06d7-4e2a-8e1e-85e2e38d3854]: (4, ('- - 0', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:58 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Searching for a device in session 27 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:18:58 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CVtZzOqD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 08:18:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:18:59 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:18:59 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '23462326665653433', 'path': '/dev/sdc'} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:18:59 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23462326665653433', 'path': '/dev/sdc'} {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 08:18:59 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.285s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:18:59 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:18:59 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:18:59 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:18:59 user nova-compute[95467]: INFO os_brick.initiator.connectors.iscsi [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 08:18:59 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7 -p 172.16.0.220:3260 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:59 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:59 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b44e86-1eba-470c-b97f-fcd441922140]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:59 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 08:18:59 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:18:59 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7 -p 172.16.0.220:3260 --interface default --op new {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:59 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Calling os-brick to attach iSCSI Volume {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 08:18:59 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oflqFjBz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:18:59 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:18:59 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:18:59 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:59 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[749b2018-ce34-414e-8aff-35ebd2aed1ed]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7] added\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:59 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7] added
Nov 15 08:18:59 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:18:59 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:59 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:59 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df04faa-54af-41eb-8e96-a281a894d9f7]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:59 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:18:59 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:59 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:59 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3c229b-0f01-4d37-94aa-d25ae723d2e2]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:59 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:18:59 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SiQnKfkJ {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:59 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SiQnKfkJ" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:59 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[333d3990-3e00-44a4-a5f2-43f1b42e9229]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:59 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SiQnKfkJ'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:18:59 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:59 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:59 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[7efceb80-de3e-4f9c-bca2-dd23b1573ab2]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:59 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:18:59 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:59 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:59 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[624ff392-6af1-4980-a77a-fa831f5e074a]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:59 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:18:59 user nova-compute[95467]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)
Nov 15 08:18:59 user nova-compute[95467]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 (non-flash)
Nov 15 08:18:59 user nova-compute[95467]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b (non-flash)
Nov 15 08:18:59 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:18:59 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:18:59 user nova-compute[95467]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)
Nov 15 08:18:59 user nova-compute[95467]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 (non-flash)
Nov 15 08:18:59 user nova-compute[95467]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b (non-flash)
Nov 15 08:18:59 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:18:59 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7 -p 172.16.0.220:3260 --login {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:18:59 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:59 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e789463-5f8a-4f68-85cc-5cc10100e6df]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:59 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7, portal: 172.16.0.220,3260]
Nov 15 08:18:59 user nova-compute[95467]: Login to [iface: default, target: iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7, portal: 172.16.0.220,3260] successful.
Nov 15 08:18:59 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:18:59 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:59 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:59 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f609688-ab4f-4349-8ef8-17c304a021a2]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:59 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:18:59 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:59 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:59 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[1212fb45-35ce-4044-8f1d-bb78cf101ff8]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:59 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:18:59 user nova-compute[95467]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)
Nov 15 08:18:59 user nova-compute[95467]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 (non-flash)
Nov 15 08:18:59 user nova-compute[95467]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b (non-flash)
Nov 15 08:18:59 user nova-compute[95467]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7 (non-flash)
Nov 15 08:18:59 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:18:59 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:18:59 user nova-compute[95467]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)
Nov 15 08:18:59 user nova-compute[95467]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 (non-flash)
Nov 15 08:18:59 user nova-compute[95467]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b (non-flash)
Nov 15 08:18:59 user nova-compute[95467]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7 (non-flash)
Nov 15 08:18:59 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:18:59 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:18:59 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Connected to 172.16.0.220:3260 {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 08:18:59 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] HCTL ('35', '-', '-', 0) found on session 28 with lun 0 {{(pid=95467) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 08:18:59 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=95467) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 08:18:59 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:18:59 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:18:59 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d58074-cdd9-4efb-9aef-dd4a2a78ba87]: (4, ('- - 0', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:18:59 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Searching for a device in session 28 and hctl ['35', '*', '*', 0] yield: None {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Searching for a device in session 28 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SiQnKfkJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] <== connect_volume: return (2603ms) {'type': 'block', 'scsi_wwn': '26362666436346335', 'path': '/dev/sdd'} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362666436346335', 'path': '/dev/sdd'} {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.279s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:19:00 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:19:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:19:00 user nova-compute[95467]: INFO os_brick.initiator.connectors.iscsi [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 08:19:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612 -p 172.16.0.220:3260 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:18:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1151932159',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1151932159',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1151932159',id=30,image_ref='5f4b45b8-26f5-436f-bfae-87ad013c9492',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLHqRbASCeSwLnaE6cpqUgYpm2vgNRmspTV3XNz5fuTAsGiJoqsVkKecCgCqzsT2HYsSHc/+vUh/+jNmFflgW37j0Ss98W6ShXroA9Yk6xJw00YUMKBWMhv6TG52UWNOwQ==',key_name='tempest-keypair-827467051',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7791bd92c7c488aa72474ecde2e1155',ramdisk_id='',reservation_id='r-7pneup80',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-978207351',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-978207351-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-978207351',owner_user_name='tempest-TestVolumeBootPattern-978207351-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:18:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11bbbd3ef322402cb5dc60455a54319b',uuid=13957136-17e4-4d38-aba3-37453e1fb878,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb6b8f05-83f8-4ee0-9e3b-1efc13a335fb", "address": "fa:16:3e:c3:96:a0", "network": {"id": "96d9262b-11fb-497d-8e38-fa46076c010f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2069167691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7791bd92c7c488aa72474ecde2e1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb6b8f05-83", "ovs_interfaceid": "fb6b8f05-83f8-4ee0-9e3b-1efc13a335fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Converting VIF {"id": "fb6b8f05-83f8-4ee0-9e3b-1efc13a335fb", "address": "fa:16:3e:c3:96:a0", "network": {"id": "96d9262b-11fb-497d-8e38-fa46076c010f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2069167691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7791bd92c7c488aa72474ecde2e1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb6b8f05-83", "ovs_interfaceid": "fb6b8f05-83f8-4ee0-9e3b-1efc13a335fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:96:a0,bridge_name='br-int',has_traffic_filtering=True,id=fb6b8f05-83f8-4ee0-9e3b-1efc13a335fb,network=Network(96d9262b-11fb-497d-8e38-fa46076c010f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb6b8f05-83') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG nova.objects.instance [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lazy-loading 'pci_devices' on Instance uuid 13957136-17e4-4d38-aba3-37453e1fb878 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec16dad7-710f-4ad6-9423-360f1e03fbb0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 08:19:00 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612 -p 172.16.0.220:3260 --interface default --op new {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:19:00 user nova-compute[95467]:   <uuid>13957136-17e4-4d38-aba3-37453e1fb878</uuid>
Nov 15 08:19:00 user nova-compute[95467]:   <name>instance-0000001e</name>
Nov 15 08:19:00 user nova-compute[95467]:   <memory>524288</memory>
Nov 15 08:19:00 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:19:00 user nova-compute[95467]:   <metadata>
Nov 15 08:19:00 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:19:00 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:19:00 user nova-compute[95467]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1151932159</nova:name>
Nov 15 08:19:00 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:18:57</nova:creationTime>
Nov 15 08:19:00 user nova-compute[95467]:       <nova:flavor name="m1.tiny">
Nov 15 08:19:00 user nova-compute[95467]:         <nova:memory>512</nova:memory>
Nov 15 08:19:00 user nova-compute[95467]:         <nova:disk>1</nova:disk>
Nov 15 08:19:00 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:19:00 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:19:00 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:19:00 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:19:00 user nova-compute[95467]:       <nova:owner>
Nov 15 08:19:00 user nova-compute[95467]:         <nova:user uuid="11bbbd3ef322402cb5dc60455a54319b">tempest-TestVolumeBootPattern-978207351-project-member</nova:user>
Nov 15 08:19:00 user nova-compute[95467]:         <nova:project uuid="e7791bd92c7c488aa72474ecde2e1155">tempest-TestVolumeBootPattern-978207351</nova:project>
Nov 15 08:19:00 user nova-compute[95467]:       </nova:owner>
Nov 15 08:19:00 user nova-compute[95467]:       <nova:root type="image" uuid="5f4b45b8-26f5-436f-bfae-87ad013c9492"/>
Nov 15 08:19:00 user nova-compute[95467]:       <nova:ports>
Nov 15 08:19:00 user nova-compute[95467]:         <nova:port uuid="fb6b8f05-83f8-4ee0-9e3b-1efc13a335fb">
Nov 15 08:19:00 user nova-compute[95467]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 08:19:00 user nova-compute[95467]:         </nova:port>
Nov 15 08:19:00 user nova-compute[95467]:       </nova:ports>
Nov 15 08:19:00 user nova-compute[95467]:     </nova:instance>
Nov 15 08:19:00 user nova-compute[95467]:   </metadata>
Nov 15 08:19:00 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:19:00 user nova-compute[95467]:     <system>
Nov 15 08:19:00 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:19:00 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:19:00 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:19:00 user nova-compute[95467]:       <entry name="serial">13957136-17e4-4d38-aba3-37453e1fb878</entry>
Nov 15 08:19:00 user nova-compute[95467]:       <entry name="uuid">13957136-17e4-4d38-aba3-37453e1fb878</entry>
Nov 15 08:19:00 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:19:00 user nova-compute[95467]:     </system>
Nov 15 08:19:00 user nova-compute[95467]:   </sysinfo>
Nov 15 08:19:00 user nova-compute[95467]:   <os>
Nov 15 08:19:00 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:19:00 user nova-compute[95467]:     <boot dev="hd"/>
Nov 15 08:19:00 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:19:00 user nova-compute[95467]:   </os>
Nov 15 08:19:00 user nova-compute[95467]:   <features>
Nov 15 08:19:00 user nova-compute[95467]:     <acpi/>
Nov 15 08:19:00 user nova-compute[95467]:     <apic/>
Nov 15 08:19:00 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:19:00 user nova-compute[95467]:   </features>
Nov 15 08:19:00 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:19:00 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:19:00 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:19:00 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:19:00 user nova-compute[95467]:   </clock>
Nov 15 08:19:00 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:19:00 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:19:00 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:19:00 user nova-compute[95467]:   </cpu>
Nov 15 08:19:00 user nova-compute[95467]:   <devices>
Nov 15 08:19:00 user nova-compute[95467]:     <disk type="block" device="disk">
Nov 15 08:19:00 user nova-compute[95467]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:19:00 user nova-compute[95467]:       <source dev="/dev/sdd"/>
Nov 15 08:19:00 user nova-compute[95467]:       <target dev="vda" bus="virtio"/>
Nov 15 08:19:00 user nova-compute[95467]:       <serial>45d4eaa4-4485-488d-88b5-068a6e58d5e7</serial>
Nov 15 08:19:00 user nova-compute[95467]:     </disk>
Nov 15 08:19:00 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:19:00 user nova-compute[95467]:       <mac address="fa:16:3e:c3:96:a0"/>
Nov 15 08:19:00 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:19:00 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:19:00 user nova-compute[95467]:       <target dev="tapfb6b8f05-83"/>
Nov 15 08:19:00 user nova-compute[95467]:     </interface>
Nov 15 08:19:00 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:19:00 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/13957136-17e4-4d38-aba3-37453e1fb878/console.log" append="off"/>
Nov 15 08:19:00 user nova-compute[95467]:     </serial>
Nov 15 08:19:00 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:19:00 user nova-compute[95467]:     <video>
Nov 15 08:19:00 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:19:00 user nova-compute[95467]:     </video>
Nov 15 08:19:00 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:19:00 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:19:00 user nova-compute[95467]:     </rng>
Nov 15 08:19:00 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:19:00 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:19:00 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:19:00 user nova-compute[95467]:     </memballoon>
Nov 15 08:19:00 user nova-compute[95467]:   </devices>
Nov 15 08:19:00 user nova-compute[95467]: </domain>
Nov 15 08:19:00 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:18:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1151932159',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1151932159',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1151932159',id=30,image_ref='5f4b45b8-26f5-436f-bfae-87ad013c9492',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLHqRbASCeSwLnaE6cpqUgYpm2vgNRmspTV3XNz5fuTAsGiJoqsVkKecCgCqzsT2HYsSHc/+vUh/+jNmFflgW37j0Ss98W6ShXroA9Yk6xJw00YUMKBWMhv6TG52UWNOwQ==',key_name='tempest-keypair-827467051',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7791bd92c7c488aa72474ecde2e1155',ramdisk_id='',reservation_id='r-7pneup80',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-978207351',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-978207351-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-978207351',owner_user_name='tempest-TestVolumeBootPattern-978207351-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:18:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11bbbd3ef322402cb5dc60455a54319b',uuid=13957136-17e4-4d38-aba3-37453e1fb878,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb6b8f05-83f8-4ee0-9e3b-1efc13a335fb", "address": "fa:16:3e:c3:96:a0", "network": {"id": "96d9262b-11fb-497d-8e38-fa46076c010f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2069167691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7791bd92c7c488aa72474ecde2e1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb6b8f05-83", "ovs_interfaceid": "fb6b8f05-83f8-4ee0-9e3b-1efc13a335fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Converting VIF {"id": "fb6b8f05-83f8-4ee0-9e3b-1efc13a335fb", "address": "fa:16:3e:c3:96:a0", "network": {"id": "96d9262b-11fb-497d-8e38-fa46076c010f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2069167691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7791bd92c7c488aa72474ecde2e1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb6b8f05-83", "ovs_interfaceid": "fb6b8f05-83f8-4ee0-9e3b-1efc13a335fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:96:a0,bridge_name='br-int',has_traffic_filtering=True,id=fb6b8f05-83f8-4ee0-9e3b-1efc13a335fb,network=Network(96d9262b-11fb-497d-8e38-fa46076c010f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb6b8f05-83') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG os_vif [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:96:a0,bridge_name='br-int',has_traffic_filtering=True,id=fb6b8f05-83f8-4ee0-9e3b-1efc13a335fb,network=Network(96d9262b-11fb-497d-8e38-fa46076c010f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb6b8f05-83') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5f9cfa22-5fa2-5f0f-adac-fdae79e446a9', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed114101-76d3-48ac-9db9-644213784394]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612] added\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612] added
Nov 15 08:19:00 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfb6b8f05-83, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfb6b8f05-83, col_values=(('qos', UUID('8aafea22-9c9d-44b8-9d77-26708633c04a')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfb6b8f05-83, col_values=(('external_ids', {'iface-id': 'fb6b8f05-83f8-4ee0-9e3b-1efc13a335fb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:96:a0', 'vm-uuid': '13957136-17e4-4d38-aba3-37453e1fb878'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:00 user nova-compute[95467]: INFO os_vif [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:96:a0,bridge_name='br-int',has_traffic_filtering=True,id=fb6b8f05-83f8-4ee0-9e3b-1efc13a335fb,network=Network(96d9262b-11fb-497d-8e38-fa46076c010f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb6b8f05-83')
Nov 15 08:19:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee18522d-5a0f-4f6a-a2b3-88fabc9d4a89]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[615a8e5e-3f09-417d-89c4-05ab7f44df95]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oflqFjBz {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oflqFjBz" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5cf85b-75c9-4c93-995b-039129d6a2d3]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oflqFjBz'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] No VIF found with MAC fa:16:3e:c3:96:a0, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.054s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d393cfc1-37ea-44ef-8322-7740f9970bf8]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[df6b79b8-690d-400a-ade8-be2aba79ef1a]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:19:00 user nova-compute[95467]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)
Nov 15 08:19:00 user nova-compute[95467]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 (non-flash)
Nov 15 08:19:00 user nova-compute[95467]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b (non-flash)
Nov 15 08:19:00 user nova-compute[95467]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7 (non-flash)
Nov 15 08:19:00 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:19:00 user nova-compute[95467]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)
Nov 15 08:19:00 user nova-compute[95467]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 (non-flash)
Nov 15 08:19:00 user nova-compute[95467]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b (non-flash)
Nov 15 08:19:00 user nova-compute[95467]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7 (non-flash)
Nov 15 08:19:00 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612 -p 172.16.0.220:3260 --login {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecee7d6a-3b3e-48f1-8a9d-3cf8fac0a73e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612, portal: 172.16.0.220,3260]
Nov 15 08:19:00 user nova-compute[95467]: Login to [iface: default, target: iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612, portal: 172.16.0.220,3260] successful.
Nov 15 08:19:00 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c162f2-e0a9-40e1-aea4-dd4c40adda54]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[1585aa82-68ab-4d2b-90a3-d0a2e972265b]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:19:00 user nova-compute[95467]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)
Nov 15 08:19:00 user nova-compute[95467]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 (non-flash)
Nov 15 08:19:00 user nova-compute[95467]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b (non-flash)
Nov 15 08:19:00 user nova-compute[95467]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7 (non-flash)
Nov 15 08:19:00 user nova-compute[95467]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612 (non-flash)
Nov 15 08:19:00 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:19:00 user nova-compute[95467]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)
Nov 15 08:19:00 user nova-compute[95467]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 (non-flash)
Nov 15 08:19:00 user nova-compute[95467]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b (non-flash)
Nov 15 08:19:00 user nova-compute[95467]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7 (non-flash)
Nov 15 08:19:00 user nova-compute[95467]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612 (non-flash)
Nov 15 08:19:00 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.352s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Connected to 172.16.0.220:3260 {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] HCTL ('38', '-', '-', 0) found on session 29 with lun 0 {{(pid=95467) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=95467) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae6ecda8-c13f-4224-89a4-726e26bcf297]: (4, ('- - 0', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:19:00 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Searching for a device in session 29 and hctl ['38', '*', '*', 0] yield: None {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:19:01 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:01 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Searching for a device in session 29 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:19:01 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oflqFjBz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 08:19:01 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.381s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:19:01 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] <== connect_volume: return (2661ms) {'type': 'block', 'scsi_wwn': '26432373332356565', 'path': '/dev/sdg'} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:19:01 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26432373332356565', 'path': '/dev/sdg'} {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 08:19:01 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:01 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Calling os-brick to attach iSCSI Volume {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 08:19:01 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yImUtSeO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:19:01 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:19:01 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:19:01 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:19:01 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:19:01 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:19:01 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:19:01 user nova-compute[95467]: INFO os_brick.initiator.connectors.iscsi [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 08:19:01 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:01 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551 -p 172.16.0.220:3260 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:19:01 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:19:01 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[77670bf9-2d47-431f-971c-a5736b82de04]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:19:01 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 08:19:01 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:19:01 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551 -p 172.16.0.220:3260 --interface default --op new {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:19:01 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:19:01 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[99da0b4b-8cfa-4fa3-8920-63b35e3d5b3b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551] added\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:19:01 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551] added
Nov 15 08:19:01 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:19:01 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:19:01 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:19:01 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[49deac8e-cb3e-4708-bc3b-d5b78186b7b7]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:19:01 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:19:01 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:19:01 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:19:01 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0a93b9-9e1f-4512-85a9-3c6c5962256f]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:19:01 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:19:01 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yImUtSeO {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:19:01 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yImUtSeO" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:19:01 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8116b71c-37ce-4aea-9406-1eb999d77021]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:19:01 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yImUtSeO'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:19:01 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:19:01 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:19:01 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb9fb99-4f27-4974-b3b0-35231f069b47]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:19:01 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:19:01 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:19:01 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:19:01 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[7edb327b-1dbe-440c-9d9c-810ff489ddbf]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:19:01 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:19:01 user nova-compute[95467]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)
Nov 15 08:19:01 user nova-compute[95467]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 (non-flash)
Nov 15 08:19:01 user nova-compute[95467]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b (non-flash)
Nov 15 08:19:01 user nova-compute[95467]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7 (non-flash)
Nov 15 08:19:01 user nova-compute[95467]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612 (non-flash)
Nov 15 08:19:01 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:19:01 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:19:01 user nova-compute[95467]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)
Nov 15 08:19:01 user nova-compute[95467]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 (non-flash)
Nov 15 08:19:01 user nova-compute[95467]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b (non-flash)
Nov 15 08:19:01 user nova-compute[95467]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7 (non-flash)
Nov 15 08:19:01 user nova-compute[95467]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612 (non-flash)
Nov 15 08:19:01 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:19:01 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551 -p 172.16.0.220:3260 --login {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:19:01 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:01 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:01 user nova-compute[95467]: DEBUG nova.compute.manager [req-443cce6a-9dbc-4c86-ae13-48212f3717bd req-1ab47271-5684-466e-b841-ff22daf0f22a service nova] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] Received event network-vif-plugged-fb6b8f05-83f8-4ee0-9e3b-1efc13a335fb {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:19:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-443cce6a-9dbc-4c86-ae13-48212f3717bd req-1ab47271-5684-466e-b841-ff22daf0f22a service nova] Acquiring lock "13957136-17e4-4d38-aba3-37453e1fb878-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:19:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-443cce6a-9dbc-4c86-ae13-48212f3717bd req-1ab47271-5684-466e-b841-ff22daf0f22a service nova] Lock "13957136-17e4-4d38-aba3-37453e1fb878-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:19:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-443cce6a-9dbc-4c86-ae13-48212f3717bd req-1ab47271-5684-466e-b841-ff22daf0f22a service nova] Lock "13957136-17e4-4d38-aba3-37453e1fb878-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:19:01 user nova-compute[95467]: DEBUG nova.compute.manager [req-443cce6a-9dbc-4c86-ae13-48212f3717bd req-1ab47271-5684-466e-b841-ff22daf0f22a service nova] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] No waiting events found dispatching network-vif-plugged-fb6b8f05-83f8-4ee0-9e3b-1efc13a335fb {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:19:01 user nova-compute[95467]: WARNING nova.compute.manager [req-443cce6a-9dbc-4c86-ae13-48212f3717bd req-1ab47271-5684-466e-b841-ff22daf0f22a service nova] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] Received unexpected event network-vif-plugged-fb6b8f05-83f8-4ee0-9e3b-1efc13a335fb for instance with vm_state building and task_state spawning.
Nov 15 08:19:02 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551 -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:19:02 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a7e332-86b6-4f7f-9bcb-d3ffb60b0465]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:19:02 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551, portal: 172.16.0.220,3260]
Nov 15 08:19:02 user nova-compute[95467]: Login to [iface: default, target: iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551, portal: 172.16.0.220,3260] successful.
Nov 15 08:19:02 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:19:02 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:19:02 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:19:02 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7606c7-8850-4794-971c-492f28e79ce0]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:19:02 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:19:02 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:19:02 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:19:02 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b791232-4cac-4184-9b1a-41e101eb3a3a]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:19:02 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:19:02 user nova-compute[95467]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)
Nov 15 08:19:02 user nova-compute[95467]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 (non-flash)
Nov 15 08:19:02 user nova-compute[95467]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b (non-flash)
Nov 15 08:19:02 user nova-compute[95467]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7 (non-flash)
Nov 15 08:19:02 user nova-compute[95467]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612 (non-flash)
Nov 15 08:19:02 user nova-compute[95467]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551 (non-flash)
Nov 15 08:19:02 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:19:02 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:19:02 user nova-compute[95467]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)
Nov 15 08:19:02 user nova-compute[95467]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 (non-flash)
Nov 15 08:19:02 user nova-compute[95467]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b (non-flash)
Nov 15 08:19:02 user nova-compute[95467]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7 (non-flash)
Nov 15 08:19:02 user nova-compute[95467]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612 (non-flash)
Nov 15 08:19:02 user nova-compute[95467]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551 (non-flash)
Nov 15 08:19:02 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:19:02 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.370s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:19:02 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Connected to 172.16.0.220:3260 {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 08:19:02 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] HCTL ('39', '-', '-', 0) found on session 30 with lun 0 {{(pid=95467) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 08:19:02 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=95467) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 08:19:02 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:19:02 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:19:02 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7648b2-ea45-4d90-a666-52439a97f54c]: (4, ('- - 0', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:19:02 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Searching for a device in session 30 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:19:02 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yImUtSeO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 08:19:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.407s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] <== connect_volume: return (1408ms) {'type': 'block', 'scsi_wwn': '26630366363626364', 'path': '/dev/sdh'} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630366363626364', 'path': '/dev/sdh'} {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T08:18:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-163188137',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-163188137',id=29,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPc3ntsDCHvSt2Zeq2Eoj7Sh8oVGFbUIkQaZX9nyjxUcj7agqfuKFvy+F+MPCCQt5Teq5JV4myceW+vQlye/stucWDEV+fW0F7nLBuTFv4gu71gMuBsUY5AVHQyQOb6pzQ==',key_name='tempest-keypair-475690846',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40e501e472d742539ef6a4d9c5175d3d',ramdisk_id='',reservation_id='r-z06nzzlq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-248573984',owner_user_name='tempest-TaggedBootDevicesTest-248573984-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:18:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2da4703cb9454345a21adb41812a37ad',uuid=1c438a54-5528-4354-9836-f1a198532c9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5cab4329-e3d7-4d50-9a27-c1291f6f4b4a", "address": "fa:16:3e:52:67:fa", "network": {"id": "ca364f10-9c7d-4574-ae0a-76a1a2a3116d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-497069669-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cab4329-e3", "ovs_interfaceid": "5cab4329-e3d7-4d50-9a27-c1291f6f4b4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Converting VIF {"id": "5cab4329-e3d7-4d50-9a27-c1291f6f4b4a", "address": "fa:16:3e:52:67:fa", "network": {"id": "ca364f10-9c7d-4574-ae0a-76a1a2a3116d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-497069669-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cab4329-e3", "ovs_interfaceid": "5cab4329-e3d7-4d50-9a27-c1291f6f4b4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:67:fa,bridge_name='br-int',has_traffic_filtering=True,id=5cab4329-e3d7-4d50-9a27-c1291f6f4b4a,network=Network(ca364f10-9c7d-4574-ae0a-76a1a2a3116d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cab4329-e3') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T08:18:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-163188137',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-163188137',id=29,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPc3ntsDCHvSt2Zeq2Eoj7Sh8oVGFbUIkQaZX9nyjxUcj7agqfuKFvy+F+MPCCQt5Teq5JV4myceW+vQlye/stucWDEV+fW0F7nLBuTFv4gu71gMuBsUY5AVHQyQOb6pzQ==',key_name='tempest-keypair-475690846',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40e501e472d742539ef6a4d9c5175d3d',ramdisk_id='',reservation_id='r-z06nzzlq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-248573984',owner_user_name='tempest-TaggedBootDevicesTest-248573984-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:18:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2da4703cb9454345a21adb41812a37ad',uuid=1c438a54-5528-4354-9836-f1a198532c9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6c4a108-4733-4daa-935a-56424ed362e9", "address": "fa:16:3e:d7:91:0a", "network": {"id": "fd06ef46-be25-4b52-8c3b-cda8a4ec8124", "bridge": "br-int", "label": "tempest-device-tagging-net1-887816556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c4a108-47", "ovs_interfaceid": "d6c4a108-4733-4daa-935a-56424ed362e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Converting VIF {"id": "d6c4a108-4733-4daa-935a-56424ed362e9", "address": "fa:16:3e:d7:91:0a", "network": {"id": "fd06ef46-be25-4b52-8c3b-cda8a4ec8124", "bridge": "br-int", "label": "tempest-device-tagging-net1-887816556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c4a108-47", "ovs_interfaceid": "d6c4a108-4733-4daa-935a-56424ed362e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:91:0a,bridge_name='br-int',has_traffic_filtering=True,id=d6c4a108-4733-4daa-935a-56424ed362e9,network=Network(fd06ef46-be25-4b52-8c3b-cda8a4ec8124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd6c4a108-47') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T08:18:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-163188137',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-163188137',id=29,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPc3ntsDCHvSt2Zeq2Eoj7Sh8oVGFbUIkQaZX9nyjxUcj7agqfuKFvy+F+MPCCQt5Teq5JV4myceW+vQlye/stucWDEV+fW0F7nLBuTFv4gu71gMuBsUY5AVHQyQOb6pzQ==',key_name='tempest-keypair-475690846',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40e501e472d742539ef6a4d9c5175d3d',ramdisk_id='',reservation_id='r-z06nzzlq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-248573984',owner_user_name='tempest-TaggedBootDevicesTest-248573984-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:18:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2da4703cb9454345a21adb41812a37ad',uuid=1c438a54-5528-4354-9836-f1a198532c9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68127374-b841-456d-b9eb-29e96bd43dc6", "address": "fa:16:3e:0c:8b:29", "network": {"id": "fd06ef46-be25-4b52-8c3b-cda8a4ec8124", "bridge": "br-int", "label": "tempest-device-tagging-net1-887816556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68127374-b8", "ovs_interfaceid": "68127374-b841-456d-b9eb-29e96bd43dc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Converting VIF {"id": "68127374-b841-456d-b9eb-29e96bd43dc6", "address": "fa:16:3e:0c:8b:29", "network": {"id": "fd06ef46-be25-4b52-8c3b-cda8a4ec8124", "bridge": "br-int", "label": "tempest-device-tagging-net1-887816556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68127374-b8", "ovs_interfaceid": "68127374-b841-456d-b9eb-29e96bd43dc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:8b:29,bridge_name='br-int',has_traffic_filtering=True,id=68127374-b841-456d-b9eb-29e96bd43dc6,network=Network(fd06ef46-be25-4b52-8c3b-cda8a4ec8124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap68127374-b8') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T08:18:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-163188137',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-163188137',id=29,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPc3ntsDCHvSt2Zeq2Eoj7Sh8oVGFbUIkQaZX9nyjxUcj7agqfuKFvy+F+MPCCQt5Teq5JV4myceW+vQlye/stucWDEV+fW0F7nLBuTFv4gu71gMuBsUY5AVHQyQOb6pzQ==',key_name='tempest-keypair-475690846',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40e501e472d742539ef6a4d9c5175d3d',ramdisk_id='',reservation_id='r-z06nzzlq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-248573984',owner_user_name='tempest-TaggedBootDevicesTest-248573984-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:18:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2da4703cb9454345a21adb41812a37ad',uuid=1c438a54-5528-4354-9836-f1a198532c9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79b592a8-b5f9-48e6-ae2d-d535ded922b1", "address": "fa:16:3e:f8:e1:13", "network": {"id": "fd06ef46-be25-4b52-8c3b-cda8a4ec8124", "bridge": "br-int", "label": "tempest-device-tagging-net1-887816556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79b592a8-b5", "ovs_interfaceid": "79b592a8-b5f9-48e6-ae2d-d535ded922b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Converting VIF {"id": "79b592a8-b5f9-48e6-ae2d-d535ded922b1", "address": "fa:16:3e:f8:e1:13", "network": {"id": "fd06ef46-be25-4b52-8c3b-cda8a4ec8124", "bridge": "br-int", "label": "tempest-device-tagging-net1-887816556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79b592a8-b5", "ovs_interfaceid": "79b592a8-b5f9-48e6-ae2d-d535ded922b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:e1:13,bridge_name='br-int',has_traffic_filtering=True,id=79b592a8-b5f9-48e6-ae2d-d535ded922b1,network=Network(fd06ef46-be25-4b52-8c3b-cda8a4ec8124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79b592a8-b5') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T08:18:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-163188137',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-163188137',id=29,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPc3ntsDCHvSt2Zeq2Eoj7Sh8oVGFbUIkQaZX9nyjxUcj7agqfuKFvy+F+MPCCQt5Teq5JV4myceW+vQlye/stucWDEV+fW0F7nLBuTFv4gu71gMuBsUY5AVHQyQOb6pzQ==',key_name='tempest-keypair-475690846',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40e501e472d742539ef6a4d9c5175d3d',ramdisk_id='',reservation_id='r-z06nzzlq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-248573984',owner_user_name='tempest-TaggedBootDevicesTest-248573984-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:18:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2da4703cb9454345a21adb41812a37ad',uuid=1c438a54-5528-4354-9836-f1a198532c9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71b2b3bf-8597-40e5-803d-be98308390b7", "address": "fa:16:3e:97:58:f0", "network": {"id": "fd06ef46-be25-4b52-8c3b-cda8a4ec8124", "bridge": "br-int", "label": "tempest-device-tagging-net1-887816556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71b2b3bf-85", "ovs_interfaceid": "71b2b3bf-8597-40e5-803d-be98308390b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Converting VIF {"id": "71b2b3bf-8597-40e5-803d-be98308390b7", "address": "fa:16:3e:97:58:f0", "network": {"id": "fd06ef46-be25-4b52-8c3b-cda8a4ec8124", "bridge": "br-int", "label": "tempest-device-tagging-net1-887816556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71b2b3bf-85", "ovs_interfaceid": "71b2b3bf-8597-40e5-803d-be98308390b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:58:f0,bridge_name='br-int',has_traffic_filtering=True,id=71b2b3bf-8597-40e5-803d-be98308390b7,network=Network(fd06ef46-be25-4b52-8c3b-cda8a4ec8124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71b2b3bf-85') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T08:18:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-163188137',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-163188137',id=29,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPc3ntsDCHvSt2Zeq2Eoj7Sh8oVGFbUIkQaZX9nyjxUcj7agqfuKFvy+F+MPCCQt5Teq5JV4myceW+vQlye/stucWDEV+fW0F7nLBuTFv4gu71gMuBsUY5AVHQyQOb6pzQ==',key_name='tempest-keypair-475690846',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40e501e472d742539ef6a4d9c5175d3d',ramdisk_id='',reservation_id='r-z06nzzlq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-248573984',owner_user_name='tempest-TaggedBootDevicesTest-248573984-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:18:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2da4703cb9454345a21adb41812a37ad',uuid=1c438a54-5528-4354-9836-f1a198532c9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ffab8636-a06b-43fc-9aa8-fcec46b2426d", "address": "fa:16:3e:60:ba:2c", "network": {"id": "eee7a16a-db60-4993-aaae-5142fa17ff37", "bridge": "br-int", "label": "tempest-device-tagging-net2-2138433061", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffab8636-a0", "ovs_interfaceid": "ffab8636-a06b-43fc-9aa8-fcec46b2426d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Converting VIF {"id": "ffab8636-a06b-43fc-9aa8-fcec46b2426d", "address": "fa:16:3e:60:ba:2c", "network": {"id": "eee7a16a-db60-4993-aaae-5142fa17ff37", "bridge": "br-int", "label": "tempest-device-tagging-net2-2138433061", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffab8636-a0", "ovs_interfaceid": "ffab8636-a06b-43fc-9aa8-fcec46b2426d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:ba:2c,bridge_name='br-int',has_traffic_filtering=True,id=ffab8636-a06b-43fc-9aa8-fcec46b2426d,network=Network(eee7a16a-db60-4993-aaae-5142fa17ff37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffab8636-a0') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T08:18:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-163188137',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-163188137',id=29,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPc3ntsDCHvSt2Zeq2Eoj7Sh8oVGFbUIkQaZX9nyjxUcj7agqfuKFvy+F+MPCCQt5Teq5JV4myceW+vQlye/stucWDEV+fW0F7nLBuTFv4gu71gMuBsUY5AVHQyQOb6pzQ==',key_name='tempest-keypair-475690846',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40e501e472d742539ef6a4d9c5175d3d',ramdisk_id='',reservation_id='r-z06nzzlq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-248573984',owner_user_name='tempest-TaggedBootDevicesTest-248573984-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:18:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2da4703cb9454345a21adb41812a37ad',uuid=1c438a54-5528-4354-9836-f1a198532c9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27370ddc-29be-446e-8205-a50379d200d7", "address": "fa:16:3e:36:19:6a", "network": {"id": "eee7a16a-db60-4993-aaae-5142fa17ff37", "bridge": "br-int", "label": "tempest-device-tagging-net2-2138433061", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27370ddc-29", "ovs_interfaceid": "27370ddc-29be-446e-8205-a50379d200d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Converting VIF {"id": "27370ddc-29be-446e-8205-a50379d200d7", "address": "fa:16:3e:36:19:6a", "network": {"id": "eee7a16a-db60-4993-aaae-5142fa17ff37", "bridge": "br-int", "label": "tempest-device-tagging-net2-2138433061", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27370ddc-29", "ovs_interfaceid": "27370ddc-29be-446e-8205-a50379d200d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:19:6a,bridge_name='br-int',has_traffic_filtering=True,id=27370ddc-29be-446e-8205-a50379d200d7,network=Network(eee7a16a-db60-4993-aaae-5142fa17ff37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27370ddc-29') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG nova.objects.instance [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Lazy-loading 'pci_devices' on Instance uuid 1c438a54-5528-4354-9836-f1a198532c9b {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:19:03 user nova-compute[95467]:   <uuid>1c438a54-5528-4354-9836-f1a198532c9b</uuid>
Nov 15 08:19:03 user nova-compute[95467]:   <name>instance-0000001d</name>
Nov 15 08:19:03 user nova-compute[95467]:   <memory>524288</memory>
Nov 15 08:19:03 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:19:03 user nova-compute[95467]:   <metadata>
Nov 15 08:19:03 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:19:03 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:19:03 user nova-compute[95467]:       <nova:name>tempest-device-tagging-server-163188137</nova:name>
Nov 15 08:19:03 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:18:57</nova:creationTime>
Nov 15 08:19:03 user nova-compute[95467]:       <nova:flavor name="m1.tiny">
Nov 15 08:19:03 user nova-compute[95467]:         <nova:memory>512</nova:memory>
Nov 15 08:19:03 user nova-compute[95467]:         <nova:disk>1</nova:disk>
Nov 15 08:19:03 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:19:03 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:19:03 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:19:03 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:19:03 user nova-compute[95467]:       <nova:owner>
Nov 15 08:19:03 user nova-compute[95467]:         <nova:user uuid="2da4703cb9454345a21adb41812a37ad">tempest-TaggedBootDevicesTest-248573984-project-member</nova:user>
Nov 15 08:19:03 user nova-compute[95467]:         <nova:project uuid="40e501e472d742539ef6a4d9c5175d3d">tempest-TaggedBootDevicesTest-248573984</nova:project>
Nov 15 08:19:03 user nova-compute[95467]:       </nova:owner>
Nov 15 08:19:03 user nova-compute[95467]:       <nova:root type="image" uuid="ed9c48aa-ce73-4b3b-9db1-235898be671b"/>
Nov 15 08:19:03 user nova-compute[95467]:       <nova:ports>
Nov 15 08:19:03 user nova-compute[95467]:         <nova:port uuid="5cab4329-e3d7-4d50-9a27-c1291f6f4b4a">
Nov 15 08:19:03 user nova-compute[95467]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 08:19:03 user nova-compute[95467]:         </nova:port>
Nov 15 08:19:03 user nova-compute[95467]:         <nova:port uuid="d6c4a108-4733-4daa-935a-56424ed362e9">
Nov 15 08:19:03 user nova-compute[95467]:           <nova:ip type="fixed" address="10.1.1.221" ipVersion="4"/>
Nov 15 08:19:03 user nova-compute[95467]:         </nova:port>
Nov 15 08:19:03 user nova-compute[95467]:         <nova:port uuid="68127374-b841-456d-b9eb-29e96bd43dc6">
Nov 15 08:19:03 user nova-compute[95467]:           <nova:ip type="fixed" address="10.1.1.35" ipVersion="4"/>
Nov 15 08:19:03 user nova-compute[95467]:         </nova:port>
Nov 15 08:19:03 user nova-compute[95467]:         <nova:port uuid="79b592a8-b5f9-48e6-ae2d-d535ded922b1">
Nov 15 08:19:03 user nova-compute[95467]:           <nova:ip type="fixed" address="10.1.1.24" ipVersion="4"/>
Nov 15 08:19:03 user nova-compute[95467]:         </nova:port>
Nov 15 08:19:03 user nova-compute[95467]:         <nova:port uuid="71b2b3bf-8597-40e5-803d-be98308390b7">
Nov 15 08:19:03 user nova-compute[95467]:           <nova:ip type="fixed" address="10.1.1.56" ipVersion="4"/>
Nov 15 08:19:03 user nova-compute[95467]:         </nova:port>
Nov 15 08:19:03 user nova-compute[95467]:         <nova:port uuid="ffab8636-a06b-43fc-9aa8-fcec46b2426d">
Nov 15 08:19:03 user nova-compute[95467]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 15 08:19:03 user nova-compute[95467]:         </nova:port>
Nov 15 08:19:03 user nova-compute[95467]:         <nova:port uuid="27370ddc-29be-446e-8205-a50379d200d7">
Nov 15 08:19:03 user nova-compute[95467]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 15 08:19:03 user nova-compute[95467]:         </nova:port>
Nov 15 08:19:03 user nova-compute[95467]:       </nova:ports>
Nov 15 08:19:03 user nova-compute[95467]:     </nova:instance>
Nov 15 08:19:03 user nova-compute[95467]:   </metadata>
Nov 15 08:19:03 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:19:03 user nova-compute[95467]:     <system>
Nov 15 08:19:03 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:19:03 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:19:03 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:19:03 user nova-compute[95467]:       <entry name="serial">1c438a54-5528-4354-9836-f1a198532c9b</entry>
Nov 15 08:19:03 user nova-compute[95467]:       <entry name="uuid">1c438a54-5528-4354-9836-f1a198532c9b</entry>
Nov 15 08:19:03 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:19:03 user nova-compute[95467]:     </system>
Nov 15 08:19:03 user nova-compute[95467]:   </sysinfo>
Nov 15 08:19:03 user nova-compute[95467]:   <os>
Nov 15 08:19:03 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:19:03 user nova-compute[95467]:     <boot dev="hd"/>
Nov 15 08:19:03 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:19:03 user nova-compute[95467]:   </os>
Nov 15 08:19:03 user nova-compute[95467]:   <features>
Nov 15 08:19:03 user nova-compute[95467]:     <acpi/>
Nov 15 08:19:03 user nova-compute[95467]:     <apic/>
Nov 15 08:19:03 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:19:03 user nova-compute[95467]:   </features>
Nov 15 08:19:03 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:19:03 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:19:03 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:19:03 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:19:03 user nova-compute[95467]:   </clock>
Nov 15 08:19:03 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:19:03 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:19:03 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:19:03 user nova-compute[95467]:   </cpu>
Nov 15 08:19:03 user nova-compute[95467]:   <devices>
Nov 15 08:19:03 user nova-compute[95467]:     <disk type="file" device="cdrom">
Nov 15 08:19:03 user nova-compute[95467]:       <driver name="qemu" type="raw" cache="none"/>
Nov 15 08:19:03 user nova-compute[95467]:       <source file="/opt/stack/data/nova/instances/1c438a54-5528-4354-9836-f1a198532c9b/disk.config"/>
Nov 15 08:19:03 user nova-compute[95467]:       <target dev="hda" bus="ide"/>
Nov 15 08:19:03 user nova-compute[95467]:     </disk>
Nov 15 08:19:03 user nova-compute[95467]:     <disk type="block" device="disk">
Nov 15 08:19:03 user nova-compute[95467]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:19:03 user nova-compute[95467]:       <source dev="/dev/sdc"/>
Nov 15 08:19:03 user nova-compute[95467]:       <target dev="vda" bus="virtio"/>
Nov 15 08:19:03 user nova-compute[95467]:       <serial>74097ec0-88f6-4b8c-b01f-3be5fdbdf87b</serial>
Nov 15 08:19:03 user nova-compute[95467]:     </disk>
Nov 15 08:19:03 user nova-compute[95467]:     <disk type="block" device="disk">
Nov 15 08:19:03 user nova-compute[95467]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:19:03 user nova-compute[95467]:       <source dev="/dev/sdg"/>
Nov 15 08:19:03 user nova-compute[95467]:       <target dev="vdb" bus="virtio"/>
Nov 15 08:19:03 user nova-compute[95467]:       <serial>bef17724-2105-4964-a1f3-57663bf01612</serial>
Nov 15 08:19:03 user nova-compute[95467]:     </disk>
Nov 15 08:19:03 user nova-compute[95467]:     <disk type="block" device="disk">
Nov 15 08:19:03 user nova-compute[95467]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:19:03 user nova-compute[95467]:       <source dev="/dev/sdh"/>
Nov 15 08:19:03 user nova-compute[95467]:       <target dev="vdc" bus="virtio"/>
Nov 15 08:19:03 user nova-compute[95467]:       <serial>e8e174af-7109-499d-8142-127fae825551</serial>
Nov 15 08:19:03 user nova-compute[95467]:     </disk>
Nov 15 08:19:03 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:19:03 user nova-compute[95467]:       <mac address="fa:16:3e:52:67:fa"/>
Nov 15 08:19:03 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:19:03 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:19:03 user nova-compute[95467]:       <target dev="tap5cab4329-e3"/>
Nov 15 08:19:03 user nova-compute[95467]:     </interface>
Nov 15 08:19:03 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:19:03 user nova-compute[95467]:       <mac address="fa:16:3e:d7:91:0a"/>
Nov 15 08:19:03 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:19:03 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:19:03 user nova-compute[95467]:       <target dev="tapd6c4a108-47"/>
Nov 15 08:19:03 user nova-compute[95467]:     </interface>
Nov 15 08:19:03 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:19:03 user nova-compute[95467]:       <mac address="fa:16:3e:0c:8b:29"/>
Nov 15 08:19:03 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:19:03 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:19:03 user nova-compute[95467]:       <target dev="tap68127374-b8"/>
Nov 15 08:19:03 user nova-compute[95467]:     </interface>
Nov 15 08:19:03 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:19:03 user nova-compute[95467]:       <mac address="fa:16:3e:f8:e1:13"/>
Nov 15 08:19:03 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:19:03 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:19:03 user nova-compute[95467]:       <target dev="tap79b592a8-b5"/>
Nov 15 08:19:03 user nova-compute[95467]:     </interface>
Nov 15 08:19:03 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:19:03 user nova-compute[95467]:       <mac address="fa:16:3e:97:58:f0"/>
Nov 15 08:19:03 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:19:03 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:19:03 user nova-compute[95467]:       <target dev="tap71b2b3bf-85"/>
Nov 15 08:19:03 user nova-compute[95467]:     </interface>
Nov 15 08:19:03 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:19:03 user nova-compute[95467]:       <mac address="fa:16:3e:60:ba:2c"/>
Nov 15 08:19:03 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:19:03 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:19:03 user nova-compute[95467]:       <target dev="tapffab8636-a0"/>
Nov 15 08:19:03 user nova-compute[95467]:     </interface>
Nov 15 08:19:03 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:19:03 user nova-compute[95467]:       <mac address="fa:16:3e:36:19:6a"/>
Nov 15 08:19:03 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:19:03 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:19:03 user nova-compute[95467]:       <target dev="tap27370ddc-29"/>
Nov 15 08:19:03 user nova-compute[95467]:     </interface>
Nov 15 08:19:03 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:19:03 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/1c438a54-5528-4354-9836-f1a198532c9b/console.log" append="off"/>
Nov 15 08:19:03 user nova-compute[95467]:     </serial>
Nov 15 08:19:03 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:19:03 user nova-compute[95467]:     <video>
Nov 15 08:19:03 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:19:03 user nova-compute[95467]:     </video>
Nov 15 08:19:03 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:19:03 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:19:03 user nova-compute[95467]:     </rng>
Nov 15 08:19:03 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:19:03 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:19:03 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:19:03 user nova-compute[95467]:     </memballoon>
Nov 15 08:19:03 user nova-compute[95467]:   </devices>
Nov 15 08:19:03 user nova-compute[95467]: </domain>
Nov 15 08:19:03 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T08:18:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-163188137',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-163188137',id=29,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPc3ntsDCHvSt2Zeq2Eoj7Sh8oVGFbUIkQaZX9nyjxUcj7agqfuKFvy+F+MPCCQt5Teq5JV4myceW+vQlye/stucWDEV+fW0F7nLBuTFv4gu71gMuBsUY5AVHQyQOb6pzQ==',key_name='tempest-keypair-475690846',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40e501e472d742539ef6a4d9c5175d3d',ramdisk_id='',reservation_id='r-z06nzzlq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-248573984',owner_user_name='tempest-TaggedBootDevicesTest-248573984-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:18:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2da4703cb9454345a21adb41812a37ad',uuid=1c438a54-5528-4354-9836-f1a198532c9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5cab4329-e3d7-4d50-9a27-c1291f6f4b4a", "address": "fa:16:3e:52:67:fa", "network": {"id": "ca364f10-9c7d-4574-ae0a-76a1a2a3116d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-497069669-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cab4329-e3", "ovs_interfaceid": "5cab4329-e3d7-4d50-9a27-c1291f6f4b4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Converting VIF {"id": "5cab4329-e3d7-4d50-9a27-c1291f6f4b4a", "address": "fa:16:3e:52:67:fa", "network": {"id": "ca364f10-9c7d-4574-ae0a-76a1a2a3116d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-497069669-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cab4329-e3", "ovs_interfaceid": "5cab4329-e3d7-4d50-9a27-c1291f6f4b4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:67:fa,bridge_name='br-int',has_traffic_filtering=True,id=5cab4329-e3d7-4d50-9a27-c1291f6f4b4a,network=Network(ca364f10-9c7d-4574-ae0a-76a1a2a3116d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cab4329-e3') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG os_vif [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:67:fa,bridge_name='br-int',has_traffic_filtering=True,id=5cab4329-e3d7-4d50-9a27-c1291f6f4b4a,network=Network(ca364f10-9c7d-4574-ae0a-76a1a2a3116d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cab4329-e3') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '29fc83a9-184f-54c0-a01e-963abd91fc36', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5cab4329-e3, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5cab4329-e3, col_values=(('qos', UUID('c25cdef5-af03-4570-8925-39c8f320c740')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5cab4329-e3, col_values=(('external_ids', {'iface-id': '5cab4329-e3d7-4d50-9a27-c1291f6f4b4a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:67:fa', 'vm-uuid': '1c438a54-5528-4354-9836-f1a198532c9b'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:03 user nova-compute[95467]: INFO os_vif [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:67:fa,bridge_name='br-int',has_traffic_filtering=True,id=5cab4329-e3d7-4d50-9a27-c1291f6f4b4a,network=Network(ca364f10-9c7d-4574-ae0a-76a1a2a3116d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cab4329-e3')
Nov 15 08:19:03 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T08:18:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-163188137',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-163188137',id=29,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPc3ntsDCHvSt2Zeq2Eoj7Sh8oVGFbUIkQaZX9nyjxUcj7agqfuKFvy+F+MPCCQt5Teq5JV4myceW+vQlye/stucWDEV+fW0F7nLBuTFv4gu71gMuBsUY5AVHQyQOb6pzQ==',key_name='tempest-keypair-475690846',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40e501e472d742539ef6a4d9c5175d3d',ramdisk_id='',reservation_id='r-z06nzzlq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-248573984',owner_user_name='tempest-TaggedBootDevicesTest-248573984-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:18:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2da4703cb9454345a21adb41812a37ad',uuid=1c438a54-5528-4354-9836-f1a198532c9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6c4a108-4733-4daa-935a-56424ed362e9", "address": "fa:16:3e:d7:91:0a", "network": {"id": "fd06ef46-be25-4b52-8c3b-cda8a4ec8124", "bridge": "br-int", "label": "tempest-device-tagging-net1-887816556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c4a108-47", "ovs_interfaceid": "d6c4a108-4733-4daa-935a-56424ed362e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Converting VIF {"id": "d6c4a108-4733-4daa-935a-56424ed362e9", "address": "fa:16:3e:d7:91:0a", "network": {"id": "fd06ef46-be25-4b52-8c3b-cda8a4ec8124", "bridge": "br-int", "label": "tempest-device-tagging-net1-887816556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c4a108-47", "ovs_interfaceid": "d6c4a108-4733-4daa-935a-56424ed362e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:91:0a,bridge_name='br-int',has_traffic_filtering=True,id=d6c4a108-4733-4daa-935a-56424ed362e9,network=Network(fd06ef46-be25-4b52-8c3b-cda8a4ec8124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd6c4a108-47') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG os_vif [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:91:0a,bridge_name='br-int',has_traffic_filtering=True,id=d6c4a108-4733-4daa-935a-56424ed362e9,network=Network(fd06ef46-be25-4b52-8c3b-cda8a4ec8124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd6c4a108-47') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ea830541-db21-596c-bfd5-28061581e6c5', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd6c4a108-47, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd6c4a108-47, col_values=(('qos', UUID('30dfca19-12a5-4f9d-954b-1cf144524706')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd6c4a108-47, col_values=(('external_ids', {'iface-id': 'd6c4a108-4733-4daa-935a-56424ed362e9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:91:0a', 'vm-uuid': '1c438a54-5528-4354-9836-f1a198532c9b'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:03 user nova-compute[95467]: INFO os_vif [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:91:0a,bridge_name='br-int',has_traffic_filtering=True,id=d6c4a108-4733-4daa-935a-56424ed362e9,network=Network(fd06ef46-be25-4b52-8c3b-cda8a4ec8124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd6c4a108-47')
Nov 15 08:19:03 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T08:18:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-163188137',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-163188137',id=29,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPc3ntsDCHvSt2Zeq2Eoj7Sh8oVGFbUIkQaZX9nyjxUcj7agqfuKFvy+F+MPCCQt5Teq5JV4myceW+vQlye/stucWDEV+fW0F7nLBuTFv4gu71gMuBsUY5AVHQyQOb6pzQ==',key_name='tempest-keypair-475690846',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40e501e472d742539ef6a4d9c5175d3d',ramdisk_id='',reservation_id='r-z06nzzlq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-248573984',owner_user_name='tempest-TaggedBootDevicesTest-248573984-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:18:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2da4703cb9454345a21adb41812a37ad',uuid=1c438a54-5528-4354-9836-f1a198532c9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68127374-b841-456d-b9eb-29e96bd43dc6", "address": "fa:16:3e:0c:8b:29", "network": {"id": "fd06ef46-be25-4b52-8c3b-cda8a4ec8124", "bridge": "br-int", "label": "tempest-device-tagging-net1-887816556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68127374-b8", "ovs_interfaceid": "68127374-b841-456d-b9eb-29e96bd43dc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Converting VIF {"id": "68127374-b841-456d-b9eb-29e96bd43dc6", "address": "fa:16:3e:0c:8b:29", "network": {"id": "fd06ef46-be25-4b52-8c3b-cda8a4ec8124", "bridge": "br-int", "label": "tempest-device-tagging-net1-887816556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68127374-b8", "ovs_interfaceid": "68127374-b841-456d-b9eb-29e96bd43dc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:8b:29,bridge_name='br-int',has_traffic_filtering=True,id=68127374-b841-456d-b9eb-29e96bd43dc6,network=Network(fd06ef46-be25-4b52-8c3b-cda8a4ec8124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap68127374-b8') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG os_vif [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:8b:29,bridge_name='br-int',has_traffic_filtering=True,id=68127374-b841-456d-b9eb-29e96bd43dc6,network=Network(fd06ef46-be25-4b52-8c3b-cda8a4ec8124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap68127374-b8') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '75ba2404-4d7a-54f9-9a57-422748265a2f', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap68127374-b8, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap68127374-b8, col_values=(('qos', UUID('a4d1bea1-3321-4a7d-9846-86dd511dcb9e')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap68127374-b8, col_values=(('external_ids', {'iface-id': '68127374-b841-456d-b9eb-29e96bd43dc6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:8b:29', 'vm-uuid': '1c438a54-5528-4354-9836-f1a198532c9b'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:03 user nova-compute[95467]: INFO os_vif [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:8b:29,bridge_name='br-int',has_traffic_filtering=True,id=68127374-b841-456d-b9eb-29e96bd43dc6,network=Network(fd06ef46-be25-4b52-8c3b-cda8a4ec8124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap68127374-b8')
Nov 15 08:19:03 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T08:18:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-163188137',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-163188137',id=29,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPc3ntsDCHvSt2Zeq2Eoj7Sh8oVGFbUIkQaZX9nyjxUcj7agqfuKFvy+F+MPCCQt5Teq5JV4myceW+vQlye/stucWDEV+fW0F7nLBuTFv4gu71gMuBsUY5AVHQyQOb6pzQ==',key_name='tempest-keypair-475690846',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40e501e472d742539ef6a4d9c5175d3d',ramdisk_id='',reservation_id='r-z06nzzlq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-248573984',owner_user_name='tempest-TaggedBootDevicesTest-248573984-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:18:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2da4703cb9454345a21adb41812a37ad',uuid=1c438a54-5528-4354-9836-f1a198532c9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79b592a8-b5f9-48e6-ae2d-d535ded922b1", "address": "fa:16:3e:f8:e1:13", "network": {"id": "fd06ef46-be25-4b52-8c3b-cda8a4ec8124", "bridge": "br-int", "label": "tempest-device-tagging-net1-887816556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79b592a8-b5", "ovs_interfaceid": "79b592a8-b5f9-48e6-ae2d-d535ded922b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Converting VIF {"id": "79b592a8-b5f9-48e6-ae2d-d535ded922b1", "address": "fa:16:3e:f8:e1:13", "network": {"id": "fd06ef46-be25-4b52-8c3b-cda8a4ec8124", "bridge": "br-int", "label": "tempest-device-tagging-net1-887816556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79b592a8-b5", "ovs_interfaceid": "79b592a8-b5f9-48e6-ae2d-d535ded922b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:e1:13,bridge_name='br-int',has_traffic_filtering=True,id=79b592a8-b5f9-48e6-ae2d-d535ded922b1,network=Network(fd06ef46-be25-4b52-8c3b-cda8a4ec8124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79b592a8-b5') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG os_vif [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:e1:13,bridge_name='br-int',has_traffic_filtering=True,id=79b592a8-b5f9-48e6-ae2d-d535ded922b1,network=Network(fd06ef46-be25-4b52-8c3b-cda8a4ec8124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79b592a8-b5') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fe36f658-7b17-5d6f-bdfb-ac5c78431b83', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap79b592a8-b5, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap79b592a8-b5, col_values=(('qos', UUID('9f225024-3f0b-4854-8daf-11bf02646a9a')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap79b592a8-b5, col_values=(('external_ids', {'iface-id': '79b592a8-b5f9-48e6-ae2d-d535ded922b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:e1:13', 'vm-uuid': '1c438a54-5528-4354-9836-f1a198532c9b'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:03 user nova-compute[95467]: INFO os_vif [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:e1:13,bridge_name='br-int',has_traffic_filtering=True,id=79b592a8-b5f9-48e6-ae2d-d535ded922b1,network=Network(fd06ef46-be25-4b52-8c3b-cda8a4ec8124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79b592a8-b5')
Nov 15 08:19:03 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T08:18:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-163188137',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-163188137',id=29,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPc3ntsDCHvSt2Zeq2Eoj7Sh8oVGFbUIkQaZX9nyjxUcj7agqfuKFvy+F+MPCCQt5Teq5JV4myceW+vQlye/stucWDEV+fW0F7nLBuTFv4gu71gMuBsUY5AVHQyQOb6pzQ==',key_name='tempest-keypair-475690846',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40e501e472d742539ef6a4d9c5175d3d',ramdisk_id='',reservation_id='r-z06nzzlq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-248573984',owner_user_name='tempest-TaggedBootDevicesTest-248573984-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:18:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2da4703cb9454345a21adb41812a37ad',uuid=1c438a54-5528-4354-9836-f1a198532c9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71b2b3bf-8597-40e5-803d-be98308390b7", "address": "fa:16:3e:97:58:f0", "network": {"id": "fd06ef46-be25-4b52-8c3b-cda8a4ec8124", "bridge": "br-int", "label": "tempest-device-tagging-net1-887816556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71b2b3bf-85", "ovs_interfaceid": "71b2b3bf-8597-40e5-803d-be98308390b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Converting VIF {"id": "71b2b3bf-8597-40e5-803d-be98308390b7", "address": "fa:16:3e:97:58:f0", "network": {"id": "fd06ef46-be25-4b52-8c3b-cda8a4ec8124", "bridge": "br-int", "label": "tempest-device-tagging-net1-887816556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71b2b3bf-85", "ovs_interfaceid": "71b2b3bf-8597-40e5-803d-be98308390b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:58:f0,bridge_name='br-int',has_traffic_filtering=True,id=71b2b3bf-8597-40e5-803d-be98308390b7,network=Network(fd06ef46-be25-4b52-8c3b-cda8a4ec8124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71b2b3bf-85') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG os_vif [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:58:f0,bridge_name='br-int',has_traffic_filtering=True,id=71b2b3bf-8597-40e5-803d-be98308390b7,network=Network(fd06ef46-be25-4b52-8c3b-cda8a4ec8124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71b2b3bf-85') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '59ca866e-0b9f-5d8e-86b5-199eb61d8968', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap71b2b3bf-85, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap71b2b3bf-85, col_values=(('qos', UUID('7cc52e40-9e20-4fe1-a665-6a30cde4a288')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap71b2b3bf-85, col_values=(('external_ids', {'iface-id': '71b2b3bf-8597-40e5-803d-be98308390b7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:58:f0', 'vm-uuid': '1c438a54-5528-4354-9836-f1a198532c9b'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:03 user nova-compute[95467]: INFO os_vif [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:58:f0,bridge_name='br-int',has_traffic_filtering=True,id=71b2b3bf-8597-40e5-803d-be98308390b7,network=Network(fd06ef46-be25-4b52-8c3b-cda8a4ec8124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71b2b3bf-85')
Nov 15 08:19:03 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T08:18:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-163188137',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-163188137',id=29,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPc3ntsDCHvSt2Zeq2Eoj7Sh8oVGFbUIkQaZX9nyjxUcj7agqfuKFvy+F+MPCCQt5Teq5JV4myceW+vQlye/stucWDEV+fW0F7nLBuTFv4gu71gMuBsUY5AVHQyQOb6pzQ==',key_name='tempest-keypair-475690846',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40e501e472d742539ef6a4d9c5175d3d',ramdisk_id='',reservation_id='r-z06nzzlq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-248573984',owner_user_name='tempest-TaggedBootDevicesTest-248573984-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:18:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2da4703cb9454345a21adb41812a37ad',uuid=1c438a54-5528-4354-9836-f1a198532c9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ffab8636-a06b-43fc-9aa8-fcec46b2426d", "address": "fa:16:3e:60:ba:2c", "network": {"id": "eee7a16a-db60-4993-aaae-5142fa17ff37", "bridge": "br-int", "label": "tempest-device-tagging-net2-2138433061", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffab8636-a0", "ovs_interfaceid": "ffab8636-a06b-43fc-9aa8-fcec46b2426d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Converting VIF {"id": "ffab8636-a06b-43fc-9aa8-fcec46b2426d", "address": "fa:16:3e:60:ba:2c", "network": {"id": "eee7a16a-db60-4993-aaae-5142fa17ff37", "bridge": "br-int", "label": "tempest-device-tagging-net2-2138433061", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffab8636-a0", "ovs_interfaceid": "ffab8636-a06b-43fc-9aa8-fcec46b2426d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:ba:2c,bridge_name='br-int',has_traffic_filtering=True,id=ffab8636-a06b-43fc-9aa8-fcec46b2426d,network=Network(eee7a16a-db60-4993-aaae-5142fa17ff37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffab8636-a0') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG os_vif [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:ba:2c,bridge_name='br-int',has_traffic_filtering=True,id=ffab8636-a06b-43fc-9aa8-fcec46b2426d,network=Network(eee7a16a-db60-4993-aaae-5142fa17ff37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffab8636-a0') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5ecaedac-4a11-59c6-bf4d-eaf4fead1086', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapffab8636-a0, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapffab8636-a0, col_values=(('qos', UUID('adfa5b35-8b87-4bf6-98c9-59f8c77643b8')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapffab8636-a0, col_values=(('external_ids', {'iface-id': 'ffab8636-a06b-43fc-9aa8-fcec46b2426d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:ba:2c', 'vm-uuid': '1c438a54-5528-4354-9836-f1a198532c9b'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:03 user nova-compute[95467]: INFO os_vif [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:ba:2c,bridge_name='br-int',has_traffic_filtering=True,id=ffab8636-a06b-43fc-9aa8-fcec46b2426d,network=Network(eee7a16a-db60-4993-aaae-5142fa17ff37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffab8636-a0')
Nov 15 08:19:03 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T08:18:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-163188137',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-163188137',id=29,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPc3ntsDCHvSt2Zeq2Eoj7Sh8oVGFbUIkQaZX9nyjxUcj7agqfuKFvy+F+MPCCQt5Teq5JV4myceW+vQlye/stucWDEV+fW0F7nLBuTFv4gu71gMuBsUY5AVHQyQOb6pzQ==',key_name='tempest-keypair-475690846',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40e501e472d742539ef6a4d9c5175d3d',ramdisk_id='',reservation_id='r-z06nzzlq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-248573984',owner_user_name='tempest-TaggedBootDevicesTest-248573984-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:18:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2da4703cb9454345a21adb41812a37ad',uuid=1c438a54-5528-4354-9836-f1a198532c9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27370ddc-29be-446e-8205-a50379d200d7", "address": "fa:16:3e:36:19:6a", "network": {"id": "eee7a16a-db60-4993-aaae-5142fa17ff37", "bridge": "br-int", "label": "tempest-device-tagging-net2-2138433061", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27370ddc-29", "ovs_interfaceid": "27370ddc-29be-446e-8205-a50379d200d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Converting VIF {"id": "27370ddc-29be-446e-8205-a50379d200d7", "address": "fa:16:3e:36:19:6a", "network": {"id": "eee7a16a-db60-4993-aaae-5142fa17ff37", "bridge": "br-int", "label": "tempest-device-tagging-net2-2138433061", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27370ddc-29", "ovs_interfaceid": "27370ddc-29be-446e-8205-a50379d200d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:19:6a,bridge_name='br-int',has_traffic_filtering=True,id=27370ddc-29be-446e-8205-a50379d200d7,network=Network(eee7a16a-db60-4993-aaae-5142fa17ff37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27370ddc-29') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG os_vif [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:19:6a,bridge_name='br-int',has_traffic_filtering=True,id=27370ddc-29be-446e-8205-a50379d200d7,network=Network(eee7a16a-db60-4993-aaae-5142fa17ff37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27370ddc-29') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f627fee6-dbcf-5143-82ee-9b6b4adc0a38', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap27370ddc-29, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap27370ddc-29, col_values=(('qos', UUID('b49002cb-2a11-488f-86d6-6118415f0d3c')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap27370ddc-29, col_values=(('external_ids', {'iface-id': '27370ddc-29be-446e-8205-a50379d200d7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:19:6a', 'vm-uuid': '1c438a54-5528-4354-9836-f1a198532c9b'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:03 user nova-compute[95467]: INFO os_vif [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:19:6a,bridge_name='br-int',has_traffic_filtering=True,id=27370ddc-29be-446e-8205-a50379d200d7,network=Network(eee7a16a-db60-4993-aaae-5142fa17ff37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27370ddc-29')
Nov 15 08:19:03 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] Instance event wait completed in 0 seconds for  {{(pid=95467) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] Guest created on hypervisor {{(pid=95467) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 08:19:03 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] Instance spawned successfully.
Nov 15 08:19:03 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] Found default for hw_input_bus of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] Found default for hw_pointer_model of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] No BDM found with device name hda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] No BDM found with device name vdc, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] No VIF found with MAC fa:16:3e:52:67:fa, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:19:03 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] No VIF found with MAC fa:16:3e:97:58:f0, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:19:03 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Using config drive
Nov 15 08:19:03 user nova-compute[95467]: INFO nova.compute.manager [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] Took 6.30 seconds to spawn the instance on the hypervisor.
Nov 15 08:19:03 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:19:04 user nova-compute[95467]: DEBUG nova.compute.manager [req-65e0b9dc-7ec1-41ee-9129-6a8da6efcb92 req-7d45e0c9-4769-41c5-8869-1d0137b5506e service nova] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] Received event network-vif-plugged-fb6b8f05-83f8-4ee0-9e3b-1efc13a335fb {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:19:04 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-65e0b9dc-7ec1-41ee-9129-6a8da6efcb92 req-7d45e0c9-4769-41c5-8869-1d0137b5506e service nova] Acquiring lock "13957136-17e4-4d38-aba3-37453e1fb878-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:19:04 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-65e0b9dc-7ec1-41ee-9129-6a8da6efcb92 req-7d45e0c9-4769-41c5-8869-1d0137b5506e service nova] Lock "13957136-17e4-4d38-aba3-37453e1fb878-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:19:04 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-65e0b9dc-7ec1-41ee-9129-6a8da6efcb92 req-7d45e0c9-4769-41c5-8869-1d0137b5506e service nova] Lock "13957136-17e4-4d38-aba3-37453e1fb878-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.007s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:19:04 user nova-compute[95467]: DEBUG nova.compute.manager [req-65e0b9dc-7ec1-41ee-9129-6a8da6efcb92 req-7d45e0c9-4769-41c5-8869-1d0137b5506e service nova] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] No waiting events found dispatching network-vif-plugged-fb6b8f05-83f8-4ee0-9e3b-1efc13a335fb {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:19:04 user nova-compute[95467]: WARNING nova.compute.manager [req-65e0b9dc-7ec1-41ee-9129-6a8da6efcb92 req-7d45e0c9-4769-41c5-8869-1d0137b5506e service nova] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] Received unexpected event network-vif-plugged-fb6b8f05-83f8-4ee0-9e3b-1efc13a335fb for instance with vm_state building and task_state spawning.
Nov 15 08:19:04 user nova-compute[95467]: INFO nova.compute.manager [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] Took 22.86 seconds to build instance.
Nov 15 08:19:04 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3a31c204-2c2b-470a-97ba-a3c1b29fec8e tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "13957136-17e4-4d38-aba3-37453e1fb878" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.987s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:19:04 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Creating config drive at /opt/stack/data/nova/instances/1c438a54-5528-4354-9836-f1a198532c9b/disk.config
Nov 15 08:19:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1c438a54-5528-4354-9836-f1a198532c9b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpj14k1kqa {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:19:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1c438a54-5528-4354-9836-f1a198532c9b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpj14k1kqa" returned: 0 in 0.069s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:19:05 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:05 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:05 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:05 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:05 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:06 user nova-compute[95467]: DEBUG nova.compute.manager [req-a6ef2660-fe05-4ab6-ae20-d9c15e6f8a4b req-9a6970f4-3c75-4498-9e21-7f823152f4b6 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Received event network-vif-plugged-5cab4329-e3d7-4d50-9a27-c1291f6f4b4a {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:19:06 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-a6ef2660-fe05-4ab6-ae20-d9c15e6f8a4b req-9a6970f4-3c75-4498-9e21-7f823152f4b6 service nova] Acquiring lock "1c438a54-5528-4354-9836-f1a198532c9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:19:06 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-a6ef2660-fe05-4ab6-ae20-d9c15e6f8a4b req-9a6970f4-3c75-4498-9e21-7f823152f4b6 service nova] Lock "1c438a54-5528-4354-9836-f1a198532c9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:19:06 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-a6ef2660-fe05-4ab6-ae20-d9c15e6f8a4b req-9a6970f4-3c75-4498-9e21-7f823152f4b6 service nova] Lock "1c438a54-5528-4354-9836-f1a198532c9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:19:06 user nova-compute[95467]: DEBUG nova.compute.manager [req-a6ef2660-fe05-4ab6-ae20-d9c15e6f8a4b req-9a6970f4-3c75-4498-9e21-7f823152f4b6 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] No waiting events found dispatching network-vif-plugged-5cab4329-e3d7-4d50-9a27-c1291f6f4b4a {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:19:06 user nova-compute[95467]: WARNING nova.compute.manager [req-a6ef2660-fe05-4ab6-ae20-d9c15e6f8a4b req-9a6970f4-3c75-4498-9e21-7f823152f4b6 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Received unexpected event network-vif-plugged-5cab4329-e3d7-4d50-9a27-c1291f6f4b4a for instance with vm_state building and task_state spawning.
Nov 15 08:19:06 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:06 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:06 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:06 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:06 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:06 user nova-compute[95467]: DEBUG nova.compute.manager [req-10484139-a04f-474b-b512-d6f005a30ec5 req-69d237bd-2da2-4294-b7a0-b532410eaa6f service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Received event network-vif-plugged-d6c4a108-4733-4daa-935a-56424ed362e9 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:19:06 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-10484139-a04f-474b-b512-d6f005a30ec5 req-69d237bd-2da2-4294-b7a0-b532410eaa6f service nova] Acquiring lock "1c438a54-5528-4354-9836-f1a198532c9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:19:06 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-10484139-a04f-474b-b512-d6f005a30ec5 req-69d237bd-2da2-4294-b7a0-b532410eaa6f service nova] Lock "1c438a54-5528-4354-9836-f1a198532c9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:19:06 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-10484139-a04f-474b-b512-d6f005a30ec5 req-69d237bd-2da2-4294-b7a0-b532410eaa6f service nova] Lock "1c438a54-5528-4354-9836-f1a198532c9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:19:06 user nova-compute[95467]: DEBUG nova.compute.manager [req-10484139-a04f-474b-b512-d6f005a30ec5 req-69d237bd-2da2-4294-b7a0-b532410eaa6f service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] No waiting events found dispatching network-vif-plugged-d6c4a108-4733-4daa-935a-56424ed362e9 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:19:06 user nova-compute[95467]: WARNING nova.compute.manager [req-10484139-a04f-474b-b512-d6f005a30ec5 req-69d237bd-2da2-4294-b7a0-b532410eaa6f service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Received unexpected event network-vif-plugged-d6c4a108-4733-4daa-935a-56424ed362e9 for instance with vm_state building and task_state spawning.
Nov 15 08:19:06 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:06 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:06 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:06 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:06 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:06 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:06 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:06 user nova-compute[95467]: DEBUG nova.compute.manager [req-765c1e7b-0465-47b5-848a-2815f58f37dd req-ec9e5afc-479a-432f-94b1-e68cf0041f4d service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Received event network-vif-plugged-79b592a8-b5f9-48e6-ae2d-d535ded922b1 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:19:06 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-765c1e7b-0465-47b5-848a-2815f58f37dd req-ec9e5afc-479a-432f-94b1-e68cf0041f4d service nova] Acquiring lock "1c438a54-5528-4354-9836-f1a198532c9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:19:06 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-765c1e7b-0465-47b5-848a-2815f58f37dd req-ec9e5afc-479a-432f-94b1-e68cf0041f4d service nova] Lock "1c438a54-5528-4354-9836-f1a198532c9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:19:06 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-765c1e7b-0465-47b5-848a-2815f58f37dd req-ec9e5afc-479a-432f-94b1-e68cf0041f4d service nova] Lock "1c438a54-5528-4354-9836-f1a198532c9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:19:06 user nova-compute[95467]: DEBUG nova.compute.manager [req-765c1e7b-0465-47b5-848a-2815f58f37dd req-ec9e5afc-479a-432f-94b1-e68cf0041f4d service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] No waiting events found dispatching network-vif-plugged-79b592a8-b5f9-48e6-ae2d-d535ded922b1 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:19:06 user nova-compute[95467]: WARNING nova.compute.manager [req-765c1e7b-0465-47b5-848a-2815f58f37dd req-ec9e5afc-479a-432f-94b1-e68cf0041f4d service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Received unexpected event network-vif-plugged-79b592a8-b5f9-48e6-ae2d-d535ded922b1 for instance with vm_state building and task_state spawning.
Nov 15 08:19:07 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:07 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:07 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:07 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:07 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:07 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:07 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:07 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:07 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:07 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:07 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:07 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:07 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:07 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:07 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:08 user nova-compute[95467]: DEBUG nova.compute.manager [req-9c9dd9c0-f990-4da6-9a32-1f58a34c0681 req-8e4ffb8a-efba-436e-9b31-a2c634837ef0 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Received event network-vif-plugged-5cab4329-e3d7-4d50-9a27-c1291f6f4b4a {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:19:08 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-9c9dd9c0-f990-4da6-9a32-1f58a34c0681 req-8e4ffb8a-efba-436e-9b31-a2c634837ef0 service nova] Acquiring lock "1c438a54-5528-4354-9836-f1a198532c9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:19:08 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-9c9dd9c0-f990-4da6-9a32-1f58a34c0681 req-8e4ffb8a-efba-436e-9b31-a2c634837ef0 service nova] Lock "1c438a54-5528-4354-9836-f1a198532c9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:19:08 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-9c9dd9c0-f990-4da6-9a32-1f58a34c0681 req-8e4ffb8a-efba-436e-9b31-a2c634837ef0 service nova] Lock "1c438a54-5528-4354-9836-f1a198532c9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:19:08 user nova-compute[95467]: DEBUG nova.compute.manager [req-9c9dd9c0-f990-4da6-9a32-1f58a34c0681 req-8e4ffb8a-efba-436e-9b31-a2c634837ef0 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] No waiting events found dispatching network-vif-plugged-5cab4329-e3d7-4d50-9a27-c1291f6f4b4a {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:19:08 user nova-compute[95467]: WARNING nova.compute.manager [req-9c9dd9c0-f990-4da6-9a32-1f58a34c0681 req-8e4ffb8a-efba-436e-9b31-a2c634837ef0 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Received unexpected event network-vif-plugged-5cab4329-e3d7-4d50-9a27-c1291f6f4b4a for instance with vm_state building and task_state spawning.
Nov 15 08:19:08 user nova-compute[95467]: DEBUG nova.compute.manager [req-9c9dd9c0-f990-4da6-9a32-1f58a34c0681 req-8e4ffb8a-efba-436e-9b31-a2c634837ef0 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Received event network-vif-plugged-68127374-b841-456d-b9eb-29e96bd43dc6 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:19:08 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-9c9dd9c0-f990-4da6-9a32-1f58a34c0681 req-8e4ffb8a-efba-436e-9b31-a2c634837ef0 service nova] Acquiring lock "1c438a54-5528-4354-9836-f1a198532c9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:19:08 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-9c9dd9c0-f990-4da6-9a32-1f58a34c0681 req-8e4ffb8a-efba-436e-9b31-a2c634837ef0 service nova] Lock "1c438a54-5528-4354-9836-f1a198532c9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:19:08 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-9c9dd9c0-f990-4da6-9a32-1f58a34c0681 req-8e4ffb8a-efba-436e-9b31-a2c634837ef0 service nova] Lock "1c438a54-5528-4354-9836-f1a198532c9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:19:08 user nova-compute[95467]: DEBUG nova.compute.manager [req-9c9dd9c0-f990-4da6-9a32-1f58a34c0681 req-8e4ffb8a-efba-436e-9b31-a2c634837ef0 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] No waiting events found dispatching network-vif-plugged-68127374-b841-456d-b9eb-29e96bd43dc6 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:19:08 user nova-compute[95467]: WARNING nova.compute.manager [req-9c9dd9c0-f990-4da6-9a32-1f58a34c0681 req-8e4ffb8a-efba-436e-9b31-a2c634837ef0 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Received unexpected event network-vif-plugged-68127374-b841-456d-b9eb-29e96bd43dc6 for instance with vm_state building and task_state spawning.
Nov 15 08:19:08 user nova-compute[95467]: DEBUG nova.compute.manager [req-9c9dd9c0-f990-4da6-9a32-1f58a34c0681 req-8e4ffb8a-efba-436e-9b31-a2c634837ef0 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Received event network-vif-plugged-68127374-b841-456d-b9eb-29e96bd43dc6 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:19:08 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-9c9dd9c0-f990-4da6-9a32-1f58a34c0681 req-8e4ffb8a-efba-436e-9b31-a2c634837ef0 service nova] Acquiring lock "1c438a54-5528-4354-9836-f1a198532c9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:19:08 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-9c9dd9c0-f990-4da6-9a32-1f58a34c0681 req-8e4ffb8a-efba-436e-9b31-a2c634837ef0 service nova] Lock "1c438a54-5528-4354-9836-f1a198532c9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:19:08 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-9c9dd9c0-f990-4da6-9a32-1f58a34c0681 req-8e4ffb8a-efba-436e-9b31-a2c634837ef0 service nova] Lock "1c438a54-5528-4354-9836-f1a198532c9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:19:08 user nova-compute[95467]: DEBUG nova.compute.manager [req-9c9dd9c0-f990-4da6-9a32-1f58a34c0681 req-8e4ffb8a-efba-436e-9b31-a2c634837ef0 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] No waiting events found dispatching network-vif-plugged-68127374-b841-456d-b9eb-29e96bd43dc6 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:19:08 user nova-compute[95467]: WARNING nova.compute.manager [req-9c9dd9c0-f990-4da6-9a32-1f58a34c0681 req-8e4ffb8a-efba-436e-9b31-a2c634837ef0 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Received unexpected event network-vif-plugged-68127374-b841-456d-b9eb-29e96bd43dc6 for instance with vm_state building and task_state spawning.
Nov 15 08:19:08 user nova-compute[95467]: DEBUG nova.compute.manager [req-9c9dd9c0-f990-4da6-9a32-1f58a34c0681 req-8e4ffb8a-efba-436e-9b31-a2c634837ef0 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Received event network-vif-plugged-ffab8636-a06b-43fc-9aa8-fcec46b2426d {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:19:08 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-9c9dd9c0-f990-4da6-9a32-1f58a34c0681 req-8e4ffb8a-efba-436e-9b31-a2c634837ef0 service nova] Acquiring lock "1c438a54-5528-4354-9836-f1a198532c9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:19:08 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-9c9dd9c0-f990-4da6-9a32-1f58a34c0681 req-8e4ffb8a-efba-436e-9b31-a2c634837ef0 service nova] Lock "1c438a54-5528-4354-9836-f1a198532c9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:19:08 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-9c9dd9c0-f990-4da6-9a32-1f58a34c0681 req-8e4ffb8a-efba-436e-9b31-a2c634837ef0 service nova] Lock "1c438a54-5528-4354-9836-f1a198532c9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:19:08 user nova-compute[95467]: DEBUG nova.compute.manager [req-9c9dd9c0-f990-4da6-9a32-1f58a34c0681 req-8e4ffb8a-efba-436e-9b31-a2c634837ef0 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] No waiting events found dispatching network-vif-plugged-ffab8636-a06b-43fc-9aa8-fcec46b2426d {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:19:08 user nova-compute[95467]: WARNING nova.compute.manager [req-9c9dd9c0-f990-4da6-9a32-1f58a34c0681 req-8e4ffb8a-efba-436e-9b31-a2c634837ef0 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Received unexpected event network-vif-plugged-ffab8636-a06b-43fc-9aa8-fcec46b2426d for instance with vm_state building and task_state spawning.
Nov 15 08:19:08 user nova-compute[95467]: DEBUG nova.compute.manager [req-9c9dd9c0-f990-4da6-9a32-1f58a34c0681 req-8e4ffb8a-efba-436e-9b31-a2c634837ef0 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Received event network-vif-plugged-ffab8636-a06b-43fc-9aa8-fcec46b2426d {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:19:08 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-9c9dd9c0-f990-4da6-9a32-1f58a34c0681 req-8e4ffb8a-efba-436e-9b31-a2c634837ef0 service nova] Acquiring lock "1c438a54-5528-4354-9836-f1a198532c9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:19:08 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-9c9dd9c0-f990-4da6-9a32-1f58a34c0681 req-8e4ffb8a-efba-436e-9b31-a2c634837ef0 service nova] Lock "1c438a54-5528-4354-9836-f1a198532c9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:19:08 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-9c9dd9c0-f990-4da6-9a32-1f58a34c0681 req-8e4ffb8a-efba-436e-9b31-a2c634837ef0 service nova] Lock "1c438a54-5528-4354-9836-f1a198532c9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:19:08 user nova-compute[95467]: DEBUG nova.compute.manager [req-9c9dd9c0-f990-4da6-9a32-1f58a34c0681 req-8e4ffb8a-efba-436e-9b31-a2c634837ef0 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] No waiting events found dispatching network-vif-plugged-ffab8636-a06b-43fc-9aa8-fcec46b2426d {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:19:08 user nova-compute[95467]: WARNING nova.compute.manager [req-9c9dd9c0-f990-4da6-9a32-1f58a34c0681 req-8e4ffb8a-efba-436e-9b31-a2c634837ef0 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Received unexpected event network-vif-plugged-ffab8636-a06b-43fc-9aa8-fcec46b2426d for instance with vm_state building and task_state spawning.
Nov 15 08:19:08 user nova-compute[95467]: DEBUG nova.compute.manager [req-9c9dd9c0-f990-4da6-9a32-1f58a34c0681 req-8e4ffb8a-efba-436e-9b31-a2c634837ef0 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Received event network-vif-plugged-27370ddc-29be-446e-8205-a50379d200d7 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:19:08 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-9c9dd9c0-f990-4da6-9a32-1f58a34c0681 req-8e4ffb8a-efba-436e-9b31-a2c634837ef0 service nova] Acquiring lock "1c438a54-5528-4354-9836-f1a198532c9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:19:08 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-9c9dd9c0-f990-4da6-9a32-1f58a34c0681 req-8e4ffb8a-efba-436e-9b31-a2c634837ef0 service nova] Lock "1c438a54-5528-4354-9836-f1a198532c9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:19:08 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-9c9dd9c0-f990-4da6-9a32-1f58a34c0681 req-8e4ffb8a-efba-436e-9b31-a2c634837ef0 service nova] Lock "1c438a54-5528-4354-9836-f1a198532c9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:19:08 user nova-compute[95467]: DEBUG nova.compute.manager [req-9c9dd9c0-f990-4da6-9a32-1f58a34c0681 req-8e4ffb8a-efba-436e-9b31-a2c634837ef0 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] No waiting events found dispatching network-vif-plugged-27370ddc-29be-446e-8205-a50379d200d7 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:19:08 user nova-compute[95467]: WARNING nova.compute.manager [req-9c9dd9c0-f990-4da6-9a32-1f58a34c0681 req-8e4ffb8a-efba-436e-9b31-a2c634837ef0 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Received unexpected event network-vif-plugged-27370ddc-29be-446e-8205-a50379d200d7 for instance with vm_state building and task_state spawning.
Nov 15 08:19:08 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:08 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:08 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:08 user nova-compute[95467]: DEBUG nova.compute.manager [req-ed0e5f51-40a6-4661-be4d-cafad4f31118 req-0dba0056-9559-498c-9cb2-3c983d850758 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Received event network-vif-plugged-d6c4a108-4733-4daa-935a-56424ed362e9 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:19:08 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ed0e5f51-40a6-4661-be4d-cafad4f31118 req-0dba0056-9559-498c-9cb2-3c983d850758 service nova] Acquiring lock "1c438a54-5528-4354-9836-f1a198532c9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:19:08 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ed0e5f51-40a6-4661-be4d-cafad4f31118 req-0dba0056-9559-498c-9cb2-3c983d850758 service nova] Lock "1c438a54-5528-4354-9836-f1a198532c9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:19:08 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ed0e5f51-40a6-4661-be4d-cafad4f31118 req-0dba0056-9559-498c-9cb2-3c983d850758 service nova] Lock "1c438a54-5528-4354-9836-f1a198532c9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:19:08 user nova-compute[95467]: DEBUG nova.compute.manager [req-ed0e5f51-40a6-4661-be4d-cafad4f31118 req-0dba0056-9559-498c-9cb2-3c983d850758 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] No waiting events found dispatching network-vif-plugged-d6c4a108-4733-4daa-935a-56424ed362e9 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:19:08 user nova-compute[95467]: WARNING nova.compute.manager [req-ed0e5f51-40a6-4661-be4d-cafad4f31118 req-0dba0056-9559-498c-9cb2-3c983d850758 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Received unexpected event network-vif-plugged-d6c4a108-4733-4daa-935a-56424ed362e9 for instance with vm_state building and task_state spawning.
Nov 15 08:19:08 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:09 user nova-compute[95467]: DEBUG nova.compute.manager [req-15f94776-a90c-4684-9031-074cddb5c7a3 req-5e74a8a8-4e67-401d-82e0-4d3b41ae7874 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Received event network-vif-plugged-79b592a8-b5f9-48e6-ae2d-d535ded922b1 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:19:09 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-15f94776-a90c-4684-9031-074cddb5c7a3 req-5e74a8a8-4e67-401d-82e0-4d3b41ae7874 service nova] Acquiring lock "1c438a54-5528-4354-9836-f1a198532c9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:19:09 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-15f94776-a90c-4684-9031-074cddb5c7a3 req-5e74a8a8-4e67-401d-82e0-4d3b41ae7874 service nova] Lock "1c438a54-5528-4354-9836-f1a198532c9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:19:09 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-15f94776-a90c-4684-9031-074cddb5c7a3 req-5e74a8a8-4e67-401d-82e0-4d3b41ae7874 service nova] Lock "1c438a54-5528-4354-9836-f1a198532c9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:19:09 user nova-compute[95467]: DEBUG nova.compute.manager [req-15f94776-a90c-4684-9031-074cddb5c7a3 req-5e74a8a8-4e67-401d-82e0-4d3b41ae7874 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] No waiting events found dispatching network-vif-plugged-79b592a8-b5f9-48e6-ae2d-d535ded922b1 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:19:09 user nova-compute[95467]: WARNING nova.compute.manager [req-15f94776-a90c-4684-9031-074cddb5c7a3 req-5e74a8a8-4e67-401d-82e0-4d3b41ae7874 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Received unexpected event network-vif-plugged-79b592a8-b5f9-48e6-ae2d-d535ded922b1 for instance with vm_state building and task_state spawning.
Nov 15 08:19:09 user nova-compute[95467]: DEBUG nova.compute.manager [req-15f94776-a90c-4684-9031-074cddb5c7a3 req-5e74a8a8-4e67-401d-82e0-4d3b41ae7874 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Received event network-vif-plugged-71b2b3bf-8597-40e5-803d-be98308390b7 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:19:09 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-15f94776-a90c-4684-9031-074cddb5c7a3 req-5e74a8a8-4e67-401d-82e0-4d3b41ae7874 service nova] Acquiring lock "1c438a54-5528-4354-9836-f1a198532c9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:19:09 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-15f94776-a90c-4684-9031-074cddb5c7a3 req-5e74a8a8-4e67-401d-82e0-4d3b41ae7874 service nova] Lock "1c438a54-5528-4354-9836-f1a198532c9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:19:09 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-15f94776-a90c-4684-9031-074cddb5c7a3 req-5e74a8a8-4e67-401d-82e0-4d3b41ae7874 service nova] Lock "1c438a54-5528-4354-9836-f1a198532c9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:19:09 user nova-compute[95467]: DEBUG nova.compute.manager [req-15f94776-a90c-4684-9031-074cddb5c7a3 req-5e74a8a8-4e67-401d-82e0-4d3b41ae7874 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] No waiting events found dispatching network-vif-plugged-71b2b3bf-8597-40e5-803d-be98308390b7 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:19:09 user nova-compute[95467]: WARNING nova.compute.manager [req-15f94776-a90c-4684-9031-074cddb5c7a3 req-5e74a8a8-4e67-401d-82e0-4d3b41ae7874 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Received unexpected event network-vif-plugged-71b2b3bf-8597-40e5-803d-be98308390b7 for instance with vm_state building and task_state spawning.
Nov 15 08:19:09 user nova-compute[95467]: DEBUG nova.compute.manager [req-15f94776-a90c-4684-9031-074cddb5c7a3 req-5e74a8a8-4e67-401d-82e0-4d3b41ae7874 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Received event network-vif-plugged-71b2b3bf-8597-40e5-803d-be98308390b7 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:19:09 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-15f94776-a90c-4684-9031-074cddb5c7a3 req-5e74a8a8-4e67-401d-82e0-4d3b41ae7874 service nova] Acquiring lock "1c438a54-5528-4354-9836-f1a198532c9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:19:09 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-15f94776-a90c-4684-9031-074cddb5c7a3 req-5e74a8a8-4e67-401d-82e0-4d3b41ae7874 service nova] Lock "1c438a54-5528-4354-9836-f1a198532c9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:19:09 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-15f94776-a90c-4684-9031-074cddb5c7a3 req-5e74a8a8-4e67-401d-82e0-4d3b41ae7874 service nova] Lock "1c438a54-5528-4354-9836-f1a198532c9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:19:09 user nova-compute[95467]: DEBUG nova.compute.manager [req-15f94776-a90c-4684-9031-074cddb5c7a3 req-5e74a8a8-4e67-401d-82e0-4d3b41ae7874 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] No waiting events found dispatching network-vif-plugged-71b2b3bf-8597-40e5-803d-be98308390b7 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:19:09 user nova-compute[95467]: WARNING nova.compute.manager [req-15f94776-a90c-4684-9031-074cddb5c7a3 req-5e74a8a8-4e67-401d-82e0-4d3b41ae7874 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Received unexpected event network-vif-plugged-71b2b3bf-8597-40e5-803d-be98308390b7 for instance with vm_state building and task_state spawning.
Nov 15 08:19:09 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:09 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:09 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:09 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:09 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:10 user nova-compute[95467]: DEBUG nova.compute.manager [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Instance event wait completed in 0 seconds for  {{(pid=95467) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 08:19:10 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Guest created on hypervisor {{(pid=95467) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 08:19:10 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Instance spawned successfully.
Nov 15 08:19:10 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 08:19:10 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Found default for hw_cdrom_bus of ide {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:19:10 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Found default for hw_disk_bus of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:19:10 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Found default for hw_input_bus of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:19:10 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Found default for hw_pointer_model of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:19:10 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Found default for hw_video_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:19:10 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Found default for hw_vif_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:19:10 user nova-compute[95467]: DEBUG nova.compute.manager [req-12508db4-4862-42f5-ace6-7f26cec2e2e3 req-1e8b87ca-6d94-47c9-ac38-941a8a78fa85 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Received event network-vif-plugged-27370ddc-29be-446e-8205-a50379d200d7 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:19:10 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-12508db4-4862-42f5-ace6-7f26cec2e2e3 req-1e8b87ca-6d94-47c9-ac38-941a8a78fa85 service nova] Acquiring lock "1c438a54-5528-4354-9836-f1a198532c9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:19:10 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-12508db4-4862-42f5-ace6-7f26cec2e2e3 req-1e8b87ca-6d94-47c9-ac38-941a8a78fa85 service nova] Lock "1c438a54-5528-4354-9836-f1a198532c9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:19:10 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-12508db4-4862-42f5-ace6-7f26cec2e2e3 req-1e8b87ca-6d94-47c9-ac38-941a8a78fa85 service nova] Lock "1c438a54-5528-4354-9836-f1a198532c9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:19:10 user nova-compute[95467]: DEBUG nova.compute.manager [req-12508db4-4862-42f5-ace6-7f26cec2e2e3 req-1e8b87ca-6d94-47c9-ac38-941a8a78fa85 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] No waiting events found dispatching network-vif-plugged-27370ddc-29be-446e-8205-a50379d200d7 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:19:10 user nova-compute[95467]: WARNING nova.compute.manager [req-12508db4-4862-42f5-ace6-7f26cec2e2e3 req-1e8b87ca-6d94-47c9-ac38-941a8a78fa85 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Received unexpected event network-vif-plugged-27370ddc-29be-446e-8205-a50379d200d7 for instance with vm_state building and task_state spawning.
Nov 15 08:19:10 user nova-compute[95467]: DEBUG nova.compute.manager [req-12508db4-4862-42f5-ace6-7f26cec2e2e3 req-1e8b87ca-6d94-47c9-ac38-941a8a78fa85 service nova] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Received event network-changed-7f8e69fc-628f-4a31-9ba0-db0b320dff09 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:19:10 user nova-compute[95467]: DEBUG nova.compute.manager [req-12508db4-4862-42f5-ace6-7f26cec2e2e3 req-1e8b87ca-6d94-47c9-ac38-941a8a78fa85 service nova] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Refreshing instance network info cache due to event network-changed-7f8e69fc-628f-4a31-9ba0-db0b320dff09. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:19:10 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-12508db4-4862-42f5-ace6-7f26cec2e2e3 req-1e8b87ca-6d94-47c9-ac38-941a8a78fa85 service nova] Acquiring lock "refresh_cache-e7805e5c-1777-4b0c-95c7-b232be66528c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:19:10 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-12508db4-4862-42f5-ace6-7f26cec2e2e3 req-1e8b87ca-6d94-47c9-ac38-941a8a78fa85 service nova] Acquired lock "refresh_cache-e7805e5c-1777-4b0c-95c7-b232be66528c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:19:10 user nova-compute[95467]: DEBUG nova.network.neutron [req-12508db4-4862-42f5-ace6-7f26cec2e2e3 req-1e8b87ca-6d94-47c9-ac38-941a8a78fa85 service nova] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Refreshing network info cache for port 7f8e69fc-628f-4a31-9ba0-db0b320dff09 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:19:10 user nova-compute[95467]: INFO nova.compute.manager [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Took 12.78 seconds to spawn the instance on the hypervisor.
Nov 15 08:19:10 user nova-compute[95467]: DEBUG nova.compute.manager [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:19:10 user nova-compute[95467]: INFO nova.compute.manager [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Took 38.58 seconds to build instance.
Nov 15 08:19:10 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-cf52b994-7dd4-48e9-9288-c366babc7311 tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Lock "1c438a54-5528-4354-9836-f1a198532c9b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 38.674s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:19:10 user nova-compute[95467]: DEBUG nova.network.neutron [req-12508db4-4862-42f5-ace6-7f26cec2e2e3 req-1e8b87ca-6d94-47c9-ac38-941a8a78fa85 service nova] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Updated VIF entry in instance network info cache for port 7f8e69fc-628f-4a31-9ba0-db0b320dff09. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:19:10 user nova-compute[95467]: DEBUG nova.network.neutron [req-12508db4-4862-42f5-ace6-7f26cec2e2e3 req-1e8b87ca-6d94-47c9-ac38-941a8a78fa85 service nova] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Updating instance_info_cache with network_info: [{"id": "7f8e69fc-628f-4a31-9ba0-db0b320dff09", "address": "fa:16:3e:46:f0:15", "network": {"id": "f7871b75-73b3-4f0a-8e6c-814bc61ebd6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-945672014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b04c448c61451d8d46ebc7a61a5e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f8e69fc-62", "ovs_interfaceid": "7f8e69fc-628f-4a31-9ba0-db0b320dff09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:19:10 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-12508db4-4862-42f5-ace6-7f26cec2e2e3 req-1e8b87ca-6d94-47c9-ac38-941a8a78fa85 service nova] Releasing lock "refresh_cache-e7805e5c-1777-4b0c-95c7-b232be66528c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:19:12 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3bfe953c-aad5-4efd-af0d-8b414b7c88bc tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Acquiring lock "e7805e5c-1777-4b0c-95c7-b232be66528c" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:19:12 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3bfe953c-aad5-4efd-af0d-8b414b7c88bc tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "e7805e5c-1777-4b0c-95c7-b232be66528c" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:19:12 user nova-compute[95467]: INFO nova.compute.manager [None req-3bfe953c-aad5-4efd-af0d-8b414b7c88bc tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Shelving
Nov 15 08:19:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:12 user nova-compute[95467]: DEBUG nova.compute.manager [req-720d0d27-145d-43a6-a254-0f2a3c617c83 req-c061288b-2068-4a02-952a-fd1e6528f0e9 service nova] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Received event network-vif-unplugged-7f8e69fc-628f-4a31-9ba0-db0b320dff09 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:19:12 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-720d0d27-145d-43a6-a254-0f2a3c617c83 req-c061288b-2068-4a02-952a-fd1e6528f0e9 service nova] Acquiring lock "e7805e5c-1777-4b0c-95c7-b232be66528c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:19:12 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-720d0d27-145d-43a6-a254-0f2a3c617c83 req-c061288b-2068-4a02-952a-fd1e6528f0e9 service nova] Lock "e7805e5c-1777-4b0c-95c7-b232be66528c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:19:12 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-720d0d27-145d-43a6-a254-0f2a3c617c83 req-c061288b-2068-4a02-952a-fd1e6528f0e9 service nova] Lock "e7805e5c-1777-4b0c-95c7-b232be66528c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:19:12 user nova-compute[95467]: DEBUG nova.compute.manager [req-720d0d27-145d-43a6-a254-0f2a3c617c83 req-c061288b-2068-4a02-952a-fd1e6528f0e9 service nova] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] No waiting events found dispatching network-vif-unplugged-7f8e69fc-628f-4a31-9ba0-db0b320dff09 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:19:12 user nova-compute[95467]: WARNING nova.compute.manager [req-720d0d27-145d-43a6-a254-0f2a3c617c83 req-c061288b-2068-4a02-952a-fd1e6528f0e9 service nova] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Received unexpected event network-vif-unplugged-7f8e69fc-628f-4a31-9ba0-db0b320dff09 for instance with vm_state active and task_state shelving.
Nov 15 08:19:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:12 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Instance destroyed successfully.
Nov 15 08:19:12 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-3bfe953c-aad5-4efd-af0d-8b414b7c88bc tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Beginning cold snapshot process
Nov 15 08:19:12 user nova-compute[95467]: DEBUG nova.privsep.utils [None req-3bfe953c-aad5-4efd-af0d-8b414b7c88bc tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=95467) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 08:19:12 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3bfe953c-aad5-4efd-af0d-8b414b7c88bc tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/e7805e5c-1777-4b0c-95c7-b232be66528c/disk /opt/stack/data/nova/instances/snapshots/tmphyog9mkc/0bf0cc8c3d1f4afd84922db0ffff9443 {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:19:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3bfe953c-aad5-4efd-af0d-8b414b7c88bc tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/e7805e5c-1777-4b0c-95c7-b232be66528c/disk /opt/stack/data/nova/instances/snapshots/tmphyog9mkc/0bf0cc8c3d1f4afd84922db0ffff9443" returned: 0 in 0.685s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:19:13 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-3bfe953c-aad5-4efd-af0d-8b414b7c88bc tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Snapshot extracted, beginning image upload
Nov 15 08:19:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:14 user nova-compute[95467]: DEBUG nova.compute.manager [req-58528fb6-d679-4b41-801c-5276be9c1b4c req-9146eb5f-5b9e-450b-86cc-3152443b4a8a service nova] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Received event network-vif-plugged-7f8e69fc-628f-4a31-9ba0-db0b320dff09 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:19:14 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-58528fb6-d679-4b41-801c-5276be9c1b4c req-9146eb5f-5b9e-450b-86cc-3152443b4a8a service nova] Acquiring lock "e7805e5c-1777-4b0c-95c7-b232be66528c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:19:14 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-58528fb6-d679-4b41-801c-5276be9c1b4c req-9146eb5f-5b9e-450b-86cc-3152443b4a8a service nova] Lock "e7805e5c-1777-4b0c-95c7-b232be66528c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:19:14 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-58528fb6-d679-4b41-801c-5276be9c1b4c req-9146eb5f-5b9e-450b-86cc-3152443b4a8a service nova] Lock "e7805e5c-1777-4b0c-95c7-b232be66528c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:19:14 user nova-compute[95467]: DEBUG nova.compute.manager [req-58528fb6-d679-4b41-801c-5276be9c1b4c req-9146eb5f-5b9e-450b-86cc-3152443b4a8a service nova] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] No waiting events found dispatching network-vif-plugged-7f8e69fc-628f-4a31-9ba0-db0b320dff09 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:19:14 user nova-compute[95467]: WARNING nova.compute.manager [req-58528fb6-d679-4b41-801c-5276be9c1b4c req-9146eb5f-5b9e-450b-86cc-3152443b4a8a service nova] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Received unexpected event network-vif-plugged-7f8e69fc-628f-4a31-9ba0-db0b320dff09 for instance with vm_state active and task_state shelving_image_uploading.
Nov 15 08:19:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Acquiring lock "ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:19:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lock "ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:19:15 user nova-compute[95467]: DEBUG nova.compute.manager [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] Starting instance... {{(pid=95467) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 08:19:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-df819aee-555a-476e-8dc8-0f63475a9c87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Acquiring lock "2765af98-917a-4f0f-95af-3393e0d50a52" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:19:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-df819aee-555a-476e-8dc8-0f63475a9c87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "2765af98-917a-4f0f-95af-3393e0d50a52" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:19:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-df819aee-555a-476e-8dc8-0f63475a9c87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Acquiring lock "2765af98-917a-4f0f-95af-3393e0d50a52-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:19:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-df819aee-555a-476e-8dc8-0f63475a9c87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "2765af98-917a-4f0f-95af-3393e0d50a52-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:19:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-df819aee-555a-476e-8dc8-0f63475a9c87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "2765af98-917a-4f0f-95af-3393e0d50a52-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:19:15 user nova-compute[95467]: INFO nova.compute.manager [None req-df819aee-555a-476e-8dc8-0f63475a9c87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] Terminating instance
Nov 15 08:19:15 user nova-compute[95467]: DEBUG nova.compute.manager [None req-df819aee-555a-476e-8dc8-0f63475a9c87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] Start destroying the instance on the hypervisor. {{(pid=95467) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 08:19:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:19:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:19:15 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=95467) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 08:19:15 user nova-compute[95467]: INFO nova.compute.claims [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] Claim successful on node user
Nov 15 08:19:15 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:15 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:15 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:15 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:15 user nova-compute[95467]: DEBUG nova.compute.manager [req-1717465d-1835-4124-9051-055ab795a6ae req-0c2240c8-8a53-4345-ba99-98743c8531cb service nova] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] Received event network-vif-unplugged-1033bb03-0ef8-48ae-9006-240ec7ab4d63 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:19:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-1717465d-1835-4124-9051-055ab795a6ae req-0c2240c8-8a53-4345-ba99-98743c8531cb service nova] Acquiring lock "2765af98-917a-4f0f-95af-3393e0d50a52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:19:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-1717465d-1835-4124-9051-055ab795a6ae req-0c2240c8-8a53-4345-ba99-98743c8531cb service nova] Lock "2765af98-917a-4f0f-95af-3393e0d50a52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:19:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-1717465d-1835-4124-9051-055ab795a6ae req-0c2240c8-8a53-4345-ba99-98743c8531cb service nova] Lock "2765af98-917a-4f0f-95af-3393e0d50a52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:19:15 user nova-compute[95467]: DEBUG nova.compute.manager [req-1717465d-1835-4124-9051-055ab795a6ae req-0c2240c8-8a53-4345-ba99-98743c8531cb service nova] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] No waiting events found dispatching network-vif-unplugged-1033bb03-0ef8-48ae-9006-240ec7ab4d63 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:19:15 user nova-compute[95467]: DEBUG nova.compute.manager [req-1717465d-1835-4124-9051-055ab795a6ae req-0c2240c8-8a53-4345-ba99-98743c8531cb service nova] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] Received event network-vif-unplugged-1033bb03-0ef8-48ae-9006-240ec7ab4d63 for instance with task_state deleting. {{(pid=95467) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 08:19:16 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:19:16 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:19:16 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.762s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:19:16 user nova-compute[95467]: DEBUG nova.compute.manager [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] Start building networks asynchronously for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 08:19:16 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] Instance destroyed successfully.
Nov 15 08:19:16 user nova-compute[95467]: DEBUG nova.objects.instance [None req-df819aee-555a-476e-8dc8-0f63475a9c87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lazy-loading 'resources' on Instance uuid 2765af98-917a-4f0f-95af-3393e0d50a52 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:19:16 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-df819aee-555a-476e-8dc8-0f63475a9c87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:16:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1315317158',display_name='tempest-AttachVolumeNegativeTest-server-1315317158',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1315317158',id=26,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGbv8JeJz+7mWgEQpg3K6t3RS/zPBmL1s+k5vF27QtCf0pf9iHhis+PQNKAWg1oreYL73UumFeqTUgWx5oJHZUY8nAoislySkyRjbalQkY+/28lMpZBF4HjrsHz3mcnEcQ==',key_name='tempest-keypair-1798096385',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:16:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='50e2fec6a90a41a5a586c6da227caacc',ramdisk_id='',reservation_id='r-cfmyfa8q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1750086293',owner_user_name='tempest-AttachVolumeNegativeTest-1750086293-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:16:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='acce273b07b64e44af6e062175afa92d',uuid=2765af98-917a-4f0f-95af-3393e0d50a52,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1033bb03-0ef8-48ae-9006-240ec7ab4d63", "address": "fa:16:3e:4b:8a:91", "network": {"id": "27fd2b0f-65bd-4ae4-b5c8-dfca91668078", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1310727750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50e2fec6a90a41a5a586c6da227caacc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1033bb03-0e", "ovs_interfaceid": "1033bb03-0ef8-48ae-9006-240ec7ab4d63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:19:16 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-df819aee-555a-476e-8dc8-0f63475a9c87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Converting VIF {"id": "1033bb03-0ef8-48ae-9006-240ec7ab4d63", "address": "fa:16:3e:4b:8a:91", "network": {"id": "27fd2b0f-65bd-4ae4-b5c8-dfca91668078", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1310727750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50e2fec6a90a41a5a586c6da227caacc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1033bb03-0e", "ovs_interfaceid": "1033bb03-0ef8-48ae-9006-240ec7ab4d63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:19:16 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-df819aee-555a-476e-8dc8-0f63475a9c87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4b:8a:91,bridge_name='br-int',has_traffic_filtering=True,id=1033bb03-0ef8-48ae-9006-240ec7ab4d63,network=Network(27fd2b0f-65bd-4ae4-b5c8-dfca91668078),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1033bb03-0e') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:19:16 user nova-compute[95467]: DEBUG os_vif [None req-df819aee-555a-476e-8dc8-0f63475a9c87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:8a:91,bridge_name='br-int',has_traffic_filtering=True,id=1033bb03-0ef8-48ae-9006-240ec7ab4d63,network=Network(27fd2b0f-65bd-4ae4-b5c8-dfca91668078),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1033bb03-0e') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:19:16 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:16 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1033bb03-0e, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:19:16 user nova-compute[95467]: DEBUG nova.compute.manager [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] Allocating IP information in the background. {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 08:19:16 user nova-compute[95467]: DEBUG nova.network.neutron [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] allocate_for_instance() {{(pid=95467) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 08:19:16 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:16 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 08:19:16 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:19:16 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:16 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e8e9efcc-f551-4173-a4b2-19df0acab8c8) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:19:16 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:16 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:19:16 user nova-compute[95467]: DEBUG nova.compute.manager [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] Start building block device mappings for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 08:19:16 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:16 user nova-compute[95467]: INFO os_vif [None req-df819aee-555a-476e-8dc8-0f63475a9c87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:8a:91,bridge_name='br-int',has_traffic_filtering=True,id=1033bb03-0ef8-48ae-9006-240ec7ab4d63,network=Network(27fd2b0f-65bd-4ae4-b5c8-dfca91668078),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1033bb03-0e')
Nov 15 08:19:16 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-df819aee-555a-476e-8dc8-0f63475a9c87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] Deleting instance files /opt/stack/data/nova/instances/2765af98-917a-4f0f-95af-3393e0d50a52_del
Nov 15 08:19:16 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-df819aee-555a-476e-8dc8-0f63475a9c87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] Deletion of /opt/stack/data/nova/instances/2765af98-917a-4f0f-95af-3393e0d50a52_del complete
Nov 15 08:19:16 user nova-compute[95467]: INFO nova.compute.manager [None req-df819aee-555a-476e-8dc8-0f63475a9c87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] Took 1.02 seconds to destroy the instance on the hypervisor.
Nov 15 08:19:16 user nova-compute[95467]: DEBUG oslo.service.loopingcall [None req-df819aee-555a-476e-8dc8-0f63475a9c87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=95467) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 08:19:16 user nova-compute[95467]: DEBUG nova.compute.manager [-] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] Deallocating network for instance {{(pid=95467) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 08:19:16 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] deallocate_for_instance() {{(pid=95467) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 08:19:16 user nova-compute[95467]: DEBUG nova.policy [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '993622d17e1848a0980fd759e248edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1fa68347914efe87ae8edd3901e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95467) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 08:19:16 user nova-compute[95467]: DEBUG nova.compute.manager [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] Start spawning the instance on the hypervisor. {{(pid=95467) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 08:19:16 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] Creating instance directory {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 08:19:16 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] Creating image(s)
Nov 15 08:19:16 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Acquiring lock "/opt/stack/data/nova/instances/ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:19:16 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lock "/opt/stack/data/nova/instances/ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:19:16 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lock "/opt/stack/data/nova/instances/ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:19:16 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:19:16 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.215s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:19:16 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Acquiring lock "a3fcf60225fcefd310404971cd18ab9851c548dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:19:16 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:19:16 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:19:17 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.265s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:19:17 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a/disk 1073741824 {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:19:17 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a/disk 1073741824" returned: 0 in 0.052s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:19:17 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.325s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:19:17 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:19:17 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-3bfe953c-aad5-4efd-af0d-8b414b7c88bc tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Snapshot image upload complete
Nov 15 08:19:17 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3bfe953c-aad5-4efd-af0d-8b414b7c88bc tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:19:17 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:17 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.230s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:19:17 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a/disk. size=1073741824 {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 08:19:17 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:19:17 user nova-compute[95467]: INFO nova.compute.manager [None req-3bfe953c-aad5-4efd-af0d-8b414b7c88bc tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Shelve offloading
Nov 15 08:19:17 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Instance destroyed successfully.
Nov 15 08:19:17 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3bfe953c-aad5-4efd-af0d-8b414b7c88bc tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:19:17 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3bfe953c-aad5-4efd-af0d-8b414b7c88bc tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Acquiring lock "refresh_cache-e7805e5c-1777-4b0c-95c7-b232be66528c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:19:17 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3bfe953c-aad5-4efd-af0d-8b414b7c88bc tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Acquired lock "refresh_cache-e7805e5c-1777-4b0c-95c7-b232be66528c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:19:17 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3bfe953c-aad5-4efd-af0d-8b414b7c88bc tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:19:17 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:19:17 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Cannot resize image /opt/stack/data/nova/instances/ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a/disk to a smaller size. {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 08:19:17 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] Created local disks {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 08:19:17 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] Ensure instance console log exists: /opt/stack/data/nova/instances/ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a/console.log {{(pid=95467) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 08:19:17 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:19:17 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:19:17 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:19:17 user nova-compute[95467]: DEBUG nova.compute.manager [req-8190d2a2-8822-438e-a062-b42173f67ed8 req-691cf636-cbfb-48ce-840a-a1d5d800f7c4 service nova] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] Received event network-vif-plugged-1033bb03-0ef8-48ae-9006-240ec7ab4d63 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:19:17 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-8190d2a2-8822-438e-a062-b42173f67ed8 req-691cf636-cbfb-48ce-840a-a1d5d800f7c4 service nova] Acquiring lock "2765af98-917a-4f0f-95af-3393e0d50a52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:19:17 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-8190d2a2-8822-438e-a062-b42173f67ed8 req-691cf636-cbfb-48ce-840a-a1d5d800f7c4 service nova] Lock "2765af98-917a-4f0f-95af-3393e0d50a52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:19:17 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-8190d2a2-8822-438e-a062-b42173f67ed8 req-691cf636-cbfb-48ce-840a-a1d5d800f7c4 service nova] Lock "2765af98-917a-4f0f-95af-3393e0d50a52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:19:17 user nova-compute[95467]: DEBUG nova.compute.manager [req-8190d2a2-8822-438e-a062-b42173f67ed8 req-691cf636-cbfb-48ce-840a-a1d5d800f7c4 service nova] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] No waiting events found dispatching network-vif-plugged-1033bb03-0ef8-48ae-9006-240ec7ab4d63 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:19:17 user nova-compute[95467]: WARNING nova.compute.manager [req-8190d2a2-8822-438e-a062-b42173f67ed8 req-691cf636-cbfb-48ce-840a-a1d5d800f7c4 service nova] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] Received unexpected event network-vif-plugged-1033bb03-0ef8-48ae-9006-240ec7ab4d63 for instance with vm_state active and task_state deleting.
Nov 15 08:19:18 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3bfe953c-aad5-4efd-af0d-8b414b7c88bc tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Updating instance_info_cache with network_info: [{"id": "7f8e69fc-628f-4a31-9ba0-db0b320dff09", "address": "fa:16:3e:46:f0:15", "network": {"id": "f7871b75-73b3-4f0a-8e6c-814bc61ebd6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-945672014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b04c448c61451d8d46ebc7a61a5e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f8e69fc-62", "ovs_interfaceid": "7f8e69fc-628f-4a31-9ba0-db0b320dff09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:19:18 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3bfe953c-aad5-4efd-af0d-8b414b7c88bc tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Releasing lock "refresh_cache-e7805e5c-1777-4b0c-95c7-b232be66528c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:19:18 user nova-compute[95467]: DEBUG nova.network.neutron [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] Successfully created port: e998bcd4-3b5b-4cb1-9b31-7b44f124f51f {{(pid=95467) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 08:19:18 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:19:18 user nova-compute[95467]: INFO nova.compute.manager [-] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] Took 1.98 seconds to deallocate network for instance.
Nov 15 08:19:18 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-df819aee-555a-476e-8dc8-0f63475a9c87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:19:18 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-df819aee-555a-476e-8dc8-0f63475a9c87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:19:18 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Instance destroyed successfully.
Nov 15 08:19:18 user nova-compute[95467]: DEBUG nova.objects.instance [None req-3bfe953c-aad5-4efd-af0d-8b414b7c88bc tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lazy-loading 'resources' on Instance uuid e7805e5c-1777-4b0c-95c7-b232be66528c {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:19:18 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-3bfe953c-aad5-4efd-af0d-8b414b7c88bc tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:17:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2096143899',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2096143899',id=28,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBJ4d3/P/W4IM4c/SDFdf9+rwPXC3NZ0eghDPz0brXh+NeL91puTUjJZ6Wd0+WEV7wlTz3Y4+T858B8rzcbTbkNawWiCCL5nZHqbWqmnXBZ63bY9/9J2fUPSgv/Bhxp1g==',key_name='tempest-keypair-559293739',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:17:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='94b04c448c61451d8d46ebc7a61a5e6e',ramdisk_id='',reservation_id='r-1r9tzmt8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1251988905',owner_user_name='tempest-AttachVolumeShelveTestJSON-1251988905-project-member',shelved_at='2023-11-15T08:19:17.365248',shelved_host='user',shelved_image_id='4b964778-6892-4b00-8b6b-8c24f8a8a5bf'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:19:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b03564d022e84f5cb133b9771e76bae8',uuid=e7805e5c-1777-4b0c-95c7-b232be66528c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "7f8e69fc-628f-4a31-9ba0-db0b320dff09", "address": "fa:16:3e:46:f0:15", "network": {"id": "f7871b75-73b3-4f0a-8e6c-814bc61ebd6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-945672014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b04c448c61451d8d46ebc7a61a5e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f8e69fc-62", "ovs_interfaceid": "7f8e69fc-628f-4a31-9ba0-db0b320dff09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:19:18 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-3bfe953c-aad5-4efd-af0d-8b414b7c88bc tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Converting VIF {"id": "7f8e69fc-628f-4a31-9ba0-db0b320dff09", "address": "fa:16:3e:46:f0:15", "network": {"id": "f7871b75-73b3-4f0a-8e6c-814bc61ebd6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-945672014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b04c448c61451d8d46ebc7a61a5e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f8e69fc-62", "ovs_interfaceid": "7f8e69fc-628f-4a31-9ba0-db0b320dff09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:19:18 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-3bfe953c-aad5-4efd-af0d-8b414b7c88bc tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:f0:15,bridge_name='br-int',has_traffic_filtering=True,id=7f8e69fc-628f-4a31-9ba0-db0b320dff09,network=Network(f7871b75-73b3-4f0a-8e6c-814bc61ebd6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f8e69fc-62') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:19:18 user nova-compute[95467]: DEBUG os_vif [None req-3bfe953c-aad5-4efd-af0d-8b414b7c88bc tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:f0:15,bridge_name='br-int',has_traffic_filtering=True,id=7f8e69fc-628f-4a31-9ba0-db0b320dff09,network=Network(f7871b75-73b3-4f0a-8e6c-814bc61ebd6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f8e69fc-62') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:19:18 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:18 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7f8e69fc-62, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:19:18 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:19:18 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:18 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:18 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dc83cd40-aacd-40e3-b96f-7e45382763ea) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:19:18 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:18 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:19:18 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:18 user nova-compute[95467]: DEBUG nova.compute.manager [req-7b5d1fc4-ea74-4e96-9403-62119b8fae67 req-c3991d1b-a8e8-4b4a-acf6-1807cb2cf615 service nova] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Received event network-changed-7f8e69fc-628f-4a31-9ba0-db0b320dff09 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:19:18 user nova-compute[95467]: DEBUG nova.compute.manager [req-7b5d1fc4-ea74-4e96-9403-62119b8fae67 req-c3991d1b-a8e8-4b4a-acf6-1807cb2cf615 service nova] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Refreshing instance network info cache due to event network-changed-7f8e69fc-628f-4a31-9ba0-db0b320dff09. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:19:18 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-7b5d1fc4-ea74-4e96-9403-62119b8fae67 req-c3991d1b-a8e8-4b4a-acf6-1807cb2cf615 service nova] Acquiring lock "refresh_cache-e7805e5c-1777-4b0c-95c7-b232be66528c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:19:18 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-7b5d1fc4-ea74-4e96-9403-62119b8fae67 req-c3991d1b-a8e8-4b4a-acf6-1807cb2cf615 service nova] Acquired lock "refresh_cache-e7805e5c-1777-4b0c-95c7-b232be66528c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:19:18 user nova-compute[95467]: DEBUG nova.network.neutron [req-7b5d1fc4-ea74-4e96-9403-62119b8fae67 req-c3991d1b-a8e8-4b4a-acf6-1807cb2cf615 service nova] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Refreshing network info cache for port 7f8e69fc-628f-4a31-9ba0-db0b320dff09 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:19:18 user nova-compute[95467]: INFO os_vif [None req-3bfe953c-aad5-4efd-af0d-8b414b7c88bc tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:f0:15,bridge_name='br-int',has_traffic_filtering=True,id=7f8e69fc-628f-4a31-9ba0-db0b320dff09,network=Network(f7871b75-73b3-4f0a-8e6c-814bc61ebd6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f8e69fc-62')
Nov 15 08:19:18 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-3bfe953c-aad5-4efd-af0d-8b414b7c88bc tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Deleting instance files /opt/stack/data/nova/instances/e7805e5c-1777-4b0c-95c7-b232be66528c_del
Nov 15 08:19:18 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-3bfe953c-aad5-4efd-af0d-8b414b7c88bc tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Deletion of /opt/stack/data/nova/instances/e7805e5c-1777-4b0c-95c7-b232be66528c_del complete
Nov 15 08:19:18 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-df819aee-555a-476e-8dc8-0f63475a9c87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:19:19 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-df819aee-555a-476e-8dc8-0f63475a9c87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:19:19 user nova-compute[95467]: INFO nova.scheduler.client.report [None req-3bfe953c-aad5-4efd-af0d-8b414b7c88bc tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Deleted allocations for instance e7805e5c-1777-4b0c-95c7-b232be66528c
Nov 15 08:19:19 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-df819aee-555a-476e-8dc8-0f63475a9c87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.510s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:19:19 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3bfe953c-aad5-4efd-af0d-8b414b7c88bc tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:19:19 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3bfe953c-aad5-4efd-af0d-8b414b7c88bc tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:19:19 user nova-compute[95467]: DEBUG nova.objects.instance [None req-3bfe953c-aad5-4efd-af0d-8b414b7c88bc tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lazy-loading 'numa_topology' on Instance uuid e7805e5c-1777-4b0c-95c7-b232be66528c {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:19:19 user nova-compute[95467]: INFO nova.scheduler.client.report [None req-df819aee-555a-476e-8dc8-0f63475a9c87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Deleted allocations for instance 2765af98-917a-4f0f-95af-3393e0d50a52
Nov 15 08:19:19 user nova-compute[95467]: DEBUG nova.objects.base [None req-3bfe953c-aad5-4efd-af0d-8b414b7c88bc tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Object Instance<e7805e5c-1777-4b0c-95c7-b232be66528c> lazy-loaded attributes: resources,numa_topology {{(pid=95467) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 08:19:19 user nova-compute[95467]: DEBUG nova.network.neutron [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] Successfully updated port: e998bcd4-3b5b-4cb1-9b31-7b44f124f51f {{(pid=95467) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 08:19:19 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Acquiring lock "refresh_cache-ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:19:19 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Acquired lock "refresh_cache-ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:19:19 user nova-compute[95467]: DEBUG nova.network.neutron [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:19:19 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-df819aee-555a-476e-8dc8-0f63475a9c87 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "2765af98-917a-4f0f-95af-3393e0d50a52" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.735s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:19:19 user nova-compute[95467]: DEBUG nova.network.neutron [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] Instance cache missing network info. {{(pid=95467) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 08:19:19 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-3bfe953c-aad5-4efd-af0d-8b414b7c88bc tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:19:19 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3bfe953c-aad5-4efd-af0d-8b414b7c88bc tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:19:19 user nova-compute[95467]: DEBUG nova.network.neutron [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] Updating instance_info_cache with network_info: [{"id": "e998bcd4-3b5b-4cb1-9b31-7b44f124f51f", "address": "fa:16:3e:a6:60:b2", "network": {"id": "8220309c-e09f-4c20-8f74-abdf4688fe64", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-160547739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b1fa68347914efe87ae8edd3901e11a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape998bcd4-3b", "ovs_interfaceid": "e998bcd4-3b5b-4cb1-9b31-7b44f124f51f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:19:19 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Releasing lock "refresh_cache-ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:19:19 user nova-compute[95467]: DEBUG nova.compute.manager [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] Instance network_info: |[{"id": "e998bcd4-3b5b-4cb1-9b31-7b44f124f51f", "address": "fa:16:3e:a6:60:b2", "network": {"id": "8220309c-e09f-4c20-8f74-abdf4688fe64", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-160547739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b1fa68347914efe87ae8edd3901e11a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape998bcd4-3b", "ovs_interfaceid": "e998bcd4-3b5b-4cb1-9b31-7b44f124f51f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 08:19:19 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] Start _get_guest_xml network_info=[{"id": "e998bcd4-3b5b-4cb1-9b31-7b44f124f51f", "address": "fa:16:3e:a6:60:b2", "network": {"id": "8220309c-e09f-4c20-8f74-abdf4688fe64", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-160547739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b1fa68347914efe87ae8edd3901e11a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape998bcd4-3b", "ovs_interfaceid": "e998bcd4-3b5b-4cb1-9b31-7b44f124f51f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'ed9c48aa-ce73-4b3b-9db1-235898be671b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:19:19 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3bfe953c-aad5-4efd-af0d-8b414b7c88bc tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.458s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:19:19 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:19:19 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:19:19 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:19:19 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:19:19 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:19:19 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:19:19 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:19:19 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:19:19 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:19:19 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:19:19 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:19:19 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:19:19 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:19:19 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:19:19 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:19:19 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:19:19 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:19:19 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:19:19 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:19:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-9504693',display_name='tempest-VolumesSnapshotTestJSON-instance-9504693',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-9504693',id=31,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE3U8SysIZB5CghQ0nTVG7TnMbRSpJwwUZ7XeChV+5Q8vhF8isngbOAHIETwQqC01asp6Fsz/SmPvfmCoBDLhtXpUeP+9o5shnpMf18bO7hmEleO3iLjUUqI86IkZswW/w==',key_name='tempest-keypair-1199575254',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b1fa68347914efe87ae8edd3901e11a',ramdisk_id='',reservation_id='r-0kk1yzjs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-151902651',owner_user_name='tempest-VolumesSnapshotTestJSON-151902651-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:19:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='993622d17e1848a0980fd759e248edda',uuid=ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e998bcd4-3b5b-4cb1-9b31-7b44f124f51f", "address": "fa:16:3e:a6:60:b2", "network": {"id": "8220309c-e09f-4c20-8f74-abdf4688fe64", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-160547739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b1fa68347914efe87ae8edd3901e11a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape998bcd4-3b", "ovs_interfaceid": "e998bcd4-3b5b-4cb1-9b31-7b44f124f51f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:19:19 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Converting VIF {"id": "e998bcd4-3b5b-4cb1-9b31-7b44f124f51f", "address": "fa:16:3e:a6:60:b2", "network": {"id": "8220309c-e09f-4c20-8f74-abdf4688fe64", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-160547739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b1fa68347914efe87ae8edd3901e11a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape998bcd4-3b", "ovs_interfaceid": "e998bcd4-3b5b-4cb1-9b31-7b44f124f51f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:19:19 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:60:b2,bridge_name='br-int',has_traffic_filtering=True,id=e998bcd4-3b5b-4cb1-9b31-7b44f124f51f,network=Network(8220309c-e09f-4c20-8f74-abdf4688fe64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape998bcd4-3b') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:19:19 user nova-compute[95467]: DEBUG nova.objects.instance [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lazy-loading 'pci_devices' on Instance uuid ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:19:19 user nova-compute[95467]: DEBUG nova.network.neutron [req-7b5d1fc4-ea74-4e96-9403-62119b8fae67 req-c3991d1b-a8e8-4b4a-acf6-1807cb2cf615 service nova] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Updated VIF entry in instance network info cache for port 7f8e69fc-628f-4a31-9ba0-db0b320dff09. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:19:19 user nova-compute[95467]: DEBUG nova.network.neutron [req-7b5d1fc4-ea74-4e96-9403-62119b8fae67 req-c3991d1b-a8e8-4b4a-acf6-1807cb2cf615 service nova] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Updating instance_info_cache with network_info: [{"id": "7f8e69fc-628f-4a31-9ba0-db0b320dff09", "address": "fa:16:3e:46:f0:15", "network": {"id": "f7871b75-73b3-4f0a-8e6c-814bc61ebd6d", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-945672014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b04c448c61451d8d46ebc7a61a5e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap7f8e69fc-62", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:19:19 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:19:19 user nova-compute[95467]:   <uuid>ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a</uuid>
Nov 15 08:19:19 user nova-compute[95467]:   <name>instance-0000001f</name>
Nov 15 08:19:19 user nova-compute[95467]:   <memory>524288</memory>
Nov 15 08:19:19 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:19:19 user nova-compute[95467]:   <metadata>
Nov 15 08:19:19 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:19:19 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:19:19 user nova-compute[95467]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-9504693</nova:name>
Nov 15 08:19:19 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:19:19</nova:creationTime>
Nov 15 08:19:19 user nova-compute[95467]:       <nova:flavor name="m1.tiny">
Nov 15 08:19:19 user nova-compute[95467]:         <nova:memory>512</nova:memory>
Nov 15 08:19:19 user nova-compute[95467]:         <nova:disk>1</nova:disk>
Nov 15 08:19:19 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:19:19 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:19:19 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:19:19 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:19:19 user nova-compute[95467]:       <nova:owner>
Nov 15 08:19:19 user nova-compute[95467]:         <nova:user uuid="993622d17e1848a0980fd759e248edda">tempest-VolumesSnapshotTestJSON-151902651-project-member</nova:user>
Nov 15 08:19:19 user nova-compute[95467]:         <nova:project uuid="0b1fa68347914efe87ae8edd3901e11a">tempest-VolumesSnapshotTestJSON-151902651</nova:project>
Nov 15 08:19:19 user nova-compute[95467]:       </nova:owner>
Nov 15 08:19:19 user nova-compute[95467]:       <nova:root type="image" uuid="ed9c48aa-ce73-4b3b-9db1-235898be671b"/>
Nov 15 08:19:19 user nova-compute[95467]:       <nova:ports>
Nov 15 08:19:19 user nova-compute[95467]:         <nova:port uuid="e998bcd4-3b5b-4cb1-9b31-7b44f124f51f">
Nov 15 08:19:19 user nova-compute[95467]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 08:19:19 user nova-compute[95467]:         </nova:port>
Nov 15 08:19:19 user nova-compute[95467]:       </nova:ports>
Nov 15 08:19:19 user nova-compute[95467]:     </nova:instance>
Nov 15 08:19:19 user nova-compute[95467]:   </metadata>
Nov 15 08:19:19 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:19:19 user nova-compute[95467]:     <system>
Nov 15 08:19:19 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:19:19 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:19:19 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:19:19 user nova-compute[95467]:       <entry name="serial">ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a</entry>
Nov 15 08:19:19 user nova-compute[95467]:       <entry name="uuid">ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a</entry>
Nov 15 08:19:19 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:19:19 user nova-compute[95467]:     </system>
Nov 15 08:19:19 user nova-compute[95467]:   </sysinfo>
Nov 15 08:19:19 user nova-compute[95467]:   <os>
Nov 15 08:19:19 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:19:19 user nova-compute[95467]:     <boot dev="hd"/>
Nov 15 08:19:19 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:19:19 user nova-compute[95467]:   </os>
Nov 15 08:19:19 user nova-compute[95467]:   <features>
Nov 15 08:19:19 user nova-compute[95467]:     <acpi/>
Nov 15 08:19:19 user nova-compute[95467]:     <apic/>
Nov 15 08:19:19 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:19:19 user nova-compute[95467]:   </features>
Nov 15 08:19:19 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:19:19 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:19:19 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:19:19 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:19:19 user nova-compute[95467]:   </clock>
Nov 15 08:19:19 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:19:19 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:19:19 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:19:19 user nova-compute[95467]:   </cpu>
Nov 15 08:19:19 user nova-compute[95467]:   <devices>
Nov 15 08:19:19 user nova-compute[95467]:     <disk type="file" device="disk">
Nov 15 08:19:19 user nova-compute[95467]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 08:19:19 user nova-compute[95467]:       <source file="/opt/stack/data/nova/instances/ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a/disk"/>
Nov 15 08:19:19 user nova-compute[95467]:       <target dev="vda" bus="virtio"/>
Nov 15 08:19:19 user nova-compute[95467]:     </disk>
Nov 15 08:19:19 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:19:19 user nova-compute[95467]:       <mac address="fa:16:3e:a6:60:b2"/>
Nov 15 08:19:19 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:19:19 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:19:19 user nova-compute[95467]:       <target dev="tape998bcd4-3b"/>
Nov 15 08:19:19 user nova-compute[95467]:     </interface>
Nov 15 08:19:19 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:19:19 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a/console.log" append="off"/>
Nov 15 08:19:19 user nova-compute[95467]:     </serial>
Nov 15 08:19:19 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:19:19 user nova-compute[95467]:     <video>
Nov 15 08:19:19 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:19:19 user nova-compute[95467]:     </video>
Nov 15 08:19:19 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:19:19 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:19:19 user nova-compute[95467]:     </rng>
Nov 15 08:19:19 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:19:19 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:19:19 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:19:19 user nova-compute[95467]:     </memballoon>
Nov 15 08:19:19 user nova-compute[95467]:   </devices>
Nov 15 08:19:19 user nova-compute[95467]: </domain>
Nov 15 08:19:19 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:19:19 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:19:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-9504693',display_name='tempest-VolumesSnapshotTestJSON-instance-9504693',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-9504693',id=31,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE3U8SysIZB5CghQ0nTVG7TnMbRSpJwwUZ7XeChV+5Q8vhF8isngbOAHIETwQqC01asp6Fsz/SmPvfmCoBDLhtXpUeP+9o5shnpMf18bO7hmEleO3iLjUUqI86IkZswW/w==',key_name='tempest-keypair-1199575254',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b1fa68347914efe87ae8edd3901e11a',ramdisk_id='',reservation_id='r-0kk1yzjs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-151902651',owner_user_name='tempest-VolumesSnapshotTestJSON-151902651-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:19:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='993622d17e1848a0980fd759e248edda',uuid=ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e998bcd4-3b5b-4cb1-9b31-7b44f124f51f", "address": "fa:16:3e:a6:60:b2", "network": {"id": "8220309c-e09f-4c20-8f74-abdf4688fe64", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-160547739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b1fa68347914efe87ae8edd3901e11a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape998bcd4-3b", "ovs_interfaceid": "e998bcd4-3b5b-4cb1-9b31-7b44f124f51f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:19:19 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Converting VIF {"id": "e998bcd4-3b5b-4cb1-9b31-7b44f124f51f", "address": "fa:16:3e:a6:60:b2", "network": {"id": "8220309c-e09f-4c20-8f74-abdf4688fe64", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-160547739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b1fa68347914efe87ae8edd3901e11a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape998bcd4-3b", "ovs_interfaceid": "e998bcd4-3b5b-4cb1-9b31-7b44f124f51f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:19:19 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:60:b2,bridge_name='br-int',has_traffic_filtering=True,id=e998bcd4-3b5b-4cb1-9b31-7b44f124f51f,network=Network(8220309c-e09f-4c20-8f74-abdf4688fe64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape998bcd4-3b') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:19:19 user nova-compute[95467]: DEBUG os_vif [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:60:b2,bridge_name='br-int',has_traffic_filtering=True,id=e998bcd4-3b5b-4cb1-9b31-7b44f124f51f,network=Network(8220309c-e09f-4c20-8f74-abdf4688fe64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape998bcd4-3b') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:19:19 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:19 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:19:19 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:19:19 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-7b5d1fc4-ea74-4e96-9403-62119b8fae67 req-c3991d1b-a8e8-4b4a-acf6-1807cb2cf615 service nova] Releasing lock "refresh_cache-e7805e5c-1777-4b0c-95c7-b232be66528c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:19:19 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:19 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5c14877c-a19b-503d-a562-9079f415a23e', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:19:19 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3bfe953c-aad5-4efd-af0d-8b414b7c88bc tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "e7805e5c-1777-4b0c-95c7-b232be66528c" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.647s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:19:19 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:19 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:19:19 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:19 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape998bcd4-3b, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:19:19 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape998bcd4-3b, col_values=(('qos', UUID('af851bb6-604b-4af5-aa77-2c15f9074106')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:19:19 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape998bcd4-3b, col_values=(('external_ids', {'iface-id': 'e998bcd4-3b5b-4cb1-9b31-7b44f124f51f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:60:b2', 'vm-uuid': 'ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:19:19 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:19 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:19:19 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:19 user nova-compute[95467]: INFO os_vif [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:60:b2,bridge_name='br-int',has_traffic_filtering=True,id=e998bcd4-3b5b-4cb1-9b31-7b44f124f51f,network=Network(8220309c-e09f-4c20-8f74-abdf4688fe64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape998bcd4-3b')
Nov 15 08:19:19 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:19:19 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] No VIF found with MAC fa:16:3e:a6:60:b2, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:19:20 user nova-compute[95467]: DEBUG nova.compute.manager [req-bba8bfa1-1997-4d0d-9b77-97befd914515 req-d0b4081d-a16c-4bbd-adc9-2fe0bf5e6f89 service nova] [instance: 2765af98-917a-4f0f-95af-3393e0d50a52] Received event network-vif-deleted-1033bb03-0ef8-48ae-9006-240ec7ab4d63 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:19:20 user nova-compute[95467]: DEBUG nova.compute.manager [req-bba8bfa1-1997-4d0d-9b77-97befd914515 req-d0b4081d-a16c-4bbd-adc9-2fe0bf5e6f89 service nova] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] Received event network-changed-e998bcd4-3b5b-4cb1-9b31-7b44f124f51f {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:19:20 user nova-compute[95467]: DEBUG nova.compute.manager [req-bba8bfa1-1997-4d0d-9b77-97befd914515 req-d0b4081d-a16c-4bbd-adc9-2fe0bf5e6f89 service nova] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] Refreshing instance network info cache due to event network-changed-e998bcd4-3b5b-4cb1-9b31-7b44f124f51f. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:19:20 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-bba8bfa1-1997-4d0d-9b77-97befd914515 req-d0b4081d-a16c-4bbd-adc9-2fe0bf5e6f89 service nova] Acquiring lock "refresh_cache-ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:19:20 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-bba8bfa1-1997-4d0d-9b77-97befd914515 req-d0b4081d-a16c-4bbd-adc9-2fe0bf5e6f89 service nova] Acquired lock "refresh_cache-ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:19:20 user nova-compute[95467]: DEBUG nova.network.neutron [req-bba8bfa1-1997-4d0d-9b77-97befd914515 req-d0b4081d-a16c-4bbd-adc9-2fe0bf5e6f89 service nova] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] Refreshing network info cache for port e998bcd4-3b5b-4cb1-9b31-7b44f124f51f {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:19:20 user nova-compute[95467]: DEBUG nova.network.neutron [req-bba8bfa1-1997-4d0d-9b77-97befd914515 req-d0b4081d-a16c-4bbd-adc9-2fe0bf5e6f89 service nova] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] Updated VIF entry in instance network info cache for port e998bcd4-3b5b-4cb1-9b31-7b44f124f51f. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:19:20 user nova-compute[95467]: DEBUG nova.network.neutron [req-bba8bfa1-1997-4d0d-9b77-97befd914515 req-d0b4081d-a16c-4bbd-adc9-2fe0bf5e6f89 service nova] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] Updating instance_info_cache with network_info: [{"id": "e998bcd4-3b5b-4cb1-9b31-7b44f124f51f", "address": "fa:16:3e:a6:60:b2", "network": {"id": "8220309c-e09f-4c20-8f74-abdf4688fe64", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-160547739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b1fa68347914efe87ae8edd3901e11a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape998bcd4-3b", "ovs_interfaceid": "e998bcd4-3b5b-4cb1-9b31-7b44f124f51f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:19:20 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-bba8bfa1-1997-4d0d-9b77-97befd914515 req-d0b4081d-a16c-4bbd-adc9-2fe0bf5e6f89 service nova] Releasing lock "refresh_cache-ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:19:20 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:21 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:21 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:21 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:21 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:21 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:21 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:22 user nova-compute[95467]: DEBUG nova.compute.manager [req-f197f875-a758-465c-a39a-8e0451533f74 req-a93e6d12-b203-45de-8b92-1cfde00b1378 service nova] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] Received event network-vif-plugged-e998bcd4-3b5b-4cb1-9b31-7b44f124f51f {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:19:22 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-f197f875-a758-465c-a39a-8e0451533f74 req-a93e6d12-b203-45de-8b92-1cfde00b1378 service nova] Acquiring lock "ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:19:22 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-f197f875-a758-465c-a39a-8e0451533f74 req-a93e6d12-b203-45de-8b92-1cfde00b1378 service nova] Lock "ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:19:22 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-f197f875-a758-465c-a39a-8e0451533f74 req-a93e6d12-b203-45de-8b92-1cfde00b1378 service nova] Lock "ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:19:22 user nova-compute[95467]: DEBUG nova.compute.manager [req-f197f875-a758-465c-a39a-8e0451533f74 req-a93e6d12-b203-45de-8b92-1cfde00b1378 service nova] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] No waiting events found dispatching network-vif-plugged-e998bcd4-3b5b-4cb1-9b31-7b44f124f51f {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:19:22 user nova-compute[95467]: WARNING nova.compute.manager [req-f197f875-a758-465c-a39a-8e0451533f74 req-a93e6d12-b203-45de-8b92-1cfde00b1378 service nova] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] Received unexpected event network-vif-plugged-e998bcd4-3b5b-4cb1-9b31-7b44f124f51f for instance with vm_state building and task_state spawning.
Nov 15 08:19:22 user nova-compute[95467]: DEBUG nova.compute.manager [req-f197f875-a758-465c-a39a-8e0451533f74 req-a93e6d12-b203-45de-8b92-1cfde00b1378 service nova] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] Received event network-vif-plugged-e998bcd4-3b5b-4cb1-9b31-7b44f124f51f {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:19:22 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-f197f875-a758-465c-a39a-8e0451533f74 req-a93e6d12-b203-45de-8b92-1cfde00b1378 service nova] Acquiring lock "ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:19:22 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-f197f875-a758-465c-a39a-8e0451533f74 req-a93e6d12-b203-45de-8b92-1cfde00b1378 service nova] Lock "ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:19:22 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-f197f875-a758-465c-a39a-8e0451533f74 req-a93e6d12-b203-45de-8b92-1cfde00b1378 service nova] Lock "ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:19:22 user nova-compute[95467]: DEBUG nova.compute.manager [req-f197f875-a758-465c-a39a-8e0451533f74 req-a93e6d12-b203-45de-8b92-1cfde00b1378 service nova] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] No waiting events found dispatching network-vif-plugged-e998bcd4-3b5b-4cb1-9b31-7b44f124f51f {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:19:22 user nova-compute[95467]: WARNING nova.compute.manager [req-f197f875-a758-465c-a39a-8e0451533f74 req-a93e6d12-b203-45de-8b92-1cfde00b1378 service nova] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] Received unexpected event network-vif-plugged-e998bcd4-3b5b-4cb1-9b31-7b44f124f51f for instance with vm_state building and task_state spawning.
Nov 15 08:19:22 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-9210ac02-33d9-4835-a031-3704d0c63da0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Acquiring lock "3711c883-ec5f-4a09-88f8-d4c0668ae570" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:19:22 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-9210ac02-33d9-4835-a031-3704d0c63da0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "3711c883-ec5f-4a09-88f8-d4c0668ae570" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:19:22 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-9210ac02-33d9-4835-a031-3704d0c63da0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Acquiring lock "3711c883-ec5f-4a09-88f8-d4c0668ae570-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:19:22 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-9210ac02-33d9-4835-a031-3704d0c63da0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "3711c883-ec5f-4a09-88f8-d4c0668ae570-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:19:22 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-9210ac02-33d9-4835-a031-3704d0c63da0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "3711c883-ec5f-4a09-88f8-d4c0668ae570-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.003s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:19:22 user nova-compute[95467]: INFO nova.compute.manager [None req-9210ac02-33d9-4835-a031-3704d0c63da0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Terminating instance
Nov 15 08:19:22 user nova-compute[95467]: DEBUG nova.compute.manager [None req-9210ac02-33d9-4835-a031-3704d0c63da0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Start destroying the instance on the hypervisor. {{(pid=95467) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 08:19:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:22 user nova-compute[95467]: DEBUG nova.compute.manager [req-ac6dfa59-9762-4498-b014-59136addc90b req-0b081c07-b506-4118-a8ac-9c2c3eb45a6b service nova] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Received event network-vif-unplugged-a30d1fd9-58f1-4efc-8331-ddcaa241fd9b {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:19:22 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ac6dfa59-9762-4498-b014-59136addc90b req-0b081c07-b506-4118-a8ac-9c2c3eb45a6b service nova] Acquiring lock "3711c883-ec5f-4a09-88f8-d4c0668ae570-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:19:22 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ac6dfa59-9762-4498-b014-59136addc90b req-0b081c07-b506-4118-a8ac-9c2c3eb45a6b service nova] Lock "3711c883-ec5f-4a09-88f8-d4c0668ae570-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:19:22 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ac6dfa59-9762-4498-b014-59136addc90b req-0b081c07-b506-4118-a8ac-9c2c3eb45a6b service nova] Lock "3711c883-ec5f-4a09-88f8-d4c0668ae570-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:19:22 user nova-compute[95467]: DEBUG nova.compute.manager [req-ac6dfa59-9762-4498-b014-59136addc90b req-0b081c07-b506-4118-a8ac-9c2c3eb45a6b service nova] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] No waiting events found dispatching network-vif-unplugged-a30d1fd9-58f1-4efc-8331-ddcaa241fd9b {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:19:22 user nova-compute[95467]: DEBUG nova.compute.manager [req-ac6dfa59-9762-4498-b014-59136addc90b req-0b081c07-b506-4118-a8ac-9c2c3eb45a6b service nova] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Received event network-vif-unplugged-a30d1fd9-58f1-4efc-8331-ddcaa241fd9b for instance with task_state deleting. {{(pid=95467) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 08:19:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:22 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Instance destroyed successfully.
Nov 15 08:19:22 user nova-compute[95467]: DEBUG nova.objects.instance [None req-9210ac02-33d9-4835-a031-3704d0c63da0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lazy-loading 'resources' on Instance uuid 3711c883-ec5f-4a09-88f8-d4c0668ae570 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:19:22 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-9210ac02-33d9-4835-a031-3704d0c63da0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T08:13:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-687199955',display_name='tempest-ServerActionsTestOtherA-server-94598860',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-687199955',id=17,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCNocaX54qCPZAA9ULAdwlEWPInJDPNBSZ9W8AQmBrWmivIiKz/S0iGFfDxJElLCR+9ambdrPTd00JJrCoxQkWwaJ0sGcUaHDPo10f7hFEQSvZGXEdlnJ7SNY9krWZQ+oQ==',key_name='tempest-keypair-1527809969',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:15:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0a1aa4f562c64545a94157d4aaf8d14e',ramdisk_id='',reservation_id='r-nbpm0erc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-937420730',owner_user_name='tempest-ServerActionsTestOtherA-937420730-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:15:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d9b34339b404facac21f500f40b1686',uuid=3711c883-ec5f-4a09-88f8-d4c0668ae570,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a30d1fd9-58f1-4efc-8331-ddcaa241fd9b", "address": "fa:16:3e:bf:61:9e", "network": {"id": "d8a362dc-0dc8-49dd-b2da-0e0749d5edca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-256373617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a1aa4f562c64545a94157d4aaf8d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa30d1fd9-58", "ovs_interfaceid": "a30d1fd9-58f1-4efc-8331-ddcaa241fd9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:19:22 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-9210ac02-33d9-4835-a031-3704d0c63da0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Converting VIF {"id": "a30d1fd9-58f1-4efc-8331-ddcaa241fd9b", "address": "fa:16:3e:bf:61:9e", "network": {"id": "d8a362dc-0dc8-49dd-b2da-0e0749d5edca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-256373617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a1aa4f562c64545a94157d4aaf8d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa30d1fd9-58", "ovs_interfaceid": "a30d1fd9-58f1-4efc-8331-ddcaa241fd9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:19:22 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-9210ac02-33d9-4835-a031-3704d0c63da0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bf:61:9e,bridge_name='br-int',has_traffic_filtering=True,id=a30d1fd9-58f1-4efc-8331-ddcaa241fd9b,network=Network(d8a362dc-0dc8-49dd-b2da-0e0749d5edca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa30d1fd9-58') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:19:22 user nova-compute[95467]: DEBUG os_vif [None req-9210ac02-33d9-4835-a031-3704d0c63da0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:61:9e,bridge_name='br-int',has_traffic_filtering=True,id=a30d1fd9-58f1-4efc-8331-ddcaa241fd9b,network=Network(d8a362dc-0dc8-49dd-b2da-0e0749d5edca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa30d1fd9-58') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:19:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa30d1fd9-58, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:19:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:19:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6d718cb8-552b-4486-80e1-eea9953de1fa) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:19:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:19:22 user nova-compute[95467]: INFO os_vif [None req-9210ac02-33d9-4835-a031-3704d0c63da0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:61:9e,bridge_name='br-int',has_traffic_filtering=True,id=a30d1fd9-58f1-4efc-8331-ddcaa241fd9b,network=Network(d8a362dc-0dc8-49dd-b2da-0e0749d5edca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa30d1fd9-58')
Nov 15 08:19:22 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-9210ac02-33d9-4835-a031-3704d0c63da0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Deleting instance files /opt/stack/data/nova/instances/3711c883-ec5f-4a09-88f8-d4c0668ae570_del
Nov 15 08:19:22 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-9210ac02-33d9-4835-a031-3704d0c63da0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Deletion of /opt/stack/data/nova/instances/3711c883-ec5f-4a09-88f8-d4c0668ae570_del complete
Nov 15 08:19:23 user nova-compute[95467]: INFO nova.compute.manager [None req-9210ac02-33d9-4835-a031-3704d0c63da0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 15 08:19:23 user nova-compute[95467]: DEBUG oslo.service.loopingcall [None req-9210ac02-33d9-4835-a031-3704d0c63da0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=95467) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 08:19:23 user nova-compute[95467]: DEBUG nova.compute.manager [-] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Deallocating network for instance {{(pid=95467) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 08:19:23 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] deallocate_for_instance() {{(pid=95467) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 08:19:23 user nova-compute[95467]: DEBUG nova.compute.manager [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] Instance event wait completed in 0 seconds for  {{(pid=95467) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 08:19:23 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] Guest created on hypervisor {{(pid=95467) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 08:19:23 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] Instance spawned successfully.
Nov 15 08:19:23 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 08:19:23 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] Found default for hw_cdrom_bus of ide {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:19:23 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] Found default for hw_disk_bus of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:19:23 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] Found default for hw_input_bus of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:19:23 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] Found default for hw_pointer_model of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:19:23 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] Found default for hw_video_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:19:23 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] Found default for hw_vif_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:19:23 user nova-compute[95467]: INFO nova.compute.manager [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] Took 6.90 seconds to spawn the instance on the hypervisor.
Nov 15 08:19:23 user nova-compute[95467]: DEBUG nova.compute.manager [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:19:23 user nova-compute[95467]: INFO nova.compute.manager [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] Took 8.11 seconds to build instance.
Nov 15 08:19:23 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a69fc1df-64a7-4cfa-98b4-2d127b333473 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lock "ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.256s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:19:23 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:19:23 user nova-compute[95467]: INFO nova.compute.manager [-] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Took 0.87 seconds to deallocate network for instance.
Nov 15 08:19:23 user nova-compute[95467]: DEBUG nova.compute.manager [req-eb5be426-93ac-4336-a64a-49aa6b983394 req-b68be0f5-99ae-40b7-b175-638d405e346b service nova] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Received event network-vif-deleted-a30d1fd9-58f1-4efc-8331-ddcaa241fd9b {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:19:23 user nova-compute[95467]: INFO nova.compute.manager [req-eb5be426-93ac-4336-a64a-49aa6b983394 req-b68be0f5-99ae-40b7-b175-638d405e346b service nova] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Neutron deleted interface a30d1fd9-58f1-4efc-8331-ddcaa241fd9b; detaching it from the instance and deleting it from the info cache
Nov 15 08:19:23 user nova-compute[95467]: DEBUG nova.network.neutron [req-eb5be426-93ac-4336-a64a-49aa6b983394 req-b68be0f5-99ae-40b7-b175-638d405e346b service nova] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:19:23 user nova-compute[95467]: DEBUG nova.compute.manager [req-eb5be426-93ac-4336-a64a-49aa6b983394 req-b68be0f5-99ae-40b7-b175-638d405e346b service nova] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Detach interface failed, port_id=a30d1fd9-58f1-4efc-8331-ddcaa241fd9b, reason: Instance 3711c883-ec5f-4a09-88f8-d4c0668ae570 could not be found. {{(pid=95467) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 08:19:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-9210ac02-33d9-4835-a031-3704d0c63da0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:19:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-9210ac02-33d9-4835-a031-3704d0c63da0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:19:24 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-9210ac02-33d9-4835-a031-3704d0c63da0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:19:24 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-9210ac02-33d9-4835-a031-3704d0c63da0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:19:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-9210ac02-33d9-4835-a031-3704d0c63da0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.497s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:19:24 user nova-compute[95467]: INFO nova.scheduler.client.report [None req-9210ac02-33d9-4835-a031-3704d0c63da0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Deleted allocations for instance 3711c883-ec5f-4a09-88f8-d4c0668ae570
Nov 15 08:19:24 user nova-compute[95467]: DEBUG nova.compute.manager [req-eee8cb0c-dd05-4650-bbd0-8268b8ad25b9 req-2f682a33-57dc-4b66-b021-28c3f5583013 service nova] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Received event network-vif-plugged-a30d1fd9-58f1-4efc-8331-ddcaa241fd9b {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:19:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-eee8cb0c-dd05-4650-bbd0-8268b8ad25b9 req-2f682a33-57dc-4b66-b021-28c3f5583013 service nova] Acquiring lock "3711c883-ec5f-4a09-88f8-d4c0668ae570-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:19:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-eee8cb0c-dd05-4650-bbd0-8268b8ad25b9 req-2f682a33-57dc-4b66-b021-28c3f5583013 service nova] Lock "3711c883-ec5f-4a09-88f8-d4c0668ae570-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:19:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-eee8cb0c-dd05-4650-bbd0-8268b8ad25b9 req-2f682a33-57dc-4b66-b021-28c3f5583013 service nova] Lock "3711c883-ec5f-4a09-88f8-d4c0668ae570-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:19:24 user nova-compute[95467]: DEBUG nova.compute.manager [req-eee8cb0c-dd05-4650-bbd0-8268b8ad25b9 req-2f682a33-57dc-4b66-b021-28c3f5583013 service nova] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] No waiting events found dispatching network-vif-plugged-a30d1fd9-58f1-4efc-8331-ddcaa241fd9b {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:19:24 user nova-compute[95467]: WARNING nova.compute.manager [req-eee8cb0c-dd05-4650-bbd0-8268b8ad25b9 req-2f682a33-57dc-4b66-b021-28c3f5583013 service nova] [instance: 3711c883-ec5f-4a09-88f8-d4c0668ae570] Received unexpected event network-vif-plugged-a30d1fd9-58f1-4efc-8331-ddcaa241fd9b for instance with vm_state deleted and task_state None.
Nov 15 08:19:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-9210ac02-33d9-4835-a031-3704d0c63da0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "3711c883-ec5f-4a09-88f8-d4c0668ae570" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.521s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:19:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:28 user nova-compute[95467]: INFO nova.compute.manager [None req-27bbbae0-4c92-4ee4-b9ba-41644eb939fd tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Unrescuing
Nov 15 08:19:28 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-27bbbae0-4c92-4ee4-b9ba-41644eb939fd tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Acquiring lock "refresh_cache-bee31898-4f12-4c68-a18b-a678f9f584aa" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:19:28 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-27bbbae0-4c92-4ee4-b9ba-41644eb939fd tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Acquired lock "refresh_cache-bee31898-4f12-4c68-a18b-a678f9f584aa" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:19:28 user nova-compute[95467]: DEBUG nova.network.neutron [None req-27bbbae0-4c92-4ee4-b9ba-41644eb939fd tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:19:29 user nova-compute[95467]: DEBUG nova.network.neutron [None req-27bbbae0-4c92-4ee4-b9ba-41644eb939fd tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Updating instance_info_cache with network_info: [{"id": "eea925f5-c956-40d3-99a5-b45573318378", "address": "fa:16:3e:b4:e9:ab", "network": {"id": "dcbc2304-8d20-4589-b81e-a75a22ef7114", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-333949369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6f7599b8526444a8276cac35f0a1500", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeea925f5-c9", "ovs_interfaceid": "eea925f5-c956-40d3-99a5-b45573318378", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:19:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-27bbbae0-4c92-4ee4-b9ba-41644eb939fd tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Releasing lock "refresh_cache-bee31898-4f12-4c68-a18b-a678f9f584aa" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:19:29 user nova-compute[95467]: DEBUG nova.objects.instance [None req-27bbbae0-4c92-4ee4-b9ba-41644eb939fd tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Lazy-loading 'flavor' on Instance uuid bee31898-4f12-4c68-a18b-a678f9f584aa {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:19:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:29 user nova-compute[95467]: DEBUG nova.compute.manager [req-ba3a54b2-c44e-46ba-a564-54694d2f7d86 req-eca23d34-9d45-4878-8ff4-27e6c0fafad8 service nova] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Received event network-vif-unplugged-eea925f5-c956-40d3-99a5-b45573318378 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:19:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ba3a54b2-c44e-46ba-a564-54694d2f7d86 req-eca23d34-9d45-4878-8ff4-27e6c0fafad8 service nova] Acquiring lock "bee31898-4f12-4c68-a18b-a678f9f584aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:19:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ba3a54b2-c44e-46ba-a564-54694d2f7d86 req-eca23d34-9d45-4878-8ff4-27e6c0fafad8 service nova] Lock "bee31898-4f12-4c68-a18b-a678f9f584aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:19:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ba3a54b2-c44e-46ba-a564-54694d2f7d86 req-eca23d34-9d45-4878-8ff4-27e6c0fafad8 service nova] Lock "bee31898-4f12-4c68-a18b-a678f9f584aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:19:29 user nova-compute[95467]: DEBUG nova.compute.manager [req-ba3a54b2-c44e-46ba-a564-54694d2f7d86 req-eca23d34-9d45-4878-8ff4-27e6c0fafad8 service nova] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] No waiting events found dispatching network-vif-unplugged-eea925f5-c956-40d3-99a5-b45573318378 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:19:29 user nova-compute[95467]: WARNING nova.compute.manager [req-ba3a54b2-c44e-46ba-a564-54694d2f7d86 req-eca23d34-9d45-4878-8ff4-27e6c0fafad8 service nova] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Received unexpected event network-vif-unplugged-eea925f5-c956-40d3-99a5-b45573318378 for instance with vm_state rescued and task_state unrescuing.
Nov 15 08:19:30 user nova-compute[95467]: DEBUG nova.compute.manager [req-e694c61a-f4c6-4a7a-a6f6-05357a5dd5da req-40ce619d-e328-4502-acd1-3ac4cf4d0892 service nova] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Received event network-changed-eea925f5-c956-40d3-99a5-b45573318378 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:19:30 user nova-compute[95467]: DEBUG nova.compute.manager [req-e694c61a-f4c6-4a7a-a6f6-05357a5dd5da req-40ce619d-e328-4502-acd1-3ac4cf4d0892 service nova] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Refreshing instance network info cache due to event network-changed-eea925f5-c956-40d3-99a5-b45573318378. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:19:30 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-e694c61a-f4c6-4a7a-a6f6-05357a5dd5da req-40ce619d-e328-4502-acd1-3ac4cf4d0892 service nova] Acquiring lock "refresh_cache-bee31898-4f12-4c68-a18b-a678f9f584aa" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:19:30 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-e694c61a-f4c6-4a7a-a6f6-05357a5dd5da req-40ce619d-e328-4502-acd1-3ac4cf4d0892 service nova] Acquired lock "refresh_cache-bee31898-4f12-4c68-a18b-a678f9f584aa" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:19:30 user nova-compute[95467]: DEBUG nova.network.neutron [req-e694c61a-f4c6-4a7a-a6f6-05357a5dd5da req-40ce619d-e328-4502-acd1-3ac4cf4d0892 service nova] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Refreshing network info cache for port eea925f5-c956-40d3-99a5-b45573318378 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:19:30 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Instance destroyed successfully.
Nov 15 08:19:30 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:30 user nova-compute[95467]: DEBUG nova.network.neutron [req-e694c61a-f4c6-4a7a-a6f6-05357a5dd5da req-40ce619d-e328-4502-acd1-3ac4cf4d0892 service nova] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Updated VIF entry in instance network info cache for port eea925f5-c956-40d3-99a5-b45573318378. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:19:30 user nova-compute[95467]: DEBUG nova.network.neutron [req-e694c61a-f4c6-4a7a-a6f6-05357a5dd5da req-40ce619d-e328-4502-acd1-3ac4cf4d0892 service nova] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Updating instance_info_cache with network_info: [{"id": "eea925f5-c956-40d3-99a5-b45573318378", "address": "fa:16:3e:b4:e9:ab", "network": {"id": "dcbc2304-8d20-4589-b81e-a75a22ef7114", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-333949369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6f7599b8526444a8276cac35f0a1500", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeea925f5-c9", "ovs_interfaceid": "eea925f5-c956-40d3-99a5-b45573318378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:19:30 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-e694c61a-f4c6-4a7a-a6f6-05357a5dd5da req-40ce619d-e328-4502-acd1-3ac4cf4d0892 service nova] Releasing lock "refresh_cache-bee31898-4f12-4c68-a18b-a678f9f584aa" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:19:31 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:31 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:31 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:31 user nova-compute[95467]: DEBUG nova.compute.manager [req-727c3fc3-ca04-4d30-9be2-859fcdc4ee1b req-929ec22f-2e10-4bcf-b58c-a1e1ab211eea service nova] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Received event network-vif-plugged-eea925f5-c956-40d3-99a5-b45573318378 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:19:31 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-727c3fc3-ca04-4d30-9be2-859fcdc4ee1b req-929ec22f-2e10-4bcf-b58c-a1e1ab211eea service nova] Acquiring lock "bee31898-4f12-4c68-a18b-a678f9f584aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:19:31 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-727c3fc3-ca04-4d30-9be2-859fcdc4ee1b req-929ec22f-2e10-4bcf-b58c-a1e1ab211eea service nova] Lock "bee31898-4f12-4c68-a18b-a678f9f584aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:19:31 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-727c3fc3-ca04-4d30-9be2-859fcdc4ee1b req-929ec22f-2e10-4bcf-b58c-a1e1ab211eea service nova] Lock "bee31898-4f12-4c68-a18b-a678f9f584aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:19:31 user nova-compute[95467]: DEBUG nova.compute.manager [req-727c3fc3-ca04-4d30-9be2-859fcdc4ee1b req-929ec22f-2e10-4bcf-b58c-a1e1ab211eea service nova] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] No waiting events found dispatching network-vif-plugged-eea925f5-c956-40d3-99a5-b45573318378 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:19:31 user nova-compute[95467]: WARNING nova.compute.manager [req-727c3fc3-ca04-4d30-9be2-859fcdc4ee1b req-929ec22f-2e10-4bcf-b58c-a1e1ab211eea service nova] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Received unexpected event network-vif-plugged-eea925f5-c956-40d3-99a5-b45573318378 for instance with vm_state rescued and task_state unrescuing.
Nov 15 08:19:32 user nova-compute[95467]: DEBUG nova.compute.manager [req-f768aacf-4783-4c1c-85b3-f352af31f82e req-34947307-4c66-4e57-a041-69766084a120 service nova] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Received event network-changed-eea925f5-c956-40d3-99a5-b45573318378 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:19:32 user nova-compute[95467]: DEBUG nova.compute.manager [req-f768aacf-4783-4c1c-85b3-f352af31f82e req-34947307-4c66-4e57-a041-69766084a120 service nova] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Refreshing instance network info cache due to event network-changed-eea925f5-c956-40d3-99a5-b45573318378. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:19:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-f768aacf-4783-4c1c-85b3-f352af31f82e req-34947307-4c66-4e57-a041-69766084a120 service nova] Acquiring lock "refresh_cache-bee31898-4f12-4c68-a18b-a678f9f584aa" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:19:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-f768aacf-4783-4c1c-85b3-f352af31f82e req-34947307-4c66-4e57-a041-69766084a120 service nova] Acquired lock "refresh_cache-bee31898-4f12-4c68-a18b-a678f9f584aa" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:19:32 user nova-compute[95467]: DEBUG nova.network.neutron [req-f768aacf-4783-4c1c-85b3-f352af31f82e req-34947307-4c66-4e57-a041-69766084a120 service nova] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Refreshing network info cache for port eea925f5-c956-40d3-99a5-b45573318378 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:19:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:32 user nova-compute[95467]: DEBUG nova.network.neutron [req-f768aacf-4783-4c1c-85b3-f352af31f82e req-34947307-4c66-4e57-a041-69766084a120 service nova] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Updated VIF entry in instance network info cache for port eea925f5-c956-40d3-99a5-b45573318378. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:19:32 user nova-compute[95467]: DEBUG nova.network.neutron [req-f768aacf-4783-4c1c-85b3-f352af31f82e req-34947307-4c66-4e57-a041-69766084a120 service nova] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Updating instance_info_cache with network_info: [{"id": "eea925f5-c956-40d3-99a5-b45573318378", "address": "fa:16:3e:b4:e9:ab", "network": {"id": "dcbc2304-8d20-4589-b81e-a75a22ef7114", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-333949369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6f7599b8526444a8276cac35f0a1500", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeea925f5-c9", "ovs_interfaceid": "eea925f5-c956-40d3-99a5-b45573318378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:19:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-f768aacf-4783-4c1c-85b3-f352af31f82e req-34947307-4c66-4e57-a041-69766084a120 service nova] Releasing lock "refresh_cache-bee31898-4f12-4c68-a18b-a678f9f584aa" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:19:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:33 user nova-compute[95467]: DEBUG nova.compute.manager [None req-27bbbae0-4c92-4ee4-b9ba-41644eb939fd tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:19:34 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:36 user nova-compute[95467]: DEBUG nova.compute.manager [req-d97781ef-fdf3-453a-85f1-96647fa42438 req-23aad0e3-96c8-43ce-8595-d117185137e7 service nova] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Received event network-vif-plugged-eea925f5-c956-40d3-99a5-b45573318378 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:19:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-d97781ef-fdf3-453a-85f1-96647fa42438 req-23aad0e3-96c8-43ce-8595-d117185137e7 service nova] Acquiring lock "bee31898-4f12-4c68-a18b-a678f9f584aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:19:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-d97781ef-fdf3-453a-85f1-96647fa42438 req-23aad0e3-96c8-43ce-8595-d117185137e7 service nova] Lock "bee31898-4f12-4c68-a18b-a678f9f584aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:19:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-d97781ef-fdf3-453a-85f1-96647fa42438 req-23aad0e3-96c8-43ce-8595-d117185137e7 service nova] Lock "bee31898-4f12-4c68-a18b-a678f9f584aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:19:36 user nova-compute[95467]: DEBUG nova.compute.manager [req-d97781ef-fdf3-453a-85f1-96647fa42438 req-23aad0e3-96c8-43ce-8595-d117185137e7 service nova] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] No waiting events found dispatching network-vif-plugged-eea925f5-c956-40d3-99a5-b45573318378 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:19:36 user nova-compute[95467]: WARNING nova.compute.manager [req-d97781ef-fdf3-453a-85f1-96647fa42438 req-23aad0e3-96c8-43ce-8595-d117185137e7 service nova] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Received unexpected event network-vif-plugged-eea925f5-c956-40d3-99a5-b45573318378 for instance with vm_state active and task_state None.
Nov 15 08:19:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:37 user nova-compute[95467]: INFO nova.compute.manager [None req-369e63b7-224e-4950-b6b4-02cc74654b8d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Unrescuing
Nov 15 08:19:37 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-369e63b7-224e-4950-b6b4-02cc74654b8d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Acquiring lock "refresh_cache-3825a691-ac5c-4c06-b4a4-2a0b40c638c4" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:19:37 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-369e63b7-224e-4950-b6b4-02cc74654b8d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Acquired lock "refresh_cache-3825a691-ac5c-4c06-b4a4-2a0b40c638c4" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:19:37 user nova-compute[95467]: DEBUG nova.network.neutron [None req-369e63b7-224e-4950-b6b4-02cc74654b8d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:19:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:37 user nova-compute[95467]: DEBUG nova.network.neutron [None req-369e63b7-224e-4950-b6b4-02cc74654b8d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Updating instance_info_cache with network_info: [{"id": "3fddc7dd-48af-4964-bc1a-a54623453f62", "address": "fa:16:3e:c6:49:ac", "network": {"id": "ac9a381d-25fe-4419-b151-f03333413813", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1183680999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34d65a8000347feb2b3966b7ce0d785", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fddc7dd-48", "ovs_interfaceid": "3fddc7dd-48af-4964-bc1a-a54623453f62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:19:37 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-369e63b7-224e-4950-b6b4-02cc74654b8d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Releasing lock "refresh_cache-3825a691-ac5c-4c06-b4a4-2a0b40c638c4" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:19:37 user nova-compute[95467]: DEBUG nova.objects.instance [None req-369e63b7-224e-4950-b6b4-02cc74654b8d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lazy-loading 'flavor' on Instance uuid 3825a691-ac5c-4c06-b4a4-2a0b40c638c4 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:19:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:38 user nova-compute[95467]: DEBUG nova.compute.manager [req-86d113dd-1586-43a2-abae-5ed678ecca83 req-9fbae185-8e56-4dc7-b610-6fca21878cd5 service nova] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Received event network-vif-unplugged-3fddc7dd-48af-4964-bc1a-a54623453f62 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:19:38 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-86d113dd-1586-43a2-abae-5ed678ecca83 req-9fbae185-8e56-4dc7-b610-6fca21878cd5 service nova] Acquiring lock "3825a691-ac5c-4c06-b4a4-2a0b40c638c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:19:38 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-86d113dd-1586-43a2-abae-5ed678ecca83 req-9fbae185-8e56-4dc7-b610-6fca21878cd5 service nova] Lock "3825a691-ac5c-4c06-b4a4-2a0b40c638c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:19:38 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-86d113dd-1586-43a2-abae-5ed678ecca83 req-9fbae185-8e56-4dc7-b610-6fca21878cd5 service nova] Lock "3825a691-ac5c-4c06-b4a4-2a0b40c638c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:19:38 user nova-compute[95467]: DEBUG nova.compute.manager [req-86d113dd-1586-43a2-abae-5ed678ecca83 req-9fbae185-8e56-4dc7-b610-6fca21878cd5 service nova] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] No waiting events found dispatching network-vif-unplugged-3fddc7dd-48af-4964-bc1a-a54623453f62 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:19:38 user nova-compute[95467]: WARNING nova.compute.manager [req-86d113dd-1586-43a2-abae-5ed678ecca83 req-9fbae185-8e56-4dc7-b610-6fca21878cd5 service nova] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Received unexpected event network-vif-unplugged-3fddc7dd-48af-4964-bc1a-a54623453f62 for instance with vm_state rescued and task_state unrescuing.
Nov 15 08:19:38 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:38 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:38 user nova-compute[95467]: DEBUG nova.compute.manager [req-0a85519c-3ba4-4025-995b-2814b3044fba req-d1dbfeb8-52dc-49b8-a88a-2e0f7cf59f05 service nova] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Received event network-vif-plugged-eea925f5-c956-40d3-99a5-b45573318378 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:19:38 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-0a85519c-3ba4-4025-995b-2814b3044fba req-d1dbfeb8-52dc-49b8-a88a-2e0f7cf59f05 service nova] Acquiring lock "bee31898-4f12-4c68-a18b-a678f9f584aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:19:38 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-0a85519c-3ba4-4025-995b-2814b3044fba req-d1dbfeb8-52dc-49b8-a88a-2e0f7cf59f05 service nova] Lock "bee31898-4f12-4c68-a18b-a678f9f584aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:19:38 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-0a85519c-3ba4-4025-995b-2814b3044fba req-d1dbfeb8-52dc-49b8-a88a-2e0f7cf59f05 service nova] Lock "bee31898-4f12-4c68-a18b-a678f9f584aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:19:38 user nova-compute[95467]: DEBUG nova.compute.manager [req-0a85519c-3ba4-4025-995b-2814b3044fba req-d1dbfeb8-52dc-49b8-a88a-2e0f7cf59f05 service nova] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] No waiting events found dispatching network-vif-plugged-eea925f5-c956-40d3-99a5-b45573318378 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:19:38 user nova-compute[95467]: WARNING nova.compute.manager [req-0a85519c-3ba4-4025-995b-2814b3044fba req-d1dbfeb8-52dc-49b8-a88a-2e0f7cf59f05 service nova] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Received unexpected event network-vif-plugged-eea925f5-c956-40d3-99a5-b45573318378 for instance with vm_state active and task_state None.
Nov 15 08:19:38 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Instance destroyed successfully.
Nov 15 08:19:39 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:39 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:39 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:40 user nova-compute[95467]: DEBUG nova.compute.manager [req-431d14b1-4fbe-46ff-bcbd-b6b4e3b01950 req-329e0c53-783e-4ad3-ae9c-63ddef3c6753 service nova] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Received event network-vif-plugged-3fddc7dd-48af-4964-bc1a-a54623453f62 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:19:40 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-431d14b1-4fbe-46ff-bcbd-b6b4e3b01950 req-329e0c53-783e-4ad3-ae9c-63ddef3c6753 service nova] Acquiring lock "3825a691-ac5c-4c06-b4a4-2a0b40c638c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:19:40 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-431d14b1-4fbe-46ff-bcbd-b6b4e3b01950 req-329e0c53-783e-4ad3-ae9c-63ddef3c6753 service nova] Lock "3825a691-ac5c-4c06-b4a4-2a0b40c638c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:19:40 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-431d14b1-4fbe-46ff-bcbd-b6b4e3b01950 req-329e0c53-783e-4ad3-ae9c-63ddef3c6753 service nova] Lock "3825a691-ac5c-4c06-b4a4-2a0b40c638c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:19:40 user nova-compute[95467]: DEBUG nova.compute.manager [req-431d14b1-4fbe-46ff-bcbd-b6b4e3b01950 req-329e0c53-783e-4ad3-ae9c-63ddef3c6753 service nova] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] No waiting events found dispatching network-vif-plugged-3fddc7dd-48af-4964-bc1a-a54623453f62 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:19:40 user nova-compute[95467]: WARNING nova.compute.manager [req-431d14b1-4fbe-46ff-bcbd-b6b4e3b01950 req-329e0c53-783e-4ad3-ae9c-63ddef3c6753 service nova] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Received unexpected event network-vif-plugged-3fddc7dd-48af-4964-bc1a-a54623453f62 for instance with vm_state rescued and task_state unrescuing.
Nov 15 08:19:40 user nova-compute[95467]: DEBUG nova.compute.manager [req-431d14b1-4fbe-46ff-bcbd-b6b4e3b01950 req-329e0c53-783e-4ad3-ae9c-63ddef3c6753 service nova] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Received event network-vif-plugged-3fddc7dd-48af-4964-bc1a-a54623453f62 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:19:40 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-431d14b1-4fbe-46ff-bcbd-b6b4e3b01950 req-329e0c53-783e-4ad3-ae9c-63ddef3c6753 service nova] Acquiring lock "3825a691-ac5c-4c06-b4a4-2a0b40c638c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:19:40 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-431d14b1-4fbe-46ff-bcbd-b6b4e3b01950 req-329e0c53-783e-4ad3-ae9c-63ddef3c6753 service nova] Lock "3825a691-ac5c-4c06-b4a4-2a0b40c638c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:19:40 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-431d14b1-4fbe-46ff-bcbd-b6b4e3b01950 req-329e0c53-783e-4ad3-ae9c-63ddef3c6753 service nova] Lock "3825a691-ac5c-4c06-b4a4-2a0b40c638c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:19:40 user nova-compute[95467]: DEBUG nova.compute.manager [req-431d14b1-4fbe-46ff-bcbd-b6b4e3b01950 req-329e0c53-783e-4ad3-ae9c-63ddef3c6753 service nova] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] No waiting events found dispatching network-vif-plugged-3fddc7dd-48af-4964-bc1a-a54623453f62 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:19:40 user nova-compute[95467]: WARNING nova.compute.manager [req-431d14b1-4fbe-46ff-bcbd-b6b4e3b01950 req-329e0c53-783e-4ad3-ae9c-63ddef3c6753 service nova] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Received unexpected event network-vif-plugged-3fddc7dd-48af-4964-bc1a-a54623453f62 for instance with vm_state rescued and task_state unrescuing.
Nov 15 08:19:40 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:19:40 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=95467) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 08:19:41 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager.update_available_resource {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:19:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:19:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:19:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:19:41 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Auditing locally available compute resources for user (node: user) {{(pid=95467) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 08:19:42 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Acquiring lock "a1a155e6-0ee2-4728-a526-17c149107ab0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:19:42 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lock "a1a155e6-0ee2-4728-a526-17c149107ab0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:19:42 user nova-compute[95467]: DEBUG nova.compute.manager [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Starting instance... {{(pid=95467) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 08:19:42 user nova-compute[95467]: DEBUG nova.compute.manager [None req-369e63b7-224e-4950-b6b4-02cc74654b8d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:19:42 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:19:42 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:19:42 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=95467) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 08:19:42 user nova-compute[95467]: INFO nova.compute.claims [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Claim successful on node user
Nov 15 08:19:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:19:42 user nova-compute[95467]: DEBUG nova.compute.manager [req-66300c2c-3dd9-4347-b856-2e4967999f8c req-e96892e4-ff53-445c-ad10-90a0ed41fa26 service nova] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Received event network-vif-plugged-3fddc7dd-48af-4964-bc1a-a54623453f62 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:19:42 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-66300c2c-3dd9-4347-b856-2e4967999f8c req-e96892e4-ff53-445c-ad10-90a0ed41fa26 service nova] Acquiring lock "3825a691-ac5c-4c06-b4a4-2a0b40c638c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:19:42 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-66300c2c-3dd9-4347-b856-2e4967999f8c req-e96892e4-ff53-445c-ad10-90a0ed41fa26 service nova] Lock "3825a691-ac5c-4c06-b4a4-2a0b40c638c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:19:42 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-66300c2c-3dd9-4347-b856-2e4967999f8c req-e96892e4-ff53-445c-ad10-90a0ed41fa26 service nova] Lock "3825a691-ac5c-4c06-b4a4-2a0b40c638c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:19:42 user nova-compute[95467]: DEBUG nova.compute.manager [req-66300c2c-3dd9-4347-b856-2e4967999f8c req-e96892e4-ff53-445c-ad10-90a0ed41fa26 service nova] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] No waiting events found dispatching network-vif-plugged-3fddc7dd-48af-4964-bc1a-a54623453f62 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:19:42 user nova-compute[95467]: WARNING nova.compute.manager [req-66300c2c-3dd9-4347-b856-2e4967999f8c req-e96892e4-ff53-445c-ad10-90a0ed41fa26 service nova] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Received unexpected event network-vif-plugged-3fddc7dd-48af-4964-bc1a-a54623453f62 for instance with vm_state active and task_state None.
Nov 15 08:19:42 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:19:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:19:42 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:19:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:19:42 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:19:42 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:19:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:19:42 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.601s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:19:42 user nova-compute[95467]: DEBUG nova.compute.manager [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Start building networks asynchronously for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 08:19:42 user nova-compute[95467]: DEBUG nova.compute.manager [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Allocating IP information in the background. {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 08:19:42 user nova-compute[95467]: DEBUG nova.network.neutron [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] allocate_for_instance() {{(pid=95467) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 08:19:42 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 08:19:42 user nova-compute[95467]: DEBUG nova.compute.manager [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Start building block device mappings for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 08:19:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:19:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:19:42 user nova-compute[95467]: DEBUG nova.policy [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4ac0c1f0393c47de8452fba44e6c28d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f9b647fefc431099e9f77370b00e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95467) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 08:19:42 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:43 user nova-compute[95467]: DEBUG nova.compute.manager [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Start spawning the instance on the hypervisor. {{(pid=95467) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 08:19:43 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Creating instance directory {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 08:19:43 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Creating image(s)
Nov 15 08:19:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Acquiring lock "/opt/stack/data/nova/instances/a1a155e6-0ee2-4728-a526-17c149107ab0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:19:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lock "/opt/stack/data/nova/instances/a1a155e6-0ee2-4728-a526-17c149107ab0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:19:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lock "/opt/stack/data/nova/instances/a1a155e6-0ee2-4728-a526-17c149107ab0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:19:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:19:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:19:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bee31898-4f12-4c68-a18b-a678f9f584aa/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:19:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.212s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:19:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Acquiring lock "a3fcf60225fcefd310404971cd18ab9851c548dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:19:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:19:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:19:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bee31898-4f12-4c68-a18b-a678f9f584aa/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:19:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bee31898-4f12-4c68-a18b-a678f9f584aa/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:19:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.188s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:19:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/a1a155e6-0ee2-4728-a526-17c149107ab0/disk 1073741824 {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:19:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bee31898-4f12-4c68-a18b-a678f9f584aa/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:19:43 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:19:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/a1a155e6-0ee2-4728-a526-17c149107ab0/disk 1073741824" returned: 0 in 0.066s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:19:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:19:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:19:43 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:19:43 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:19:43 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:19:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:19:43 user nova-compute[95467]: DEBUG nova.network.neutron [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Successfully created port: d9b8cd88-c40b-4437-afd9-403eb882e80c {{(pid=95467) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 08:19:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.211s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:19:43 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a1a155e6-0ee2-4728-a526-17c149107ab0/disk. size=1073741824 {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 08:19:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a155e6-0ee2-4728-a526-17c149107ab0/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:19:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:19:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:19:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a155e6-0ee2-4728-a526-17c149107ab0/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:19:43 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Cannot resize image /opt/stack/data/nova/instances/a1a155e6-0ee2-4728-a526-17c149107ab0/disk to a smaller size. {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 08:19:43 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Created local disks {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 08:19:43 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Ensure instance console log exists: /opt/stack/data/nova/instances/a1a155e6-0ee2-4728-a526-17c149107ab0/console.log {{(pid=95467) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 08:19:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:19:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:19:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:19:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:19:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:19:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:19:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:19:44 user nova-compute[95467]: DEBUG nova.network.neutron [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Successfully updated port: d9b8cd88-c40b-4437-afd9-403eb882e80c {{(pid=95467) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 08:19:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:19:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk.rescue --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:19:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Acquiring lock "refresh_cache-a1a155e6-0ee2-4728-a526-17c149107ab0" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:19:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Acquired lock "refresh_cache-a1a155e6-0ee2-4728-a526-17c149107ab0" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:19:44 user nova-compute[95467]: DEBUG nova.network.neutron [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:19:44 user nova-compute[95467]: DEBUG nova.compute.manager [req-ee5f0106-1573-49a8-a0b7-74a4cc8984fa req-ec0aff92-cd2c-487b-b7b8-d9378ab0dd94 service nova] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Received event network-changed-d9b8cd88-c40b-4437-afd9-403eb882e80c {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:19:44 user nova-compute[95467]: DEBUG nova.compute.manager [req-ee5f0106-1573-49a8-a0b7-74a4cc8984fa req-ec0aff92-cd2c-487b-b7b8-d9378ab0dd94 service nova] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Refreshing instance network info cache due to event network-changed-d9b8cd88-c40b-4437-afd9-403eb882e80c. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:19:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ee5f0106-1573-49a8-a0b7-74a4cc8984fa req-ec0aff92-cd2c-487b-b7b8-d9378ab0dd94 service nova] Acquiring lock "refresh_cache-a1a155e6-0ee2-4728-a526-17c149107ab0" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:19:44 user nova-compute[95467]: DEBUG nova.network.neutron [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Instance cache missing network info. {{(pid=95467) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 08:19:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:19:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk.rescue --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:19:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:19:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:19:44 user nova-compute[95467]: DEBUG nova.network.neutron [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Updating instance_info_cache with network_info: [{"id": "d9b8cd88-c40b-4437-afd9-403eb882e80c", "address": "fa:16:3e:83:dc:7a", "network": {"id": "34c396ed-35f3-4c64-ae71-fec43375e75b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-631332774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f9b647fefc431099e9f77370b00e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9b8cd88-c4", "ovs_interfaceid": "d9b8cd88-c40b-4437-afd9-403eb882e80c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:19:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Releasing lock "refresh_cache-a1a155e6-0ee2-4728-a526-17c149107ab0" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:19:44 user nova-compute[95467]: DEBUG nova.compute.manager [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Instance network_info: |[{"id": "d9b8cd88-c40b-4437-afd9-403eb882e80c", "address": "fa:16:3e:83:dc:7a", "network": {"id": "34c396ed-35f3-4c64-ae71-fec43375e75b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-631332774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f9b647fefc431099e9f77370b00e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9b8cd88-c4", "ovs_interfaceid": "d9b8cd88-c40b-4437-afd9-403eb882e80c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 08:19:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ee5f0106-1573-49a8-a0b7-74a4cc8984fa req-ec0aff92-cd2c-487b-b7b8-d9378ab0dd94 service nova] Acquired lock "refresh_cache-a1a155e6-0ee2-4728-a526-17c149107ab0" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:19:44 user nova-compute[95467]: DEBUG nova.network.neutron [req-ee5f0106-1573-49a8-a0b7-74a4cc8984fa req-ec0aff92-cd2c-487b-b7b8-d9378ab0dd94 service nova] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Refreshing network info cache for port d9b8cd88-c40b-4437-afd9-403eb882e80c {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:19:44 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Start _get_guest_xml network_info=[{"id": "d9b8cd88-c40b-4437-afd9-403eb882e80c", "address": "fa:16:3e:83:dc:7a", "network": {"id": "34c396ed-35f3-4c64-ae71-fec43375e75b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-631332774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f9b647fefc431099e9f77370b00e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9b8cd88-c4", "ovs_interfaceid": "d9b8cd88-c40b-4437-afd9-403eb882e80c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'ed9c48aa-ce73-4b3b-9db1-235898be671b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:19:44 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:19:44 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:19:44 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:19:44 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:19:44 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:19:44 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:19:44 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:19:44 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:19:44 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:19:44 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:19:44 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:19:44 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:19:44 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:19:44 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:19:44 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:19:44 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:19:44 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:19:44 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:19:44 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:19:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1324921877',display_name='tempest-SnapshotDataIntegrityTests-server-1324921877',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1324921877',id=32,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHE/7FAOObH6E30WeSRJDqbkxPN84jkeAolmf0oK7rvzxbEs94wBSTkJ9Sc83CURZQDHrGXL2vLymO6z7ODNaiq166wkVa+DSyeprPIhYESjVXzpFnlfBtAfHQ6jscdsMQ==',key_name='tempest-keypair-840734884',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84f9b647fefc431099e9f77370b00e9a',ramdisk_id='',reservation_id='r-5mrupc9n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-234501990',owner_user_name='tempest-SnapshotDataIntegrityTests-234501990-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:19:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ac0c1f0393c47de8452fba44e6c28d5',uuid=a1a155e6-0ee2-4728-a526-17c149107ab0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9b8cd88-c40b-4437-afd9-403eb882e80c", "address": "fa:16:3e:83:dc:7a", "network": {"id": "34c396ed-35f3-4c64-ae71-fec43375e75b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-631332774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f9b647fefc431099e9f77370b00e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9b8cd88-c4", "ovs_interfaceid": "d9b8cd88-c40b-4437-afd9-403eb882e80c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:19:44 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Converting VIF {"id": "d9b8cd88-c40b-4437-afd9-403eb882e80c", "address": "fa:16:3e:83:dc:7a", "network": {"id": "34c396ed-35f3-4c64-ae71-fec43375e75b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-631332774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f9b647fefc431099e9f77370b00e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9b8cd88-c4", "ovs_interfaceid": "d9b8cd88-c40b-4437-afd9-403eb882e80c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:19:44 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:dc:7a,bridge_name='br-int',has_traffic_filtering=True,id=d9b8cd88-c40b-4437-afd9-403eb882e80c,network=Network(34c396ed-35f3-4c64-ae71-fec43375e75b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9b8cd88-c4') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:19:44 user nova-compute[95467]: DEBUG nova.objects.instance [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lazy-loading 'pci_devices' on Instance uuid a1a155e6-0ee2-4728-a526-17c149107ab0 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:19:44 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:19:44 user nova-compute[95467]:   <uuid>a1a155e6-0ee2-4728-a526-17c149107ab0</uuid>
Nov 15 08:19:44 user nova-compute[95467]:   <name>instance-00000020</name>
Nov 15 08:19:44 user nova-compute[95467]:   <memory>524288</memory>
Nov 15 08:19:44 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:19:44 user nova-compute[95467]:   <metadata>
Nov 15 08:19:44 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:19:44 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:19:44 user nova-compute[95467]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1324921877</nova:name>
Nov 15 08:19:44 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:19:44</nova:creationTime>
Nov 15 08:19:44 user nova-compute[95467]:       <nova:flavor name="m1.tiny">
Nov 15 08:19:44 user nova-compute[95467]:         <nova:memory>512</nova:memory>
Nov 15 08:19:44 user nova-compute[95467]:         <nova:disk>1</nova:disk>
Nov 15 08:19:44 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:19:44 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:19:44 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:19:44 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:19:44 user nova-compute[95467]:       <nova:owner>
Nov 15 08:19:44 user nova-compute[95467]:         <nova:user uuid="4ac0c1f0393c47de8452fba44e6c28d5">tempest-SnapshotDataIntegrityTests-234501990-project-member</nova:user>
Nov 15 08:19:44 user nova-compute[95467]:         <nova:project uuid="84f9b647fefc431099e9f77370b00e9a">tempest-SnapshotDataIntegrityTests-234501990</nova:project>
Nov 15 08:19:44 user nova-compute[95467]:       </nova:owner>
Nov 15 08:19:44 user nova-compute[95467]:       <nova:root type="image" uuid="ed9c48aa-ce73-4b3b-9db1-235898be671b"/>
Nov 15 08:19:44 user nova-compute[95467]:       <nova:ports>
Nov 15 08:19:44 user nova-compute[95467]:         <nova:port uuid="d9b8cd88-c40b-4437-afd9-403eb882e80c">
Nov 15 08:19:44 user nova-compute[95467]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 08:19:44 user nova-compute[95467]:         </nova:port>
Nov 15 08:19:44 user nova-compute[95467]:       </nova:ports>
Nov 15 08:19:44 user nova-compute[95467]:     </nova:instance>
Nov 15 08:19:44 user nova-compute[95467]:   </metadata>
Nov 15 08:19:44 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:19:44 user nova-compute[95467]:     <system>
Nov 15 08:19:44 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:19:44 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:19:44 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:19:44 user nova-compute[95467]:       <entry name="serial">a1a155e6-0ee2-4728-a526-17c149107ab0</entry>
Nov 15 08:19:44 user nova-compute[95467]:       <entry name="uuid">a1a155e6-0ee2-4728-a526-17c149107ab0</entry>
Nov 15 08:19:44 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:19:44 user nova-compute[95467]:     </system>
Nov 15 08:19:44 user nova-compute[95467]:   </sysinfo>
Nov 15 08:19:44 user nova-compute[95467]:   <os>
Nov 15 08:19:44 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:19:44 user nova-compute[95467]:     <boot dev="hd"/>
Nov 15 08:19:44 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:19:44 user nova-compute[95467]:   </os>
Nov 15 08:19:44 user nova-compute[95467]:   <features>
Nov 15 08:19:44 user nova-compute[95467]:     <acpi/>
Nov 15 08:19:44 user nova-compute[95467]:     <apic/>
Nov 15 08:19:44 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:19:44 user nova-compute[95467]:   </features>
Nov 15 08:19:44 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:19:44 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:19:44 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:19:44 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:19:44 user nova-compute[95467]:   </clock>
Nov 15 08:19:44 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:19:44 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:19:44 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:19:44 user nova-compute[95467]:   </cpu>
Nov 15 08:19:44 user nova-compute[95467]:   <devices>
Nov 15 08:19:44 user nova-compute[95467]:     <disk type="file" device="disk">
Nov 15 08:19:44 user nova-compute[95467]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 08:19:44 user nova-compute[95467]:       <source file="/opt/stack/data/nova/instances/a1a155e6-0ee2-4728-a526-17c149107ab0/disk"/>
Nov 15 08:19:44 user nova-compute[95467]:       <target dev="vda" bus="virtio"/>
Nov 15 08:19:44 user nova-compute[95467]:     </disk>
Nov 15 08:19:44 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:19:44 user nova-compute[95467]:       <mac address="fa:16:3e:83:dc:7a"/>
Nov 15 08:19:44 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:19:44 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:19:44 user nova-compute[95467]:       <target dev="tapd9b8cd88-c4"/>
Nov 15 08:19:44 user nova-compute[95467]:     </interface>
Nov 15 08:19:44 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:19:44 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/a1a155e6-0ee2-4728-a526-17c149107ab0/console.log" append="off"/>
Nov 15 08:19:44 user nova-compute[95467]:     </serial>
Nov 15 08:19:44 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:19:44 user nova-compute[95467]:     <video>
Nov 15 08:19:44 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:19:44 user nova-compute[95467]:     </video>
Nov 15 08:19:44 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:19:44 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:19:44 user nova-compute[95467]:     </rng>
Nov 15 08:19:44 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:19:44 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:19:44 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:19:44 user nova-compute[95467]:     </memballoon>
Nov 15 08:19:44 user nova-compute[95467]:   </devices>
Nov 15 08:19:44 user nova-compute[95467]: </domain>
Nov 15 08:19:44 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:19:44 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:19:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1324921877',display_name='tempest-SnapshotDataIntegrityTests-server-1324921877',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1324921877',id=32,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHE/7FAOObH6E30WeSRJDqbkxPN84jkeAolmf0oK7rvzxbEs94wBSTkJ9Sc83CURZQDHrGXL2vLymO6z7ODNaiq166wkVa+DSyeprPIhYESjVXzpFnlfBtAfHQ6jscdsMQ==',key_name='tempest-keypair-840734884',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84f9b647fefc431099e9f77370b00e9a',ramdisk_id='',reservation_id='r-5mrupc9n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-234501990',owner_user_name='tempest-SnapshotDataIntegrityTests-234501990-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:19:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ac0c1f0393c47de8452fba44e6c28d5',uuid=a1a155e6-0ee2-4728-a526-17c149107ab0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9b8cd88-c40b-4437-afd9-403eb882e80c", "address": "fa:16:3e:83:dc:7a", "network": {"id": "34c396ed-35f3-4c64-ae71-fec43375e75b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-631332774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f9b647fefc431099e9f77370b00e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9b8cd88-c4", "ovs_interfaceid": "d9b8cd88-c40b-4437-afd9-403eb882e80c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:19:44 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Converting VIF {"id": "d9b8cd88-c40b-4437-afd9-403eb882e80c", "address": "fa:16:3e:83:dc:7a", "network": {"id": "34c396ed-35f3-4c64-ae71-fec43375e75b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-631332774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f9b647fefc431099e9f77370b00e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9b8cd88-c4", "ovs_interfaceid": "d9b8cd88-c40b-4437-afd9-403eb882e80c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:19:44 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:dc:7a,bridge_name='br-int',has_traffic_filtering=True,id=d9b8cd88-c40b-4437-afd9-403eb882e80c,network=Network(34c396ed-35f3-4c64-ae71-fec43375e75b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9b8cd88-c4') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:19:44 user nova-compute[95467]: DEBUG os_vif [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:dc:7a,bridge_name='br-int',has_traffic_filtering=True,id=d9b8cd88-c40b-4437-afd9-403eb882e80c,network=Network(34c396ed-35f3-4c64-ae71-fec43375e75b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9b8cd88-c4') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:19:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:19:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:19:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c667be88-dff4-51c8-a37b-3baa1e3504c0', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:19:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:19:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:19:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:19:45 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:45 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd9b8cd88-c4, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:19:45 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd9b8cd88-c4, col_values=(('qos', UUID('60068bc0-d4d0-413f-9672-e2b5729104e5')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:19:45 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd9b8cd88-c4, col_values=(('external_ids', {'iface-id': 'd9b8cd88-c40b-4437-afd9-403eb882e80c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:dc:7a', 'vm-uuid': 'a1a155e6-0ee2-4728-a526-17c149107ab0'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:19:45 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:45 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:45 user nova-compute[95467]: INFO os_vif [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:dc:7a,bridge_name='br-int',has_traffic_filtering=True,id=d9b8cd88-c40b-4437-afd9-403eb882e80c,network=Network(34c396ed-35f3-4c64-ae71-fec43375e75b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9b8cd88-c4')
Nov 15 08:19:45 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:19:45 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] No VIF found with MAC fa:16:3e:83:dc:7a, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:19:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:19:45 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:19:45 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:19:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:49 user nova-compute[95467]: DEBUG nova.compute.manager [req-f861bdd0-d8af-43be-a803-bc146defbc3f req-26f7dea0-3219-477a-9b68-3101ebf58a3b service nova] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Received event network-vif-plugged-d9b8cd88-c40b-4437-afd9-403eb882e80c {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:19:49 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-f861bdd0-d8af-43be-a803-bc146defbc3f req-26f7dea0-3219-477a-9b68-3101ebf58a3b service nova] Acquiring lock "a1a155e6-0ee2-4728-a526-17c149107ab0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:19:49 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-f861bdd0-d8af-43be-a803-bc146defbc3f req-26f7dea0-3219-477a-9b68-3101ebf58a3b service nova] Lock "a1a155e6-0ee2-4728-a526-17c149107ab0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:19:49 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-f861bdd0-d8af-43be-a803-bc146defbc3f req-26f7dea0-3219-477a-9b68-3101ebf58a3b service nova] Lock "a1a155e6-0ee2-4728-a526-17c149107ab0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:19:49 user nova-compute[95467]: DEBUG nova.compute.manager [req-f861bdd0-d8af-43be-a803-bc146defbc3f req-26f7dea0-3219-477a-9b68-3101ebf58a3b service nova] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] No waiting events found dispatching network-vif-plugged-d9b8cd88-c40b-4437-afd9-403eb882e80c {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:19:49 user nova-compute[95467]: WARNING nova.compute.manager [req-f861bdd0-d8af-43be-a803-bc146defbc3f req-26f7dea0-3219-477a-9b68-3101ebf58a3b service nova] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Received unexpected event network-vif-plugged-d9b8cd88-c40b-4437-afd9-403eb882e80c for instance with vm_state building and task_state spawning.
Nov 15 08:19:49 user nova-compute[95467]: DEBUG nova.compute.manager [req-638b68e5-ef1e-4cf7-8e4e-b79f9c515d1f req-9081f393-007a-498d-9ab3-ceb6aafca4c1 service nova] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Received event network-vif-plugged-d9b8cd88-c40b-4437-afd9-403eb882e80c {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:19:49 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-638b68e5-ef1e-4cf7-8e4e-b79f9c515d1f req-9081f393-007a-498d-9ab3-ceb6aafca4c1 service nova] Acquiring lock "a1a155e6-0ee2-4728-a526-17c149107ab0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:19:49 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-638b68e5-ef1e-4cf7-8e4e-b79f9c515d1f req-9081f393-007a-498d-9ab3-ceb6aafca4c1 service nova] Lock "a1a155e6-0ee2-4728-a526-17c149107ab0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:19:49 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-638b68e5-ef1e-4cf7-8e4e-b79f9c515d1f req-9081f393-007a-498d-9ab3-ceb6aafca4c1 service nova] Lock "a1a155e6-0ee2-4728-a526-17c149107ab0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:19:49 user nova-compute[95467]: DEBUG nova.compute.manager [req-638b68e5-ef1e-4cf7-8e4e-b79f9c515d1f req-9081f393-007a-498d-9ab3-ceb6aafca4c1 service nova] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] No waiting events found dispatching network-vif-plugged-d9b8cd88-c40b-4437-afd9-403eb882e80c {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:19:49 user nova-compute[95467]: WARNING nova.compute.manager [req-638b68e5-ef1e-4cf7-8e4e-b79f9c515d1f req-9081f393-007a-498d-9ab3-ceb6aafca4c1 service nova] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Received unexpected event network-vif-plugged-d9b8cd88-c40b-4437-afd9-403eb882e80c for instance with vm_state building and task_state spawning.
Nov 15 08:19:49 user nova-compute[95467]: DEBUG nova.compute.manager [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Instance event wait completed in 0 seconds for  {{(pid=95467) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 08:19:49 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Guest created on hypervisor {{(pid=95467) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 08:19:49 user nova-compute[95467]: INFO nova.compute.manager [None req-cf7acb37-2278-496f-99f1-1684f5843fa5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Rescuing
Nov 15 08:19:49 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-cf7acb37-2278-496f-99f1-1684f5843fa5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Acquiring lock "refresh_cache-b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:19:49 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-cf7acb37-2278-496f-99f1-1684f5843fa5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Acquired lock "refresh_cache-b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:19:49 user nova-compute[95467]: DEBUG nova.network.neutron [None req-cf7acb37-2278-496f-99f1-1684f5843fa5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:19:49 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:19:49 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:19:49 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Hypervisor/Node resource view: name=user free_ram=7484MB free_disk=25.10775375366211GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=95467) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 08:19:49 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:19:49 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:19:49 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Instance spawned successfully.
Nov 15 08:19:49 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 08:19:49 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Found default for hw_cdrom_bus of ide {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:19:49 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Found default for hw_disk_bus of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:19:49 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Found default for hw_input_bus of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:19:49 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Found default for hw_pointer_model of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:19:49 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Found default for hw_video_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:19:49 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Found default for hw_vif_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:19:49 user nova-compute[95467]: INFO nova.compute.manager [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Took 6.27 seconds to spawn the instance on the hypervisor.
Nov 15 08:19:49 user nova-compute[95467]: DEBUG nova.compute.manager [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:19:49 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 73fe8852-c47a-47ab-a56f-6864c8ed5479 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:19:49 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 21cf2ada-b15c-490d-ac37-96e9c87e9056 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:19:49 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance bee31898-4f12-4c68-a18b-a678f9f584aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:19:49 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:19:49 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 10d73b73-ca65-4192-8954-288dc1df9f24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:19:49 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 3825a691-ac5c-4c06-b4a4-2a0b40c638c4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:19:49 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 851d354c-7f20-4e72-bfd2-a781b929e8ba actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:19:49 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 1c438a54-5528-4354-9836-f1a198532c9b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:19:49 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 13957136-17e4-4d38-aba3-37453e1fb878 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:19:49 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:19:49 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance a1a155e6-0ee2-4728-a526-17c149107ab0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:19:49 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 08:19:49 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 08:19:49 user nova-compute[95467]: INFO nova.compute.manager [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Took 7.27 seconds to build instance.
Nov 15 08:19:49 user nova-compute[95467]: DEBUG nova.network.neutron [req-ee5f0106-1573-49a8-a0b7-74a4cc8984fa req-ec0aff92-cd2c-487b-b7b8-d9378ab0dd94 service nova] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Updated VIF entry in instance network info cache for port d9b8cd88-c40b-4437-afd9-403eb882e80c. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:19:49 user nova-compute[95467]: DEBUG nova.network.neutron [req-ee5f0106-1573-49a8-a0b7-74a4cc8984fa req-ec0aff92-cd2c-487b-b7b8-d9378ab0dd94 service nova] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Updating instance_info_cache with network_info: [{"id": "d9b8cd88-c40b-4437-afd9-403eb882e80c", "address": "fa:16:3e:83:dc:7a", "network": {"id": "34c396ed-35f3-4c64-ae71-fec43375e75b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-631332774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f9b647fefc431099e9f77370b00e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9b8cd88-c4", "ovs_interfaceid": "d9b8cd88-c40b-4437-afd9-403eb882e80c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:19:49 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ee5f0106-1573-49a8-a0b7-74a4cc8984fa req-ec0aff92-cd2c-487b-b7b8-d9378ab0dd94 service nova] Releasing lock "refresh_cache-a1a155e6-0ee2-4728-a526-17c149107ab0" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:19:49 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4b4c1b40-ebf0-4e21-b7dd-c77ab521a36b tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lock "a1a155e6-0ee2-4728-a526-17c149107ab0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.383s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:19:49 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:19:49 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:19:49 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Compute_service record updated for user:user {{(pid=95467) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 08:19:49 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.552s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:19:49 user nova-compute[95467]: DEBUG nova.network.neutron [None req-cf7acb37-2278-496f-99f1-1684f5843fa5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Updating instance_info_cache with network_info: [{"id": "1436eae1-0899-4fc5-8bbe-575fa2c70d42", "address": "fa:16:3e:08:e7:36", "network": {"id": "369d2a6f-60b7-4c92-8b2d-1f3828f6698b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1491709218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd281be4e94a4d31a47a13267d51d9b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1436eae1-08", "ovs_interfaceid": "1436eae1-0899-4fc5-8bbe-575fa2c70d42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:19:49 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-cf7acb37-2278-496f-99f1-1684f5843fa5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Releasing lock "refresh_cache-b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:19:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:50 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:50 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:50 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:50 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:50 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Instance destroyed successfully.
Nov 15 08:19:50 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-cf7acb37-2278-496f-99f1-1684f5843fa5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Attempting rescue
Nov 15 08:19:50 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-cf7acb37-2278-496f-99f1-1684f5843fa5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=95467) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 08:19:50 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-cf7acb37-2278-496f-99f1-1684f5843fa5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Instance directory exists: not creating {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 08:19:50 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-cf7acb37-2278-496f-99f1-1684f5843fa5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Creating image(s)
Nov 15 08:19:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-cf7acb37-2278-496f-99f1-1684f5843fa5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Acquiring lock "/opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:19:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-cf7acb37-2278-496f-99f1-1684f5843fa5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "/opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:19:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-cf7acb37-2278-496f-99f1-1684f5843fa5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "/opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:19:50 user nova-compute[95467]: DEBUG nova.objects.instance [None req-cf7acb37-2278-496f-99f1-1684f5843fa5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lazy-loading 'trusted_certs' on Instance uuid b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:19:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-cf7acb37-2278-496f-99f1-1684f5843fa5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Acquiring lock "a3fcf60225fcefd310404971cd18ab9851c548dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:19:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-cf7acb37-2278-496f-99f1-1684f5843fa5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:19:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-cf7acb37-2278-496f-99f1-1684f5843fa5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:19:50 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:19:50 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:19:50 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:19:50 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Starting heal instance info cache {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 08:19:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "refresh_cache-21cf2ada-b15c-490d-ac37-96e9c87e9056" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:19:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquired lock "refresh_cache-21cf2ada-b15c-490d-ac37-96e9c87e9056" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:19:50 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Forcefully refreshing network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 08:19:50 user nova-compute[95467]: DEBUG nova.compute.manager [req-7db4edfd-0397-4ebf-abf1-26ce356de6cf req-82b507f8-6aa4-4b7d-bc49-fe75640cac3c service nova] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Received event network-vif-unplugged-1436eae1-0899-4fc5-8bbe-575fa2c70d42 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:19:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-7db4edfd-0397-4ebf-abf1-26ce356de6cf req-82b507f8-6aa4-4b7d-bc49-fe75640cac3c service nova] Acquiring lock "b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:19:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-7db4edfd-0397-4ebf-abf1-26ce356de6cf req-82b507f8-6aa4-4b7d-bc49-fe75640cac3c service nova] Lock "b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:19:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-7db4edfd-0397-4ebf-abf1-26ce356de6cf req-82b507f8-6aa4-4b7d-bc49-fe75640cac3c service nova] Lock "b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:19:50 user nova-compute[95467]: DEBUG nova.compute.manager [req-7db4edfd-0397-4ebf-abf1-26ce356de6cf req-82b507f8-6aa4-4b7d-bc49-fe75640cac3c service nova] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] No waiting events found dispatching network-vif-unplugged-1436eae1-0899-4fc5-8bbe-575fa2c70d42 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:19:50 user nova-compute[95467]: WARNING nova.compute.manager [req-7db4edfd-0397-4ebf-abf1-26ce356de6cf req-82b507f8-6aa4-4b7d-bc49-fe75640cac3c service nova] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Received unexpected event network-vif-unplugged-1436eae1-0899-4fc5-8bbe-575fa2c70d42 for instance with vm_state active and task_state rescuing.
Nov 15 08:19:50 user nova-compute[95467]: DEBUG nova.compute.manager [req-7db4edfd-0397-4ebf-abf1-26ce356de6cf req-82b507f8-6aa4-4b7d-bc49-fe75640cac3c service nova] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Received event network-vif-plugged-1436eae1-0899-4fc5-8bbe-575fa2c70d42 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:19:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-7db4edfd-0397-4ebf-abf1-26ce356de6cf req-82b507f8-6aa4-4b7d-bc49-fe75640cac3c service nova] Acquiring lock "b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:19:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-7db4edfd-0397-4ebf-abf1-26ce356de6cf req-82b507f8-6aa4-4b7d-bc49-fe75640cac3c service nova] Lock "b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:19:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-7db4edfd-0397-4ebf-abf1-26ce356de6cf req-82b507f8-6aa4-4b7d-bc49-fe75640cac3c service nova] Lock "b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:19:50 user nova-compute[95467]: DEBUG nova.compute.manager [req-7db4edfd-0397-4ebf-abf1-26ce356de6cf req-82b507f8-6aa4-4b7d-bc49-fe75640cac3c service nova] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] No waiting events found dispatching network-vif-plugged-1436eae1-0899-4fc5-8bbe-575fa2c70d42 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:19:50 user nova-compute[95467]: WARNING nova.compute.manager [req-7db4edfd-0397-4ebf-abf1-26ce356de6cf req-82b507f8-6aa4-4b7d-bc49-fe75640cac3c service nova] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Received unexpected event network-vif-plugged-1436eae1-0899-4fc5-8bbe-575fa2c70d42 for instance with vm_state active and task_state rescuing.
Nov 15 08:19:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-cf7acb37-2278-496f-99f1-1684f5843fa5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.181s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:19:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-cf7acb37-2278-496f-99f1-1684f5843fa5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk.rescue {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:19:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-cf7acb37-2278-496f-99f1-1684f5843fa5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk.rescue" returned: 0 in 0.066s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:19:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-cf7acb37-2278-496f-99f1-1684f5843fa5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:19:50 user nova-compute[95467]: DEBUG nova.objects.instance [None req-cf7acb37-2278-496f-99f1-1684f5843fa5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lazy-loading 'migration_context' on Instance uuid b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:19:50 user nova-compute[95467]: DEBUG nova.objects.base [None req-cf7acb37-2278-496f-99f1-1684f5843fa5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Object Instance<b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67> lazy-loaded attributes: trusted_certs,migration_context {{(pid=95467) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 08:19:50 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-cf7acb37-2278-496f-99f1-1684f5843fa5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Created local disks {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 08:19:50 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-cf7acb37-2278-496f-99f1-1684f5843fa5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Start _get_guest_xml network_info=[{"id": "1436eae1-0899-4fc5-8bbe-575fa2c70d42", "address": "fa:16:3e:08:e7:36", "network": {"id": "369d2a6f-60b7-4c92-8b2d-1f3828f6698b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1491709218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1491709218-network", "vif_mac": "fa:16:3e:08:e7:36"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd281be4e94a4d31a47a13267d51d9b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1436eae1-08", "ovs_interfaceid": "1436eae1-0899-4fc5-8bbe-575fa2c70d42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ed9c48aa-ce73-4b3b-9db1-235898be671b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:19:50 user nova-compute[95467]: DEBUG nova.objects.instance [None req-cf7acb37-2278-496f-99f1-1684f5843fa5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lazy-loading 'resources' on Instance uuid b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:19:50 user nova-compute[95467]: DEBUG nova.objects.base [None req-cf7acb37-2278-496f-99f1-1684f5843fa5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Object Instance<b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=95467) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 08:19:50 user nova-compute[95467]: DEBUG nova.objects.instance [None req-cf7acb37-2278-496f-99f1-1684f5843fa5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lazy-loading 'numa_topology' on Instance uuid b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:19:50 user nova-compute[95467]: DEBUG nova.objects.base [None req-cf7acb37-2278-496f-99f1-1684f5843fa5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Object Instance<b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=95467) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 08:19:50 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-cf7acb37-2278-496f-99f1-1684f5843fa5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:19:50 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-cf7acb37-2278-496f-99f1-1684f5843fa5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:19:50 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-cf7acb37-2278-496f-99f1-1684f5843fa5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:19:51 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-cf7acb37-2278-496f-99f1-1684f5843fa5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:19:51 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-cf7acb37-2278-496f-99f1-1684f5843fa5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:19:51 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-cf7acb37-2278-496f-99f1-1684f5843fa5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:19:51 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-cf7acb37-2278-496f-99f1-1684f5843fa5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:19:51 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-cf7acb37-2278-496f-99f1-1684f5843fa5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:19:51 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-cf7acb37-2278-496f-99f1-1684f5843fa5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:19:51 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-cf7acb37-2278-496f-99f1-1684f5843fa5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:19:51 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-cf7acb37-2278-496f-99f1-1684f5843fa5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:19:51 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-cf7acb37-2278-496f-99f1-1684f5843fa5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:19:51 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-cf7acb37-2278-496f-99f1-1684f5843fa5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:19:51 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-cf7acb37-2278-496f-99f1-1684f5843fa5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:19:51 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-cf7acb37-2278-496f-99f1-1684f5843fa5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:19:51 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-cf7acb37-2278-496f-99f1-1684f5843fa5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:19:51 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-cf7acb37-2278-496f-99f1-1684f5843fa5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:19:51 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-cf7acb37-2278-496f-99f1-1684f5843fa5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:19:51 user nova-compute[95467]: DEBUG nova.objects.instance [None req-cf7acb37-2278-496f-99f1-1684f5843fa5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lazy-loading 'vcpu_model' on Instance uuid b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:19:51 user nova-compute[95467]: DEBUG nova.objects.base [None req-cf7acb37-2278-496f-99f1-1684f5843fa5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Object Instance<b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=95467) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 08:19:51 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-cf7acb37-2278-496f-99f1-1684f5843fa5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:15:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-438049731',display_name='tempest-ServerRescueNegativeTestJSON-server-438049731',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-438049731',id=21,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:15:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bd281be4e94a4d31a47a13267d51d9b6',ramdisk_id='',reservation_id='r-x5tle0vp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1148442534',owner_user_name='tempest-ServerRescueNegativeTestJSON-1148442534-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:15:12Z,user_data=None,user_id='c07f8dbc38004ecd973f61bba63606d4',uuid=b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1436eae1-0899-4fc5-8bbe-575fa2c70d42", "address": "fa:16:3e:08:e7:36", "network": {"id": "369d2a6f-60b7-4c92-8b2d-1f3828f6698b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1491709218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1491709218-network", "vif_mac": "fa:16:3e:08:e7:36"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd281be4e94a4d31a47a13267d51d9b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1436eae1-08", "ovs_interfaceid": "1436eae1-0899-4fc5-8bbe-575fa2c70d42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:19:51 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-cf7acb37-2278-496f-99f1-1684f5843fa5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Converting VIF {"id": "1436eae1-0899-4fc5-8bbe-575fa2c70d42", "address": "fa:16:3e:08:e7:36", "network": {"id": "369d2a6f-60b7-4c92-8b2d-1f3828f6698b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1491709218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1491709218-network", "vif_mac": "fa:16:3e:08:e7:36"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd281be4e94a4d31a47a13267d51d9b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1436eae1-08", "ovs_interfaceid": "1436eae1-0899-4fc5-8bbe-575fa2c70d42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:19:51 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-cf7acb37-2278-496f-99f1-1684f5843fa5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:e7:36,bridge_name='br-int',has_traffic_filtering=True,id=1436eae1-0899-4fc5-8bbe-575fa2c70d42,network=Network(369d2a6f-60b7-4c92-8b2d-1f3828f6698b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1436eae1-08') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:19:51 user nova-compute[95467]: DEBUG nova.objects.instance [None req-cf7acb37-2278-496f-99f1-1684f5843fa5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lazy-loading 'pci_devices' on Instance uuid b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:19:51 user nova-compute[95467]: DEBUG nova.objects.base [None req-cf7acb37-2278-496f-99f1-1684f5843fa5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Object Instance<b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=95467) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 08:19:51 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-cf7acb37-2278-496f-99f1-1684f5843fa5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:19:51 user nova-compute[95467]:   <uuid>b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67</uuid>
Nov 15 08:19:51 user nova-compute[95467]:   <name>instance-00000015</name>
Nov 15 08:19:51 user nova-compute[95467]:   <memory>524288</memory>
Nov 15 08:19:51 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:19:51 user nova-compute[95467]:   <metadata>
Nov 15 08:19:51 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:19:51 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:19:51 user nova-compute[95467]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-438049731</nova:name>
Nov 15 08:19:51 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:19:50</nova:creationTime>
Nov 15 08:19:51 user nova-compute[95467]:       <nova:flavor name="m1.tiny">
Nov 15 08:19:51 user nova-compute[95467]:         <nova:memory>512</nova:memory>
Nov 15 08:19:51 user nova-compute[95467]:         <nova:disk>1</nova:disk>
Nov 15 08:19:51 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:19:51 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:19:51 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:19:51 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:19:51 user nova-compute[95467]:       <nova:owner>
Nov 15 08:19:51 user nova-compute[95467]:         <nova:user uuid="c07f8dbc38004ecd973f61bba63606d4">tempest-ServerRescueNegativeTestJSON-1148442534-project-member</nova:user>
Nov 15 08:19:51 user nova-compute[95467]:         <nova:project uuid="bd281be4e94a4d31a47a13267d51d9b6">tempest-ServerRescueNegativeTestJSON-1148442534</nova:project>
Nov 15 08:19:51 user nova-compute[95467]:       </nova:owner>
Nov 15 08:19:51 user nova-compute[95467]:       <nova:root type="image" uuid="ed9c48aa-ce73-4b3b-9db1-235898be671b"/>
Nov 15 08:19:51 user nova-compute[95467]:       <nova:ports>
Nov 15 08:19:51 user nova-compute[95467]:         <nova:port uuid="1436eae1-0899-4fc5-8bbe-575fa2c70d42">
Nov 15 08:19:51 user nova-compute[95467]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 08:19:51 user nova-compute[95467]:         </nova:port>
Nov 15 08:19:51 user nova-compute[95467]:       </nova:ports>
Nov 15 08:19:51 user nova-compute[95467]:     </nova:instance>
Nov 15 08:19:51 user nova-compute[95467]:   </metadata>
Nov 15 08:19:51 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:19:51 user nova-compute[95467]:     <system>
Nov 15 08:19:51 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:19:51 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:19:51 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:19:51 user nova-compute[95467]:       <entry name="serial">b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67</entry>
Nov 15 08:19:51 user nova-compute[95467]:       <entry name="uuid">b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67</entry>
Nov 15 08:19:51 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:19:51 user nova-compute[95467]:     </system>
Nov 15 08:19:51 user nova-compute[95467]:   </sysinfo>
Nov 15 08:19:51 user nova-compute[95467]:   <os>
Nov 15 08:19:51 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:19:51 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:19:51 user nova-compute[95467]:   </os>
Nov 15 08:19:51 user nova-compute[95467]:   <features>
Nov 15 08:19:51 user nova-compute[95467]:     <acpi/>
Nov 15 08:19:51 user nova-compute[95467]:     <apic/>
Nov 15 08:19:51 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:19:51 user nova-compute[95467]:   </features>
Nov 15 08:19:51 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:19:51 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:19:51 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:19:51 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:19:51 user nova-compute[95467]:   </clock>
Nov 15 08:19:51 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:19:51 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:19:51 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:19:51 user nova-compute[95467]:   </cpu>
Nov 15 08:19:51 user nova-compute[95467]:   <devices>
Nov 15 08:19:51 user nova-compute[95467]:     <disk type="file" device="disk">
Nov 15 08:19:51 user nova-compute[95467]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 08:19:51 user nova-compute[95467]:       <source file="/opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk.rescue"/>
Nov 15 08:19:51 user nova-compute[95467]:       <target dev="vda" bus="virtio"/>
Nov 15 08:19:51 user nova-compute[95467]:     </disk>
Nov 15 08:19:51 user nova-compute[95467]:     <disk type="file" device="disk">
Nov 15 08:19:51 user nova-compute[95467]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 08:19:51 user nova-compute[95467]:       <source file="/opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk"/>
Nov 15 08:19:51 user nova-compute[95467]:       <target dev="vdb" bus="virtio"/>
Nov 15 08:19:51 user nova-compute[95467]:     </disk>
Nov 15 08:19:51 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:19:51 user nova-compute[95467]:       <mac address="fa:16:3e:08:e7:36"/>
Nov 15 08:19:51 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:19:51 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:19:51 user nova-compute[95467]:       <target dev="tap1436eae1-08"/>
Nov 15 08:19:51 user nova-compute[95467]:     </interface>
Nov 15 08:19:51 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:19:51 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/console.log" append="off"/>
Nov 15 08:19:51 user nova-compute[95467]:     </serial>
Nov 15 08:19:51 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:19:51 user nova-compute[95467]:     <video>
Nov 15 08:19:51 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:19:51 user nova-compute[95467]:     </video>
Nov 15 08:19:51 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:19:51 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:19:51 user nova-compute[95467]:     </rng>
Nov 15 08:19:51 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:19:51 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:19:51 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:19:51 user nova-compute[95467]:     </memballoon>
Nov 15 08:19:51 user nova-compute[95467]:   </devices>
Nov 15 08:19:51 user nova-compute[95467]: </domain>
Nov 15 08:19:51 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:19:51 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Instance destroyed successfully.
Nov 15 08:19:51 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-cf7acb37-2278-496f-99f1-1684f5843fa5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:19:51 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-cf7acb37-2278-496f-99f1-1684f5843fa5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] No BDM found with device name vdb, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:19:51 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-cf7acb37-2278-496f-99f1-1684f5843fa5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] No VIF found with MAC fa:16:3e:08:e7:36, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:19:51 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Updating instance_info_cache with network_info: [{"id": "1e52d31b-a56a-41e1-8a39-b79dacfe70b9", "address": "fa:16:3e:7f:8e:61", "network": {"id": "ac9a381d-25fe-4419-b151-f03333413813", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1183680999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34d65a8000347feb2b3966b7ce0d785", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e52d31b-a5", "ovs_interfaceid": "1e52d31b-a56a-41e1-8a39-b79dacfe70b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:19:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Releasing lock "refresh_cache-21cf2ada-b15c-490d-ac37-96e9c87e9056" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:19:51 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Updated the network info_cache for instance {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 08:19:51 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:19:51 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:19:51 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:19:51 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:19:51 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:19:52 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:52 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:52 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:52 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:52 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:52 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:52 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:52 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:53 user nova-compute[95467]: DEBUG nova.compute.manager [req-2c89d7f8-80af-4ff8-beee-4b45cc356dd7 req-d4c914de-4644-44a6-91f9-69755ce30bc3 service nova] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Received event network-vif-plugged-1436eae1-0899-4fc5-8bbe-575fa2c70d42 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:19:53 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-2c89d7f8-80af-4ff8-beee-4b45cc356dd7 req-d4c914de-4644-44a6-91f9-69755ce30bc3 service nova] Acquiring lock "b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:19:53 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-2c89d7f8-80af-4ff8-beee-4b45cc356dd7 req-d4c914de-4644-44a6-91f9-69755ce30bc3 service nova] Lock "b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:19:53 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-2c89d7f8-80af-4ff8-beee-4b45cc356dd7 req-d4c914de-4644-44a6-91f9-69755ce30bc3 service nova] Lock "b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:19:53 user nova-compute[95467]: DEBUG nova.compute.manager [req-2c89d7f8-80af-4ff8-beee-4b45cc356dd7 req-d4c914de-4644-44a6-91f9-69755ce30bc3 service nova] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] No waiting events found dispatching network-vif-plugged-1436eae1-0899-4fc5-8bbe-575fa2c70d42 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:19:53 user nova-compute[95467]: WARNING nova.compute.manager [req-2c89d7f8-80af-4ff8-beee-4b45cc356dd7 req-d4c914de-4644-44a6-91f9-69755ce30bc3 service nova] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Received unexpected event network-vif-plugged-1436eae1-0899-4fc5-8bbe-575fa2c70d42 for instance with vm_state active and task_state rescuing.
Nov 15 08:19:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:54 user nova-compute[95467]: DEBUG nova.compute.manager [None req-cf7acb37-2278-496f-99f1-1684f5843fa5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:19:55 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:55 user nova-compute[95467]: DEBUG nova.compute.manager [req-fb6304db-e71f-4b12-876e-e04007e75325 req-bbbe25da-372c-4ff9-94b1-c2f5fc5e1a2c service nova] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Received event network-vif-plugged-1436eae1-0899-4fc5-8bbe-575fa2c70d42 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:19:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-fb6304db-e71f-4b12-876e-e04007e75325 req-bbbe25da-372c-4ff9-94b1-c2f5fc5e1a2c service nova] Acquiring lock "b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:19:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-fb6304db-e71f-4b12-876e-e04007e75325 req-bbbe25da-372c-4ff9-94b1-c2f5fc5e1a2c service nova] Lock "b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:19:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-fb6304db-e71f-4b12-876e-e04007e75325 req-bbbe25da-372c-4ff9-94b1-c2f5fc5e1a2c service nova] Lock "b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:19:55 user nova-compute[95467]: DEBUG nova.compute.manager [req-fb6304db-e71f-4b12-876e-e04007e75325 req-bbbe25da-372c-4ff9-94b1-c2f5fc5e1a2c service nova] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] No waiting events found dispatching network-vif-plugged-1436eae1-0899-4fc5-8bbe-575fa2c70d42 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:19:55 user nova-compute[95467]: WARNING nova.compute.manager [req-fb6304db-e71f-4b12-876e-e04007e75325 req-bbbe25da-372c-4ff9-94b1-c2f5fc5e1a2c service nova] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Received unexpected event network-vif-plugged-1436eae1-0899-4fc5-8bbe-575fa2c70d42 for instance with vm_state rescued and task_state None.
Nov 15 08:19:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:19:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-c9b119dc-964c-41b0-a588-c56001f989f1 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Acquiring lock "bee31898-4f12-4c68-a18b-a678f9f584aa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:20:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-c9b119dc-964c-41b0-a588-c56001f989f1 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Lock "bee31898-4f12-4c68-a18b-a678f9f584aa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:20:01 user nova-compute[95467]: INFO nova.compute.manager [None req-c9b119dc-964c-41b0-a588-c56001f989f1 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Detaching volume 37d2cbbd-2252-4dbb-b8c7-f8e74995fb81
Nov 15 08:20:01 user nova-compute[95467]: INFO nova.virt.block_device [None req-c9b119dc-964c-41b0-a588-c56001f989f1 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Attempting to driver detach volume 37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 from mountpoint /dev/vdb
Nov 15 08:20:01 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-c9b119dc-964c-41b0-a588-c56001f989f1 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Attempting to detach device vdb from instance bee31898-4f12-4c68-a18b-a678f9f584aa from the persistent domain config. {{(pid=95467) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 08:20:01 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-c9b119dc-964c-41b0-a588-c56001f989f1 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 08:20:01 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:20:01 user nova-compute[95467]:   <source dev="/dev/sdf"/>
Nov 15 08:20:01 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:20:01 user nova-compute[95467]:   <serial>37d2cbbd-2252-4dbb-b8c7-f8e74995fb81</serial>
Nov 15 08:20:01 user nova-compute[95467]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 08:20:01 user nova-compute[95467]: </disk>
Nov 15 08:20:01 user nova-compute[95467]:  {{(pid=95467) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 08:20:01 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-c9b119dc-964c-41b0-a588-c56001f989f1 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Successfully detached device vdb from instance bee31898-4f12-4c68-a18b-a678f9f584aa from the persistent domain config.
Nov 15 08:20:01 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-c9b119dc-964c-41b0-a588-c56001f989f1 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bee31898-4f12-4c68-a18b-a678f9f584aa from the live domain config. {{(pid=95467) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 08:20:01 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-c9b119dc-964c-41b0-a588-c56001f989f1 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 08:20:01 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:20:01 user nova-compute[95467]:   <source dev="/dev/sdf"/>
Nov 15 08:20:01 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:20:01 user nova-compute[95467]:   <serial>37d2cbbd-2252-4dbb-b8c7-f8e74995fb81</serial>
Nov 15 08:20:01 user nova-compute[95467]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 08:20:01 user nova-compute[95467]: </disk>
Nov 15 08:20:01 user nova-compute[95467]:  {{(pid=95467) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 08:20:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:02 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-c9b119dc-964c-41b0-a588-c56001f989f1 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bee31898-4f12-4c68-a18b-a678f9f584aa {{(pid=95467) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 08:20:05 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:07 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:07 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Acquiring lock "6a551521-28cf-4b4e-94e8-5f5ecc0c37f7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:20:07 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Lock "6a551521-28cf-4b4e-94e8-5f5ecc0c37f7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:20:07 user nova-compute[95467]: DEBUG nova.compute.manager [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Starting instance... {{(pid=95467) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 08:20:07 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:20:07 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:20:07 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=95467) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 08:20:07 user nova-compute[95467]: INFO nova.compute.claims [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Claim successful on node user
Nov 15 08:20:08 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:20:08 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:20:08 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.437s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:20:08 user nova-compute[95467]: DEBUG nova.compute.manager [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Start building networks asynchronously for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 08:20:08 user nova-compute[95467]: DEBUG nova.compute.manager [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Allocating IP information in the background. {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 08:20:08 user nova-compute[95467]: DEBUG nova.network.neutron [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] allocate_for_instance() {{(pid=95467) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 08:20:08 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 08:20:08 user nova-compute[95467]: DEBUG nova.compute.manager [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Start building block device mappings for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 08:20:08 user nova-compute[95467]: DEBUG nova.policy [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '354af2d9fe0e4fa4be1d9b851773e8d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7182b78b65480eb2e51db102fd9c2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95467) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 08:20:08 user nova-compute[95467]: INFO nova.virt.block_device [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Booting with volume 965f0947-8c2b-4f39-a814-22493fb16775 at /dev/vda
Nov 15 08:20:08 user nova-compute[95467]: DEBUG os_brick.utils [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:20:08 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:08 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:08 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[7826d800-1099-4335-bbeb-6c900e08c14f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:882ae90641f\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:20:08 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:08 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:08 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[39350467-8233-4e9f-b960-6a84fd54ba6e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:20:08 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:08 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:08 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c011156-02b9-4157-bb74-772d33629059]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:20:08 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[06210e52-a4a4-491f-b6ad-12b6feac29b6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:20:08 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Running cmd (subprocess): nvme version {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:08 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] 'nvme version' failed. Not Retrying. {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:20:08 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.nvmeof [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] nvme not present on system {{(pid=95467) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 08:20:08 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:08 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:20:08 user nova-compute[95467]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 08:20:08 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[4865961c-f4f0-4fe9-b970-b49241f026f0]: (4, '') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:20:08 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=95467) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 08:20:08 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 08:20:08 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] LIGHTOS: no hostnqn found. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 08:20:08 user nova-compute[95467]: DEBUG os_brick.utils [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:882ae90641f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:20:08 user nova-compute[95467]: DEBUG nova.virt.block_device [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Updating existing volume attachment record: 8ce7cfab-9d50-4b0a-b12e-221eeb4d26e8 {{(pid=95467) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 08:20:09 user nova-compute[95467]: DEBUG nova.network.neutron [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Successfully created port: 93a4c2ed-b2a8-471c-8173-d221f7251e8b {{(pid=95467) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 08:20:10 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Acquiring lock "0edcb81b-d8fe-482c-a7ca-6b76455cfe33" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:20:10 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "0edcb81b-d8fe-482c-a7ca-6b76455cfe33" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:20:10 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:10 user nova-compute[95467]: DEBUG nova.compute.manager [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] Starting instance... {{(pid=95467) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 08:20:10 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:20:10 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:20:10 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=95467) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 08:20:10 user nova-compute[95467]: INFO nova.compute.claims [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] Claim successful on node user
Nov 15 08:20:10 user nova-compute[95467]: DEBUG nova.network.neutron [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Successfully updated port: 93a4c2ed-b2a8-471c-8173-d221f7251e8b {{(pid=95467) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 08:20:10 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Acquiring lock "refresh_cache-6a551521-28cf-4b4e-94e8-5f5ecc0c37f7" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:20:10 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Acquired lock "refresh_cache-6a551521-28cf-4b4e-94e8-5f5ecc0c37f7" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:20:10 user nova-compute[95467]: DEBUG nova.network.neutron [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:20:10 user nova-compute[95467]: DEBUG nova.compute.manager [req-dfff7e86-346f-47f8-8692-a328cce97706 req-b67efb40-b67e-4dd1-a073-f61134662f46 service nova] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Received event network-changed-93a4c2ed-b2a8-471c-8173-d221f7251e8b {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:20:10 user nova-compute[95467]: DEBUG nova.compute.manager [req-dfff7e86-346f-47f8-8692-a328cce97706 req-b67efb40-b67e-4dd1-a073-f61134662f46 service nova] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Refreshing instance network info cache due to event network-changed-93a4c2ed-b2a8-471c-8173-d221f7251e8b. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:20:10 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-dfff7e86-346f-47f8-8692-a328cce97706 req-b67efb40-b67e-4dd1-a073-f61134662f46 service nova] Acquiring lock "refresh_cache-6a551521-28cf-4b4e-94e8-5f5ecc0c37f7" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:20:10 user nova-compute[95467]: DEBUG nova.network.neutron [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Instance cache missing network info. {{(pid=95467) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 08:20:10 user nova-compute[95467]: DEBUG nova.network.neutron [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Updating instance_info_cache with network_info: [{"id": "93a4c2ed-b2a8-471c-8173-d221f7251e8b", "address": "fa:16:3e:9b:81:50", "network": {"id": "44a920f2-9a44-480e-bbd4-82afd3303a7f", "bridge": "br-int", "label": "tempest-TestShelveInstance-57422602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7182b78b65480eb2e51db102fd9c2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93a4c2ed-b2", "ovs_interfaceid": "93a4c2ed-b2a8-471c-8173-d221f7251e8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:20:10 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Releasing lock "refresh_cache-6a551521-28cf-4b4e-94e8-5f5ecc0c37f7" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:20:10 user nova-compute[95467]: DEBUG nova.compute.manager [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Instance network_info: |[{"id": "93a4c2ed-b2a8-471c-8173-d221f7251e8b", "address": "fa:16:3e:9b:81:50", "network": {"id": "44a920f2-9a44-480e-bbd4-82afd3303a7f", "bridge": "br-int", "label": "tempest-TestShelveInstance-57422602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7182b78b65480eb2e51db102fd9c2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93a4c2ed-b2", "ovs_interfaceid": "93a4c2ed-b2a8-471c-8173-d221f7251e8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 08:20:10 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-dfff7e86-346f-47f8-8692-a328cce97706 req-b67efb40-b67e-4dd1-a073-f61134662f46 service nova] Acquired lock "refresh_cache-6a551521-28cf-4b4e-94e8-5f5ecc0c37f7" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:20:10 user nova-compute[95467]: DEBUG nova.network.neutron [req-dfff7e86-346f-47f8-8692-a328cce97706 req-b67efb40-b67e-4dd1-a073-f61134662f46 service nova] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Refreshing network info cache for port 93a4c2ed-b2a8-471c-8173-d221f7251e8b {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:20:10 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:20:10 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:20:10 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.516s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:20:10 user nova-compute[95467]: DEBUG nova.compute.manager [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] Start building networks asynchronously for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 08:20:10 user nova-compute[95467]: DEBUG nova.compute.manager [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] Allocating IP information in the background. {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 08:20:10 user nova-compute[95467]: DEBUG nova.network.neutron [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] allocate_for_instance() {{(pid=95467) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 08:20:10 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 08:20:10 user nova-compute[95467]: DEBUG nova.compute.manager [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] Start building block device mappings for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 08:20:10 user nova-compute[95467]: DEBUG nova.policy [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'acce273b07b64e44af6e062175afa92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e2fec6a90a41a5a586c6da227caacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95467) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 08:20:10 user nova-compute[95467]: DEBUG nova.compute.manager [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] Start spawning the instance on the hypervisor. {{(pid=95467) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 08:20:10 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] Creating instance directory {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 08:20:10 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] Creating image(s)
Nov 15 08:20:10 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Acquiring lock "/opt/stack/data/nova/instances/0edcb81b-d8fe-482c-a7ca-6b76455cfe33/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:20:10 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "/opt/stack/data/nova/instances/0edcb81b-d8fe-482c-a7ca-6b76455cfe33/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:20:10 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "/opt/stack/data/nova/instances/0edcb81b-d8fe-482c-a7ca-6b76455cfe33/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:20:10 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.194s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:11 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Acquiring lock "a3fcf60225fcefd310404971cd18ab9851c548dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:20:11 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:20:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:11 user nova-compute[95467]: DEBUG nova.network.neutron [req-dfff7e86-346f-47f8-8692-a328cce97706 req-b67efb40-b67e-4dd1-a073-f61134662f46 service nova] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Updated VIF entry in instance network info cache for port 93a4c2ed-b2a8-471c-8173-d221f7251e8b. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:20:11 user nova-compute[95467]: DEBUG nova.network.neutron [req-dfff7e86-346f-47f8-8692-a328cce97706 req-b67efb40-b67e-4dd1-a073-f61134662f46 service nova] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Updating instance_info_cache with network_info: [{"id": "93a4c2ed-b2a8-471c-8173-d221f7251e8b", "address": "fa:16:3e:9b:81:50", "network": {"id": "44a920f2-9a44-480e-bbd4-82afd3303a7f", "bridge": "br-int", "label": "tempest-TestShelveInstance-57422602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7182b78b65480eb2e51db102fd9c2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93a4c2ed-b2", "ovs_interfaceid": "93a4c2ed-b2a8-471c-8173-d221f7251e8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:20:11 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-dfff7e86-346f-47f8-8692-a328cce97706 req-b67efb40-b67e-4dd1-a073-f61134662f46 service nova] Releasing lock "refresh_cache-6a551521-28cf-4b4e-94e8-5f5ecc0c37f7" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:20:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.191s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/0edcb81b-d8fe-482c-a7ca-6b76455cfe33/disk 1073741824 {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/0edcb81b-d8fe-482c-a7ca-6b76455cfe33/disk 1073741824" returned: 0 in 0.054s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:11 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:20:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:11 user nova-compute[95467]: DEBUG nova.network.neutron [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] Successfully created port: 0469b401-fc62-46e8-bdd0-b00f131d4821 {{(pid=95467) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 08:20:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.195s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:11 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0edcb81b-d8fe-482c-a7ca-6b76455cfe33/disk. size=1073741824 {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 08:20:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0edcb81b-d8fe-482c-a7ca-6b76455cfe33/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0edcb81b-d8fe-482c-a7ca-6b76455cfe33/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:11 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Cannot resize image /opt/stack/data/nova/instances/0edcb81b-d8fe-482c-a7ca-6b76455cfe33/disk to a smaller size. {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 08:20:11 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] Created local disks {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 08:20:11 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] Ensure instance console log exists: /opt/stack/data/nova/instances/0edcb81b-d8fe-482c-a7ca-6b76455cfe33/console.log {{(pid=95467) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 08:20:11 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:20:11 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:20:11 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:20:12 user nova-compute[95467]: DEBUG nova.network.neutron [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] Successfully updated port: 0469b401-fc62-46e8-bdd0-b00f131d4821 {{(pid=95467) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 08:20:12 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Acquiring lock "refresh_cache-0edcb81b-d8fe-482c-a7ca-6b76455cfe33" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:20:12 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Acquired lock "refresh_cache-0edcb81b-d8fe-482c-a7ca-6b76455cfe33" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:20:12 user nova-compute[95467]: DEBUG nova.network.neutron [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:20:12 user nova-compute[95467]: DEBUG nova.compute.manager [req-ec70221b-5e40-405e-aeb3-0a5a77659607 req-fc2e8609-266f-41a4-a2a0-c35e2f2e0eca service nova] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] Received event network-changed-0469b401-fc62-46e8-bdd0-b00f131d4821 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:20:12 user nova-compute[95467]: DEBUG nova.compute.manager [req-ec70221b-5e40-405e-aeb3-0a5a77659607 req-fc2e8609-266f-41a4-a2a0-c35e2f2e0eca service nova] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] Refreshing instance network info cache due to event network-changed-0469b401-fc62-46e8-bdd0-b00f131d4821. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:20:12 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ec70221b-5e40-405e-aeb3-0a5a77659607 req-fc2e8609-266f-41a4-a2a0-c35e2f2e0eca service nova] Acquiring lock "refresh_cache-0edcb81b-d8fe-482c-a7ca-6b76455cfe33" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:20:12 user nova-compute[95467]: DEBUG nova.network.neutron [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] Instance cache missing network info. {{(pid=95467) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 08:20:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:12 user nova-compute[95467]: DEBUG nova.network.neutron [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] Updating instance_info_cache with network_info: [{"id": "0469b401-fc62-46e8-bdd0-b00f131d4821", "address": "fa:16:3e:7d:e4:86", "network": {"id": "27fd2b0f-65bd-4ae4-b5c8-dfca91668078", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1310727750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50e2fec6a90a41a5a586c6da227caacc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0469b401-fc", "ovs_interfaceid": "0469b401-fc62-46e8-bdd0-b00f131d4821", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:20:12 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Releasing lock "refresh_cache-0edcb81b-d8fe-482c-a7ca-6b76455cfe33" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:20:12 user nova-compute[95467]: DEBUG nova.compute.manager [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] Instance network_info: |[{"id": "0469b401-fc62-46e8-bdd0-b00f131d4821", "address": "fa:16:3e:7d:e4:86", "network": {"id": "27fd2b0f-65bd-4ae4-b5c8-dfca91668078", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1310727750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50e2fec6a90a41a5a586c6da227caacc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0469b401-fc", "ovs_interfaceid": "0469b401-fc62-46e8-bdd0-b00f131d4821", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 08:20:12 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ec70221b-5e40-405e-aeb3-0a5a77659607 req-fc2e8609-266f-41a4-a2a0-c35e2f2e0eca service nova] Acquired lock "refresh_cache-0edcb81b-d8fe-482c-a7ca-6b76455cfe33" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:20:12 user nova-compute[95467]: DEBUG nova.network.neutron [req-ec70221b-5e40-405e-aeb3-0a5a77659607 req-fc2e8609-266f-41a4-a2a0-c35e2f2e0eca service nova] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] Refreshing network info cache for port 0469b401-fc62-46e8-bdd0-b00f131d4821 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:20:12 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] Start _get_guest_xml network_info=[{"id": "0469b401-fc62-46e8-bdd0-b00f131d4821", "address": "fa:16:3e:7d:e4:86", "network": {"id": "27fd2b0f-65bd-4ae4-b5c8-dfca91668078", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1310727750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50e2fec6a90a41a5a586c6da227caacc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0469b401-fc", "ovs_interfaceid": "0469b401-fc62-46e8-bdd0-b00f131d4821", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'ed9c48aa-ce73-4b3b-9db1-235898be671b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:20:12 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:20:12 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:20:12 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:20:12 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:20:12 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:20:12 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:20:12 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:20:12 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:20:12 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:20:12 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:20:12 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:20:12 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:20:12 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:20:12 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:20:12 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:20:12 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:20:12 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:20:12 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:20:12 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:20:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1162489474',display_name='tempest-AttachVolumeNegativeTest-server-1162489474',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1162489474',id=34,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIv7hodxe5fWEgdAzwMU7vQn9xo8GZj3pJDEddbIIa2NzBqjcwsD2M3KQemXfSW+TDNkp8Mb76eCGpMtGW5a0/2F3/tNNgjp8zYjkURclJix9zn6R08z8YJPwue6BGgOxw==',key_name='tempest-keypair-1313226940',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50e2fec6a90a41a5a586c6da227caacc',ramdisk_id='',reservation_id='r-91hnjbo8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1750086293',owner_user_name='tempest-AttachVolumeNegativeTest-1750086293-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:20:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='acce273b07b64e44af6e062175afa92d',uuid=0edcb81b-d8fe-482c-a7ca-6b76455cfe33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0469b401-fc62-46e8-bdd0-b00f131d4821", "address": "fa:16:3e:7d:e4:86", "network": {"id": "27fd2b0f-65bd-4ae4-b5c8-dfca91668078", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1310727750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50e2fec6a90a41a5a586c6da227caacc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0469b401-fc", "ovs_interfaceid": "0469b401-fc62-46e8-bdd0-b00f131d4821", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:20:12 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Converting VIF {"id": "0469b401-fc62-46e8-bdd0-b00f131d4821", "address": "fa:16:3e:7d:e4:86", "network": {"id": "27fd2b0f-65bd-4ae4-b5c8-dfca91668078", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1310727750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50e2fec6a90a41a5a586c6da227caacc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0469b401-fc", "ovs_interfaceid": "0469b401-fc62-46e8-bdd0-b00f131d4821", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:20:12 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:e4:86,bridge_name='br-int',has_traffic_filtering=True,id=0469b401-fc62-46e8-bdd0-b00f131d4821,network=Network(27fd2b0f-65bd-4ae4-b5c8-dfca91668078),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0469b401-fc') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:20:12 user nova-compute[95467]: DEBUG nova.objects.instance [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lazy-loading 'pci_devices' on Instance uuid 0edcb81b-d8fe-482c-a7ca-6b76455cfe33 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:20:12 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:20:12 user nova-compute[95467]:   <uuid>0edcb81b-d8fe-482c-a7ca-6b76455cfe33</uuid>
Nov 15 08:20:12 user nova-compute[95467]:   <name>instance-00000022</name>
Nov 15 08:20:12 user nova-compute[95467]:   <memory>524288</memory>
Nov 15 08:20:12 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:20:12 user nova-compute[95467]:   <metadata>
Nov 15 08:20:12 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:20:12 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:20:12 user nova-compute[95467]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1162489474</nova:name>
Nov 15 08:20:12 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:20:12</nova:creationTime>
Nov 15 08:20:12 user nova-compute[95467]:       <nova:flavor name="m1.tiny">
Nov 15 08:20:12 user nova-compute[95467]:         <nova:memory>512</nova:memory>
Nov 15 08:20:12 user nova-compute[95467]:         <nova:disk>1</nova:disk>
Nov 15 08:20:12 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:20:12 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:20:12 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:20:12 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:20:12 user nova-compute[95467]:       <nova:owner>
Nov 15 08:20:12 user nova-compute[95467]:         <nova:user uuid="acce273b07b64e44af6e062175afa92d">tempest-AttachVolumeNegativeTest-1750086293-project-member</nova:user>
Nov 15 08:20:12 user nova-compute[95467]:         <nova:project uuid="50e2fec6a90a41a5a586c6da227caacc">tempest-AttachVolumeNegativeTest-1750086293</nova:project>
Nov 15 08:20:12 user nova-compute[95467]:       </nova:owner>
Nov 15 08:20:12 user nova-compute[95467]:       <nova:root type="image" uuid="ed9c48aa-ce73-4b3b-9db1-235898be671b"/>
Nov 15 08:20:12 user nova-compute[95467]:       <nova:ports>
Nov 15 08:20:12 user nova-compute[95467]:         <nova:port uuid="0469b401-fc62-46e8-bdd0-b00f131d4821">
Nov 15 08:20:12 user nova-compute[95467]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 08:20:12 user nova-compute[95467]:         </nova:port>
Nov 15 08:20:12 user nova-compute[95467]:       </nova:ports>
Nov 15 08:20:12 user nova-compute[95467]:     </nova:instance>
Nov 15 08:20:12 user nova-compute[95467]:   </metadata>
Nov 15 08:20:12 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:20:12 user nova-compute[95467]:     <system>
Nov 15 08:20:12 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:20:12 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:20:12 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:20:12 user nova-compute[95467]:       <entry name="serial">0edcb81b-d8fe-482c-a7ca-6b76455cfe33</entry>
Nov 15 08:20:12 user nova-compute[95467]:       <entry name="uuid">0edcb81b-d8fe-482c-a7ca-6b76455cfe33</entry>
Nov 15 08:20:12 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:20:12 user nova-compute[95467]:     </system>
Nov 15 08:20:12 user nova-compute[95467]:   </sysinfo>
Nov 15 08:20:12 user nova-compute[95467]:   <os>
Nov 15 08:20:12 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:20:12 user nova-compute[95467]:     <boot dev="hd"/>
Nov 15 08:20:12 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:20:12 user nova-compute[95467]:   </os>
Nov 15 08:20:12 user nova-compute[95467]:   <features>
Nov 15 08:20:12 user nova-compute[95467]:     <acpi/>
Nov 15 08:20:12 user nova-compute[95467]:     <apic/>
Nov 15 08:20:12 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:20:12 user nova-compute[95467]:   </features>
Nov 15 08:20:12 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:20:12 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:20:12 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:20:12 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:20:12 user nova-compute[95467]:   </clock>
Nov 15 08:20:12 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:20:12 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:20:12 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:20:12 user nova-compute[95467]:   </cpu>
Nov 15 08:20:12 user nova-compute[95467]:   <devices>
Nov 15 08:20:12 user nova-compute[95467]:     <disk type="file" device="disk">
Nov 15 08:20:12 user nova-compute[95467]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 08:20:12 user nova-compute[95467]:       <source file="/opt/stack/data/nova/instances/0edcb81b-d8fe-482c-a7ca-6b76455cfe33/disk"/>
Nov 15 08:20:12 user nova-compute[95467]:       <target dev="vda" bus="virtio"/>
Nov 15 08:20:12 user nova-compute[95467]:     </disk>
Nov 15 08:20:12 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:20:12 user nova-compute[95467]:       <mac address="fa:16:3e:7d:e4:86"/>
Nov 15 08:20:12 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:20:12 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:20:12 user nova-compute[95467]:       <target dev="tap0469b401-fc"/>
Nov 15 08:20:12 user nova-compute[95467]:     </interface>
Nov 15 08:20:12 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:20:12 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/0edcb81b-d8fe-482c-a7ca-6b76455cfe33/console.log" append="off"/>
Nov 15 08:20:12 user nova-compute[95467]:     </serial>
Nov 15 08:20:12 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:20:12 user nova-compute[95467]:     <video>
Nov 15 08:20:12 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:20:12 user nova-compute[95467]:     </video>
Nov 15 08:20:12 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:20:12 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:20:12 user nova-compute[95467]:     </rng>
Nov 15 08:20:12 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:20:12 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:20:12 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:20:12 user nova-compute[95467]:     </memballoon>
Nov 15 08:20:12 user nova-compute[95467]:   </devices>
Nov 15 08:20:12 user nova-compute[95467]: </domain>
Nov 15 08:20:12 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:20:12 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:20:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1162489474',display_name='tempest-AttachVolumeNegativeTest-server-1162489474',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1162489474',id=34,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIv7hodxe5fWEgdAzwMU7vQn9xo8GZj3pJDEddbIIa2NzBqjcwsD2M3KQemXfSW+TDNkp8Mb76eCGpMtGW5a0/2F3/tNNgjp8zYjkURclJix9zn6R08z8YJPwue6BGgOxw==',key_name='tempest-keypair-1313226940',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50e2fec6a90a41a5a586c6da227caacc',ramdisk_id='',reservation_id='r-91hnjbo8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1750086293',owner_user_name='tempest-AttachVolumeNegativeTest-1750086293-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:20:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='acce273b07b64e44af6e062175afa92d',uuid=0edcb81b-d8fe-482c-a7ca-6b76455cfe33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0469b401-fc62-46e8-bdd0-b00f131d4821", "address": "fa:16:3e:7d:e4:86", "network": {"id": "27fd2b0f-65bd-4ae4-b5c8-dfca91668078", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1310727750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50e2fec6a90a41a5a586c6da227caacc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0469b401-fc", "ovs_interfaceid": "0469b401-fc62-46e8-bdd0-b00f131d4821", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:20:12 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Converting VIF {"id": "0469b401-fc62-46e8-bdd0-b00f131d4821", "address": "fa:16:3e:7d:e4:86", "network": {"id": "27fd2b0f-65bd-4ae4-b5c8-dfca91668078", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1310727750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50e2fec6a90a41a5a586c6da227caacc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0469b401-fc", "ovs_interfaceid": "0469b401-fc62-46e8-bdd0-b00f131d4821", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:20:12 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:e4:86,bridge_name='br-int',has_traffic_filtering=True,id=0469b401-fc62-46e8-bdd0-b00f131d4821,network=Network(27fd2b0f-65bd-4ae4-b5c8-dfca91668078),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0469b401-fc') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:20:12 user nova-compute[95467]: DEBUG os_vif [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:e4:86,bridge_name='br-int',has_traffic_filtering=True,id=0469b401-fc62-46e8-bdd0-b00f131d4821,network=Network(27fd2b0f-65bd-4ae4-b5c8-dfca91668078),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0469b401-fc') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:20:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:20:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:20:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b268d92b-652f-5d89-8bd4-f33b0e4002ff', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:20:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:20:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0469b401-fc, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:20:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0469b401-fc, col_values=(('qos', UUID('57b0e9bd-eaf0-41be-9f70-1b5a5ea06f5c')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:20:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0469b401-fc, col_values=(('external_ids', {'iface-id': '0469b401-fc62-46e8-bdd0-b00f131d4821', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:e4:86', 'vm-uuid': '0edcb81b-d8fe-482c-a7ca-6b76455cfe33'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:20:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:20:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:12 user nova-compute[95467]: INFO os_vif [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:e4:86,bridge_name='br-int',has_traffic_filtering=True,id=0469b401-fc62-46e8-bdd0-b00f131d4821,network=Network(27fd2b0f-65bd-4ae4-b5c8-dfca91668078),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0469b401-fc')
Nov 15 08:20:12 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:20:12 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] No VIF found with MAC fa:16:3e:7d:e4:86, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:20:13 user nova-compute[95467]: DEBUG nova.network.neutron [req-ec70221b-5e40-405e-aeb3-0a5a77659607 req-fc2e8609-266f-41a4-a2a0-c35e2f2e0eca service nova] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] Updated VIF entry in instance network info cache for port 0469b401-fc62-46e8-bdd0-b00f131d4821. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:20:13 user nova-compute[95467]: DEBUG nova.network.neutron [req-ec70221b-5e40-405e-aeb3-0a5a77659607 req-fc2e8609-266f-41a4-a2a0-c35e2f2e0eca service nova] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] Updating instance_info_cache with network_info: [{"id": "0469b401-fc62-46e8-bdd0-b00f131d4821", "address": "fa:16:3e:7d:e4:86", "network": {"id": "27fd2b0f-65bd-4ae4-b5c8-dfca91668078", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1310727750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50e2fec6a90a41a5a586c6da227caacc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0469b401-fc", "ovs_interfaceid": "0469b401-fc62-46e8-bdd0-b00f131d4821", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:20:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ec70221b-5e40-405e-aeb3-0a5a77659607 req-fc2e8609-266f-41a4-a2a0-c35e2f2e0eca service nova] Releasing lock "refresh_cache-0edcb81b-d8fe-482c-a7ca-6b76455cfe33" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:20:13 user nova-compute[95467]: DEBUG nova.compute.manager [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Start spawning the instance on the hypervisor. {{(pid=95467) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 08:20:13 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Creating instance directory {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 08:20:13 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Creating image(s)
Nov 15 08:20:13 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Did not create local disks {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 08:20:13 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Ensure instance console log exists: /opt/stack/data/nova/instances/6a551521-28cf-4b4e-94e8-5f5ecc0c37f7/console.log {{(pid=95467) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 08:20:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:20:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:20:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:20:13 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Start _get_guest_xml network_info=[{"id": "93a4c2ed-b2a8-471c-8173-d221f7251e8b", "address": "fa:16:3e:9b:81:50", "network": {"id": "44a920f2-9a44-480e-bbd4-82afd3303a7f", "bridge": "br-int", "label": "tempest-TestShelveInstance-57422602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7182b78b65480eb2e51db102fd9c2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93a4c2ed-b2", "ovs_interfaceid": "93a4c2ed-b2a8-471c-8173-d221f7251e8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '8ce7cfab-9d50-4b0a-b12e-221eeb4d26e8', 'delete_on_termination': True, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yDMrVtcn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6a551521-28cf-4b4e-94e8-5f5ecc0c37f7', 'attached_at': '', 'detached_at': '', 'volume_id': '965f0947-8c2b-4f39-a814-22493fb16775', 'serial': '965f0947-8c2b-4f39-a814-22493fb16775'}, 'volume_type': None} {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:20:13 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:20:13 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:20:13 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:20:13 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:20:13 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:20:13 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:20:13 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:20:13 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:20:13 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:20:13 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:20:13 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:20:13 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:20:13 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:20:13 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:20:13 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:20:13 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:20:13 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:20:13 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:20:13 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Calling os-brick to attach iSCSI Volume {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 08:20:13 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yDMrVtcn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:20:13 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:20:13 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:20:13 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:20:13 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:20:13 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:20:13 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:20:13 user nova-compute[95467]: INFO os_brick.initiator.connectors.iscsi [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 08:20:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 -p 172.16.0.220:3260 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:13 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f70941-7f7b-4c5b-851d-b00409d798ad]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:20:13 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 08:20:13 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:20:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 -p 172.16.0.220:3260 --interface default --op new {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:13 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[7740085c-c288-430d-a5a8-b1b79b8632a6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775] added\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:20:13 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775] added
Nov 15 08:20:13 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:20:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:13 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc5301bc-4488-4a6e-affb-98142c97cb38]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:20:13 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:20:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:13 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4f32e9-8ee4-42cb-bbe7-196fc876b6bb]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:20:13 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:20:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yDMrVtcn {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yDMrVtcn" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:13 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74c904b-8efb-429b-953f-e15f9f78f92e]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:20:13 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yDMrVtcn'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:20:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:13 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac8cf203-44dc-40da-aeda-d2fbc4c53441]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:20:13 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:20:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:13 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70f7872-f693-4124-9d01-acbea568a904]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:20:13 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:20:13 user nova-compute[95467]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)
Nov 15 08:20:13 user nova-compute[95467]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 (non-flash)
Nov 15 08:20:13 user nova-compute[95467]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b (non-flash)
Nov 15 08:20:13 user nova-compute[95467]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7 (non-flash)
Nov 15 08:20:13 user nova-compute[95467]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612 (non-flash)
Nov 15 08:20:13 user nova-compute[95467]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551 (non-flash)
Nov 15 08:20:13 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:20:13 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:20:13 user nova-compute[95467]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)
Nov 15 08:20:13 user nova-compute[95467]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 (non-flash)
Nov 15 08:20:13 user nova-compute[95467]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b (non-flash)
Nov 15 08:20:13 user nova-compute[95467]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7 (non-flash)
Nov 15 08:20:13 user nova-compute[95467]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612 (non-flash)
Nov 15 08:20:13 user nova-compute[95467]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551 (non-flash)
Nov 15 08:20:13 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:20:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 -p 172.16.0.220:3260 --login {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:14 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:14 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[454fce1a-edd8-490b-8fa9-7972d25aa87b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:20:14 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775, portal: 172.16.0.220,3260]
Nov 15 08:20:14 user nova-compute[95467]: Login to [iface: default, target: iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775, portal: 172.16.0.220,3260] successful.
Nov 15 08:20:14 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:20:14 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:14 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:14 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8d412f-5bed-48ff-a746-0845d68a1507]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:20:14 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:20:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:14 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:14 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:14 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[cddc701d-2d9a-4450-a622-faf32b7ac576]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:20:14 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:20:14 user nova-compute[95467]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)
Nov 15 08:20:14 user nova-compute[95467]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 (non-flash)
Nov 15 08:20:14 user nova-compute[95467]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b (non-flash)
Nov 15 08:20:14 user nova-compute[95467]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7 (non-flash)
Nov 15 08:20:14 user nova-compute[95467]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612 (non-flash)
Nov 15 08:20:14 user nova-compute[95467]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551 (non-flash)
Nov 15 08:20:14 user nova-compute[95467]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:20:14 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:20:14 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:20:14 user nova-compute[95467]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)
Nov 15 08:20:14 user nova-compute[95467]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 (non-flash)
Nov 15 08:20:14 user nova-compute[95467]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b (non-flash)
Nov 15 08:20:14 user nova-compute[95467]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7 (non-flash)
Nov 15 08:20:14 user nova-compute[95467]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612 (non-flash)
Nov 15 08:20:14 user nova-compute[95467]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551 (non-flash)
Nov 15 08:20:14 user nova-compute[95467]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:20:14 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:20:14 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:20:14 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Connected to 172.16.0.220:3260 {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 08:20:14 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] HCTL ('40', '-', '-', 0) found on session 31 with lun 0 {{(pid=95467) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 08:20:14 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=95467) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 08:20:14 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:14 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:14 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[2685188c-ee1c-48ee-a851-9976fa37408a]: (4, ('- - 0', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:20:14 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Searching for a device in session 31 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:20:14 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yDMrVtcn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 08:20:14 user nova-compute[95467]: DEBUG nova.compute.manager [req-aa0498cf-ae13-4c3c-8b1c-bfc5979263c1 req-29edb166-2b59-4650-8ede-31aaddc322ef service nova] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] Received event network-vif-plugged-0469b401-fc62-46e8-bdd0-b00f131d4821 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:20:14 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-aa0498cf-ae13-4c3c-8b1c-bfc5979263c1 req-29edb166-2b59-4650-8ede-31aaddc322ef service nova] Acquiring lock "0edcb81b-d8fe-482c-a7ca-6b76455cfe33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:20:14 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-aa0498cf-ae13-4c3c-8b1c-bfc5979263c1 req-29edb166-2b59-4650-8ede-31aaddc322ef service nova] Lock "0edcb81b-d8fe-482c-a7ca-6b76455cfe33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:20:14 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-aa0498cf-ae13-4c3c-8b1c-bfc5979263c1 req-29edb166-2b59-4650-8ede-31aaddc322ef service nova] Lock "0edcb81b-d8fe-482c-a7ca-6b76455cfe33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:20:14 user nova-compute[95467]: DEBUG nova.compute.manager [req-aa0498cf-ae13-4c3c-8b1c-bfc5979263c1 req-29edb166-2b59-4650-8ede-31aaddc322ef service nova] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] No waiting events found dispatching network-vif-plugged-0469b401-fc62-46e8-bdd0-b00f131d4821 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:20:14 user nova-compute[95467]: WARNING nova.compute.manager [req-aa0498cf-ae13-4c3c-8b1c-bfc5979263c1 req-29edb166-2b59-4650-8ede-31aaddc322ef service nova] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] Received unexpected event network-vif-plugged-0469b401-fc62-46e8-bdd0-b00f131d4821 for instance with vm_state building and task_state spawning.
Nov 15 08:20:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:15 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.390s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:20:15 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] <== connect_volume: return (1391ms) {'type': 'block', 'scsi_wwn': '26636653166656534', 'path': '/dev/sdi'} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:20:15 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636653166656534', 'path': '/dev/sdi'} {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 08:20:15 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:20:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-177934737',display_name='tempest-TestShelveInstance-server-177934737',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-177934737',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJC4LZpX54Ka4CeYP7mgSTaMm2Q0taurdpd9b7can1Ul1AsTpY2sRQ536DDEYxtxG0i1vSLR8KRvCVHbBH9pBlB10+jQxss4INx8+NUQcLORFtrp/d3ty3KPezfHsZOFw==',key_name='tempest-TestShelveInstance-347903963',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd7182b78b65480eb2e51db102fd9c2d',ramdisk_id='',reservation_id='r-8qvr6rl5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-668674769',owner_user_name='tempest-TestShelveInstance-668674769-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:20:08Z,user_data=None,user_id='354af2d9fe0e4fa4be1d9b851773e8d9',uuid=6a551521-28cf-4b4e-94e8-5f5ecc0c37f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93a4c2ed-b2a8-471c-8173-d221f7251e8b", "address": "fa:16:3e:9b:81:50", "network": {"id": "44a920f2-9a44-480e-bbd4-82afd3303a7f", "bridge": "br-int", "label": "tempest-TestShelveInstance-57422602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7182b78b65480eb2e51db102fd9c2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93a4c2ed-b2", "ovs_interfaceid": "93a4c2ed-b2a8-471c-8173-d221f7251e8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:20:15 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Converting VIF {"id": "93a4c2ed-b2a8-471c-8173-d221f7251e8b", "address": "fa:16:3e:9b:81:50", "network": {"id": "44a920f2-9a44-480e-bbd4-82afd3303a7f", "bridge": "br-int", "label": "tempest-TestShelveInstance-57422602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7182b78b65480eb2e51db102fd9c2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93a4c2ed-b2", "ovs_interfaceid": "93a4c2ed-b2a8-471c-8173-d221f7251e8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:20:15 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:81:50,bridge_name='br-int',has_traffic_filtering=True,id=93a4c2ed-b2a8-471c-8173-d221f7251e8b,network=Network(44a920f2-9a44-480e-bbd4-82afd3303a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93a4c2ed-b2') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:20:15 user nova-compute[95467]: DEBUG nova.objects.instance [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Lazy-loading 'pci_devices' on Instance uuid 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:20:15 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:20:15 user nova-compute[95467]:   <uuid>6a551521-28cf-4b4e-94e8-5f5ecc0c37f7</uuid>
Nov 15 08:20:15 user nova-compute[95467]:   <name>instance-00000021</name>
Nov 15 08:20:15 user nova-compute[95467]:   <memory>524288</memory>
Nov 15 08:20:15 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:20:15 user nova-compute[95467]:   <metadata>
Nov 15 08:20:15 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:20:15 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:20:15 user nova-compute[95467]:       <nova:name>tempest-TestShelveInstance-server-177934737</nova:name>
Nov 15 08:20:15 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:20:13</nova:creationTime>
Nov 15 08:20:15 user nova-compute[95467]:       <nova:flavor name="m1.tiny">
Nov 15 08:20:15 user nova-compute[95467]:         <nova:memory>512</nova:memory>
Nov 15 08:20:15 user nova-compute[95467]:         <nova:disk>1</nova:disk>
Nov 15 08:20:15 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:20:15 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:20:15 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:20:15 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:20:15 user nova-compute[95467]:       <nova:owner>
Nov 15 08:20:15 user nova-compute[95467]:         <nova:user uuid="354af2d9fe0e4fa4be1d9b851773e8d9">tempest-TestShelveInstance-668674769-project-member</nova:user>
Nov 15 08:20:15 user nova-compute[95467]:         <nova:project uuid="dd7182b78b65480eb2e51db102fd9c2d">tempest-TestShelveInstance-668674769</nova:project>
Nov 15 08:20:15 user nova-compute[95467]:       </nova:owner>
Nov 15 08:20:15 user nova-compute[95467]:       <nova:ports>
Nov 15 08:20:15 user nova-compute[95467]:         <nova:port uuid="93a4c2ed-b2a8-471c-8173-d221f7251e8b">
Nov 15 08:20:15 user nova-compute[95467]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 08:20:15 user nova-compute[95467]:         </nova:port>
Nov 15 08:20:15 user nova-compute[95467]:       </nova:ports>
Nov 15 08:20:15 user nova-compute[95467]:     </nova:instance>
Nov 15 08:20:15 user nova-compute[95467]:   </metadata>
Nov 15 08:20:15 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:20:15 user nova-compute[95467]:     <system>
Nov 15 08:20:15 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:20:15 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:20:15 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:20:15 user nova-compute[95467]:       <entry name="serial">6a551521-28cf-4b4e-94e8-5f5ecc0c37f7</entry>
Nov 15 08:20:15 user nova-compute[95467]:       <entry name="uuid">6a551521-28cf-4b4e-94e8-5f5ecc0c37f7</entry>
Nov 15 08:20:15 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:20:15 user nova-compute[95467]:     </system>
Nov 15 08:20:15 user nova-compute[95467]:   </sysinfo>
Nov 15 08:20:15 user nova-compute[95467]:   <os>
Nov 15 08:20:15 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:20:15 user nova-compute[95467]:     <boot dev="hd"/>
Nov 15 08:20:15 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:20:15 user nova-compute[95467]:   </os>
Nov 15 08:20:15 user nova-compute[95467]:   <features>
Nov 15 08:20:15 user nova-compute[95467]:     <acpi/>
Nov 15 08:20:15 user nova-compute[95467]:     <apic/>
Nov 15 08:20:15 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:20:15 user nova-compute[95467]:   </features>
Nov 15 08:20:15 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:20:15 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:20:15 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:20:15 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:20:15 user nova-compute[95467]:   </clock>
Nov 15 08:20:15 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:20:15 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:20:15 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:20:15 user nova-compute[95467]:   </cpu>
Nov 15 08:20:15 user nova-compute[95467]:   <devices>
Nov 15 08:20:15 user nova-compute[95467]:     <disk type="block" device="disk">
Nov 15 08:20:15 user nova-compute[95467]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:20:15 user nova-compute[95467]:       <source dev="/dev/sdi"/>
Nov 15 08:20:15 user nova-compute[95467]:       <target dev="vda" bus="virtio"/>
Nov 15 08:20:15 user nova-compute[95467]:       <serial>965f0947-8c2b-4f39-a814-22493fb16775</serial>
Nov 15 08:20:15 user nova-compute[95467]:     </disk>
Nov 15 08:20:15 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:20:15 user nova-compute[95467]:       <mac address="fa:16:3e:9b:81:50"/>
Nov 15 08:20:15 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:20:15 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:20:15 user nova-compute[95467]:       <target dev="tap93a4c2ed-b2"/>
Nov 15 08:20:15 user nova-compute[95467]:     </interface>
Nov 15 08:20:15 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:20:15 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/6a551521-28cf-4b4e-94e8-5f5ecc0c37f7/console.log" append="off"/>
Nov 15 08:20:15 user nova-compute[95467]:     </serial>
Nov 15 08:20:15 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:20:15 user nova-compute[95467]:     <video>
Nov 15 08:20:15 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:20:15 user nova-compute[95467]:     </video>
Nov 15 08:20:15 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:20:15 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:20:15 user nova-compute[95467]:     </rng>
Nov 15 08:20:15 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:20:15 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:20:15 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:20:15 user nova-compute[95467]:     </memballoon>
Nov 15 08:20:15 user nova-compute[95467]:   </devices>
Nov 15 08:20:15 user nova-compute[95467]: </domain>
Nov 15 08:20:15 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:20:15 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:20:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-177934737',display_name='tempest-TestShelveInstance-server-177934737',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-177934737',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJC4LZpX54Ka4CeYP7mgSTaMm2Q0taurdpd9b7can1Ul1AsTpY2sRQ536DDEYxtxG0i1vSLR8KRvCVHbBH9pBlB10+jQxss4INx8+NUQcLORFtrp/d3ty3KPezfHsZOFw==',key_name='tempest-TestShelveInstance-347903963',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd7182b78b65480eb2e51db102fd9c2d',ramdisk_id='',reservation_id='r-8qvr6rl5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-668674769',owner_user_name='tempest-TestShelveInstance-668674769-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:20:08Z,user_data=None,user_id='354af2d9fe0e4fa4be1d9b851773e8d9',uuid=6a551521-28cf-4b4e-94e8-5f5ecc0c37f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93a4c2ed-b2a8-471c-8173-d221f7251e8b", "address": "fa:16:3e:9b:81:50", "network": {"id": "44a920f2-9a44-480e-bbd4-82afd3303a7f", "bridge": "br-int", "label": "tempest-TestShelveInstance-57422602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7182b78b65480eb2e51db102fd9c2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93a4c2ed-b2", "ovs_interfaceid": "93a4c2ed-b2a8-471c-8173-d221f7251e8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:20:15 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Converting VIF {"id": "93a4c2ed-b2a8-471c-8173-d221f7251e8b", "address": "fa:16:3e:9b:81:50", "network": {"id": "44a920f2-9a44-480e-bbd4-82afd3303a7f", "bridge": "br-int", "label": "tempest-TestShelveInstance-57422602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7182b78b65480eb2e51db102fd9c2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93a4c2ed-b2", "ovs_interfaceid": "93a4c2ed-b2a8-471c-8173-d221f7251e8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:20:15 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:81:50,bridge_name='br-int',has_traffic_filtering=True,id=93a4c2ed-b2a8-471c-8173-d221f7251e8b,network=Network(44a920f2-9a44-480e-bbd4-82afd3303a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93a4c2ed-b2') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:20:15 user nova-compute[95467]: DEBUG os_vif [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:81:50,bridge_name='br-int',has_traffic_filtering=True,id=93a4c2ed-b2a8-471c-8173-d221f7251e8b,network=Network(44a920f2-9a44-480e-bbd4-82afd3303a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93a4c2ed-b2') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:20:15 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:15 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:20:15 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:20:15 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:15 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9927b7ef-9c3d-5396-8dbd-f6615fe9ad5b', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:20:15 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:15 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:15 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:15 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap93a4c2ed-b2, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:20:15 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap93a4c2ed-b2, col_values=(('qos', UUID('e0a29230-7af4-4dd4-8f1b-034c7e253d54')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:20:15 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap93a4c2ed-b2, col_values=(('external_ids', {'iface-id': '93a4c2ed-b2a8-471c-8173-d221f7251e8b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:81:50', 'vm-uuid': '6a551521-28cf-4b4e-94e8-5f5ecc0c37f7'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:20:15 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:15 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:20:15 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:15 user nova-compute[95467]: INFO os_vif [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:81:50,bridge_name='br-int',has_traffic_filtering=True,id=93a4c2ed-b2a8-471c-8173-d221f7251e8b,network=Network(44a920f2-9a44-480e-bbd4-82afd3303a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93a4c2ed-b2')
Nov 15 08:20:15 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:20:15 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] No VIF found with MAC fa:16:3e:9b:81:50, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:20:16 user nova-compute[95467]: DEBUG nova.compute.manager [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] Instance event wait completed in 0 seconds for  {{(pid=95467) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 08:20:16 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] Guest created on hypervisor {{(pid=95467) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 08:20:16 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] Instance spawned successfully.
Nov 15 08:20:16 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 08:20:16 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] Found default for hw_cdrom_bus of ide {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:20:16 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] Found default for hw_disk_bus of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:20:16 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] Found default for hw_input_bus of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:20:16 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] Found default for hw_pointer_model of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:20:16 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] Found default for hw_video_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:20:16 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] Found default for hw_vif_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:20:16 user nova-compute[95467]: INFO nova.compute.manager [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] Took 5.33 seconds to spawn the instance on the hypervisor.
Nov 15 08:20:16 user nova-compute[95467]: DEBUG nova.compute.manager [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:20:16 user nova-compute[95467]: INFO nova.compute.manager [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] Took 6.20 seconds to build instance.
Nov 15 08:20:16 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-ce1fdf96-7d7c-487d-bb33-944ec1b0ed43 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "0edcb81b-d8fe-482c-a7ca-6b76455cfe33" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.316s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:20:16 user nova-compute[95467]: DEBUG nova.compute.manager [req-80f51bb3-6d7a-42db-a5aa-f7c8ac856c53 req-836a6bf5-60c5-4ebb-865a-e360769049e5 service nova] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] Received event network-vif-plugged-0469b401-fc62-46e8-bdd0-b00f131d4821 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:20:16 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-80f51bb3-6d7a-42db-a5aa-f7c8ac856c53 req-836a6bf5-60c5-4ebb-865a-e360769049e5 service nova] Acquiring lock "0edcb81b-d8fe-482c-a7ca-6b76455cfe33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:20:16 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-80f51bb3-6d7a-42db-a5aa-f7c8ac856c53 req-836a6bf5-60c5-4ebb-865a-e360769049e5 service nova] Lock "0edcb81b-d8fe-482c-a7ca-6b76455cfe33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:20:16 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-80f51bb3-6d7a-42db-a5aa-f7c8ac856c53 req-836a6bf5-60c5-4ebb-865a-e360769049e5 service nova] Lock "0edcb81b-d8fe-482c-a7ca-6b76455cfe33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:20:16 user nova-compute[95467]: DEBUG nova.compute.manager [req-80f51bb3-6d7a-42db-a5aa-f7c8ac856c53 req-836a6bf5-60c5-4ebb-865a-e360769049e5 service nova] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] No waiting events found dispatching network-vif-plugged-0469b401-fc62-46e8-bdd0-b00f131d4821 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:20:16 user nova-compute[95467]: WARNING nova.compute.manager [req-80f51bb3-6d7a-42db-a5aa-f7c8ac856c53 req-836a6bf5-60c5-4ebb-865a-e360769049e5 service nova] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] Received unexpected event network-vif-plugged-0469b401-fc62-46e8-bdd0-b00f131d4821 for instance with vm_state active and task_state None.
Nov 15 08:20:16 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:16 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:16 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:17 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:17 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:17 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:17 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:18 user nova-compute[95467]: DEBUG nova.compute.manager [req-97f7546a-8842-4013-9c4f-51a58710e921 req-89eca229-e925-4834-bcc2-596553324465 service nova] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Received event network-vif-plugged-93a4c2ed-b2a8-471c-8173-d221f7251e8b {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:20:18 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-97f7546a-8842-4013-9c4f-51a58710e921 req-89eca229-e925-4834-bcc2-596553324465 service nova] Acquiring lock "6a551521-28cf-4b4e-94e8-5f5ecc0c37f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:20:18 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-97f7546a-8842-4013-9c4f-51a58710e921 req-89eca229-e925-4834-bcc2-596553324465 service nova] Lock "6a551521-28cf-4b4e-94e8-5f5ecc0c37f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:20:18 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-97f7546a-8842-4013-9c4f-51a58710e921 req-89eca229-e925-4834-bcc2-596553324465 service nova] Lock "6a551521-28cf-4b4e-94e8-5f5ecc0c37f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:20:18 user nova-compute[95467]: DEBUG nova.compute.manager [req-97f7546a-8842-4013-9c4f-51a58710e921 req-89eca229-e925-4834-bcc2-596553324465 service nova] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] No waiting events found dispatching network-vif-plugged-93a4c2ed-b2a8-471c-8173-d221f7251e8b {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:20:18 user nova-compute[95467]: WARNING nova.compute.manager [req-97f7546a-8842-4013-9c4f-51a58710e921 req-89eca229-e925-4834-bcc2-596553324465 service nova] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Received unexpected event network-vif-plugged-93a4c2ed-b2a8-471c-8173-d221f7251e8b for instance with vm_state building and task_state spawning.
Nov 15 08:20:18 user nova-compute[95467]: DEBUG nova.compute.manager [req-97f7546a-8842-4013-9c4f-51a58710e921 req-89eca229-e925-4834-bcc2-596553324465 service nova] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Received event network-vif-plugged-93a4c2ed-b2a8-471c-8173-d221f7251e8b {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:20:18 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-97f7546a-8842-4013-9c4f-51a58710e921 req-89eca229-e925-4834-bcc2-596553324465 service nova] Acquiring lock "6a551521-28cf-4b4e-94e8-5f5ecc0c37f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:20:18 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-97f7546a-8842-4013-9c4f-51a58710e921 req-89eca229-e925-4834-bcc2-596553324465 service nova] Lock "6a551521-28cf-4b4e-94e8-5f5ecc0c37f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:20:18 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-97f7546a-8842-4013-9c4f-51a58710e921 req-89eca229-e925-4834-bcc2-596553324465 service nova] Lock "6a551521-28cf-4b4e-94e8-5f5ecc0c37f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:20:18 user nova-compute[95467]: DEBUG nova.compute.manager [req-97f7546a-8842-4013-9c4f-51a58710e921 req-89eca229-e925-4834-bcc2-596553324465 service nova] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] No waiting events found dispatching network-vif-plugged-93a4c2ed-b2a8-471c-8173-d221f7251e8b {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:20:18 user nova-compute[95467]: WARNING nova.compute.manager [req-97f7546a-8842-4013-9c4f-51a58710e921 req-89eca229-e925-4834-bcc2-596553324465 service nova] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Received unexpected event network-vif-plugged-93a4c2ed-b2a8-471c-8173-d221f7251e8b for instance with vm_state building and task_state spawning.
Nov 15 08:20:18 user nova-compute[95467]: DEBUG nova.compute.manager [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Instance event wait completed in 0 seconds for  {{(pid=95467) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 08:20:18 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Guest created on hypervisor {{(pid=95467) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 08:20:18 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Instance spawned successfully.
Nov 15 08:20:18 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 08:20:18 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Found default for hw_cdrom_bus of ide {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:20:18 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Found default for hw_disk_bus of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:20:18 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Found default for hw_input_bus of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:20:18 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Found default for hw_pointer_model of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:20:18 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Found default for hw_video_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:20:18 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Found default for hw_vif_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:20:18 user nova-compute[95467]: INFO nova.compute.manager [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Took 5.11 seconds to spawn the instance on the hypervisor.
Nov 15 08:20:18 user nova-compute[95467]: DEBUG nova.compute.manager [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:20:18 user nova-compute[95467]: INFO nova.compute.manager [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Took 11.14 seconds to build instance.
Nov 15 08:20:18 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-028f7b2e-2038-45c5-b7e4-c693db0c29ac tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Lock "6a551521-28cf-4b4e-94e8-5f5ecc0c37f7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.230s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:20:20 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:22 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-c9b119dc-964c-41b0-a588-c56001f989f1 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bee31898-4f12-4c68-a18b-a678f9f584aa is timed out.
Nov 15 08:20:22 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-c9b119dc-964c-41b0-a588-c56001f989f1 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Successfully detached device vdb from instance bee31898-4f12-4c68-a18b-a678f9f584aa from the live domain config.
Nov 15 08:20:22 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9b119dc-964c-41b0-a588-c56001f989f1 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] calling os-brick to detach iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 08:20:22 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b119dc-964c-41b0-a588-c56001f989f1 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, {'target_iqn': 'iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IFUhnXyo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:20:22 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-c9b119dc-964c-41b0-a588-c56001f989f1 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:20:22 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-c9b119dc-964c-41b0-a588-c56001f989f1 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:20:22 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-c9b119dc-964c-41b0-a588-c56001f989f1 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:20:22 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:22 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:22 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76b1dd6-04ae-4781-b867-d084c6bf4452]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:20:22 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b119dc-964c-41b0-a588-c56001f989f1 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 08:20:22 user nova-compute[95467]: No targets found.
Nov 15 08:20:22 user nova-compute[95467]: iSNS:
Nov 15 08:20:22 user nova-compute[95467]: No targets found.
Nov 15 08:20:22 user nova-compute[95467]: STATIC:
Nov 15 08:20:22 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7
Nov 15 08:20:22 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:20:22 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:20:22 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e
Nov 15 08:20:22 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:20:22 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:20:22 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149
Nov 15 08:20:22 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:20:22 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:20:22 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775
Nov 15 08:20:22 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:20:22 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:20:22 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81
Nov 15 08:20:22 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:20:22 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:20:22 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551
Nov 15 08:20:22 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:20:22 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:20:22 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612
Nov 15 08:20:22 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:20:22 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:20:22 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b
Nov 15 08:20:22 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:20:22 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:20:22 user nova-compute[95467]: FIRMWARE:
Nov 15 08:20:22 user nova-compute[95467]: No targets found.
Nov 15 08:20:22 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:20:22 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b119dc-964c-41b0-a588-c56001f989f1 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 08:20:22 user nova-compute[95467]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 08:20:22 user nova-compute[95467]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=95467) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 08:20:22 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b119dc-964c-41b0-a588-c56001f989f1 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81', 0)] {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 08:20:22 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:22 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:22 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[64bf34b9-5b41-4451-bb3e-6b951693ec48]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:20:22 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:22 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:22 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fcda4be-2f94-4534-b537-fd86fbc2dce4]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:20:22 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b119dc-964c-41b0-a588-c56001f989f1 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:20:22 user nova-compute[95467]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)
Nov 15 08:20:22 user nova-compute[95467]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 (non-flash)
Nov 15 08:20:22 user nova-compute[95467]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b (non-flash)
Nov 15 08:20:22 user nova-compute[95467]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7 (non-flash)
Nov 15 08:20:22 user nova-compute[95467]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612 (non-flash)
Nov 15 08:20:22 user nova-compute[95467]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551 (non-flash)
Nov 15 08:20:22 user nova-compute[95467]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:20:22 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:20:22 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b119dc-964c-41b0-a588-c56001f989f1 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:20:22 user nova-compute[95467]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)
Nov 15 08:20:22 user nova-compute[95467]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 (non-flash)
Nov 15 08:20:22 user nova-compute[95467]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b (non-flash)
Nov 15 08:20:22 user nova-compute[95467]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7 (non-flash)
Nov 15 08:20:22 user nova-compute[95467]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612 (non-flash)
Nov 15 08:20:22 user nova-compute[95467]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551 (non-flash)
Nov 15 08:20:22 user nova-compute[95467]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:20:22 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:20:22 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b119dc-964c-41b0-a588-c56001f989f1 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efec836fe20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81'): ({'sdf'}, set())}) {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 08:20:22 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-c9b119dc-964c-41b0-a588-c56001f989f1 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Removing single pathed devices sdf {{(pid=95467) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 08:20:22 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:22 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:22 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fbd045a-7102-441e-805b-1899af141fdd]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:20:22 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:22 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.026s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:22 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f50d3a-a4b7-4edf-9dc2-ac6bae6324ac]: (4, ('ok\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:20:22 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-c9b119dc-964c-41b0-a588-c56001f989f1 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Flushing IO for device /dev/sdf {{(pid=95467) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 08:20:22 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:22 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:22 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81ec13f-71c7-424f-83bc-4dce91bd6188]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:20:22 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-c9b119dc-964c-41b0-a588-c56001f989f1 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=95467) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 08:20:22 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:22 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:22 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[47eb4790-3b49-4b09-b2fd-e6b240e26199]: (4, ('1', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:20:22 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-c9b119dc-964c-41b0-a588-c56001f989f1 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 08:20:22 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-c9b119dc-964c-41b0-a588-c56001f989f1 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] SCSI volumes sdf have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 08:20:22 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b119dc-964c-41b0-a588-c56001f989f1 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81')] {{(pid=95467) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 08:20:22 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:22 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:22 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[de95ed4c-207b-4e51-be9c-05d01f459b24]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:20:22 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b119dc-964c-41b0-a588-c56001f989f1 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:20:22 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 -p 172.16.0.220:3260 --logout {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:23 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:23 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2654979-53ef-4043-9dd0-b99f835fc27f]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:20:23 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b119dc-964c-41b0-a588-c56001f989f1 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81, portal: 172.16.0.220,3260]
Nov 15 08:20:23 user nova-compute[95467]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81, portal: 172.16.0.220,3260] successful.
Nov 15 08:20:23 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:20:23 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 -p 172.16.0.220:3260 --op delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:23 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d2cbbd-2252-4dbb-b8c7-f8e74995fb81 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:23 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad41a377-67e3-4769-ac41-d7314feb053f]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:20:23 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b119dc-964c-41b0-a588-c56001f989f1 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:20:23 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-c9b119dc-964c-41b0-a588-c56001f989f1 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:20:23 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b119dc-964c-41b0-a588-c56001f989f1 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] <== disconnect_volume: return (362ms) None {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:20:23 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9b119dc-964c-41b0-a588-c56001f989f1 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Disconnected iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 08:20:23 user nova-compute[95467]: DEBUG nova.compute.manager [req-40f9eefe-3ee0-4666-8cd5-f39ec79d7f23 req-fb5d7f29-8d26-4eb3-b157-5b1c367c81c9 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Received event network-changed-5cab4329-e3d7-4d50-9a27-c1291f6f4b4a {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:20:23 user nova-compute[95467]: DEBUG nova.compute.manager [req-40f9eefe-3ee0-4666-8cd5-f39ec79d7f23 req-fb5d7f29-8d26-4eb3-b157-5b1c367c81c9 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Refreshing instance network info cache due to event network-changed-5cab4329-e3d7-4d50-9a27-c1291f6f4b4a. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:20:23 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-40f9eefe-3ee0-4666-8cd5-f39ec79d7f23 req-fb5d7f29-8d26-4eb3-b157-5b1c367c81c9 service nova] Acquiring lock "refresh_cache-1c438a54-5528-4354-9836-f1a198532c9b" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:20:23 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-40f9eefe-3ee0-4666-8cd5-f39ec79d7f23 req-fb5d7f29-8d26-4eb3-b157-5b1c367c81c9 service nova] Acquired lock "refresh_cache-1c438a54-5528-4354-9836-f1a198532c9b" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:20:23 user nova-compute[95467]: DEBUG nova.network.neutron [req-40f9eefe-3ee0-4666-8cd5-f39ec79d7f23 req-fb5d7f29-8d26-4eb3-b157-5b1c367c81c9 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Refreshing network info cache for port 5cab4329-e3d7-4d50-9a27-c1291f6f4b4a {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:20:23 user nova-compute[95467]: DEBUG nova.network.neutron [req-40f9eefe-3ee0-4666-8cd5-f39ec79d7f23 req-fb5d7f29-8d26-4eb3-b157-5b1c367c81c9 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Updated VIF entry in instance network info cache for port 5cab4329-e3d7-4d50-9a27-c1291f6f4b4a. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:20:23 user nova-compute[95467]: DEBUG nova.network.neutron [req-40f9eefe-3ee0-4666-8cd5-f39ec79d7f23 req-fb5d7f29-8d26-4eb3-b157-5b1c367c81c9 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Updating instance_info_cache with network_info: [{"id": "5cab4329-e3d7-4d50-9a27-c1291f6f4b4a", "address": "fa:16:3e:52:67:fa", "network": {"id": "ca364f10-9c7d-4574-ae0a-76a1a2a3116d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-497069669-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cab4329-e3", "ovs_interfaceid": "5cab4329-e3d7-4d50-9a27-c1291f6f4b4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d6c4a108-4733-4daa-935a-56424ed362e9", "address": "fa:16:3e:d7:91:0a", "network": {"id": "fd06ef46-be25-4b52-8c3b-cda8a4ec8124", "bridge": "br-int", "label": "tempest-device-tagging-net1-887816556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c4a108-47", "ovs_interfaceid": "d6c4a108-4733-4daa-935a-56424ed362e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "68127374-b841-456d-b9eb-29e96bd43dc6", "address": "fa:16:3e:0c:8b:29", "network": {"id": "fd06ef46-be25-4b52-8c3b-cda8a4ec8124", "bridge": "br-int", "label": "tempest-device-tagging-net1-887816556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68127374-b8", "ovs_interfaceid": "68127374-b841-456d-b9eb-29e96bd43dc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "79b592a8-b5f9-48e6-ae2d-d535ded922b1", "address": "fa:16:3e:f8:e1:13", "network": {"id": "fd06ef46-be25-4b52-8c3b-cda8a4ec8124", "bridge": "br-int", "label": "tempest-device-tagging-net1-887816556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79b592a8-b5", "ovs_interfaceid": "79b592a8-b5f9-48e6-ae2d-d535ded922b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "71b2b3bf-8597-40e5-803d-be98308390b7", "address": "fa:16:3e:97:58:f0", "network": {"id": "fd06ef46-be25-4b52-8c3b-cda8a4ec8124", "bridge": "br-int", "label": "tempest-device-tagging-net1-887816556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71b2b3bf-85", "ovs_interfaceid": "71b2b3bf-8597-40e5-803d-be98308390b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ffab8636-a06b-43fc-9aa8-fcec46b2426d", "address": "fa:16:3e:60:ba:2c", "network": {"id": "eee7a16a-db60-4993-aaae-5142fa17ff37", "bridge": "br-int", "label": "tempest-device-tagging-net2-2138433061", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffab8636-a0", "ovs_interfaceid": "ffab8636-a06b-43fc-9aa8-fcec46b2426d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "27370ddc-29be-446e-8205-a50379d200d7", "address": "fa:16:3e:36:19:6a", "network": {"id": "eee7a16a-db60-4993-aaae-5142fa17ff37", "bridge": "br-int", "label": "tempest-device-tagging-net2-2138433061", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27370ddc-29", "ovs_interfaceid": "27370ddc-29be-446e-8205-a50379d200d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:20:23 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-40f9eefe-3ee0-4666-8cd5-f39ec79d7f23 req-fb5d7f29-8d26-4eb3-b157-5b1c367c81c9 service nova] Releasing lock "refresh_cache-1c438a54-5528-4354-9836-f1a198532c9b" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:20:23 user nova-compute[95467]: DEBUG nova.objects.instance [None req-c9b119dc-964c-41b0-a588-c56001f989f1 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Lazy-loading 'flavor' on Instance uuid bee31898-4f12-4c68-a18b-a678f9f584aa {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:20:23 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-c9b119dc-964c-41b0-a588-c56001f989f1 tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Lock "bee31898-4f12-4c68-a18b-a678f9f584aa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.107s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:20:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Acquiring lock "1c438a54-5528-4354-9836-f1a198532c9b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:20:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Lock "1c438a54-5528-4354-9836-f1a198532c9b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:20:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Acquiring lock "1c438a54-5528-4354-9836-f1a198532c9b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:20:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Lock "1c438a54-5528-4354-9836-f1a198532c9b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:20:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Lock "1c438a54-5528-4354-9836-f1a198532c9b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:20:25 user nova-compute[95467]: INFO nova.compute.manager [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Terminating instance
Nov 15 08:20:25 user nova-compute[95467]: DEBUG nova.compute.manager [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Start destroying the instance on the hypervisor. {{(pid=95467) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 08:20:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:25 user nova-compute[95467]: DEBUG nova.compute.manager [req-0564e4a3-69bf-4787-9a52-e98ca6c050b1 req-5e55c1da-8b2e-4971-b98f-c215b69d39dd service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Received event network-vif-unplugged-5cab4329-e3d7-4d50-9a27-c1291f6f4b4a {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:20:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-0564e4a3-69bf-4787-9a52-e98ca6c050b1 req-5e55c1da-8b2e-4971-b98f-c215b69d39dd service nova] Acquiring lock "1c438a54-5528-4354-9836-f1a198532c9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:20:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-0564e4a3-69bf-4787-9a52-e98ca6c050b1 req-5e55c1da-8b2e-4971-b98f-c215b69d39dd service nova] Lock "1c438a54-5528-4354-9836-f1a198532c9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:20:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-0564e4a3-69bf-4787-9a52-e98ca6c050b1 req-5e55c1da-8b2e-4971-b98f-c215b69d39dd service nova] Lock "1c438a54-5528-4354-9836-f1a198532c9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:20:25 user nova-compute[95467]: DEBUG nova.compute.manager [req-0564e4a3-69bf-4787-9a52-e98ca6c050b1 req-5e55c1da-8b2e-4971-b98f-c215b69d39dd service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] No waiting events found dispatching network-vif-unplugged-5cab4329-e3d7-4d50-9a27-c1291f6f4b4a {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:20:25 user nova-compute[95467]: DEBUG nova.compute.manager [req-0564e4a3-69bf-4787-9a52-e98ca6c050b1 req-5e55c1da-8b2e-4971-b98f-c215b69d39dd service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Received event network-vif-unplugged-5cab4329-e3d7-4d50-9a27-c1291f6f4b4a for instance with task_state deleting. {{(pid=95467) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 08:20:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:26 user nova-compute[95467]: DEBUG nova.compute.manager [req-8764baba-d7d2-44e5-8f8c-d117f721912d req-ede1e001-9c12-4dab-ad84-08209e3ddd4b service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Received event network-vif-unplugged-d6c4a108-4733-4daa-935a-56424ed362e9 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:20:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-8764baba-d7d2-44e5-8f8c-d117f721912d req-ede1e001-9c12-4dab-ad84-08209e3ddd4b service nova] Acquiring lock "1c438a54-5528-4354-9836-f1a198532c9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:20:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-8764baba-d7d2-44e5-8f8c-d117f721912d req-ede1e001-9c12-4dab-ad84-08209e3ddd4b service nova] Lock "1c438a54-5528-4354-9836-f1a198532c9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:20:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-8764baba-d7d2-44e5-8f8c-d117f721912d req-ede1e001-9c12-4dab-ad84-08209e3ddd4b service nova] Lock "1c438a54-5528-4354-9836-f1a198532c9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:20:26 user nova-compute[95467]: DEBUG nova.compute.manager [req-8764baba-d7d2-44e5-8f8c-d117f721912d req-ede1e001-9c12-4dab-ad84-08209e3ddd4b service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] No waiting events found dispatching network-vif-unplugged-d6c4a108-4733-4daa-935a-56424ed362e9 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:20:26 user nova-compute[95467]: DEBUG nova.compute.manager [req-8764baba-d7d2-44e5-8f8c-d117f721912d req-ede1e001-9c12-4dab-ad84-08209e3ddd4b service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Received event network-vif-unplugged-d6c4a108-4733-4daa-935a-56424ed362e9 for instance with task_state deleting. {{(pid=95467) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 08:20:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:26 user nova-compute[95467]: DEBUG nova.compute.manager [req-aa746018-e1be-4a69-821e-0c90a16aa056 req-d0643279-9c5a-4ccc-bfbd-6ece662bbbce service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Received event network-vif-unplugged-79b592a8-b5f9-48e6-ae2d-d535ded922b1 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:20:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-aa746018-e1be-4a69-821e-0c90a16aa056 req-d0643279-9c5a-4ccc-bfbd-6ece662bbbce service nova] Acquiring lock "1c438a54-5528-4354-9836-f1a198532c9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:20:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-aa746018-e1be-4a69-821e-0c90a16aa056 req-d0643279-9c5a-4ccc-bfbd-6ece662bbbce service nova] Lock "1c438a54-5528-4354-9836-f1a198532c9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:20:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-aa746018-e1be-4a69-821e-0c90a16aa056 req-d0643279-9c5a-4ccc-bfbd-6ece662bbbce service nova] Lock "1c438a54-5528-4354-9836-f1a198532c9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:20:26 user nova-compute[95467]: DEBUG nova.compute.manager [req-aa746018-e1be-4a69-821e-0c90a16aa056 req-d0643279-9c5a-4ccc-bfbd-6ece662bbbce service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] No waiting events found dispatching network-vif-unplugged-79b592a8-b5f9-48e6-ae2d-d535ded922b1 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:20:26 user nova-compute[95467]: DEBUG nova.compute.manager [req-aa746018-e1be-4a69-821e-0c90a16aa056 req-d0643279-9c5a-4ccc-bfbd-6ece662bbbce service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Received event network-vif-unplugged-79b592a8-b5f9-48e6-ae2d-d535ded922b1 for instance with task_state deleting. {{(pid=95467) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 08:20:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:27 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Instance destroyed successfully.
Nov 15 08:20:27 user nova-compute[95467]: DEBUG nova.objects.instance [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Lazy-loading 'resources' on Instance uuid 1c438a54-5528-4354-9836-f1a198532c9b {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:20:27 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T08:18:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-163188137',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-163188137',id=29,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPc3ntsDCHvSt2Zeq2Eoj7Sh8oVGFbUIkQaZX9nyjxUcj7agqfuKFvy+F+MPCCQt5Teq5JV4myceW+vQlye/stucWDEV+fW0F7nLBuTFv4gu71gMuBsUY5AVHQyQOb6pzQ==',key_name='tempest-keypair-475690846',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:19:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='40e501e472d742539ef6a4d9c5175d3d',ramdisk_id='',reservation_id='r-z06nzzlq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-248573984',owner_user_name='tempest-TaggedBootDevicesTest-248573984-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:19:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2da4703cb9454345a21adb41812a37ad',uuid=1c438a54-5528-4354-9836-f1a198532c9b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5cab4329-e3d7-4d50-9a27-c1291f6f4b4a", "address": "fa:16:3e:52:67:fa", "network": {"id": "ca364f10-9c7d-4574-ae0a-76a1a2a3116d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-497069669-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cab4329-e3", "ovs_interfaceid": "5cab4329-e3d7-4d50-9a27-c1291f6f4b4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:20:27 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Converting VIF {"id": "5cab4329-e3d7-4d50-9a27-c1291f6f4b4a", "address": "fa:16:3e:52:67:fa", "network": {"id": "ca364f10-9c7d-4574-ae0a-76a1a2a3116d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-497069669-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cab4329-e3", "ovs_interfaceid": "5cab4329-e3d7-4d50-9a27-c1291f6f4b4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:20:27 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:52:67:fa,bridge_name='br-int',has_traffic_filtering=True,id=5cab4329-e3d7-4d50-9a27-c1291f6f4b4a,network=Network(ca364f10-9c7d-4574-ae0a-76a1a2a3116d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cab4329-e3') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:20:27 user nova-compute[95467]: DEBUG os_vif [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:67:fa,bridge_name='br-int',has_traffic_filtering=True,id=5cab4329-e3d7-4d50-9a27-c1291f6f4b4a,network=Network(ca364f10-9c7d-4574-ae0a-76a1a2a3116d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cab4329-e3') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:20:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5cab4329-e3, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:20:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:20:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c25cdef5-af03-4570-8925-39c8f320c740) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:20:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:20:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:27 user nova-compute[95467]: INFO os_vif [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:67:fa,bridge_name='br-int',has_traffic_filtering=True,id=5cab4329-e3d7-4d50-9a27-c1291f6f4b4a,network=Network(ca364f10-9c7d-4574-ae0a-76a1a2a3116d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cab4329-e3')
Nov 15 08:20:27 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T08:18:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-163188137',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-163188137',id=29,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPc3ntsDCHvSt2Zeq2Eoj7Sh8oVGFbUIkQaZX9nyjxUcj7agqfuKFvy+F+MPCCQt5Teq5JV4myceW+vQlye/stucWDEV+fW0F7nLBuTFv4gu71gMuBsUY5AVHQyQOb6pzQ==',key_name='tempest-keypair-475690846',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:19:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='40e501e472d742539ef6a4d9c5175d3d',ramdisk_id='',reservation_id='r-z06nzzlq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-248573984',owner_user_name='tempest-TaggedBootDevicesTest-248573984-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:19:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2da4703cb9454345a21adb41812a37ad',uuid=1c438a54-5528-4354-9836-f1a198532c9b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d6c4a108-4733-4daa-935a-56424ed362e9", "address": "fa:16:3e:d7:91:0a", "network": {"id": "fd06ef46-be25-4b52-8c3b-cda8a4ec8124", "bridge": "br-int", "label": "tempest-device-tagging-net1-887816556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c4a108-47", "ovs_interfaceid": "d6c4a108-4733-4daa-935a-56424ed362e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:20:27 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Converting VIF {"id": "d6c4a108-4733-4daa-935a-56424ed362e9", "address": "fa:16:3e:d7:91:0a", "network": {"id": "fd06ef46-be25-4b52-8c3b-cda8a4ec8124", "bridge": "br-int", "label": "tempest-device-tagging-net1-887816556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c4a108-47", "ovs_interfaceid": "d6c4a108-4733-4daa-935a-56424ed362e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:20:27 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:91:0a,bridge_name='br-int',has_traffic_filtering=True,id=d6c4a108-4733-4daa-935a-56424ed362e9,network=Network(fd06ef46-be25-4b52-8c3b-cda8a4ec8124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd6c4a108-47') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:20:27 user nova-compute[95467]: DEBUG os_vif [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:91:0a,bridge_name='br-int',has_traffic_filtering=True,id=d6c4a108-4733-4daa-935a-56424ed362e9,network=Network(fd06ef46-be25-4b52-8c3b-cda8a4ec8124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd6c4a108-47') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:20:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd6c4a108-47, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:20:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:20:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=30dfca19-12a5-4f9d-954b-1cf144524706) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:20:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:20:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:27 user nova-compute[95467]: INFO os_vif [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:91:0a,bridge_name='br-int',has_traffic_filtering=True,id=d6c4a108-4733-4daa-935a-56424ed362e9,network=Network(fd06ef46-be25-4b52-8c3b-cda8a4ec8124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd6c4a108-47')
Nov 15 08:20:27 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T08:18:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-163188137',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-163188137',id=29,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPc3ntsDCHvSt2Zeq2Eoj7Sh8oVGFbUIkQaZX9nyjxUcj7agqfuKFvy+F+MPCCQt5Teq5JV4myceW+vQlye/stucWDEV+fW0F7nLBuTFv4gu71gMuBsUY5AVHQyQOb6pzQ==',key_name='tempest-keypair-475690846',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:19:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='40e501e472d742539ef6a4d9c5175d3d',ramdisk_id='',reservation_id='r-z06nzzlq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-248573984',owner_user_name='tempest-TaggedBootDevicesTest-248573984-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:19:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2da4703cb9454345a21adb41812a37ad',uuid=1c438a54-5528-4354-9836-f1a198532c9b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "68127374-b841-456d-b9eb-29e96bd43dc6", "address": "fa:16:3e:0c:8b:29", "network": {"id": "fd06ef46-be25-4b52-8c3b-cda8a4ec8124", "bridge": "br-int", "label": "tempest-device-tagging-net1-887816556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68127374-b8", "ovs_interfaceid": "68127374-b841-456d-b9eb-29e96bd43dc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:20:27 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Converting VIF {"id": "68127374-b841-456d-b9eb-29e96bd43dc6", "address": "fa:16:3e:0c:8b:29", "network": {"id": "fd06ef46-be25-4b52-8c3b-cda8a4ec8124", "bridge": "br-int", "label": "tempest-device-tagging-net1-887816556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68127374-b8", "ovs_interfaceid": "68127374-b841-456d-b9eb-29e96bd43dc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:20:27 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:8b:29,bridge_name='br-int',has_traffic_filtering=True,id=68127374-b841-456d-b9eb-29e96bd43dc6,network=Network(fd06ef46-be25-4b52-8c3b-cda8a4ec8124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap68127374-b8') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:20:27 user nova-compute[95467]: DEBUG os_vif [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:8b:29,bridge_name='br-int',has_traffic_filtering=True,id=68127374-b841-456d-b9eb-29e96bd43dc6,network=Network(fd06ef46-be25-4b52-8c3b-cda8a4ec8124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap68127374-b8') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:20:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap68127374-b8, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:20:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:20:27 user nova-compute[95467]: DEBUG nova.compute.manager [req-f196825b-e649-4883-9815-f11394906bdc req-9e122028-b207-4f4b-b383-51dcc1b5139e service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Received event network-vif-plugged-5cab4329-e3d7-4d50-9a27-c1291f6f4b4a {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:20:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-f196825b-e649-4883-9815-f11394906bdc req-9e122028-b207-4f4b-b383-51dcc1b5139e service nova] Acquiring lock "1c438a54-5528-4354-9836-f1a198532c9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:20:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-f196825b-e649-4883-9815-f11394906bdc req-9e122028-b207-4f4b-b383-51dcc1b5139e service nova] Lock "1c438a54-5528-4354-9836-f1a198532c9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:20:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-f196825b-e649-4883-9815-f11394906bdc req-9e122028-b207-4f4b-b383-51dcc1b5139e service nova] Lock "1c438a54-5528-4354-9836-f1a198532c9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:20:27 user nova-compute[95467]: DEBUG nova.compute.manager [req-f196825b-e649-4883-9815-f11394906bdc req-9e122028-b207-4f4b-b383-51dcc1b5139e service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] No waiting events found dispatching network-vif-plugged-5cab4329-e3d7-4d50-9a27-c1291f6f4b4a {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:20:27 user nova-compute[95467]: WARNING nova.compute.manager [req-f196825b-e649-4883-9815-f11394906bdc req-9e122028-b207-4f4b-b383-51dcc1b5139e service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Received unexpected event network-vif-plugged-5cab4329-e3d7-4d50-9a27-c1291f6f4b4a for instance with vm_state active and task_state deleting.
Nov 15 08:20:27 user nova-compute[95467]: DEBUG nova.compute.manager [req-f196825b-e649-4883-9815-f11394906bdc req-9e122028-b207-4f4b-b383-51dcc1b5139e service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Received event network-vif-unplugged-68127374-b841-456d-b9eb-29e96bd43dc6 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:20:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-f196825b-e649-4883-9815-f11394906bdc req-9e122028-b207-4f4b-b383-51dcc1b5139e service nova] Acquiring lock "1c438a54-5528-4354-9836-f1a198532c9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:20:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-f196825b-e649-4883-9815-f11394906bdc req-9e122028-b207-4f4b-b383-51dcc1b5139e service nova] Lock "1c438a54-5528-4354-9836-f1a198532c9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:20:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-f196825b-e649-4883-9815-f11394906bdc req-9e122028-b207-4f4b-b383-51dcc1b5139e service nova] Lock "1c438a54-5528-4354-9836-f1a198532c9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:20:27 user nova-compute[95467]: DEBUG nova.compute.manager [req-f196825b-e649-4883-9815-f11394906bdc req-9e122028-b207-4f4b-b383-51dcc1b5139e service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] No waiting events found dispatching network-vif-unplugged-68127374-b841-456d-b9eb-29e96bd43dc6 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:20:27 user nova-compute[95467]: DEBUG nova.compute.manager [req-f196825b-e649-4883-9815-f11394906bdc req-9e122028-b207-4f4b-b383-51dcc1b5139e service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Received event network-vif-unplugged-68127374-b841-456d-b9eb-29e96bd43dc6 for instance with task_state deleting. {{(pid=95467) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 08:20:27 user nova-compute[95467]: DEBUG nova.compute.manager [req-f196825b-e649-4883-9815-f11394906bdc req-9e122028-b207-4f4b-b383-51dcc1b5139e service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Received event network-vif-plugged-68127374-b841-456d-b9eb-29e96bd43dc6 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:20:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-f196825b-e649-4883-9815-f11394906bdc req-9e122028-b207-4f4b-b383-51dcc1b5139e service nova] Acquiring lock "1c438a54-5528-4354-9836-f1a198532c9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:20:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-f196825b-e649-4883-9815-f11394906bdc req-9e122028-b207-4f4b-b383-51dcc1b5139e service nova] Lock "1c438a54-5528-4354-9836-f1a198532c9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:20:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-f196825b-e649-4883-9815-f11394906bdc req-9e122028-b207-4f4b-b383-51dcc1b5139e service nova] Lock "1c438a54-5528-4354-9836-f1a198532c9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:20:27 user nova-compute[95467]: DEBUG nova.compute.manager [req-f196825b-e649-4883-9815-f11394906bdc req-9e122028-b207-4f4b-b383-51dcc1b5139e service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] No waiting events found dispatching network-vif-plugged-68127374-b841-456d-b9eb-29e96bd43dc6 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:20:27 user nova-compute[95467]: WARNING nova.compute.manager [req-f196825b-e649-4883-9815-f11394906bdc req-9e122028-b207-4f4b-b383-51dcc1b5139e service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Received unexpected event network-vif-plugged-68127374-b841-456d-b9eb-29e96bd43dc6 for instance with vm_state active and task_state deleting.
Nov 15 08:20:27 user nova-compute[95467]: DEBUG nova.compute.manager [req-f196825b-e649-4883-9815-f11394906bdc req-9e122028-b207-4f4b-b383-51dcc1b5139e service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Received event network-vif-unplugged-ffab8636-a06b-43fc-9aa8-fcec46b2426d {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:20:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-f196825b-e649-4883-9815-f11394906bdc req-9e122028-b207-4f4b-b383-51dcc1b5139e service nova] Acquiring lock "1c438a54-5528-4354-9836-f1a198532c9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:20:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-f196825b-e649-4883-9815-f11394906bdc req-9e122028-b207-4f4b-b383-51dcc1b5139e service nova] Lock "1c438a54-5528-4354-9836-f1a198532c9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:20:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-f196825b-e649-4883-9815-f11394906bdc req-9e122028-b207-4f4b-b383-51dcc1b5139e service nova] Lock "1c438a54-5528-4354-9836-f1a198532c9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:20:27 user nova-compute[95467]: DEBUG nova.compute.manager [req-f196825b-e649-4883-9815-f11394906bdc req-9e122028-b207-4f4b-b383-51dcc1b5139e service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] No waiting events found dispatching network-vif-unplugged-ffab8636-a06b-43fc-9aa8-fcec46b2426d {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:20:27 user nova-compute[95467]: DEBUG nova.compute.manager [req-f196825b-e649-4883-9815-f11394906bdc req-9e122028-b207-4f4b-b383-51dcc1b5139e service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Received event network-vif-unplugged-ffab8636-a06b-43fc-9aa8-fcec46b2426d for instance with task_state deleting. {{(pid=95467) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 08:20:27 user nova-compute[95467]: DEBUG nova.compute.manager [req-f196825b-e649-4883-9815-f11394906bdc req-9e122028-b207-4f4b-b383-51dcc1b5139e service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Received event network-vif-plugged-ffab8636-a06b-43fc-9aa8-fcec46b2426d {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-f196825b-e649-4883-9815-f11394906bdc req-9e122028-b207-4f4b-b383-51dcc1b5139e service nova] Acquiring lock "1c438a54-5528-4354-9836-f1a198532c9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-f196825b-e649-4883-9815-f11394906bdc req-9e122028-b207-4f4b-b383-51dcc1b5139e service nova] Lock "1c438a54-5528-4354-9836-f1a198532c9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-f196825b-e649-4883-9815-f11394906bdc req-9e122028-b207-4f4b-b383-51dcc1b5139e service nova] Lock "1c438a54-5528-4354-9836-f1a198532c9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG nova.compute.manager [req-f196825b-e649-4883-9815-f11394906bdc req-9e122028-b207-4f4b-b383-51dcc1b5139e service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] No waiting events found dispatching network-vif-plugged-ffab8636-a06b-43fc-9aa8-fcec46b2426d {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:20:28 user nova-compute[95467]: WARNING nova.compute.manager [req-f196825b-e649-4883-9815-f11394906bdc req-9e122028-b207-4f4b-b383-51dcc1b5139e service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Received unexpected event network-vif-plugged-ffab8636-a06b-43fc-9aa8-fcec46b2426d for instance with vm_state active and task_state deleting.
Nov 15 08:20:28 user nova-compute[95467]: DEBUG nova.compute.manager [req-f196825b-e649-4883-9815-f11394906bdc req-9e122028-b207-4f4b-b383-51dcc1b5139e service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Received event network-vif-unplugged-27370ddc-29be-446e-8205-a50379d200d7 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-f196825b-e649-4883-9815-f11394906bdc req-9e122028-b207-4f4b-b383-51dcc1b5139e service nova] Acquiring lock "1c438a54-5528-4354-9836-f1a198532c9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-f196825b-e649-4883-9815-f11394906bdc req-9e122028-b207-4f4b-b383-51dcc1b5139e service nova] Lock "1c438a54-5528-4354-9836-f1a198532c9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-f196825b-e649-4883-9815-f11394906bdc req-9e122028-b207-4f4b-b383-51dcc1b5139e service nova] Lock "1c438a54-5528-4354-9836-f1a198532c9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG nova.compute.manager [req-f196825b-e649-4883-9815-f11394906bdc req-9e122028-b207-4f4b-b383-51dcc1b5139e service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] No waiting events found dispatching network-vif-unplugged-27370ddc-29be-446e-8205-a50379d200d7 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG nova.compute.manager [req-f196825b-e649-4883-9815-f11394906bdc req-9e122028-b207-4f4b-b383-51dcc1b5139e service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Received event network-vif-unplugged-27370ddc-29be-446e-8205-a50379d200d7 for instance with task_state deleting. {{(pid=95467) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG nova.compute.manager [req-f196825b-e649-4883-9815-f11394906bdc req-9e122028-b207-4f4b-b383-51dcc1b5139e service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Received event network-vif-plugged-27370ddc-29be-446e-8205-a50379d200d7 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-f196825b-e649-4883-9815-f11394906bdc req-9e122028-b207-4f4b-b383-51dcc1b5139e service nova] Acquiring lock "1c438a54-5528-4354-9836-f1a198532c9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-f196825b-e649-4883-9815-f11394906bdc req-9e122028-b207-4f4b-b383-51dcc1b5139e service nova] Lock "1c438a54-5528-4354-9836-f1a198532c9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-f196825b-e649-4883-9815-f11394906bdc req-9e122028-b207-4f4b-b383-51dcc1b5139e service nova] Lock "1c438a54-5528-4354-9836-f1a198532c9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG nova.compute.manager [req-f196825b-e649-4883-9815-f11394906bdc req-9e122028-b207-4f4b-b383-51dcc1b5139e service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] No waiting events found dispatching network-vif-plugged-27370ddc-29be-446e-8205-a50379d200d7 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:20:28 user nova-compute[95467]: WARNING nova.compute.manager [req-f196825b-e649-4883-9815-f11394906bdc req-9e122028-b207-4f4b-b383-51dcc1b5139e service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Received unexpected event network-vif-plugged-27370ddc-29be-446e-8205-a50379d200d7 for instance with vm_state active and task_state deleting.
Nov 15 08:20:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a4d1bea1-3321-4a7d-9846-86dd511dcb9e) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:28 user nova-compute[95467]: INFO os_vif [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:8b:29,bridge_name='br-int',has_traffic_filtering=True,id=68127374-b841-456d-b9eb-29e96bd43dc6,network=Network(fd06ef46-be25-4b52-8c3b-cda8a4ec8124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap68127374-b8')
Nov 15 08:20:28 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T08:18:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-163188137',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-163188137',id=29,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPc3ntsDCHvSt2Zeq2Eoj7Sh8oVGFbUIkQaZX9nyjxUcj7agqfuKFvy+F+MPCCQt5Teq5JV4myceW+vQlye/stucWDEV+fW0F7nLBuTFv4gu71gMuBsUY5AVHQyQOb6pzQ==',key_name='tempest-keypair-475690846',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:19:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='40e501e472d742539ef6a4d9c5175d3d',ramdisk_id='',reservation_id='r-z06nzzlq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-248573984',owner_user_name='tempest-TaggedBootDevicesTest-248573984-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:19:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2da4703cb9454345a21adb41812a37ad',uuid=1c438a54-5528-4354-9836-f1a198532c9b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "79b592a8-b5f9-48e6-ae2d-d535ded922b1", "address": "fa:16:3e:f8:e1:13", "network": {"id": "fd06ef46-be25-4b52-8c3b-cda8a4ec8124", "bridge": "br-int", "label": "tempest-device-tagging-net1-887816556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79b592a8-b5", "ovs_interfaceid": "79b592a8-b5f9-48e6-ae2d-d535ded922b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Converting VIF {"id": "79b592a8-b5f9-48e6-ae2d-d535ded922b1", "address": "fa:16:3e:f8:e1:13", "network": {"id": "fd06ef46-be25-4b52-8c3b-cda8a4ec8124", "bridge": "br-int", "label": "tempest-device-tagging-net1-887816556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79b592a8-b5", "ovs_interfaceid": "79b592a8-b5f9-48e6-ae2d-d535ded922b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:e1:13,bridge_name='br-int',has_traffic_filtering=True,id=79b592a8-b5f9-48e6-ae2d-d535ded922b1,network=Network(fd06ef46-be25-4b52-8c3b-cda8a4ec8124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79b592a8-b5') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG os_vif [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:e1:13,bridge_name='br-int',has_traffic_filtering=True,id=79b592a8-b5f9-48e6-ae2d-d535ded922b1,network=Network(fd06ef46-be25-4b52-8c3b-cda8a4ec8124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79b592a8-b5') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap79b592a8-b5, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG nova.compute.manager [req-aa21ef8e-ae13-4dda-b67f-ead2ea5d4f5e req-f04c127b-04cd-484a-9e23-5db267b02f05 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Received event network-vif-plugged-d6c4a108-4733-4daa-935a-56424ed362e9 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-aa21ef8e-ae13-4dda-b67f-ead2ea5d4f5e req-f04c127b-04cd-484a-9e23-5db267b02f05 service nova] Acquiring lock "1c438a54-5528-4354-9836-f1a198532c9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-aa21ef8e-ae13-4dda-b67f-ead2ea5d4f5e req-f04c127b-04cd-484a-9e23-5db267b02f05 service nova] Lock "1c438a54-5528-4354-9836-f1a198532c9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-aa21ef8e-ae13-4dda-b67f-ead2ea5d4f5e req-f04c127b-04cd-484a-9e23-5db267b02f05 service nova] Lock "1c438a54-5528-4354-9836-f1a198532c9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG nova.compute.manager [req-aa21ef8e-ae13-4dda-b67f-ead2ea5d4f5e req-f04c127b-04cd-484a-9e23-5db267b02f05 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] No waiting events found dispatching network-vif-plugged-d6c4a108-4733-4daa-935a-56424ed362e9 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:20:28 user nova-compute[95467]: WARNING nova.compute.manager [req-aa21ef8e-ae13-4dda-b67f-ead2ea5d4f5e req-f04c127b-04cd-484a-9e23-5db267b02f05 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Received unexpected event network-vif-plugged-d6c4a108-4733-4daa-935a-56424ed362e9 for instance with vm_state active and task_state deleting.
Nov 15 08:20:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9f225024-3f0b-4854-8daf-11bf02646a9a) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:28 user nova-compute[95467]: INFO os_vif [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:e1:13,bridge_name='br-int',has_traffic_filtering=True,id=79b592a8-b5f9-48e6-ae2d-d535ded922b1,network=Network(fd06ef46-be25-4b52-8c3b-cda8a4ec8124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79b592a8-b5')
Nov 15 08:20:28 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T08:18:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-163188137',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-163188137',id=29,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPc3ntsDCHvSt2Zeq2Eoj7Sh8oVGFbUIkQaZX9nyjxUcj7agqfuKFvy+F+MPCCQt5Teq5JV4myceW+vQlye/stucWDEV+fW0F7nLBuTFv4gu71gMuBsUY5AVHQyQOb6pzQ==',key_name='tempest-keypair-475690846',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:19:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='40e501e472d742539ef6a4d9c5175d3d',ramdisk_id='',reservation_id='r-z06nzzlq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-248573984',owner_user_name='tempest-TaggedBootDevicesTest-248573984-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:19:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2da4703cb9454345a21adb41812a37ad',uuid=1c438a54-5528-4354-9836-f1a198532c9b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "71b2b3bf-8597-40e5-803d-be98308390b7", "address": "fa:16:3e:97:58:f0", "network": {"id": "fd06ef46-be25-4b52-8c3b-cda8a4ec8124", "bridge": "br-int", "label": "tempest-device-tagging-net1-887816556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71b2b3bf-85", "ovs_interfaceid": "71b2b3bf-8597-40e5-803d-be98308390b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Converting VIF {"id": "71b2b3bf-8597-40e5-803d-be98308390b7", "address": "fa:16:3e:97:58:f0", "network": {"id": "fd06ef46-be25-4b52-8c3b-cda8a4ec8124", "bridge": "br-int", "label": "tempest-device-tagging-net1-887816556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71b2b3bf-85", "ovs_interfaceid": "71b2b3bf-8597-40e5-803d-be98308390b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:58:f0,bridge_name='br-int',has_traffic_filtering=True,id=71b2b3bf-8597-40e5-803d-be98308390b7,network=Network(fd06ef46-be25-4b52-8c3b-cda8a4ec8124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71b2b3bf-85') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG os_vif [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:58:f0,bridge_name='br-int',has_traffic_filtering=True,id=71b2b3bf-8597-40e5-803d-be98308390b7,network=Network(fd06ef46-be25-4b52-8c3b-cda8a4ec8124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71b2b3bf-85') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap71b2b3bf-85, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7cc52e40-9e20-4fe1-a665-6a30cde4a288) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:28 user nova-compute[95467]: INFO os_vif [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:58:f0,bridge_name='br-int',has_traffic_filtering=True,id=71b2b3bf-8597-40e5-803d-be98308390b7,network=Network(fd06ef46-be25-4b52-8c3b-cda8a4ec8124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71b2b3bf-85')
Nov 15 08:20:28 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T08:18:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-163188137',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-163188137',id=29,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPc3ntsDCHvSt2Zeq2Eoj7Sh8oVGFbUIkQaZX9nyjxUcj7agqfuKFvy+F+MPCCQt5Teq5JV4myceW+vQlye/stucWDEV+fW0F7nLBuTFv4gu71gMuBsUY5AVHQyQOb6pzQ==',key_name='tempest-keypair-475690846',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:19:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='40e501e472d742539ef6a4d9c5175d3d',ramdisk_id='',reservation_id='r-z06nzzlq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-248573984',owner_user_name='tempest-TaggedBootDevicesTest-248573984-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:19:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2da4703cb9454345a21adb41812a37ad',uuid=1c438a54-5528-4354-9836-f1a198532c9b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ffab8636-a06b-43fc-9aa8-fcec46b2426d", "address": "fa:16:3e:60:ba:2c", "network": {"id": "eee7a16a-db60-4993-aaae-5142fa17ff37", "bridge": "br-int", "label": "tempest-device-tagging-net2-2138433061", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffab8636-a0", "ovs_interfaceid": "ffab8636-a06b-43fc-9aa8-fcec46b2426d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Converting VIF {"id": "ffab8636-a06b-43fc-9aa8-fcec46b2426d", "address": "fa:16:3e:60:ba:2c", "network": {"id": "eee7a16a-db60-4993-aaae-5142fa17ff37", "bridge": "br-int", "label": "tempest-device-tagging-net2-2138433061", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffab8636-a0", "ovs_interfaceid": "ffab8636-a06b-43fc-9aa8-fcec46b2426d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:ba:2c,bridge_name='br-int',has_traffic_filtering=True,id=ffab8636-a06b-43fc-9aa8-fcec46b2426d,network=Network(eee7a16a-db60-4993-aaae-5142fa17ff37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffab8636-a0') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG os_vif [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:ba:2c,bridge_name='br-int',has_traffic_filtering=True,id=ffab8636-a06b-43fc-9aa8-fcec46b2426d,network=Network(eee7a16a-db60-4993-aaae-5142fa17ff37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffab8636-a0') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapffab8636-a0, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=adfa5b35-8b87-4bf6-98c9-59f8c77643b8) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:28 user nova-compute[95467]: INFO os_vif [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:ba:2c,bridge_name='br-int',has_traffic_filtering=True,id=ffab8636-a06b-43fc-9aa8-fcec46b2426d,network=Network(eee7a16a-db60-4993-aaae-5142fa17ff37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffab8636-a0')
Nov 15 08:20:28 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T08:18:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-163188137',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-163188137',id=29,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPc3ntsDCHvSt2Zeq2Eoj7Sh8oVGFbUIkQaZX9nyjxUcj7agqfuKFvy+F+MPCCQt5Teq5JV4myceW+vQlye/stucWDEV+fW0F7nLBuTFv4gu71gMuBsUY5AVHQyQOb6pzQ==',key_name='tempest-keypair-475690846',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:19:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='40e501e472d742539ef6a4d9c5175d3d',ramdisk_id='',reservation_id='r-z06nzzlq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-248573984',owner_user_name='tempest-TaggedBootDevicesTest-248573984-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:19:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2da4703cb9454345a21adb41812a37ad',uuid=1c438a54-5528-4354-9836-f1a198532c9b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27370ddc-29be-446e-8205-a50379d200d7", "address": "fa:16:3e:36:19:6a", "network": {"id": "eee7a16a-db60-4993-aaae-5142fa17ff37", "bridge": "br-int", "label": "tempest-device-tagging-net2-2138433061", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27370ddc-29", "ovs_interfaceid": "27370ddc-29be-446e-8205-a50379d200d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Converting VIF {"id": "27370ddc-29be-446e-8205-a50379d200d7", "address": "fa:16:3e:36:19:6a", "network": {"id": "eee7a16a-db60-4993-aaae-5142fa17ff37", "bridge": "br-int", "label": "tempest-device-tagging-net2-2138433061", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27370ddc-29", "ovs_interfaceid": "27370ddc-29be-446e-8205-a50379d200d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:19:6a,bridge_name='br-int',has_traffic_filtering=True,id=27370ddc-29be-446e-8205-a50379d200d7,network=Network(eee7a16a-db60-4993-aaae-5142fa17ff37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27370ddc-29') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG os_vif [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:19:6a,bridge_name='br-int',has_traffic_filtering=True,id=27370ddc-29be-446e-8205-a50379d200d7,network=Network(eee7a16a-db60-4993-aaae-5142fa17ff37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27370ddc-29') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap27370ddc-29, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b49002cb-2a11-488f-86d6-6118415f0d3c) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:20:28 user nova-compute[95467]: INFO os_vif [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:19:6a,bridge_name='br-int',has_traffic_filtering=True,id=27370ddc-29be-446e-8205-a50379d200d7,network=Network(eee7a16a-db60-4993-aaae-5142fa17ff37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27370ddc-29')
Nov 15 08:20:28 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] calling os-brick to detach iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, {'target_iqn': 'iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CVtZzOqD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:20:28 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:20:28 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG nova.compute.manager [req-ea103944-0733-410b-b7b8-f64e877d5736 req-af378a9e-b577-425f-be6c-d858f041c6ba service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Received event network-vif-plugged-79b592a8-b5f9-48e6-ae2d-d535ded922b1 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ea103944-0733-410b-b7b8-f64e877d5736 req-af378a9e-b577-425f-be6c-d858f041c6ba service nova] Acquiring lock "1c438a54-5528-4354-9836-f1a198532c9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ea103944-0733-410b-b7b8-f64e877d5736 req-af378a9e-b577-425f-be6c-d858f041c6ba service nova] Lock "1c438a54-5528-4354-9836-f1a198532c9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ea103944-0733-410b-b7b8-f64e877d5736 req-af378a9e-b577-425f-be6c-d858f041c6ba service nova] Lock "1c438a54-5528-4354-9836-f1a198532c9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG nova.compute.manager [req-ea103944-0733-410b-b7b8-f64e877d5736 req-af378a9e-b577-425f-be6c-d858f041c6ba service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] No waiting events found dispatching network-vif-plugged-79b592a8-b5f9-48e6-ae2d-d535ded922b1 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:20:28 user nova-compute[95467]: WARNING nova.compute.manager [req-ea103944-0733-410b-b7b8-f64e877d5736 req-af378a9e-b577-425f-be6c-d858f041c6ba service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Received unexpected event network-vif-plugged-79b592a8-b5f9-48e6-ae2d-d535ded922b1 for instance with vm_state active and task_state deleting.
Nov 15 08:20:28 user nova-compute[95467]: DEBUG nova.compute.manager [req-ea103944-0733-410b-b7b8-f64e877d5736 req-af378a9e-b577-425f-be6c-d858f041c6ba service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Received event network-vif-unplugged-71b2b3bf-8597-40e5-803d-be98308390b7 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ea103944-0733-410b-b7b8-f64e877d5736 req-af378a9e-b577-425f-be6c-d858f041c6ba service nova] Acquiring lock "1c438a54-5528-4354-9836-f1a198532c9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ea103944-0733-410b-b7b8-f64e877d5736 req-af378a9e-b577-425f-be6c-d858f041c6ba service nova] Lock "1c438a54-5528-4354-9836-f1a198532c9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ea103944-0733-410b-b7b8-f64e877d5736 req-af378a9e-b577-425f-be6c-d858f041c6ba service nova] Lock "1c438a54-5528-4354-9836-f1a198532c9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG nova.compute.manager [req-ea103944-0733-410b-b7b8-f64e877d5736 req-af378a9e-b577-425f-be6c-d858f041c6ba service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] No waiting events found dispatching network-vif-unplugged-71b2b3bf-8597-40e5-803d-be98308390b7 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG nova.compute.manager [req-ea103944-0733-410b-b7b8-f64e877d5736 req-af378a9e-b577-425f-be6c-d858f041c6ba service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Received event network-vif-unplugged-71b2b3bf-8597-40e5-803d-be98308390b7 for instance with task_state deleting. {{(pid=95467) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG nova.compute.manager [req-ea103944-0733-410b-b7b8-f64e877d5736 req-af378a9e-b577-425f-be6c-d858f041c6ba service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Received event network-vif-plugged-71b2b3bf-8597-40e5-803d-be98308390b7 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ea103944-0733-410b-b7b8-f64e877d5736 req-af378a9e-b577-425f-be6c-d858f041c6ba service nova] Acquiring lock "1c438a54-5528-4354-9836-f1a198532c9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ea103944-0733-410b-b7b8-f64e877d5736 req-af378a9e-b577-425f-be6c-d858f041c6ba service nova] Lock "1c438a54-5528-4354-9836-f1a198532c9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ea103944-0733-410b-b7b8-f64e877d5736 req-af378a9e-b577-425f-be6c-d858f041c6ba service nova] Lock "1c438a54-5528-4354-9836-f1a198532c9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG nova.compute.manager [req-ea103944-0733-410b-b7b8-f64e877d5736 req-af378a9e-b577-425f-be6c-d858f041c6ba service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] No waiting events found dispatching network-vif-plugged-71b2b3bf-8597-40e5-803d-be98308390b7 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:20:28 user nova-compute[95467]: WARNING nova.compute.manager [req-ea103944-0733-410b-b7b8-f64e877d5736 req-af378a9e-b577-425f-be6c-d858f041c6ba service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Received unexpected event network-vif-plugged-71b2b3bf-8597-40e5-803d-be98308390b7 for instance with vm_state active and task_state deleting.
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5ad442-8402-4f8a-bf2b-9b124ac62aad]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 08:20:28 user nova-compute[95467]: No targets found.
Nov 15 08:20:28 user nova-compute[95467]: iSNS:
Nov 15 08:20:28 user nova-compute[95467]: No targets found.
Nov 15 08:20:28 user nova-compute[95467]: STATIC:
Nov 15 08:20:28 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7
Nov 15 08:20:28 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:20:28 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:20:28 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e
Nov 15 08:20:28 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:20:28 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:20:28 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149
Nov 15 08:20:28 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:20:28 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:20:28 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775
Nov 15 08:20:28 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:20:28 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:20:28 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551
Nov 15 08:20:28 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:20:28 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:20:28 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612
Nov 15 08:20:28 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:20:28 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:20:28 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b
Nov 15 08:20:28 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:20:28 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:20:28 user nova-compute[95467]: FIRMWARE:
Nov 15 08:20:28 user nova-compute[95467]: No targets found.
Nov 15 08:20:28 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 08:20:28 user nova-compute[95467]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 08:20:28 user nova-compute[95467]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=95467) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b', 0)] {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[512d499e-eae4-4dac-9e77-4f4220de9664]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c16ac9a4-1912-4ec2-a6c9-f8212a986e01]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:20:28 user nova-compute[95467]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)
Nov 15 08:20:28 user nova-compute[95467]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b (non-flash)
Nov 15 08:20:28 user nova-compute[95467]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7 (non-flash)
Nov 15 08:20:28 user nova-compute[95467]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612 (non-flash)
Nov 15 08:20:28 user nova-compute[95467]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551 (non-flash)
Nov 15 08:20:28 user nova-compute[95467]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:20:28 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:20:28 user nova-compute[95467]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)
Nov 15 08:20:28 user nova-compute[95467]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b (non-flash)
Nov 15 08:20:28 user nova-compute[95467]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7 (non-flash)
Nov 15 08:20:28 user nova-compute[95467]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612 (non-flash)
Nov 15 08:20:28 user nova-compute[95467]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551 (non-flash)
Nov 15 08:20:28 user nova-compute[95467]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:20:28 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efec8349870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b'): ({'sdc'}, set())}) {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Removing single pathed devices sdc {{(pid=95467) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[71cfc48a-be95-4b6a-8f4a-5ab4465fb57b]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe7f1cf-9688-48b6-833c-525030cebe5f]: (4, ('ok\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Flushing IO for device /dev/sdc {{(pid=95467) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f70014-7fa6-4dea-becb-2f520547ecfa]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=95467) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.057s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3913120-5c72-4e26-b566-9f4640eea0b9]: (4, ('1', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] SCSI volumes sdc have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b')] {{(pid=95467) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.051s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f11b41d2-37ee-4e36-964e-960e3ce326af]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b -p 172.16.0.220:3260 --logout {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c2b130-fec6-4802-a892-7d650462261c]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b, portal: 172.16.0.220,3260]
Nov 15 08:20:28 user nova-compute[95467]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b, portal: 172.16.0.220,3260] successful.
Nov 15 08:20:28 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b -p 172.16.0.220:3260 --op delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74097ec0-88f6-4b8c-b01f-3be5fdbdf87b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d524b7b4-eba3-4642-83f1-c6eba6819a73]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.416s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] <== disconnect_volume: return (418ms) None {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Disconnected iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] calling os-brick to detach iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, {'target_iqn': 'iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oflqFjBz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:20:28 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:20:28 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[afea22aa-3bfe-42f3-b757-705b57c63337]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 08:20:28 user nova-compute[95467]: No targets found.
Nov 15 08:20:28 user nova-compute[95467]: iSNS:
Nov 15 08:20:28 user nova-compute[95467]: No targets found.
Nov 15 08:20:28 user nova-compute[95467]: STATIC:
Nov 15 08:20:28 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7
Nov 15 08:20:28 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:20:28 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:20:28 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e
Nov 15 08:20:28 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:20:28 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:20:28 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149
Nov 15 08:20:28 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:20:28 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:20:28 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775
Nov 15 08:20:28 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:20:28 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:20:28 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551
Nov 15 08:20:28 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:20:28 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:20:28 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612
Nov 15 08:20:28 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:20:28 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:20:28 user nova-compute[95467]: FIRMWARE:
Nov 15 08:20:28 user nova-compute[95467]: No targets found.
Nov 15 08:20:28 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 08:20:28 user nova-compute[95467]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 08:20:28 user nova-compute[95467]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=95467) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612', 0)] {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d32d06-8b83-42e0-82da-3ae0e266a2fc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb5529b-2a64-4598-b905-4b607105afbb]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:20:28 user nova-compute[95467]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)
Nov 15 08:20:28 user nova-compute[95467]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7 (non-flash)
Nov 15 08:20:28 user nova-compute[95467]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612 (non-flash)
Nov 15 08:20:28 user nova-compute[95467]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551 (non-flash)
Nov 15 08:20:28 user nova-compute[95467]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:20:28 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:20:28 user nova-compute[95467]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)
Nov 15 08:20:28 user nova-compute[95467]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7 (non-flash)
Nov 15 08:20:28 user nova-compute[95467]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612 (non-flash)
Nov 15 08:20:28 user nova-compute[95467]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551 (non-flash)
Nov 15 08:20:28 user nova-compute[95467]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:20:28 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efed857a4d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612'): ({'sdg'}, set())}) {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Removing single pathed devices sdg {{(pid=95467) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e2992b-aedb-4ab4-8286-a4b6359d5deb]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[3012a507-0fbd-40f6-83b0-0c7655b01939]: (4, ('ok\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Flushing IO for device /dev/sdg {{(pid=95467) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[67372975-4247-48af-8768-1f2ddd9d70bd]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=95467) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.041s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[287e526a-a885-4298-9cfe-c38466024a0d]: (4, ('1', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] SCSI volumes sdg have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612')] {{(pid=95467) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f2b43a-d798-45b6-85c6-5b92516b097d]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:20:28 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612 -p 172.16.0.220:3260 --logout {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:29 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8deac63-4582-489d-9639-92cbcda8aaae]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:20:29 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612, portal: 172.16.0.220,3260]
Nov 15 08:20:29 user nova-compute[95467]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612, portal: 172.16.0.220,3260] successful.
Nov 15 08:20:29 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:20:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612 -p 172.16.0.220:3260 --op delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bef17724-2105-4964-a1f3-57663bf01612 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:29 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f707f371-4631-44f2-b119-3d998d219173]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:20:29 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:20:29 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:20:29 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] <== disconnect_volume: return (306ms) None {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:20:29 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Disconnected iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 08:20:29 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] calling os-brick to detach iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 08:20:29 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, {'target_iqn': 'iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yImUtSeO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:20:29 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:20:29 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:20:29 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:20:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:29 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2553ba-f7d7-4330-9762-8ca69290179f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:20:29 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 08:20:29 user nova-compute[95467]: No targets found.
Nov 15 08:20:29 user nova-compute[95467]: iSNS:
Nov 15 08:20:29 user nova-compute[95467]: No targets found.
Nov 15 08:20:29 user nova-compute[95467]: STATIC:
Nov 15 08:20:29 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7
Nov 15 08:20:29 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:20:29 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:20:29 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e
Nov 15 08:20:29 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:20:29 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:20:29 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149
Nov 15 08:20:29 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:20:29 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:20:29 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775
Nov 15 08:20:29 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:20:29 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:20:29 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551
Nov 15 08:20:29 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:20:29 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:20:29 user nova-compute[95467]: FIRMWARE:
Nov 15 08:20:29 user nova-compute[95467]: No targets found.
Nov 15 08:20:29 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:20:29 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 08:20:29 user nova-compute[95467]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 08:20:29 user nova-compute[95467]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=95467) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 08:20:29 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551', 0)] {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 08:20:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:29 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[828d5274-56c6-431b-b936-4b207088adef]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:20:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:29 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16f9b37-a400-4fa2-97fc-db005a4a33d4]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:20:29 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:20:29 user nova-compute[95467]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)
Nov 15 08:20:29 user nova-compute[95467]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7 (non-flash)
Nov 15 08:20:29 user nova-compute[95467]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551 (non-flash)
Nov 15 08:20:29 user nova-compute[95467]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:20:29 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:20:29 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:20:29 user nova-compute[95467]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)
Nov 15 08:20:29 user nova-compute[95467]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7 (non-flash)
Nov 15 08:20:29 user nova-compute[95467]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551 (non-flash)
Nov 15 08:20:29 user nova-compute[95467]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:20:29 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:20:29 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efed857a4d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551'): ({'sdh'}, set())}) {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 08:20:29 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Removing single pathed devices sdh {{(pid=95467) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 08:20:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:29 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[33bcca29-a62e-4a5f-b8e5-7eac844b2b51]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:20:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.024s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:29 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d684455-e630-4611-bcc9-310809a7722d]: (4, ('ok\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:20:29 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Flushing IO for device /dev/sdh {{(pid=95467) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 08:20:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.012s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:29 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd563f8-5710-495b-ab00-edc60b013404]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:20:29 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=95467) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 08:20:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.052s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:29 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[39404318-1ace-4c01-902f-e670dee407e1]: (4, ('1', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:20:29 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 08:20:29 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] SCSI volumes sdh have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 08:20:29 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551')] {{(pid=95467) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 08:20:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:29 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82f1a05-4165-48db-8a2a-6d94161973a9]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:20:29 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:20:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551 -p 172.16.0.220:3260 --logout {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:29 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[681de8dd-09d1-4693-8762-c01af335c13f]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:20:29 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551, portal: 172.16.0.220,3260]
Nov 15 08:20:29 user nova-compute[95467]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551, portal: 172.16.0.220,3260] successful.
Nov 15 08:20:29 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:20:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551 -p 172.16.0.220:3260 --op delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:29 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8e174af-7109-499d-8142-127fae825551 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:29 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6b8ef0-00c5-4f8e-9329-8bb1960c22c7]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:20:29 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:20:29 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:20:29 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] <== disconnect_volume: return (313ms) None {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:20:29 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Disconnected iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 08:20:29 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Deleting instance files /opt/stack/data/nova/instances/1c438a54-5528-4354-9836-f1a198532c9b_del
Nov 15 08:20:29 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Deletion of /opt/stack/data/nova/instances/1c438a54-5528-4354-9836-f1a198532c9b_del complete
Nov 15 08:20:29 user nova-compute[95467]: INFO nova.compute.manager [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Took 3.86 seconds to destroy the instance on the hypervisor.
Nov 15 08:20:29 user nova-compute[95467]: DEBUG oslo.service.loopingcall [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=95467) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 08:20:29 user nova-compute[95467]: DEBUG nova.compute.manager [-] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Deallocating network for instance {{(pid=95467) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 08:20:29 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] deallocate_for_instance() {{(pid=95467) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 08:20:30 user nova-compute[95467]: DEBUG nova.compute.manager [req-4a6d9a81-35ea-4ccd-b079-300e2931cd47 req-132fdafe-fdea-4f03-9fea-74fff85b2696 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Received event network-vif-deleted-27370ddc-29be-446e-8205-a50379d200d7 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:20:30 user nova-compute[95467]: INFO nova.compute.manager [req-4a6d9a81-35ea-4ccd-b079-300e2931cd47 req-132fdafe-fdea-4f03-9fea-74fff85b2696 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Neutron deleted interface 27370ddc-29be-446e-8205-a50379d200d7; detaching it from the instance and deleting it from the info cache
Nov 15 08:20:30 user nova-compute[95467]: DEBUG nova.network.neutron [req-4a6d9a81-35ea-4ccd-b079-300e2931cd47 req-132fdafe-fdea-4f03-9fea-74fff85b2696 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Updating instance_info_cache with network_info: [{"id": "5cab4329-e3d7-4d50-9a27-c1291f6f4b4a", "address": "fa:16:3e:52:67:fa", "network": {"id": "ca364f10-9c7d-4574-ae0a-76a1a2a3116d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-497069669-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cab4329-e3", "ovs_interfaceid": "5cab4329-e3d7-4d50-9a27-c1291f6f4b4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d6c4a108-4733-4daa-935a-56424ed362e9", "address": "fa:16:3e:d7:91:0a", "network": {"id": "fd06ef46-be25-4b52-8c3b-cda8a4ec8124", "bridge": "br-int", "label": "tempest-device-tagging-net1-887816556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c4a108-47", "ovs_interfaceid": "d6c4a108-4733-4daa-935a-56424ed362e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "68127374-b841-456d-b9eb-29e96bd43dc6", "address": "fa:16:3e:0c:8b:29", "network": {"id": "fd06ef46-be25-4b52-8c3b-cda8a4ec8124", "bridge": "br-int", "label": "tempest-device-tagging-net1-887816556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68127374-b8", "ovs_interfaceid": "68127374-b841-456d-b9eb-29e96bd43dc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "79b592a8-b5f9-48e6-ae2d-d535ded922b1", "address": "fa:16:3e:f8:e1:13", "network": {"id": "fd06ef46-be25-4b52-8c3b-cda8a4ec8124", "bridge": "br-int", "label": "tempest-device-tagging-net1-887816556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79b592a8-b5", "ovs_interfaceid": "79b592a8-b5f9-48e6-ae2d-d535ded922b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "71b2b3bf-8597-40e5-803d-be98308390b7", "address": "fa:16:3e:97:58:f0", "network": {"id": "fd06ef46-be25-4b52-8c3b-cda8a4ec8124", "bridge": "br-int", "label": "tempest-device-tagging-net1-887816556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71b2b3bf-85", "ovs_interfaceid": "71b2b3bf-8597-40e5-803d-be98308390b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ffab8636-a06b-43fc-9aa8-fcec46b2426d", "address": "fa:16:3e:60:ba:2c", "network": {"id": "eee7a16a-db60-4993-aaae-5142fa17ff37", "bridge": "br-int", "label": "tempest-device-tagging-net2-2138433061", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "40e501e472d742539ef6a4d9c5175d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffab8636-a0", "ovs_interfaceid": "ffab8636-a06b-43fc-9aa8-fcec46b2426d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:20:31 user nova-compute[95467]: DEBUG nova.compute.manager [req-4a6d9a81-35ea-4ccd-b079-300e2931cd47 req-132fdafe-fdea-4f03-9fea-74fff85b2696 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Detach interface failed, port_id=27370ddc-29be-446e-8205-a50379d200d7, reason: Instance 1c438a54-5528-4354-9836-f1a198532c9b could not be found. {{(pid=95467) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 08:20:32 user nova-compute[95467]: DEBUG nova.compute.manager [req-8406acb8-0708-4cc4-a968-8ea9edcd17fd req-58248bc2-2625-425d-92aa-70d47722c798 service nova] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] Received event network-changed-fb6b8f05-83f8-4ee0-9e3b-1efc13a335fb {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:20:32 user nova-compute[95467]: DEBUG nova.compute.manager [req-8406acb8-0708-4cc4-a968-8ea9edcd17fd req-58248bc2-2625-425d-92aa-70d47722c798 service nova] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] Refreshing instance network info cache due to event network-changed-fb6b8f05-83f8-4ee0-9e3b-1efc13a335fb. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:20:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-8406acb8-0708-4cc4-a968-8ea9edcd17fd req-58248bc2-2625-425d-92aa-70d47722c798 service nova] Acquiring lock "refresh_cache-13957136-17e4-4d38-aba3-37453e1fb878" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:20:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-8406acb8-0708-4cc4-a968-8ea9edcd17fd req-58248bc2-2625-425d-92aa-70d47722c798 service nova] Acquired lock "refresh_cache-13957136-17e4-4d38-aba3-37453e1fb878" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:20:32 user nova-compute[95467]: DEBUG nova.network.neutron [req-8406acb8-0708-4cc4-a968-8ea9edcd17fd req-58248bc2-2625-425d-92aa-70d47722c798 service nova] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] Refreshing network info cache for port fb6b8f05-83f8-4ee0-9e3b-1efc13a335fb {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:20:32 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:20:32 user nova-compute[95467]: INFO nova.compute.manager [-] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Took 3.11 seconds to deallocate network for instance.
Nov 15 08:20:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:32 user nova-compute[95467]: DEBUG nova.network.neutron [req-8406acb8-0708-4cc4-a968-8ea9edcd17fd req-58248bc2-2625-425d-92aa-70d47722c798 service nova] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] Updated VIF entry in instance network info cache for port fb6b8f05-83f8-4ee0-9e3b-1efc13a335fb. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:20:32 user nova-compute[95467]: DEBUG nova.network.neutron [req-8406acb8-0708-4cc4-a968-8ea9edcd17fd req-58248bc2-2625-425d-92aa-70d47722c798 service nova] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] Updating instance_info_cache with network_info: [{"id": "fb6b8f05-83f8-4ee0-9e3b-1efc13a335fb", "address": "fa:16:3e:c3:96:a0", "network": {"id": "96d9262b-11fb-497d-8e38-fa46076c010f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2069167691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7791bd92c7c488aa72474ecde2e1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb6b8f05-83", "ovs_interfaceid": "fb6b8f05-83f8-4ee0-9e3b-1efc13a335fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:20:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-8406acb8-0708-4cc4-a968-8ea9edcd17fd req-58248bc2-2625-425d-92aa-70d47722c798 service nova] Releasing lock "refresh_cache-13957136-17e4-4d38-aba3-37453e1fb878" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:20:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3e30a0de-9178-4f25-b03c-fd3b6d81098f tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Acquiring lock "13957136-17e4-4d38-aba3-37453e1fb878" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:20:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3e30a0de-9178-4f25-b03c-fd3b6d81098f tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "13957136-17e4-4d38-aba3-37453e1fb878" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:20:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3e30a0de-9178-4f25-b03c-fd3b6d81098f tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Acquiring lock "13957136-17e4-4d38-aba3-37453e1fb878-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:20:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3e30a0de-9178-4f25-b03c-fd3b6d81098f tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "13957136-17e4-4d38-aba3-37453e1fb878-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:20:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3e30a0de-9178-4f25-b03c-fd3b6d81098f tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "13957136-17e4-4d38-aba3-37453e1fb878-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:20:32 user nova-compute[95467]: INFO nova.compute.manager [None req-3e30a0de-9178-4f25-b03c-fd3b6d81098f tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] Terminating instance
Nov 15 08:20:32 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3e30a0de-9178-4f25-b03c-fd3b6d81098f tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] Start destroying the instance on the hypervisor. {{(pid=95467) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 08:20:32 user nova-compute[95467]: DEBUG nova.compute.manager [req-b0661cc5-6acc-4b79-933d-ec60e911a583 req-3cf9f722-234c-4566-9ad1-de006d955d85 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Received event network-vif-deleted-79b592a8-b5f9-48e6-ae2d-d535ded922b1 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:20:32 user nova-compute[95467]: DEBUG nova.compute.manager [req-b0661cc5-6acc-4b79-933d-ec60e911a583 req-3cf9f722-234c-4566-9ad1-de006d955d85 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Received event network-vif-deleted-ffab8636-a06b-43fc-9aa8-fcec46b2426d {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:20:32 user nova-compute[95467]: DEBUG nova.compute.manager [req-b0661cc5-6acc-4b79-933d-ec60e911a583 req-3cf9f722-234c-4566-9ad1-de006d955d85 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Received event network-vif-deleted-5cab4329-e3d7-4d50-9a27-c1291f6f4b4a {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:20:32 user nova-compute[95467]: DEBUG nova.compute.manager [req-b0661cc5-6acc-4b79-933d-ec60e911a583 req-3cf9f722-234c-4566-9ad1-de006d955d85 service nova] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Received event network-vif-deleted-71b2b3bf-8597-40e5-803d-be98308390b7 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:20:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:33 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] Instance destroyed successfully.
Nov 15 08:20:33 user nova-compute[95467]: DEBUG nova.objects.instance [None req-3e30a0de-9178-4f25-b03c-fd3b6d81098f tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lazy-loading 'resources' on Instance uuid 13957136-17e4-4d38-aba3-37453e1fb878 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:20:33 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-3e30a0de-9178-4f25-b03c-fd3b6d81098f tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:18:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1151932159',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1151932159',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1151932159',id=30,image_ref='5f4b45b8-26f5-436f-bfae-87ad013c9492',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLHqRbASCeSwLnaE6cpqUgYpm2vgNRmspTV3XNz5fuTAsGiJoqsVkKecCgCqzsT2HYsSHc/+vUh/+jNmFflgW37j0Ss98W6ShXroA9Yk6xJw00YUMKBWMhv6TG52UWNOwQ==',key_name='tempest-keypair-827467051',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:19:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e7791bd92c7c488aa72474ecde2e1155',ramdisk_id='',reservation_id='r-7pneup80',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-978207351',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-978207351-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-978207351',owner_user_name='tempest-TestVolumeBootPattern-978207351-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:19:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11bbbd3ef322402cb5dc60455a54319b',uuid=13957136-17e4-4d38-aba3-37453e1fb878,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fb6b8f05-83f8-4ee0-9e3b-1efc13a335fb", "address": "fa:16:3e:c3:96:a0", "network": {"id": "96d9262b-11fb-497d-8e38-fa46076c010f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2069167691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7791bd92c7c488aa72474ecde2e1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb6b8f05-83", "ovs_interfaceid": "fb6b8f05-83f8-4ee0-9e3b-1efc13a335fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:20:33 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-3e30a0de-9178-4f25-b03c-fd3b6d81098f tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Converting VIF {"id": "fb6b8f05-83f8-4ee0-9e3b-1efc13a335fb", "address": "fa:16:3e:c3:96:a0", "network": {"id": "96d9262b-11fb-497d-8e38-fa46076c010f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2069167691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7791bd92c7c488aa72474ecde2e1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb6b8f05-83", "ovs_interfaceid": "fb6b8f05-83f8-4ee0-9e3b-1efc13a335fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:20:33 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-3e30a0de-9178-4f25-b03c-fd3b6d81098f tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:96:a0,bridge_name='br-int',has_traffic_filtering=True,id=fb6b8f05-83f8-4ee0-9e3b-1efc13a335fb,network=Network(96d9262b-11fb-497d-8e38-fa46076c010f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb6b8f05-83') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:20:33 user nova-compute[95467]: DEBUG os_vif [None req-3e30a0de-9178-4f25-b03c-fd3b6d81098f tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:96:a0,bridge_name='br-int',has_traffic_filtering=True,id=fb6b8f05-83f8-4ee0-9e3b-1efc13a335fb,network=Network(96d9262b-11fb-497d-8e38-fa46076c010f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb6b8f05-83') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:20:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfb6b8f05-83, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:20:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:20:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8aafea22-9c9d-44b8-9d77-26708633c04a) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:20:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:20:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:33 user nova-compute[95467]: INFO os_vif [None req-3e30a0de-9178-4f25-b03c-fd3b6d81098f tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:96:a0,bridge_name='br-int',has_traffic_filtering=True,id=fb6b8f05-83f8-4ee0-9e3b-1efc13a335fb,network=Network(96d9262b-11fb-497d-8e38-fa46076c010f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb6b8f05-83')
Nov 15 08:20:33 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e30a0de-9178-4f25-b03c-fd3b6d81098f tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] calling os-brick to detach iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 08:20:33 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e30a0de-9178-4f25-b03c-fd3b6d81098f tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, {'target_iqn': 'iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SiQnKfkJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:20:33 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-3e30a0de-9178-4f25-b03c-fd3b6d81098f tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:20:33 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-3e30a0de-9178-4f25-b03c-fd3b6d81098f tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:20:33 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-3e30a0de-9178-4f25-b03c-fd3b6d81098f tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:20:33 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:33 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:33 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa49624-1dc5-42c5-95dd-d7ded927da97]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:20:33 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e30a0de-9178-4f25-b03c-fd3b6d81098f tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 08:20:33 user nova-compute[95467]: No targets found.
Nov 15 08:20:33 user nova-compute[95467]: iSNS:
Nov 15 08:20:33 user nova-compute[95467]: No targets found.
Nov 15 08:20:33 user nova-compute[95467]: STATIC:
Nov 15 08:20:33 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7
Nov 15 08:20:33 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:20:33 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:20:33 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e
Nov 15 08:20:33 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:20:33 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:20:33 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149
Nov 15 08:20:33 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:20:33 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:20:33 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775
Nov 15 08:20:33 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:20:33 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:20:33 user nova-compute[95467]: FIRMWARE:
Nov 15 08:20:33 user nova-compute[95467]: No targets found.
Nov 15 08:20:33 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:20:33 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e30a0de-9178-4f25-b03c-fd3b6d81098f tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 08:20:33 user nova-compute[95467]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 08:20:33 user nova-compute[95467]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=95467) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 08:20:33 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e30a0de-9178-4f25-b03c-fd3b6d81098f tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7', 0)] {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 08:20:33 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:33 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:33 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc11d36b-f817-4134-8837-d78615d08ae3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:20:33 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:33 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:33 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[35710445-0f70-4683-9a7d-c87d20fa11a6]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:20:33 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e30a0de-9178-4f25-b03c-fd3b6d81098f tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:20:33 user nova-compute[95467]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)
Nov 15 08:20:33 user nova-compute[95467]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7 (non-flash)
Nov 15 08:20:33 user nova-compute[95467]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:20:33 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:20:33 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e30a0de-9178-4f25-b03c-fd3b6d81098f tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:20:33 user nova-compute[95467]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)
Nov 15 08:20:33 user nova-compute[95467]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7 (non-flash)
Nov 15 08:20:33 user nova-compute[95467]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:20:33 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:20:33 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e30a0de-9178-4f25-b03c-fd3b6d81098f tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efec8573d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7'): ({'sdd'}, set())}) {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 08:20:33 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-3e30a0de-9178-4f25-b03c-fd3b6d81098f tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Removing single pathed devices sdd {{(pid=95467) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 08:20:33 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:34 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:34 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79e6797-0976-49ce-a097-bf9c68ee51e8]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:20:34 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:34 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:34 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e5e81a-4dac-49be-83a0-aa6912d0b0e7]: (4, ('ok\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:20:34 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-3e30a0de-9178-4f25-b03c-fd3b6d81098f tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Flushing IO for device /dev/sdd {{(pid=95467) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 08:20:34 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:34 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:34 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e7e718-43c5-4bcc-9428-b6b7b952d5d2]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:20:34 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-3e30a0de-9178-4f25-b03c-fd3b6d81098f tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=95467) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 08:20:34 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:34 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.059s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:34 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db7cfa9-2905-428e-80b2-46ba3bd39801]: (4, ('1', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:20:34 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-3e30a0de-9178-4f25-b03c-fd3b6d81098f tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 08:20:34 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-3e30a0de-9178-4f25-b03c-fd3b6d81098f tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] SCSI volumes sdd have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 08:20:34 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e30a0de-9178-4f25-b03c-fd3b6d81098f tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7')] {{(pid=95467) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 08:20:34 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:34 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:34 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a671168c-a56d-4e67-85ff-fecad9ea0960]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:20:34 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e30a0de-9178-4f25-b03c-fd3b6d81098f tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:20:34 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7 -p 172.16.0.220:3260 --logout {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:34 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:34 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c8f414-44a5-4203-b43a-08b48ecde5ae]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:20:34 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e30a0de-9178-4f25-b03c-fd3b6d81098f tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7, portal: 172.16.0.220,3260]
Nov 15 08:20:34 user nova-compute[95467]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7, portal: 172.16.0.220,3260] successful.
Nov 15 08:20:34 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:20:34 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7 -p 172.16.0.220:3260 --op delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:34 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45d4eaa4-4485-488d-88b5-068a6e58d5e7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:34 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d69a2f5-b1ca-4163-b545-3e4ca415b5b2]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:20:34 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e30a0de-9178-4f25-b03c-fd3b6d81098f tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:20:34 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-3e30a0de-9178-4f25-b03c-fd3b6d81098f tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:20:34 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e30a0de-9178-4f25-b03c-fd3b6d81098f tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] <== disconnect_volume: return (344ms) None {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:20:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e30a0de-9178-4f25-b03c-fd3b6d81098f tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] Disconnected iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 08:20:34 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-3e30a0de-9178-4f25-b03c-fd3b6d81098f tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] Deleting instance files /opt/stack/data/nova/instances/13957136-17e4-4d38-aba3-37453e1fb878_del
Nov 15 08:20:34 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-3e30a0de-9178-4f25-b03c-fd3b6d81098f tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] Deletion of /opt/stack/data/nova/instances/13957136-17e4-4d38-aba3-37453e1fb878_del complete
Nov 15 08:20:34 user nova-compute[95467]: INFO nova.compute.manager [None req-3e30a0de-9178-4f25-b03c-fd3b6d81098f tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] Took 1.46 seconds to destroy the instance on the hypervisor.
Nov 15 08:20:34 user nova-compute[95467]: DEBUG oslo.service.loopingcall [None req-3e30a0de-9178-4f25-b03c-fd3b6d81098f tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=95467) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 08:20:34 user nova-compute[95467]: DEBUG nova.compute.manager [-] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] Deallocating network for instance {{(pid=95467) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 08:20:34 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] deallocate_for_instance() {{(pid=95467) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 08:20:35 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:20:35 user nova-compute[95467]: DEBUG nova.compute.manager [req-0c7a0f86-0923-4190-ac14-cdd39f123ad0 req-838b2ea0-f223-4c4d-a0ea-88f3662e8fb0 service nova] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] Received event network-vif-unplugged-fb6b8f05-83f8-4ee0-9e3b-1efc13a335fb {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:20:35 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-0c7a0f86-0923-4190-ac14-cdd39f123ad0 req-838b2ea0-f223-4c4d-a0ea-88f3662e8fb0 service nova] Acquiring lock "13957136-17e4-4d38-aba3-37453e1fb878-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:20:35 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-0c7a0f86-0923-4190-ac14-cdd39f123ad0 req-838b2ea0-f223-4c4d-a0ea-88f3662e8fb0 service nova] Lock "13957136-17e4-4d38-aba3-37453e1fb878-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:20:35 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-0c7a0f86-0923-4190-ac14-cdd39f123ad0 req-838b2ea0-f223-4c4d-a0ea-88f3662e8fb0 service nova] Lock "13957136-17e4-4d38-aba3-37453e1fb878-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:20:35 user nova-compute[95467]: DEBUG nova.compute.manager [req-0c7a0f86-0923-4190-ac14-cdd39f123ad0 req-838b2ea0-f223-4c4d-a0ea-88f3662e8fb0 service nova] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] No waiting events found dispatching network-vif-unplugged-fb6b8f05-83f8-4ee0-9e3b-1efc13a335fb {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:20:35 user nova-compute[95467]: DEBUG nova.compute.manager [req-0c7a0f86-0923-4190-ac14-cdd39f123ad0 req-838b2ea0-f223-4c4d-a0ea-88f3662e8fb0 service nova] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] Received event network-vif-unplugged-fb6b8f05-83f8-4ee0-9e3b-1efc13a335fb for instance with task_state deleting. {{(pid=95467) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 08:20:35 user nova-compute[95467]: DEBUG nova.compute.manager [req-0c7a0f86-0923-4190-ac14-cdd39f123ad0 req-838b2ea0-f223-4c4d-a0ea-88f3662e8fb0 service nova] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] Received event network-vif-plugged-fb6b8f05-83f8-4ee0-9e3b-1efc13a335fb {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:20:35 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-0c7a0f86-0923-4190-ac14-cdd39f123ad0 req-838b2ea0-f223-4c4d-a0ea-88f3662e8fb0 service nova] Acquiring lock "13957136-17e4-4d38-aba3-37453e1fb878-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:20:35 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-0c7a0f86-0923-4190-ac14-cdd39f123ad0 req-838b2ea0-f223-4c4d-a0ea-88f3662e8fb0 service nova] Lock "13957136-17e4-4d38-aba3-37453e1fb878-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:20:35 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-0c7a0f86-0923-4190-ac14-cdd39f123ad0 req-838b2ea0-f223-4c4d-a0ea-88f3662e8fb0 service nova] Lock "13957136-17e4-4d38-aba3-37453e1fb878-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:20:35 user nova-compute[95467]: DEBUG nova.compute.manager [req-0c7a0f86-0923-4190-ac14-cdd39f123ad0 req-838b2ea0-f223-4c4d-a0ea-88f3662e8fb0 service nova] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] No waiting events found dispatching network-vif-plugged-fb6b8f05-83f8-4ee0-9e3b-1efc13a335fb {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:20:35 user nova-compute[95467]: WARNING nova.compute.manager [req-0c7a0f86-0923-4190-ac14-cdd39f123ad0 req-838b2ea0-f223-4c4d-a0ea-88f3662e8fb0 service nova] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] Received unexpected event network-vif-plugged-fb6b8f05-83f8-4ee0-9e3b-1efc13a335fb for instance with vm_state active and task_state deleting.
Nov 15 08:20:35 user nova-compute[95467]: INFO nova.compute.manager [-] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] Took 0.66 seconds to deallocate network for instance.
Nov 15 08:20:35 user nova-compute[95467]: DEBUG nova.compute.manager [req-b406624d-ca0c-4937-84c1-9600fbf5c9a1 req-997d81c9-300d-4a20-9d31-e237d8e03a7c service nova] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] Received event network-vif-deleted-fb6b8f05-83f8-4ee0-9e3b-1efc13a335fb {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:20:35 user nova-compute[95467]: INFO nova.compute.manager [req-b406624d-ca0c-4937-84c1-9600fbf5c9a1 req-997d81c9-300d-4a20-9d31-e237d8e03a7c service nova] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] Neutron deleted interface fb6b8f05-83f8-4ee0-9e3b-1efc13a335fb; detaching it from the instance and deleting it from the info cache
Nov 15 08:20:35 user nova-compute[95467]: DEBUG nova.network.neutron [req-b406624d-ca0c-4937-84c1-9600fbf5c9a1 req-997d81c9-300d-4a20-9d31-e237d8e03a7c service nova] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:20:35 user nova-compute[95467]: DEBUG nova.compute.manager [req-b406624d-ca0c-4937-84c1-9600fbf5c9a1 req-997d81c9-300d-4a20-9d31-e237d8e03a7c service nova] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] Detach interface failed, port_id=fb6b8f05-83f8-4ee0-9e3b-1efc13a335fb, reason: Instance 13957136-17e4-4d38-aba3-37453e1fb878 could not be found. {{(pid=95467) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 08:20:36 user nova-compute[95467]: INFO nova.compute.manager [None req-3e30a0de-9178-4f25-b03c-fd3b6d81098f tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] Took 1.20 seconds to detach 1 volumes for instance.
Nov 15 08:20:36 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3e30a0de-9178-4f25-b03c-fd3b6d81098f tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 13957136-17e4-4d38-aba3-37453e1fb878] Deleting volume: 45d4eaa4-4485-488d-88b5-068a6e58d5e7 {{(pid=95467) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 08:20:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3e30a0de-9178-4f25-b03c-fd3b6d81098f tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:20:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3e30a0de-9178-4f25-b03c-fd3b6d81098f tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:20:36 user nova-compute[95467]: INFO nova.compute.manager [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] [instance: 1c438a54-5528-4354-9836-f1a198532c9b] Took 4.01 seconds to detach 3 volumes for instance.
Nov 15 08:20:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:20:36 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-3e30a0de-9178-4f25-b03c-fd3b6d81098f tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:20:36 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3e30a0de-9178-4f25-b03c-fd3b6d81098f tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:20:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3e30a0de-9178-4f25-b03c-fd3b6d81098f tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.425s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:20:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.210s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:20:36 user nova-compute[95467]: INFO nova.scheduler.client.report [None req-3e30a0de-9178-4f25-b03c-fd3b6d81098f tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Deleted allocations for instance 13957136-17e4-4d38-aba3-37453e1fb878
Nov 15 08:20:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3e30a0de-9178-4f25-b03c-fd3b6d81098f tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "13957136-17e4-4d38-aba3-37453e1fb878" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.014s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:20:37 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:20:37 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:20:37 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.364s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:20:37 user nova-compute[95467]: INFO nova.scheduler.client.report [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Deleted allocations for instance 1c438a54-5528-4354-9836-f1a198532c9b
Nov 15 08:20:37 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-c2833516-e1b5-4f30-8c9a-68cce3e92a6e tempest-TaggedBootDevicesTest-248573984 tempest-TaggedBootDevicesTest-248573984-project-member] Lock "1c438a54-5528-4354-9836-f1a198532c9b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.881s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:20:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:38 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:39 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:20:39 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Cleaning up deleted instances with incomplete migration  {{(pid=95467) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 08:20:39 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:20:42 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:42 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:20:42 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=95467) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 08:20:42 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager.update_available_resource {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:20:42 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:20:42 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:20:42 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:20:42 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Auditing locally available compute resources for user (node: user) {{(pid=95467) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 08:20:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:43 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:20:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk.rescue --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk.rescue --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a155e6-0ee2-4728-a526-17c149107ab0/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a155e6-0ee2-4728-a526-17c149107ab0/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a155e6-0ee2-4728-a526-17c149107ab0/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a155e6-0ee2-4728-a526-17c149107ab0/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bee31898-4f12-4c68-a18b-a678f9f584aa/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bee31898-4f12-4c68-a18b-a678f9f584aa/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bee31898-4f12-4c68-a18b-a678f9f584aa/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bee31898-4f12-4c68-a18b-a678f9f584aa/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:45 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:20:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0edcb81b-d8fe-482c-a7ca-6b76455cfe33/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0edcb81b-d8fe-482c-a7ca-6b76455cfe33/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0edcb81b-d8fe-482c-a7ca-6b76455cfe33/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0edcb81b-d8fe-482c-a7ca-6b76455cfe33/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk.rescue --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk.rescue --force-share --output=json" returned: 0 in 0.166s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk.rescue --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:20:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:20:46 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:20:46 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:20:46 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:20:46 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Hypervisor/Node resource view: name=user free_ram=7235MB free_disk=25.036029815673828GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=95467) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 08:20:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:20:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:20:47 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 73fe8852-c47a-47ab-a56f-6864c8ed5479 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:20:47 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 21cf2ada-b15c-490d-ac37-96e9c87e9056 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:20:47 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance bee31898-4f12-4c68-a18b-a678f9f584aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:20:47 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:20:47 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 10d73b73-ca65-4192-8954-288dc1df9f24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:20:47 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 3825a691-ac5c-4c06-b4a4-2a0b40c638c4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:20:47 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 851d354c-7f20-4e72-bfd2-a781b929e8ba actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:20:47 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:20:47 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance a1a155e6-0ee2-4728-a526-17c149107ab0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:20:47 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:20:47 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 0edcb81b-d8fe-482c-a7ca-6b76455cfe33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:20:47 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 08:20:47 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 08:20:47 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Refreshing inventories for resource provider f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 08:20:47 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Updating ProviderTree inventory for provider f56c3524-ed11-494e-82e4-b1a23920d1ae from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 08:20:47 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Updating inventory in ProviderTree for provider f56c3524-ed11-494e-82e4-b1a23920d1ae with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 08:20:47 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Refreshing aggregate associations for resource provider f56c3524-ed11-494e-82e4-b1a23920d1ae, aggregates: None {{(pid=95467) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 08:20:47 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Refreshing trait associations for resource provider f56c3524-ed11-494e-82e4-b1a23920d1ae, traits: COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSSE3,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI {{(pid=95467) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 08:20:47 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:20:47 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:47 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:20:47 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Compute_service record updated for user:user {{(pid=95467) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 08:20:47 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.642s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:20:48 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:20:48 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:20:48 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:20:48 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:20:48 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:20:48 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:20:48 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Cleaning up deleted instances {{(pid=95467) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 08:20:48 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] There are 0 instances to clean {{(pid=95467) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 08:20:48 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:49 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:20:50 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:20:50 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Starting heal instance info cache {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 08:20:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "refresh_cache-bee31898-4f12-4c68-a18b-a678f9f584aa" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:20:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquired lock "refresh_cache-bee31898-4f12-4c68-a18b-a678f9f584aa" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:20:50 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Forcefully refreshing network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 08:20:51 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Updating instance_info_cache with network_info: [{"id": "eea925f5-c956-40d3-99a5-b45573318378", "address": "fa:16:3e:b4:e9:ab", "network": {"id": "dcbc2304-8d20-4589-b81e-a75a22ef7114", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-333949369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6f7599b8526444a8276cac35f0a1500", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeea925f5-c9", "ovs_interfaceid": "eea925f5-c956-40d3-99a5-b45573318378", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:20:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Releasing lock "refresh_cache-bee31898-4f12-4c68-a18b-a678f9f584aa" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:20:51 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Updated the network info_cache for instance {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 08:20:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-124f16f0-1176-41c2-9c4e-d6dd2c7f6ebd tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Acquiring lock "bee31898-4f12-4c68-a18b-a678f9f584aa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:20:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-124f16f0-1176-41c2-9c4e-d6dd2c7f6ebd tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Lock "bee31898-4f12-4c68-a18b-a678f9f584aa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:20:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-124f16f0-1176-41c2-9c4e-d6dd2c7f6ebd tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Acquiring lock "bee31898-4f12-4c68-a18b-a678f9f584aa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:20:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-124f16f0-1176-41c2-9c4e-d6dd2c7f6ebd tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Lock "bee31898-4f12-4c68-a18b-a678f9f584aa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:20:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-124f16f0-1176-41c2-9c4e-d6dd2c7f6ebd tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Lock "bee31898-4f12-4c68-a18b-a678f9f584aa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:20:52 user nova-compute[95467]: INFO nova.compute.manager [None req-124f16f0-1176-41c2-9c4e-d6dd2c7f6ebd tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Terminating instance
Nov 15 08:20:52 user nova-compute[95467]: DEBUG nova.compute.manager [None req-124f16f0-1176-41c2-9c4e-d6dd2c7f6ebd tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Start destroying the instance on the hypervisor. {{(pid=95467) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 08:20:52 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:52 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:52 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:52 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:52 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:52 user nova-compute[95467]: DEBUG nova.compute.manager [req-e8eb1c6c-2478-4856-a9c8-d053b8a34039 req-9591a3b6-cf40-447c-81cc-273e6cb6f970 service nova] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Received event network-vif-unplugged-eea925f5-c956-40d3-99a5-b45573318378 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:20:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-e8eb1c6c-2478-4856-a9c8-d053b8a34039 req-9591a3b6-cf40-447c-81cc-273e6cb6f970 service nova] Acquiring lock "bee31898-4f12-4c68-a18b-a678f9f584aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:20:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-e8eb1c6c-2478-4856-a9c8-d053b8a34039 req-9591a3b6-cf40-447c-81cc-273e6cb6f970 service nova] Lock "bee31898-4f12-4c68-a18b-a678f9f584aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:20:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-e8eb1c6c-2478-4856-a9c8-d053b8a34039 req-9591a3b6-cf40-447c-81cc-273e6cb6f970 service nova] Lock "bee31898-4f12-4c68-a18b-a678f9f584aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:20:52 user nova-compute[95467]: DEBUG nova.compute.manager [req-e8eb1c6c-2478-4856-a9c8-d053b8a34039 req-9591a3b6-cf40-447c-81cc-273e6cb6f970 service nova] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] No waiting events found dispatching network-vif-unplugged-eea925f5-c956-40d3-99a5-b45573318378 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:20:52 user nova-compute[95467]: DEBUG nova.compute.manager [req-e8eb1c6c-2478-4856-a9c8-d053b8a34039 req-9591a3b6-cf40-447c-81cc-273e6cb6f970 service nova] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Received event network-vif-unplugged-eea925f5-c956-40d3-99a5-b45573318378 for instance with task_state deleting. {{(pid=95467) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 08:20:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:53 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Instance destroyed successfully.
Nov 15 08:20:53 user nova-compute[95467]: DEBUG nova.objects.instance [None req-124f16f0-1176-41c2-9c4e-d6dd2c7f6ebd tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Lazy-loading 'resources' on Instance uuid bee31898-4f12-4c68-a18b-a678f9f584aa {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:20:53 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-124f16f0-1176-41c2-9c4e-d6dd2c7f6ebd tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:13:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1122164487',display_name='tempest-ServerStableDeviceRescueTest-server-1122164487',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1122164487',id=18,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC73Es7i1dvV3LCl2zYhULAGR03vami/IaiKmQSVJ68TybZ572m0/Ot5YFz5r9uOo9phDDYCr9s7SvGnvG3a6hG2FKLwECxJAhXmm41agKdBv9qR6a3hPpbXRn0iKH8nfg==',key_name='tempest-keypair-1738856651',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:17:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b6f7599b8526444a8276cac35f0a1500',ramdisk_id='',reservation_id='r-1fnevzzw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1999795038',owner_user_name='tempest-ServerStableDeviceRescueTest-1999795038-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:19:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd652210088a41839fcca0be41322dad',uuid=bee31898-4f12-4c68-a18b-a678f9f584aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eea925f5-c956-40d3-99a5-b45573318378", "address": "fa:16:3e:b4:e9:ab", "network": {"id": "dcbc2304-8d20-4589-b81e-a75a22ef7114", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-333949369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6f7599b8526444a8276cac35f0a1500", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeea925f5-c9", "ovs_interfaceid": "eea925f5-c956-40d3-99a5-b45573318378", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:20:53 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-124f16f0-1176-41c2-9c4e-d6dd2c7f6ebd tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Converting VIF {"id": "eea925f5-c956-40d3-99a5-b45573318378", "address": "fa:16:3e:b4:e9:ab", "network": {"id": "dcbc2304-8d20-4589-b81e-a75a22ef7114", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-333949369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6f7599b8526444a8276cac35f0a1500", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeea925f5-c9", "ovs_interfaceid": "eea925f5-c956-40d3-99a5-b45573318378", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:20:53 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-124f16f0-1176-41c2-9c4e-d6dd2c7f6ebd tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:e9:ab,bridge_name='br-int',has_traffic_filtering=True,id=eea925f5-c956-40d3-99a5-b45573318378,network=Network(dcbc2304-8d20-4589-b81e-a75a22ef7114),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeea925f5-c9') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:20:53 user nova-compute[95467]: DEBUG os_vif [None req-124f16f0-1176-41c2-9c4e-d6dd2c7f6ebd tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:e9:ab,bridge_name='br-int',has_traffic_filtering=True,id=eea925f5-c956-40d3-99a5-b45573318378,network=Network(dcbc2304-8d20-4589-b81e-a75a22ef7114),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeea925f5-c9') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:20:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeea925f5-c9, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:20:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:20:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5818d387-0c69-4a41-87ab-15423af3d53f) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:20:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:20:53 user nova-compute[95467]: INFO os_vif [None req-124f16f0-1176-41c2-9c4e-d6dd2c7f6ebd tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:e9:ab,bridge_name='br-int',has_traffic_filtering=True,id=eea925f5-c956-40d3-99a5-b45573318378,network=Network(dcbc2304-8d20-4589-b81e-a75a22ef7114),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeea925f5-c9')
Nov 15 08:20:53 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-124f16f0-1176-41c2-9c4e-d6dd2c7f6ebd tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Deleting instance files /opt/stack/data/nova/instances/bee31898-4f12-4c68-a18b-a678f9f584aa_del
Nov 15 08:20:53 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-124f16f0-1176-41c2-9c4e-d6dd2c7f6ebd tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Deletion of /opt/stack/data/nova/instances/bee31898-4f12-4c68-a18b-a678f9f584aa_del complete
Nov 15 08:20:53 user nova-compute[95467]: INFO nova.compute.manager [None req-124f16f0-1176-41c2-9c4e-d6dd2c7f6ebd tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 15 08:20:53 user nova-compute[95467]: DEBUG oslo.service.loopingcall [None req-124f16f0-1176-41c2-9c4e-d6dd2c7f6ebd tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=95467) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 08:20:53 user nova-compute[95467]: DEBUG nova.compute.manager [-] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Deallocating network for instance {{(pid=95467) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 08:20:53 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] deallocate_for_instance() {{(pid=95467) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 08:20:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:20:54 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:20:54 user nova-compute[95467]: INFO nova.compute.manager [-] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Took 0.70 seconds to deallocate network for instance.
Nov 15 08:20:54 user nova-compute[95467]: DEBUG nova.compute.manager [req-08ec16d8-fe48-4068-8fb5-4c390c26bf22 req-7aaa5d64-3960-4523-8fc1-a3249cbcb7f4 service nova] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Received event network-vif-deleted-eea925f5-c956-40d3-99a5-b45573318378 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:20:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-124f16f0-1176-41c2-9c4e-d6dd2c7f6ebd tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:20:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-124f16f0-1176-41c2-9c4e-d6dd2c7f6ebd tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:20:54 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-124f16f0-1176-41c2-9c4e-d6dd2c7f6ebd tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:20:54 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-124f16f0-1176-41c2-9c4e-d6dd2c7f6ebd tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:20:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-124f16f0-1176-41c2-9c4e-d6dd2c7f6ebd tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.324s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:20:54 user nova-compute[95467]: INFO nova.scheduler.client.report [None req-124f16f0-1176-41c2-9c4e-d6dd2c7f6ebd tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Deleted allocations for instance bee31898-4f12-4c68-a18b-a678f9f584aa
Nov 15 08:20:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-124f16f0-1176-41c2-9c4e-d6dd2c7f6ebd tempest-ServerStableDeviceRescueTest-1999795038 tempest-ServerStableDeviceRescueTest-1999795038-project-member] Lock "bee31898-4f12-4c68-a18b-a678f9f584aa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.093s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:20:54 user nova-compute[95467]: DEBUG nova.compute.manager [req-bed59571-fe0f-4f32-a711-fee0b2d422ee req-8371401c-6610-4166-beb7-70ae139a6372 service nova] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Received event network-vif-plugged-eea925f5-c956-40d3-99a5-b45573318378 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:20:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-bed59571-fe0f-4f32-a711-fee0b2d422ee req-8371401c-6610-4166-beb7-70ae139a6372 service nova] Acquiring lock "bee31898-4f12-4c68-a18b-a678f9f584aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:20:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-bed59571-fe0f-4f32-a711-fee0b2d422ee req-8371401c-6610-4166-beb7-70ae139a6372 service nova] Lock "bee31898-4f12-4c68-a18b-a678f9f584aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:20:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-bed59571-fe0f-4f32-a711-fee0b2d422ee req-8371401c-6610-4166-beb7-70ae139a6372 service nova] Lock "bee31898-4f12-4c68-a18b-a678f9f584aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:20:54 user nova-compute[95467]: DEBUG nova.compute.manager [req-bed59571-fe0f-4f32-a711-fee0b2d422ee req-8371401c-6610-4166-beb7-70ae139a6372 service nova] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] No waiting events found dispatching network-vif-plugged-eea925f5-c956-40d3-99a5-b45573318378 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:20:54 user nova-compute[95467]: WARNING nova.compute.manager [req-bed59571-fe0f-4f32-a711-fee0b2d422ee req-8371401c-6610-4166-beb7-70ae139a6372 service nova] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Received unexpected event network-vif-plugged-eea925f5-c956-40d3-99a5-b45573318378 for instance with vm_state deleted and task_state None.
Nov 15 08:20:54 user nova-compute[95467]: DEBUG nova.compute.manager [req-bed59571-fe0f-4f32-a711-fee0b2d422ee req-8371401c-6610-4166-beb7-70ae139a6372 service nova] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Received event network-vif-plugged-eea925f5-c956-40d3-99a5-b45573318378 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:20:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-bed59571-fe0f-4f32-a711-fee0b2d422ee req-8371401c-6610-4166-beb7-70ae139a6372 service nova] Acquiring lock "bee31898-4f12-4c68-a18b-a678f9f584aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:20:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-bed59571-fe0f-4f32-a711-fee0b2d422ee req-8371401c-6610-4166-beb7-70ae139a6372 service nova] Lock "bee31898-4f12-4c68-a18b-a678f9f584aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:20:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-bed59571-fe0f-4f32-a711-fee0b2d422ee req-8371401c-6610-4166-beb7-70ae139a6372 service nova] Lock "bee31898-4f12-4c68-a18b-a678f9f584aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:20:54 user nova-compute[95467]: DEBUG nova.compute.manager [req-bed59571-fe0f-4f32-a711-fee0b2d422ee req-8371401c-6610-4166-beb7-70ae139a6372 service nova] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] No waiting events found dispatching network-vif-plugged-eea925f5-c956-40d3-99a5-b45573318378 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:20:54 user nova-compute[95467]: WARNING nova.compute.manager [req-bed59571-fe0f-4f32-a711-fee0b2d422ee req-8371401c-6610-4166-beb7-70ae139a6372 service nova] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Received unexpected event network-vif-plugged-eea925f5-c956-40d3-99a5-b45573318378 for instance with vm_state deleted and task_state None.
Nov 15 08:20:54 user nova-compute[95467]: DEBUG nova.compute.manager [req-bed59571-fe0f-4f32-a711-fee0b2d422ee req-8371401c-6610-4166-beb7-70ae139a6372 service nova] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Received event network-vif-plugged-eea925f5-c956-40d3-99a5-b45573318378 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:20:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-bed59571-fe0f-4f32-a711-fee0b2d422ee req-8371401c-6610-4166-beb7-70ae139a6372 service nova] Acquiring lock "bee31898-4f12-4c68-a18b-a678f9f584aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:20:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-bed59571-fe0f-4f32-a711-fee0b2d422ee req-8371401c-6610-4166-beb7-70ae139a6372 service nova] Lock "bee31898-4f12-4c68-a18b-a678f9f584aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:20:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-bed59571-fe0f-4f32-a711-fee0b2d422ee req-8371401c-6610-4166-beb7-70ae139a6372 service nova] Lock "bee31898-4f12-4c68-a18b-a678f9f584aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:20:54 user nova-compute[95467]: DEBUG nova.compute.manager [req-bed59571-fe0f-4f32-a711-fee0b2d422ee req-8371401c-6610-4166-beb7-70ae139a6372 service nova] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] No waiting events found dispatching network-vif-plugged-eea925f5-c956-40d3-99a5-b45573318378 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:20:54 user nova-compute[95467]: WARNING nova.compute.manager [req-bed59571-fe0f-4f32-a711-fee0b2d422ee req-8371401c-6610-4166-beb7-70ae139a6372 service nova] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Received unexpected event network-vif-plugged-eea925f5-c956-40d3-99a5-b45573318378 for instance with vm_state deleted and task_state None.
Nov 15 08:20:54 user nova-compute[95467]: DEBUG nova.compute.manager [req-bed59571-fe0f-4f32-a711-fee0b2d422ee req-8371401c-6610-4166-beb7-70ae139a6372 service nova] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Received event network-vif-unplugged-eea925f5-c956-40d3-99a5-b45573318378 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:20:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-bed59571-fe0f-4f32-a711-fee0b2d422ee req-8371401c-6610-4166-beb7-70ae139a6372 service nova] Acquiring lock "bee31898-4f12-4c68-a18b-a678f9f584aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:20:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-bed59571-fe0f-4f32-a711-fee0b2d422ee req-8371401c-6610-4166-beb7-70ae139a6372 service nova] Lock "bee31898-4f12-4c68-a18b-a678f9f584aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:20:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-bed59571-fe0f-4f32-a711-fee0b2d422ee req-8371401c-6610-4166-beb7-70ae139a6372 service nova] Lock "bee31898-4f12-4c68-a18b-a678f9f584aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:20:54 user nova-compute[95467]: DEBUG nova.compute.manager [req-bed59571-fe0f-4f32-a711-fee0b2d422ee req-8371401c-6610-4166-beb7-70ae139a6372 service nova] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] No waiting events found dispatching network-vif-unplugged-eea925f5-c956-40d3-99a5-b45573318378 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:20:54 user nova-compute[95467]: WARNING nova.compute.manager [req-bed59571-fe0f-4f32-a711-fee0b2d422ee req-8371401c-6610-4166-beb7-70ae139a6372 service nova] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Received unexpected event network-vif-unplugged-eea925f5-c956-40d3-99a5-b45573318378 for instance with vm_state deleted and task_state None.
Nov 15 08:20:54 user nova-compute[95467]: DEBUG nova.compute.manager [req-bed59571-fe0f-4f32-a711-fee0b2d422ee req-8371401c-6610-4166-beb7-70ae139a6372 service nova] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Received event network-vif-plugged-eea925f5-c956-40d3-99a5-b45573318378 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:20:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-bed59571-fe0f-4f32-a711-fee0b2d422ee req-8371401c-6610-4166-beb7-70ae139a6372 service nova] Acquiring lock "bee31898-4f12-4c68-a18b-a678f9f584aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:20:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-bed59571-fe0f-4f32-a711-fee0b2d422ee req-8371401c-6610-4166-beb7-70ae139a6372 service nova] Lock "bee31898-4f12-4c68-a18b-a678f9f584aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:20:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-bed59571-fe0f-4f32-a711-fee0b2d422ee req-8371401c-6610-4166-beb7-70ae139a6372 service nova] Lock "bee31898-4f12-4c68-a18b-a678f9f584aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:20:54 user nova-compute[95467]: DEBUG nova.compute.manager [req-bed59571-fe0f-4f32-a711-fee0b2d422ee req-8371401c-6610-4166-beb7-70ae139a6372 service nova] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] No waiting events found dispatching network-vif-plugged-eea925f5-c956-40d3-99a5-b45573318378 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:20:54 user nova-compute[95467]: WARNING nova.compute.manager [req-bed59571-fe0f-4f32-a711-fee0b2d422ee req-8371401c-6610-4166-beb7-70ae139a6372 service nova] [instance: bee31898-4f12-4c68-a18b-a678f9f584aa] Received unexpected event network-vif-plugged-eea925f5-c956-40d3-99a5-b45573318378 for instance with vm_state deleted and task_state None.
Nov 15 08:20:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:05 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Acquiring lock "e7805e5c-1777-4b0c-95c7-b232be66528c" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:21:05 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "e7805e5c-1777-4b0c-95c7-b232be66528c" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:21:05 user nova-compute[95467]: INFO nova.compute.manager [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Unshelving
Nov 15 08:21:05 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:21:05 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:21:05 user nova-compute[95467]: DEBUG nova.objects.instance [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lazy-loading 'pci_requests' on Instance uuid e7805e5c-1777-4b0c-95c7-b232be66528c {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:21:05 user nova-compute[95467]: DEBUG nova.objects.instance [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lazy-loading 'numa_topology' on Instance uuid e7805e5c-1777-4b0c-95c7-b232be66528c {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:21:05 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=95467) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 08:21:05 user nova-compute[95467]: INFO nova.compute.claims [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Claim successful on node user
Nov 15 08:21:05 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:21:05 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:21:05 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.457s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:21:05 user nova-compute[95467]: INFO nova.network.neutron [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Updating port 7f8e69fc-628f-4a31-9ba0-db0b320dff09 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 15 08:21:06 user nova-compute[95467]: DEBUG nova.compute.manager [req-7d5ed3ae-8ce7-43f1-b121-6e25b46f4d91 req-4c4a6704-3a7b-4eae-901f-cafaacdb5d11 service nova] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] Received event network-changed-e998bcd4-3b5b-4cb1-9b31-7b44f124f51f {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:21:06 user nova-compute[95467]: DEBUG nova.compute.manager [req-7d5ed3ae-8ce7-43f1-b121-6e25b46f4d91 req-4c4a6704-3a7b-4eae-901f-cafaacdb5d11 service nova] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] Refreshing instance network info cache due to event network-changed-e998bcd4-3b5b-4cb1-9b31-7b44f124f51f. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:21:06 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-7d5ed3ae-8ce7-43f1-b121-6e25b46f4d91 req-4c4a6704-3a7b-4eae-901f-cafaacdb5d11 service nova] Acquiring lock "refresh_cache-ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:21:06 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-7d5ed3ae-8ce7-43f1-b121-6e25b46f4d91 req-4c4a6704-3a7b-4eae-901f-cafaacdb5d11 service nova] Acquired lock "refresh_cache-ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:21:06 user nova-compute[95467]: DEBUG nova.network.neutron [req-7d5ed3ae-8ce7-43f1-b121-6e25b46f4d91 req-4c4a6704-3a7b-4eae-901f-cafaacdb5d11 service nova] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] Refreshing network info cache for port e998bcd4-3b5b-4cb1-9b31-7b44f124f51f {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:21:06 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-5c8d31c5-0727-4c8e-9c15-a42bbb692ee4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Acquiring lock "ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:21:06 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-5c8d31c5-0727-4c8e-9c15-a42bbb692ee4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lock "ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:21:06 user nova-compute[95467]: DEBUG nova.objects.instance [None req-5c8d31c5-0727-4c8e-9c15-a42bbb692ee4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lazy-loading 'flavor' on Instance uuid ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:21:06 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-5c8d31c5-0727-4c8e-9c15-a42bbb692ee4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] Ignoring supplied device name: /dev/vdb
Nov 15 08:21:06 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-5c8d31c5-0727-4c8e-9c15-a42bbb692ee4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lock "ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:21:06 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-5c8d31c5-0727-4c8e-9c15-a42bbb692ee4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Acquiring lock "ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:21:06 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-5c8d31c5-0727-4c8e-9c15-a42bbb692ee4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lock "ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:21:06 user nova-compute[95467]: INFO nova.compute.manager [None req-5c8d31c5-0727-4c8e-9c15-a42bbb692ee4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] Attaching volume b6e2b3d2-26f3-4a80-a8cf-5fc07c558802 to /dev/vdb
Nov 15 08:21:06 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Acquiring lock "refresh_cache-e7805e5c-1777-4b0c-95c7-b232be66528c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:21:06 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Acquired lock "refresh_cache-e7805e5c-1777-4b0c-95c7-b232be66528c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:21:06 user nova-compute[95467]: DEBUG nova.network.neutron [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:21:06 user nova-compute[95467]: DEBUG os_brick.utils [None req-5c8d31c5-0727-4c8e-9c15-a42bbb692ee4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:21:06 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:06 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:06 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b605e3-3214-4ede-a701-54c6078647ab]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:882ae90641f\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:06 user nova-compute[95467]: DEBUG nova.compute.manager [req-065f5fd4-d1c8-4151-9b28-f39d95a62f98 req-40cd0d33-47b6-4d6e-8b78-4d31398f221d service nova] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Received event network-changed-7f8e69fc-628f-4a31-9ba0-db0b320dff09 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:21:06 user nova-compute[95467]: DEBUG nova.compute.manager [req-065f5fd4-d1c8-4151-9b28-f39d95a62f98 req-40cd0d33-47b6-4d6e-8b78-4d31398f221d service nova] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Refreshing instance network info cache due to event network-changed-7f8e69fc-628f-4a31-9ba0-db0b320dff09. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:21:06 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-065f5fd4-d1c8-4151-9b28-f39d95a62f98 req-40cd0d33-47b6-4d6e-8b78-4d31398f221d service nova] Acquiring lock "refresh_cache-e7805e5c-1777-4b0c-95c7-b232be66528c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:21:06 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:06 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:06 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f0c87f-81a7-4257-9fbc-844054ebbc03]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:06 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:06 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:06 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2b4703-c4f2-455d-8d09-d9a48c9ef6ac]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:06 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[888fad8e-e97d-4bae-9163-6d4f584e1945]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:06 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-5c8d31c5-0727-4c8e-9c15-a42bbb692ee4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Running cmd (subprocess): nvme version {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:06 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-5c8d31c5-0727-4c8e-9c15-a42bbb692ee4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] 'nvme version' failed. Not Retrying. {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:21:06 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5c8d31c5-0727-4c8e-9c15-a42bbb692ee4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] nvme not present on system {{(pid=95467) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 08:21:06 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:06 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:21:06 user nova-compute[95467]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 08:21:06 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a349530e-c674-41f0-b943-e65174e020ae]: (4, '') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:06 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-5c8d31c5-0727-4c8e-9c15-a42bbb692ee4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=95467) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 08:21:06 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-5c8d31c5-0727-4c8e-9c15-a42bbb692ee4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 08:21:06 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-5c8d31c5-0727-4c8e-9c15-a42bbb692ee4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] LIGHTOS: no hostnqn found. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 08:21:06 user nova-compute[95467]: DEBUG os_brick.utils [None req-5c8d31c5-0727-4c8e-9c15-a42bbb692ee4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:882ae90641f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:21:06 user nova-compute[95467]: DEBUG nova.virt.block_device [None req-5c8d31c5-0727-4c8e-9c15-a42bbb692ee4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] Updating existing volume attachment record: fc12e1bb-ba4c-40e7-b330-237b0336408f {{(pid=95467) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 08:21:06 user nova-compute[95467]: DEBUG nova.network.neutron [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Updating instance_info_cache with network_info: [{"id": "7f8e69fc-628f-4a31-9ba0-db0b320dff09", "address": "fa:16:3e:46:f0:15", "network": {"id": "f7871b75-73b3-4f0a-8e6c-814bc61ebd6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-945672014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b04c448c61451d8d46ebc7a61a5e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f8e69fc-62", "ovs_interfaceid": "7f8e69fc-628f-4a31-9ba0-db0b320dff09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:21:07 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Releasing lock "refresh_cache-e7805e5c-1777-4b0c-95c7-b232be66528c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:21:07 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Creating instance directory {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 08:21:07 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Creating image(s)
Nov 15 08:21:07 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Acquiring lock "/opt/stack/data/nova/instances/e7805e5c-1777-4b0c-95c7-b232be66528c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:21:07 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "/opt/stack/data/nova/instances/e7805e5c-1777-4b0c-95c7-b232be66528c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:21:07 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "/opt/stack/data/nova/instances/e7805e5c-1777-4b0c-95c7-b232be66528c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:21:07 user nova-compute[95467]: DEBUG nova.objects.instance [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lazy-loading 'trusted_certs' on Instance uuid e7805e5c-1777-4b0c-95c7-b232be66528c {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:21:07 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-065f5fd4-d1c8-4151-9b28-f39d95a62f98 req-40cd0d33-47b6-4d6e-8b78-4d31398f221d service nova] Acquired lock "refresh_cache-e7805e5c-1777-4b0c-95c7-b232be66528c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:21:07 user nova-compute[95467]: DEBUG nova.network.neutron [req-065f5fd4-d1c8-4151-9b28-f39d95a62f98 req-40cd0d33-47b6-4d6e-8b78-4d31398f221d service nova] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Refreshing network info cache for port 7f8e69fc-628f-4a31-9ba0-db0b320dff09 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:21:07 user nova-compute[95467]: DEBUG nova.objects.base [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Object Instance<e7805e5c-1777-4b0c-95c7-b232be66528c> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=95467) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 08:21:07 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Acquiring lock "9cc4859b3e1415e88a37209eb7f11bcfbadb10dc" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:21:07 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "9cc4859b3e1415e88a37209eb7f11bcfbadb10dc" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:21:07 user nova-compute[95467]: DEBUG nova.network.neutron [req-7d5ed3ae-8ce7-43f1-b121-6e25b46f4d91 req-4c4a6704-3a7b-4eae-901f-cafaacdb5d11 service nova] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] Updated VIF entry in instance network info cache for port e998bcd4-3b5b-4cb1-9b31-7b44f124f51f. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:21:07 user nova-compute[95467]: DEBUG nova.network.neutron [req-7d5ed3ae-8ce7-43f1-b121-6e25b46f4d91 req-4c4a6704-3a7b-4eae-901f-cafaacdb5d11 service nova] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] Updating instance_info_cache with network_info: [{"id": "e998bcd4-3b5b-4cb1-9b31-7b44f124f51f", "address": "fa:16:3e:a6:60:b2", "network": {"id": "8220309c-e09f-4c20-8f74-abdf4688fe64", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-160547739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b1fa68347914efe87ae8edd3901e11a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape998bcd4-3b", "ovs_interfaceid": "e998bcd4-3b5b-4cb1-9b31-7b44f124f51f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:21:08 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9cc4859b3e1415e88a37209eb7f11bcfbadb10dc.part --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:08 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:08 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-7d5ed3ae-8ce7-43f1-b121-6e25b46f4d91 req-4c4a6704-3a7b-4eae-901f-cafaacdb5d11 service nova] Releasing lock "refresh_cache-ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:21:08 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:08 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9cc4859b3e1415e88a37209eb7f11bcfbadb10dc.part --force-share --output=json" returned: 0 in 0.181s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:08 user nova-compute[95467]: DEBUG nova.virt.images [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] 4b964778-6892-4b00-8b6b-8c24f8a8a5bf was qcow2, converting to raw {{(pid=95467) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 08:21:08 user nova-compute[95467]: DEBUG nova.privsep.utils [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=95467) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 08:21:08 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9cc4859b3e1415e88a37209eb7f11bcfbadb10dc.part /opt/stack/data/nova/instances/_base/9cc4859b3e1415e88a37209eb7f11bcfbadb10dc.converted {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:08 user nova-compute[95467]: DEBUG nova.network.neutron [req-065f5fd4-d1c8-4151-9b28-f39d95a62f98 req-40cd0d33-47b6-4d6e-8b78-4d31398f221d service nova] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Updated VIF entry in instance network info cache for port 7f8e69fc-628f-4a31-9ba0-db0b320dff09. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:21:08 user nova-compute[95467]: DEBUG nova.network.neutron [req-065f5fd4-d1c8-4151-9b28-f39d95a62f98 req-40cd0d33-47b6-4d6e-8b78-4d31398f221d service nova] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Updating instance_info_cache with network_info: [{"id": "7f8e69fc-628f-4a31-9ba0-db0b320dff09", "address": "fa:16:3e:46:f0:15", "network": {"id": "f7871b75-73b3-4f0a-8e6c-814bc61ebd6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-945672014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b04c448c61451d8d46ebc7a61a5e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f8e69fc-62", "ovs_interfaceid": "7f8e69fc-628f-4a31-9ba0-db0b320dff09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:21:08 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-065f5fd4-d1c8-4151-9b28-f39d95a62f98 req-40cd0d33-47b6-4d6e-8b78-4d31398f221d service nova] Releasing lock "refresh_cache-e7805e5c-1777-4b0c-95c7-b232be66528c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:21:08 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9cc4859b3e1415e88a37209eb7f11bcfbadb10dc.part /opt/stack/data/nova/instances/_base/9cc4859b3e1415e88a37209eb7f11bcfbadb10dc.converted" returned: 0 in 0.514s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:08 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9cc4859b3e1415e88a37209eb7f11bcfbadb10dc.converted --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:09 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9cc4859b3e1415e88a37209eb7f11bcfbadb10dc.converted --force-share --output=json" returned: 0 in 0.171s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:09 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "9cc4859b3e1415e88a37209eb7f11bcfbadb10dc" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.079s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:21:09 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9cc4859b3e1415e88a37209eb7f11bcfbadb10dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:09 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9cc4859b3e1415e88a37209eb7f11bcfbadb10dc --force-share --output=json" returned: 0 in 0.174s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:09 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Acquiring lock "9cc4859b3e1415e88a37209eb7f11bcfbadb10dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:21:09 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "9cc4859b3e1415e88a37209eb7f11bcfbadb10dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:21:09 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9cc4859b3e1415e88a37209eb7f11bcfbadb10dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:09 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9cc4859b3e1415e88a37209eb7f11bcfbadb10dc --force-share --output=json" returned: 0 in 0.172s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:09 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9cc4859b3e1415e88a37209eb7f11bcfbadb10dc,backing_fmt=raw /opt/stack/data/nova/instances/e7805e5c-1777-4b0c-95c7-b232be66528c/disk 1073741824 {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:09 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9cc4859b3e1415e88a37209eb7f11bcfbadb10dc,backing_fmt=raw /opt/stack/data/nova/instances/e7805e5c-1777-4b0c-95c7-b232be66528c/disk 1073741824" returned: 0 in 0.053s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:09 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "9cc4859b3e1415e88a37209eb7f11bcfbadb10dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:21:09 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9cc4859b3e1415e88a37209eb7f11bcfbadb10dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:09 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9cc4859b3e1415e88a37209eb7f11bcfbadb10dc --force-share --output=json" returned: 0 in 0.182s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:09 user nova-compute[95467]: DEBUG nova.objects.instance [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lazy-loading 'migration_context' on Instance uuid e7805e5c-1777-4b0c-95c7-b232be66528c {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:21:09 user nova-compute[95467]: DEBUG nova.objects.base [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Object Instance<e7805e5c-1777-4b0c-95c7-b232be66528c> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=95467) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 08:21:09 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Rebasing disk image.
Nov 15 08:21:09 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:09 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.177s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:09 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc -F raw /opt/stack/data/nova/instances/e7805e5c-1777-4b0c-95c7-b232be66528c/disk {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:11 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c8d31c5-0727-4c8e-9c15-a42bbb692ee4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] Calling os-brick to attach iSCSI Volume {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 08:21:11 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c8d31c5-0727-4c8e-9c15-a42bbb692ee4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AkGWsugt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:21:11 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-5c8d31c5-0727-4c8e-9c15-a42bbb692ee4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:21:11 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-5c8d31c5-0727-4c8e-9c15-a42bbb692ee4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:21:11 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-5c8d31c5-0727-4c8e-9c15-a42bbb692ee4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:21:11 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-5c8d31c5-0727-4c8e-9c15-a42bbb692ee4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:21:11 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-5c8d31c5-0727-4c8e-9c15-a42bbb692ee4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:21:11 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-5c8d31c5-0727-4c8e-9c15-a42bbb692ee4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:21:11 user nova-compute[95467]: INFO os_brick.initiator.connectors.iscsi [None req-5c8d31c5-0727-4c8e-9c15-a42bbb692ee4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 08:21:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802 -p 172.16.0.220:3260 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:11 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[babc7207-7b7a-4661-b374-6fa9ddee8f96]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:11 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c8d31c5-0727-4c8e-9c15-a42bbb692ee4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 08:21:11 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:21:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802 -p 172.16.0.220:3260 --interface default --op new {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:11 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[443d483f-5bed-45a0-b512-b4a080d3e189]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802] added\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:11 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c8d31c5-0727-4c8e-9c15-a42bbb692ee4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802] added
Nov 15 08:21:11 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:21:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:11 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[47815986-ad8d-4a38-a967-44b14d45f159]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:11 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c8d31c5-0727-4c8e-9c15-a42bbb692ee4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:21:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:11 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b95380f-53af-4bf1-86c5-f0ce098d6f2e]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:11 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c8d31c5-0727-4c8e-9c15-a42bbb692ee4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:21:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AkGWsugt {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AkGWsugt" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:11 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd4519d-f889-4846-a73b-687a60c0f425]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:11 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c8d31c5-0727-4c8e-9c15-a42bbb692ee4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AkGWsugt'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:21:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:11 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa56a62-f966-4274-893a-714ecf80fa1e]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:11 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c8d31c5-0727-4c8e-9c15-a42bbb692ee4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:21:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:11 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d5b6e6-b487-47d7-acbc-a4c416799162]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:11 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c8d31c5-0727-4c8e-9c15-a42bbb692ee4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:21:11 user nova-compute[95467]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)
Nov 15 08:21:11 user nova-compute[95467]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:21:11 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:21:11 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c8d31c5-0727-4c8e-9c15-a42bbb692ee4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:21:11 user nova-compute[95467]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)
Nov 15 08:21:11 user nova-compute[95467]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:21:11 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:21:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802 -p 172.16.0.220:3260 --login {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:11 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[0813c1d6-3a6f-4887-bad9-2d3bd38abc0a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:11 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c8d31c5-0727-4c8e-9c15-a42bbb692ee4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802, portal: 172.16.0.220,3260]
Nov 15 08:21:11 user nova-compute[95467]: Login to [iface: default, target: iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802, portal: 172.16.0.220,3260] successful.
Nov 15 08:21:11 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:21:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:11 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[650ec5d0-f47e-4a6f-86a5-18a21dba36fc]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:11 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c8d31c5-0727-4c8e-9c15-a42bbb692ee4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:21:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:11 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[5001b06f-b49b-4835-a8b6-8f32b5abd095]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:11 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c8d31c5-0727-4c8e-9c15-a42bbb692ee4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:21:11 user nova-compute[95467]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)
Nov 15 08:21:11 user nova-compute[95467]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:21:11 user nova-compute[95467]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802 (non-flash)
Nov 15 08:21:11 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:21:11 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c8d31c5-0727-4c8e-9c15-a42bbb692ee4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:21:11 user nova-compute[95467]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)
Nov 15 08:21:11 user nova-compute[95467]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:21:11 user nova-compute[95467]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802 (non-flash)
Nov 15 08:21:11 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:21:11 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-5c8d31c5-0727-4c8e-9c15-a42bbb692ee4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:21:11 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c8d31c5-0727-4c8e-9c15-a42bbb692ee4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Connected to 172.16.0.220:3260 {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 08:21:11 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-5c8d31c5-0727-4c8e-9c15-a42bbb692ee4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] HCTL ('34', '-', '-', 0) found on session 32 with lun 0 {{(pid=95467) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 08:21:11 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-5c8d31c5-0727-4c8e-9c15-a42bbb692ee4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=95467) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 08:21:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:11 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1aa6cc5-3ff2-4d1e-b222-72e830814a52]: (4, ('- - 0', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:11 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-5c8d31c5-0727-4c8e-9c15-a42bbb692ee4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Searching for a device in session 32 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:21:11 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c8d31c5-0727-4c8e-9c15-a42bbb692ee4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AkGWsugt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 08:21:12 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc -F raw /opt/stack/data/nova/instances/e7805e5c-1777-4b0c-95c7-b232be66528c/disk" returned: 0 in 2.170s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:12 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Created local disks {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 08:21:12 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Ensure instance console log exists: /opt/stack/data/nova/instances/e7805e5c-1777-4b0c-95c7-b232be66528c/console.log {{(pid=95467) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 08:21:12 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:21:12 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:21:12 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:21:12 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Start _get_guest_xml network_info=[{"id": "7f8e69fc-628f-4a31-9ba0-db0b320dff09", "address": "fa:16:3e:46:f0:15", "network": {"id": "f7871b75-73b3-4f0a-8e6c-814bc61ebd6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-945672014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b04c448c61451d8d46ebc7a61a5e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f8e69fc-62", "ovs_interfaceid": "7f8e69fc-628f-4a31-9ba0-db0b320dff09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='90a4d4073535d699203be7c098b610c3',container_format='bare',created_at=2023-11-15T08:19:12Z,direct_url=<?>,disk_format='qcow2',id=4b964778-6892-4b00-8b6b-8c24f8a8a5bf,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-2096143899-shelved',owner='94b04c448c61451d8d46ebc7a61a5e6e',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-15T08:19:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'ed9c48aa-ce73-4b3b-9db1-235898be671b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:21:12 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:21:12 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:21:12 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:21:12 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:21:12 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:21:12 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:21:12 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:21:12 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='90a4d4073535d699203be7c098b610c3',container_format='bare',created_at=2023-11-15T08:19:12Z,direct_url=<?>,disk_format='qcow2',id=4b964778-6892-4b00-8b6b-8c24f8a8a5bf,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-2096143899-shelved',owner='94b04c448c61451d8d46ebc7a61a5e6e',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-15T08:19:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:21:12 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:21:12 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:21:12 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:21:12 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:21:12 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:21:12 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:21:12 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:21:12 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:21:12 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:21:12 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:21:12 user nova-compute[95467]: DEBUG nova.objects.instance [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lazy-loading 'vcpu_model' on Instance uuid e7805e5c-1777-4b0c-95c7-b232be66528c {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:21:12 user nova-compute[95467]: DEBUG nova.objects.base [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Object Instance<e7805e5c-1777-4b0c-95c7-b232be66528c> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=95467) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 08:21:12 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T08:17:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2096143899',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2096143899',id=28,image_ref='4b964778-6892-4b00-8b6b-8c24f8a8a5bf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-559293739',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:17:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='94b04c448c61451d8d46ebc7a61a5e6e',ramdisk_id='',reservation_id='r-1r9tzmt8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1251988905',owner_user_name='tempest-AttachVolumeShelveTestJSON-1251988905-project-member',shelved_at='2023-11-15T08:19:17.365248',shelved_host='user',shelved_image_id='4b964778-6892-4b00-8b6b-8c24f8a8a5bf'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:21:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b03564d022e84f5cb133b9771e76bae8',uuid=e7805e5c-1777-4b0c-95c7-b232be66528c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "7f8e69fc-628f-4a31-9ba0-db0b320dff09", "address": "fa:16:3e:46:f0:15", "network": {"id": "f7871b75-73b3-4f0a-8e6c-814bc61ebd6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-945672014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b04c448c61451d8d46ebc7a61a5e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f8e69fc-62", "ovs_interfaceid": "7f8e69fc-628f-4a31-9ba0-db0b320dff09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:21:12 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Converting VIF {"id": "7f8e69fc-628f-4a31-9ba0-db0b320dff09", "address": "fa:16:3e:46:f0:15", "network": {"id": "f7871b75-73b3-4f0a-8e6c-814bc61ebd6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-945672014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b04c448c61451d8d46ebc7a61a5e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f8e69fc-62", "ovs_interfaceid": "7f8e69fc-628f-4a31-9ba0-db0b320dff09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:21:12 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:f0:15,bridge_name='br-int',has_traffic_filtering=True,id=7f8e69fc-628f-4a31-9ba0-db0b320dff09,network=Network(f7871b75-73b3-4f0a-8e6c-814bc61ebd6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f8e69fc-62') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:21:12 user nova-compute[95467]: DEBUG nova.objects.instance [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lazy-loading 'pci_devices' on Instance uuid e7805e5c-1777-4b0c-95c7-b232be66528c {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:21:12 user nova-compute[95467]: DEBUG nova.objects.base [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Object Instance<e7805e5c-1777-4b0c-95c7-b232be66528c> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=95467) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 08:21:12 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:21:12 user nova-compute[95467]:   <uuid>e7805e5c-1777-4b0c-95c7-b232be66528c</uuid>
Nov 15 08:21:12 user nova-compute[95467]:   <name>instance-0000001c</name>
Nov 15 08:21:12 user nova-compute[95467]:   <memory>524288</memory>
Nov 15 08:21:12 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:21:12 user nova-compute[95467]:   <metadata>
Nov 15 08:21:12 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:21:12 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:21:12 user nova-compute[95467]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-2096143899</nova:name>
Nov 15 08:21:12 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:21:12</nova:creationTime>
Nov 15 08:21:12 user nova-compute[95467]:       <nova:flavor name="m1.tiny">
Nov 15 08:21:12 user nova-compute[95467]:         <nova:memory>512</nova:memory>
Nov 15 08:21:12 user nova-compute[95467]:         <nova:disk>1</nova:disk>
Nov 15 08:21:12 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:21:12 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:21:12 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:21:12 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:21:12 user nova-compute[95467]:       <nova:owner>
Nov 15 08:21:12 user nova-compute[95467]:         <nova:user uuid="b03564d022e84f5cb133b9771e76bae8">tempest-AttachVolumeShelveTestJSON-1251988905-project-member</nova:user>
Nov 15 08:21:12 user nova-compute[95467]:         <nova:project uuid="94b04c448c61451d8d46ebc7a61a5e6e">tempest-AttachVolumeShelveTestJSON-1251988905</nova:project>
Nov 15 08:21:12 user nova-compute[95467]:       </nova:owner>
Nov 15 08:21:12 user nova-compute[95467]:       <nova:root type="image" uuid="4b964778-6892-4b00-8b6b-8c24f8a8a5bf"/>
Nov 15 08:21:12 user nova-compute[95467]:       <nova:ports>
Nov 15 08:21:12 user nova-compute[95467]:         <nova:port uuid="7f8e69fc-628f-4a31-9ba0-db0b320dff09">
Nov 15 08:21:12 user nova-compute[95467]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 08:21:12 user nova-compute[95467]:         </nova:port>
Nov 15 08:21:12 user nova-compute[95467]:       </nova:ports>
Nov 15 08:21:12 user nova-compute[95467]:     </nova:instance>
Nov 15 08:21:12 user nova-compute[95467]:   </metadata>
Nov 15 08:21:12 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:21:12 user nova-compute[95467]:     <system>
Nov 15 08:21:12 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:21:12 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:21:12 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:21:12 user nova-compute[95467]:       <entry name="serial">e7805e5c-1777-4b0c-95c7-b232be66528c</entry>
Nov 15 08:21:12 user nova-compute[95467]:       <entry name="uuid">e7805e5c-1777-4b0c-95c7-b232be66528c</entry>
Nov 15 08:21:12 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:21:12 user nova-compute[95467]:     </system>
Nov 15 08:21:12 user nova-compute[95467]:   </sysinfo>
Nov 15 08:21:12 user nova-compute[95467]:   <os>
Nov 15 08:21:12 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:21:12 user nova-compute[95467]:     <boot dev="hd"/>
Nov 15 08:21:12 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:21:12 user nova-compute[95467]:   </os>
Nov 15 08:21:12 user nova-compute[95467]:   <features>
Nov 15 08:21:12 user nova-compute[95467]:     <acpi/>
Nov 15 08:21:12 user nova-compute[95467]:     <apic/>
Nov 15 08:21:12 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:21:12 user nova-compute[95467]:   </features>
Nov 15 08:21:12 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:21:12 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:21:12 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:21:12 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:21:12 user nova-compute[95467]:   </clock>
Nov 15 08:21:12 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:21:12 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:21:12 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:21:12 user nova-compute[95467]:   </cpu>
Nov 15 08:21:12 user nova-compute[95467]:   <devices>
Nov 15 08:21:12 user nova-compute[95467]:     <disk type="file" device="disk">
Nov 15 08:21:12 user nova-compute[95467]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 08:21:12 user nova-compute[95467]:       <source file="/opt/stack/data/nova/instances/e7805e5c-1777-4b0c-95c7-b232be66528c/disk"/>
Nov 15 08:21:12 user nova-compute[95467]:       <target dev="vda" bus="virtio"/>
Nov 15 08:21:12 user nova-compute[95467]:     </disk>
Nov 15 08:21:12 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:21:12 user nova-compute[95467]:       <mac address="fa:16:3e:46:f0:15"/>
Nov 15 08:21:12 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:21:12 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:21:12 user nova-compute[95467]:       <target dev="tap7f8e69fc-62"/>
Nov 15 08:21:12 user nova-compute[95467]:     </interface>
Nov 15 08:21:12 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:21:12 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/e7805e5c-1777-4b0c-95c7-b232be66528c/console.log" append="off"/>
Nov 15 08:21:12 user nova-compute[95467]:     </serial>
Nov 15 08:21:12 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:21:12 user nova-compute[95467]:     <video>
Nov 15 08:21:12 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:21:12 user nova-compute[95467]:     </video>
Nov 15 08:21:12 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:21:12 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:21:12 user nova-compute[95467]:     </rng>
Nov 15 08:21:12 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:21:12 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:21:12 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:21:12 user nova-compute[95467]:     </memballoon>
Nov 15 08:21:12 user nova-compute[95467]:   </devices>
Nov 15 08:21:12 user nova-compute[95467]: </domain>
Nov 15 08:21:12 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:21:12 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T08:17:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2096143899',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2096143899',id=28,image_ref='4b964778-6892-4b00-8b6b-8c24f8a8a5bf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-559293739',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:17:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='94b04c448c61451d8d46ebc7a61a5e6e',ramdisk_id='',reservation_id='r-1r9tzmt8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1251988905',owner_user_name='tempest-AttachVolumeShelveTestJSON-1251988905-project-member',shelved_at='2023-11-15T08:19:17.365248',shelved_host='user',shelved_image_id='4b964778-6892-4b00-8b6b-8c24f8a8a5bf'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:21:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b03564d022e84f5cb133b9771e76bae8',uuid=e7805e5c-1777-4b0c-95c7-b232be66528c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "7f8e69fc-628f-4a31-9ba0-db0b320dff09", "address": "fa:16:3e:46:f0:15", "network": {"id": "f7871b75-73b3-4f0a-8e6c-814bc61ebd6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-945672014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b04c448c61451d8d46ebc7a61a5e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f8e69fc-62", "ovs_interfaceid": "7f8e69fc-628f-4a31-9ba0-db0b320dff09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:21:12 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Converting VIF {"id": "7f8e69fc-628f-4a31-9ba0-db0b320dff09", "address": "fa:16:3e:46:f0:15", "network": {"id": "f7871b75-73b3-4f0a-8e6c-814bc61ebd6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-945672014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b04c448c61451d8d46ebc7a61a5e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f8e69fc-62", "ovs_interfaceid": "7f8e69fc-628f-4a31-9ba0-db0b320dff09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:21:12 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:f0:15,bridge_name='br-int',has_traffic_filtering=True,id=7f8e69fc-628f-4a31-9ba0-db0b320dff09,network=Network(f7871b75-73b3-4f0a-8e6c-814bc61ebd6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f8e69fc-62') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:21:12 user nova-compute[95467]: DEBUG os_vif [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:f0:15,bridge_name='br-int',has_traffic_filtering=True,id=7f8e69fc-628f-4a31-9ba0-db0b320dff09,network=Network(f7871b75-73b3-4f0a-8e6c-814bc61ebd6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f8e69fc-62') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:21:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:21:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:21:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '132db885-4fe2-5e16-8179-09b8a8751bfb', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:21:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:21:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7f8e69fc-62, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:21:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7f8e69fc-62, col_values=(('qos', UUID('f0740673-3b76-43ca-ab3b-e0f081035059')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:21:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7f8e69fc-62, col_values=(('external_ids', {'iface-id': '7f8e69fc-628f-4a31-9ba0-db0b320dff09', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:f0:15', 'vm-uuid': 'e7805e5c-1777-4b0c-95c7-b232be66528c'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:21:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:21:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:12 user nova-compute[95467]: INFO os_vif [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:f0:15,bridge_name='br-int',has_traffic_filtering=True,id=7f8e69fc-628f-4a31-9ba0-db0b320dff09,network=Network(f7871b75-73b3-4f0a-8e6c-814bc61ebd6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f8e69fc-62')
Nov 15 08:21:12 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:21:12 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] No VIF found with MAC fa:16:3e:46:f0:15, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:21:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:12 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-5c8d31c5-0727-4c8e-9c15-a42bbb692ee4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:21:12 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c8d31c5-0727-4c8e-9c15-a42bbb692ee4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '23037656336323235', 'path': '/dev/sdc'} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:21:12 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c8d31c5-0727-4c8e-9c15-a42bbb692ee4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23037656336323235', 'path': '/dev/sdc'} {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 08:21:12 user nova-compute[95467]: DEBUG nova.objects.instance [None req-5c8d31c5-0727-4c8e-9c15-a42bbb692ee4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lazy-loading 'flavor' on Instance uuid ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:21:12 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-5c8d31c5-0727-4c8e-9c15-a42bbb692ee4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 08:21:12 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:21:12 user nova-compute[95467]:   <source dev="/dev/sdc"/>
Nov 15 08:21:12 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:21:12 user nova-compute[95467]:   <serial>b6e2b3d2-26f3-4a80-a8cf-5fc07c558802</serial>
Nov 15 08:21:12 user nova-compute[95467]: </disk>
Nov 15 08:21:12 user nova-compute[95467]:  {{(pid=95467) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 08:21:13 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-5c8d31c5-0727-4c8e-9c15-a42bbb692ee4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:21:13 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-5c8d31c5-0727-4c8e-9c15-a42bbb692ee4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] No BDM found with device name vdb, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:21:13 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-5c8d31c5-0727-4c8e-9c15-a42bbb692ee4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] No VIF found with MAC fa:16:3e:a6:60:b2, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:21:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-5c8d31c5-0727-4c8e-9c15-a42bbb692ee4 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lock "ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.960s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:21:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:14 user nova-compute[95467]: DEBUG nova.compute.manager [req-de67e6a0-0422-4253-9bfd-37d6c06693e1 req-71f5d8d3-3c70-4ab3-8433-95ddc127bebe service nova] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Received event network-vif-plugged-7f8e69fc-628f-4a31-9ba0-db0b320dff09 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:21:14 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-de67e6a0-0422-4253-9bfd-37d6c06693e1 req-71f5d8d3-3c70-4ab3-8433-95ddc127bebe service nova] Acquiring lock "e7805e5c-1777-4b0c-95c7-b232be66528c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:21:14 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-de67e6a0-0422-4253-9bfd-37d6c06693e1 req-71f5d8d3-3c70-4ab3-8433-95ddc127bebe service nova] Lock "e7805e5c-1777-4b0c-95c7-b232be66528c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:21:14 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-de67e6a0-0422-4253-9bfd-37d6c06693e1 req-71f5d8d3-3c70-4ab3-8433-95ddc127bebe service nova] Lock "e7805e5c-1777-4b0c-95c7-b232be66528c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:21:14 user nova-compute[95467]: DEBUG nova.compute.manager [req-de67e6a0-0422-4253-9bfd-37d6c06693e1 req-71f5d8d3-3c70-4ab3-8433-95ddc127bebe service nova] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] No waiting events found dispatching network-vif-plugged-7f8e69fc-628f-4a31-9ba0-db0b320dff09 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:21:14 user nova-compute[95467]: WARNING nova.compute.manager [req-de67e6a0-0422-4253-9bfd-37d6c06693e1 req-71f5d8d3-3c70-4ab3-8433-95ddc127bebe service nova] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Received unexpected event network-vif-plugged-7f8e69fc-628f-4a31-9ba0-db0b320dff09 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 15 08:21:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:16 user nova-compute[95467]: DEBUG nova.compute.manager [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Instance event wait completed in 0 seconds for  {{(pid=95467) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 08:21:16 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Guest created on hypervisor {{(pid=95467) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 08:21:16 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Instance spawned successfully.
Nov 15 08:21:16 user nova-compute[95467]: DEBUG nova.compute.manager [req-2778b6f9-efc9-43da-ac76-72df0e411611 req-c5f1d56d-0b6d-48e8-8531-72233977519b service nova] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Received event network-vif-plugged-7f8e69fc-628f-4a31-9ba0-db0b320dff09 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:21:16 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-2778b6f9-efc9-43da-ac76-72df0e411611 req-c5f1d56d-0b6d-48e8-8531-72233977519b service nova] Acquiring lock "e7805e5c-1777-4b0c-95c7-b232be66528c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:21:16 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-2778b6f9-efc9-43da-ac76-72df0e411611 req-c5f1d56d-0b6d-48e8-8531-72233977519b service nova] Lock "e7805e5c-1777-4b0c-95c7-b232be66528c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:21:16 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-2778b6f9-efc9-43da-ac76-72df0e411611 req-c5f1d56d-0b6d-48e8-8531-72233977519b service nova] Lock "e7805e5c-1777-4b0c-95c7-b232be66528c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:21:16 user nova-compute[95467]: DEBUG nova.compute.manager [req-2778b6f9-efc9-43da-ac76-72df0e411611 req-c5f1d56d-0b6d-48e8-8531-72233977519b service nova] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] No waiting events found dispatching network-vif-plugged-7f8e69fc-628f-4a31-9ba0-db0b320dff09 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:21:16 user nova-compute[95467]: WARNING nova.compute.manager [req-2778b6f9-efc9-43da-ac76-72df0e411611 req-c5f1d56d-0b6d-48e8-8531-72233977519b service nova] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Received unexpected event network-vif-plugged-7f8e69fc-628f-4a31-9ba0-db0b320dff09 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 15 08:21:16 user nova-compute[95467]: DEBUG nova.compute.manager [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:21:16 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-84e97d5a-82d6-45c6-9b86-bfc735011d1c tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "e7805e5c-1777-4b0c-95c7-b232be66528c" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.283s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:21:17 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:17 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:18 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Acquiring lock "a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:21:18 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:21:18 user nova-compute[95467]: DEBUG nova.compute.manager [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Starting instance... {{(pid=95467) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 08:21:18 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:21:18 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:21:18 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=95467) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 08:21:18 user nova-compute[95467]: INFO nova.compute.claims [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Claim successful on node user
Nov 15 08:21:19 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:21:19 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:21:19 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.542s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:21:19 user nova-compute[95467]: DEBUG nova.compute.manager [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Start building networks asynchronously for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 08:21:19 user nova-compute[95467]: DEBUG nova.compute.manager [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Allocating IP information in the background. {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 08:21:19 user nova-compute[95467]: DEBUG nova.network.neutron [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] allocate_for_instance() {{(pid=95467) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 08:21:19 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 08:21:19 user nova-compute[95467]: DEBUG nova.compute.manager [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Start building block device mappings for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 08:21:19 user nova-compute[95467]: DEBUG nova.policy [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2d9b34339b404facac21f500f40b1686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a1aa4f562c64545a94157d4aaf8d14e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95467) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 08:21:19 user nova-compute[95467]: INFO nova.virt.block_device [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Booting with volume 769e646a-dfe3-48d6-800c-7533bb9a7400 at /dev/vda
Nov 15 08:21:19 user nova-compute[95467]: DEBUG os_brick.utils [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:21:19 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:19 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:19 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4982b9d-3e59-46b5-a3cb-09d9ca455974]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:882ae90641f\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:19 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:19 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:19 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a49d1cd-5487-49eb-a1af-d277ee7ca238]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:19 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:19 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:19 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[67338dd5-c1c4-4d1e-816e-378f376687a6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:19 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac13203b-9f01-4426-9ca4-84f4261c68a8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:19 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Running cmd (subprocess): nvme version {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:19 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] 'nvme version' failed. Not Retrying. {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:21:19 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] nvme not present on system {{(pid=95467) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 08:21:19 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:19 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:21:19 user nova-compute[95467]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 08:21:19 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[cefbac92-492c-4b21-9c03-842ca31a0a21]: (4, '') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:19 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=95467) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 08:21:19 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 08:21:19 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] LIGHTOS: no hostnqn found. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 08:21:19 user nova-compute[95467]: DEBUG os_brick.utils [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:882ae90641f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:21:19 user nova-compute[95467]: DEBUG nova.virt.block_device [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Updating existing volume attachment record: dd21def9-7140-40ba-b88a-1895bc4a8d01 {{(pid=95467) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 08:21:20 user nova-compute[95467]: DEBUG nova.network.neutron [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Successfully created port: cb099600-0c5c-4e0d-adfe-91a6ba3e0f08 {{(pid=95467) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 08:21:20 user nova-compute[95467]: DEBUG nova.network.neutron [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Successfully updated port: cb099600-0c5c-4e0d-adfe-91a6ba3e0f08 {{(pid=95467) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 08:21:20 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Acquiring lock "refresh_cache-a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:21:20 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Acquired lock "refresh_cache-a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:21:20 user nova-compute[95467]: DEBUG nova.network.neutron [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:21:20 user nova-compute[95467]: DEBUG nova.compute.manager [req-74937f1d-a21c-4e0f-91e0-c21d3b0c238c req-88b7b192-0539-4a72-a65d-29dbb7aa4010 service nova] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Received event network-changed-cb099600-0c5c-4e0d-adfe-91a6ba3e0f08 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:21:20 user nova-compute[95467]: DEBUG nova.compute.manager [req-74937f1d-a21c-4e0f-91e0-c21d3b0c238c req-88b7b192-0539-4a72-a65d-29dbb7aa4010 service nova] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Refreshing instance network info cache due to event network-changed-cb099600-0c5c-4e0d-adfe-91a6ba3e0f08. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:21:20 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-74937f1d-a21c-4e0f-91e0-c21d3b0c238c req-88b7b192-0539-4a72-a65d-29dbb7aa4010 service nova] Acquiring lock "refresh_cache-a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:21:20 user nova-compute[95467]: DEBUG nova.network.neutron [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Instance cache missing network info. {{(pid=95467) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 08:21:21 user nova-compute[95467]: DEBUG nova.network.neutron [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Updating instance_info_cache with network_info: [{"id": "cb099600-0c5c-4e0d-adfe-91a6ba3e0f08", "address": "fa:16:3e:1d:28:85", "network": {"id": "d8a362dc-0dc8-49dd-b2da-0e0749d5edca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-256373617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a1aa4f562c64545a94157d4aaf8d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb099600-0c", "ovs_interfaceid": "cb099600-0c5c-4e0d-adfe-91a6ba3e0f08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:21:21 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Releasing lock "refresh_cache-a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:21:21 user nova-compute[95467]: DEBUG nova.compute.manager [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Instance network_info: |[{"id": "cb099600-0c5c-4e0d-adfe-91a6ba3e0f08", "address": "fa:16:3e:1d:28:85", "network": {"id": "d8a362dc-0dc8-49dd-b2da-0e0749d5edca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-256373617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a1aa4f562c64545a94157d4aaf8d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb099600-0c", "ovs_interfaceid": "cb099600-0c5c-4e0d-adfe-91a6ba3e0f08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 08:21:21 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-74937f1d-a21c-4e0f-91e0-c21d3b0c238c req-88b7b192-0539-4a72-a65d-29dbb7aa4010 service nova] Acquired lock "refresh_cache-a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:21:21 user nova-compute[95467]: DEBUG nova.network.neutron [req-74937f1d-a21c-4e0f-91e0-c21d3b0c238c req-88b7b192-0539-4a72-a65d-29dbb7aa4010 service nova] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Refreshing network info cache for port cb099600-0c5c-4e0d-adfe-91a6ba3e0f08 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:21:21 user nova-compute[95467]: DEBUG nova.network.neutron [req-74937f1d-a21c-4e0f-91e0-c21d3b0c238c req-88b7b192-0539-4a72-a65d-29dbb7aa4010 service nova] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Updated VIF entry in instance network info cache for port cb099600-0c5c-4e0d-adfe-91a6ba3e0f08. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:21:21 user nova-compute[95467]: DEBUG nova.network.neutron [req-74937f1d-a21c-4e0f-91e0-c21d3b0c238c req-88b7b192-0539-4a72-a65d-29dbb7aa4010 service nova] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Updating instance_info_cache with network_info: [{"id": "cb099600-0c5c-4e0d-adfe-91a6ba3e0f08", "address": "fa:16:3e:1d:28:85", "network": {"id": "d8a362dc-0dc8-49dd-b2da-0e0749d5edca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-256373617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a1aa4f562c64545a94157d4aaf8d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb099600-0c", "ovs_interfaceid": "cb099600-0c5c-4e0d-adfe-91a6ba3e0f08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:21:21 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-74937f1d-a21c-4e0f-91e0-c21d3b0c238c req-88b7b192-0539-4a72-a65d-29dbb7aa4010 service nova] Releasing lock "refresh_cache-a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:21:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-31dbfd5b-c3da-48ee-bb39-501abc6baf17 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Acquiring lock "851d354c-7f20-4e72-bfd2-a781b929e8ba" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:21:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-31dbfd5b-c3da-48ee-bb39-501abc6baf17 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "851d354c-7f20-4e72-bfd2-a781b929e8ba" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:21:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-31dbfd5b-c3da-48ee-bb39-501abc6baf17 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Acquiring lock "851d354c-7f20-4e72-bfd2-a781b929e8ba-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:21:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-31dbfd5b-c3da-48ee-bb39-501abc6baf17 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "851d354c-7f20-4e72-bfd2-a781b929e8ba-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:21:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-31dbfd5b-c3da-48ee-bb39-501abc6baf17 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "851d354c-7f20-4e72-bfd2-a781b929e8ba-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:21:24 user nova-compute[95467]: INFO nova.compute.manager [None req-31dbfd5b-c3da-48ee-bb39-501abc6baf17 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] Terminating instance
Nov 15 08:21:24 user nova-compute[95467]: DEBUG nova.compute.manager [None req-31dbfd5b-c3da-48ee-bb39-501abc6baf17 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] Start destroying the instance on the hypervisor. {{(pid=95467) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 08:21:24 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:24 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:24 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:24 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:24 user nova-compute[95467]: DEBUG nova.compute.manager [req-42657fbf-adfc-490c-ab96-465e93faad00 req-514ed01a-f009-4231-9466-59aca64e2c41 service nova] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] Received event network-vif-unplugged-c9bd9bbe-8c0f-476d-978d-d7050876a1ab {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:21:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-42657fbf-adfc-490c-ab96-465e93faad00 req-514ed01a-f009-4231-9466-59aca64e2c41 service nova] Acquiring lock "851d354c-7f20-4e72-bfd2-a781b929e8ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:21:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-42657fbf-adfc-490c-ab96-465e93faad00 req-514ed01a-f009-4231-9466-59aca64e2c41 service nova] Lock "851d354c-7f20-4e72-bfd2-a781b929e8ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:21:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-42657fbf-adfc-490c-ab96-465e93faad00 req-514ed01a-f009-4231-9466-59aca64e2c41 service nova] Lock "851d354c-7f20-4e72-bfd2-a781b929e8ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:21:24 user nova-compute[95467]: DEBUG nova.compute.manager [req-42657fbf-adfc-490c-ab96-465e93faad00 req-514ed01a-f009-4231-9466-59aca64e2c41 service nova] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] No waiting events found dispatching network-vif-unplugged-c9bd9bbe-8c0f-476d-978d-d7050876a1ab {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:21:24 user nova-compute[95467]: DEBUG nova.compute.manager [req-42657fbf-adfc-490c-ab96-465e93faad00 req-514ed01a-f009-4231-9466-59aca64e2c41 service nova] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] Received event network-vif-unplugged-c9bd9bbe-8c0f-476d-978d-d7050876a1ab for instance with task_state deleting. {{(pid=95467) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 08:21:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-47f37b7a-e236-4e88-a34d-07df73a09355 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Acquiring lock "ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:21:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-47f37b7a-e236-4e88-a34d-07df73a09355 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lock "ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.004s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:21:25 user nova-compute[95467]: INFO nova.compute.manager [None req-47f37b7a-e236-4e88-a34d-07df73a09355 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] Detaching volume b6e2b3d2-26f3-4a80-a8cf-5fc07c558802
Nov 15 08:21:25 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] Instance destroyed successfully.
Nov 15 08:21:25 user nova-compute[95467]: DEBUG nova.objects.instance [None req-31dbfd5b-c3da-48ee-bb39-501abc6baf17 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lazy-loading 'resources' on Instance uuid 851d354c-7f20-4e72-bfd2-a781b929e8ba {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:21:25 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-31dbfd5b-c3da-48ee-bb39-501abc6baf17 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:16:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1019745917',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1019745917',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1019745917',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOo4tu16UhZt/Wocs2ppNo9WrrX7m1ijk1oUGOQJ8WBXgkkffrV/FJQFgEm4bqalf7GptKJGuKIr8+PGpGYsPmEDx6TtDmRJLSsqhwW+LKCcGSjhNvUTuKiKWApWjDq3ZQ==',key_name='tempest-keypair-369125507',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:16:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e7791bd92c7c488aa72474ecde2e1155',ramdisk_id='',reservation_id='r-at3b3ylg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-978207351',owner_user_name='tempest-TestVolumeBootPattern-978207351-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:16:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11bbbd3ef322402cb5dc60455a54319b',uuid=851d354c-7f20-4e72-bfd2-a781b929e8ba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c9bd9bbe-8c0f-476d-978d-d7050876a1ab", "address": "fa:16:3e:c3:5d:b8", "network": {"id": "96d9262b-11fb-497d-8e38-fa46076c010f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2069167691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7791bd92c7c488aa72474ecde2e1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9bd9bbe-8c", "ovs_interfaceid": "c9bd9bbe-8c0f-476d-978d-d7050876a1ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:21:25 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-31dbfd5b-c3da-48ee-bb39-501abc6baf17 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Converting VIF {"id": "c9bd9bbe-8c0f-476d-978d-d7050876a1ab", "address": "fa:16:3e:c3:5d:b8", "network": {"id": "96d9262b-11fb-497d-8e38-fa46076c010f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2069167691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7791bd92c7c488aa72474ecde2e1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9bd9bbe-8c", "ovs_interfaceid": "c9bd9bbe-8c0f-476d-978d-d7050876a1ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:21:25 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-31dbfd5b-c3da-48ee-bb39-501abc6baf17 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:5d:b8,bridge_name='br-int',has_traffic_filtering=True,id=c9bd9bbe-8c0f-476d-978d-d7050876a1ab,network=Network(96d9262b-11fb-497d-8e38-fa46076c010f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9bd9bbe-8c') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:21:25 user nova-compute[95467]: DEBUG os_vif [None req-31dbfd5b-c3da-48ee-bb39-501abc6baf17 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:5d:b8,bridge_name='br-int',has_traffic_filtering=True,id=c9bd9bbe-8c0f-476d-978d-d7050876a1ab,network=Network(96d9262b-11fb-497d-8e38-fa46076c010f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9bd9bbe-8c') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:21:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc9bd9bbe-8c, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:21:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:21:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c8bb2941-26b1-4098-adb3-e5348d4c5272) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:21:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:21:25 user nova-compute[95467]: INFO os_vif [None req-31dbfd5b-c3da-48ee-bb39-501abc6baf17 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:5d:b8,bridge_name='br-int',has_traffic_filtering=True,id=c9bd9bbe-8c0f-476d-978d-d7050876a1ab,network=Network(96d9262b-11fb-497d-8e38-fa46076c010f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9bd9bbe-8c')
Nov 15 08:21:25 user nova-compute[95467]: INFO nova.virt.block_device [None req-47f37b7a-e236-4e88-a34d-07df73a09355 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] Attempting to driver detach volume b6e2b3d2-26f3-4a80-a8cf-5fc07c558802 from mountpoint /dev/vdb
Nov 15 08:21:25 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31dbfd5b-c3da-48ee-bb39-501abc6baf17 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] calling os-brick to detach iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 08:21:25 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-31dbfd5b-c3da-48ee-bb39-501abc6baf17 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, {'target_iqn': 'iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bIqmePSh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:21:25 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-31dbfd5b-c3da-48ee-bb39-501abc6baf17 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:21:25 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-31dbfd5b-c3da-48ee-bb39-501abc6baf17 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:21:25 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-31dbfd5b-c3da-48ee-bb39-501abc6baf17 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:21:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e7cdc0aa-6045-4d4f-9203-06684ddac663 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Acquiring lock "ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:21:25 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:25 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-47f37b7a-e236-4e88-a34d-07df73a09355 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Attempting to detach device vdb from instance ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a from the persistent domain config. {{(pid=95467) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 08:21:25 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-47f37b7a-e236-4e88-a34d-07df73a09355 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 08:21:25 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:21:25 user nova-compute[95467]:   <source dev="/dev/sdc"/>
Nov 15 08:21:25 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:21:25 user nova-compute[95467]:   <serial>b6e2b3d2-26f3-4a80-a8cf-5fc07c558802</serial>
Nov 15 08:21:25 user nova-compute[95467]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 08:21:25 user nova-compute[95467]: </disk>
Nov 15 08:21:25 user nova-compute[95467]:  {{(pid=95467) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 08:21:25 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:25 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8740bad7-ad41-4f88-9f47-b91158537e17]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:25 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-31dbfd5b-c3da-48ee-bb39-501abc6baf17 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 08:21:25 user nova-compute[95467]: No targets found.
Nov 15 08:21:25 user nova-compute[95467]: iSNS:
Nov 15 08:21:25 user nova-compute[95467]: No targets found.
Nov 15 08:21:25 user nova-compute[95467]: STATIC:
Nov 15 08:21:25 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802
Nov 15 08:21:25 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:21:25 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:21:25 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e
Nov 15 08:21:25 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:21:25 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:21:25 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149
Nov 15 08:21:25 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:21:25 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:21:25 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775
Nov 15 08:21:25 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:21:25 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:21:25 user nova-compute[95467]: FIRMWARE:
Nov 15 08:21:25 user nova-compute[95467]: No targets found.
Nov 15 08:21:25 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:21:25 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-31dbfd5b-c3da-48ee-bb39-501abc6baf17 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 08:21:25 user nova-compute[95467]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 08:21:25 user nova-compute[95467]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=95467) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 08:21:25 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-31dbfd5b-c3da-48ee-bb39-501abc6baf17 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149', 0)] {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 08:21:25 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:25 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-47f37b7a-e236-4e88-a34d-07df73a09355 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Successfully detached device vdb from instance ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a from the persistent domain config.
Nov 15 08:21:25 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-47f37b7a-e236-4e88-a34d-07df73a09355 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a from the live domain config. {{(pid=95467) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 08:21:25 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-47f37b7a-e236-4e88-a34d-07df73a09355 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 08:21:25 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:21:25 user nova-compute[95467]:   <source dev="/dev/sdc"/>
Nov 15 08:21:25 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:21:25 user nova-compute[95467]:   <serial>b6e2b3d2-26f3-4a80-a8cf-5fc07c558802</serial>
Nov 15 08:21:25 user nova-compute[95467]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 08:21:25 user nova-compute[95467]: </disk>
Nov 15 08:21:25 user nova-compute[95467]:  {{(pid=95467) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 08:21:25 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:25 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd10bdf0-438f-4b79-898c-c11c7f8c4a51]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:25 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:25 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:25 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[589f4fee-4a2b-40bd-b709-3c987c51ddfb]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:25 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-31dbfd5b-c3da-48ee-bb39-501abc6baf17 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:21:25 user nova-compute[95467]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)
Nov 15 08:21:25 user nova-compute[95467]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:21:25 user nova-compute[95467]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802 (non-flash)
Nov 15 08:21:25 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:21:25 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-31dbfd5b-c3da-48ee-bb39-501abc6baf17 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:21:25 user nova-compute[95467]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 (non-flash)
Nov 15 08:21:25 user nova-compute[95467]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:21:25 user nova-compute[95467]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802 (non-flash)
Nov 15 08:21:25 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:21:25 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-31dbfd5b-c3da-48ee-bb39-501abc6baf17 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efec8570670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149'): ({'sde'}, set())}) {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 08:21:25 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-31dbfd5b-c3da-48ee-bb39-501abc6baf17 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Removing single pathed devices sde {{(pid=95467) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 08:21:25 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:25 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:25 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7a318e-e04c-4663-bc53-559ace5249da]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:25 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:25 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:25 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2adef5-cddc-4de4-b18e-ef45bde24af2]: (4, ('ok\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:25 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-31dbfd5b-c3da-48ee-bb39-501abc6baf17 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Flushing IO for device /dev/sde {{(pid=95467) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 08:21:25 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:25 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:25 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[4486ca35-979b-4b34-9bb4-e3a072ba8231]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:25 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-31dbfd5b-c3da-48ee-bb39-501abc6baf17 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=95467) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 08:21:25 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:25 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.279s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:25 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[46921d94-5b88-4cc3-8d20-d5c681bd1148]: (4, ('1', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:25 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-31dbfd5b-c3da-48ee-bb39-501abc6baf17 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 08:21:25 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-31dbfd5b-c3da-48ee-bb39-501abc6baf17 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] SCSI volumes sde have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 08:21:25 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-31dbfd5b-c3da-48ee-bb39-501abc6baf17 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149')] {{(pid=95467) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 08:21:25 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9fa7a6b-b663-4e06-92cb-6993e242d764]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-31dbfd5b-c3da-48ee-bb39-501abc6baf17 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 -p 172.16.0.220:3260 --logout {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[2255ee7d-3451-4093-962f-fd9c7a6ae3fb]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-31dbfd5b-c3da-48ee-bb39-501abc6baf17 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149, portal: 172.16.0.220,3260]
Nov 15 08:21:26 user nova-compute[95467]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149, portal: 172.16.0.220,3260] successful.
Nov 15 08:21:26 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 -p 172.16.0.220:3260 --op delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ab9aa85-da9e-4f66-aef1-c0a3864a8149 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[0789a57c-9ad9-40f7-9f41-e22639f76243]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-31dbfd5b-c3da-48ee-bb39-501abc6baf17 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-31dbfd5b-c3da-48ee-bb39-501abc6baf17 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.572s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-31dbfd5b-c3da-48ee-bb39-501abc6baf17 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] <== disconnect_volume: return (573ms) None {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31dbfd5b-c3da-48ee-bb39-501abc6baf17 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] Disconnected iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 08:21:26 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-31dbfd5b-c3da-48ee-bb39-501abc6baf17 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] Deleting instance files /opt/stack/data/nova/instances/851d354c-7f20-4e72-bfd2-a781b929e8ba_del
Nov 15 08:21:26 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-31dbfd5b-c3da-48ee-bb39-501abc6baf17 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] Deletion of /opt/stack/data/nova/instances/851d354c-7f20-4e72-bfd2-a781b929e8ba_del complete
Nov 15 08:21:26 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-47f37b7a-e236-4e88-a34d-07df73a09355 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a {{(pid=95467) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 08:21:26 user nova-compute[95467]: INFO nova.compute.manager [None req-31dbfd5b-c3da-48ee-bb39-501abc6baf17 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] Took 1.57 seconds to destroy the instance on the hypervisor.
Nov 15 08:21:26 user nova-compute[95467]: DEBUG oslo.service.loopingcall [None req-31dbfd5b-c3da-48ee-bb39-501abc6baf17 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=95467) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG nova.compute.manager [-] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] Deallocating network for instance {{(pid=95467) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] deallocate_for_instance() {{(pid=95467) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG nova.compute.manager [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Start spawning the instance on the hypervisor. {{(pid=95467) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Creating instance directory {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 08:21:26 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Creating image(s)
Nov 15 08:21:26 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Did not create local disks {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Ensure instance console log exists: /opt/stack/data/nova/instances/a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80/console.log {{(pid=95467) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Start _get_guest_xml network_info=[{"id": "cb099600-0c5c-4e0d-adfe-91a6ba3e0f08", "address": "fa:16:3e:1d:28:85", "network": {"id": "d8a362dc-0dc8-49dd-b2da-0e0749d5edca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-256373617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a1aa4f562c64545a94157d4aaf8d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb099600-0c", "ovs_interfaceid": "cb099600-0c5c-4e0d-adfe-91a6ba3e0f08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'dd21def9-7140-40ba-b88a-1895bc4a8d01', 'delete_on_termination': True, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kFxqhEAV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80', 'attached_at': '', 'detached_at': '', 'volume_id': '769e646a-dfe3-48d6-800c-7533bb9a7400', 'serial': '769e646a-dfe3-48d6-800c-7533bb9a7400'}, 'volume_type': None} {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:21:26 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:21:26 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:21:26 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Calling os-brick to attach iSCSI Volume {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kFxqhEAV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:21:26 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:21:26 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:21:26 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:21:26 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:21:26 user nova-compute[95467]: INFO os_brick.initiator.connectors.iscsi [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 08:21:26 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 -p 172.16.0.220:3260 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2bfa307-ff76-48a8-b9ba-7f0d039c71d1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 08:21:26 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 -p 172.16.0.220:3260 --interface default --op new {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b321cb1e-4b7a-46c6-928d-e04efc2390d9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400] added\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400] added
Nov 15 08:21:26 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe57458-7c06-42e6-97bb-182a2207d707]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea5e3bd-44b2-463a-95ae-91bd515cb837]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kFxqhEAV {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kFxqhEAV" returned: 0 in 0.024s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb0697f-103d-40e0-a903-e310da0c7ad2]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kFxqhEAV'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[13da7b03-9ac9-42d4-a42f-bce55416f17f]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG nova.compute.manager [req-d3feaa70-be75-4130-ad8d-dd2d63ac8cc3 req-81f0434c-b1f9-4305-8b5a-1463cf198f5d service nova] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] Received event network-vif-plugged-c9bd9bbe-8c0f-476d-978d-d7050876a1ab {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-d3feaa70-be75-4130-ad8d-dd2d63ac8cc3 req-81f0434c-b1f9-4305-8b5a-1463cf198f5d service nova] Acquiring lock "851d354c-7f20-4e72-bfd2-a781b929e8ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-d3feaa70-be75-4130-ad8d-dd2d63ac8cc3 req-81f0434c-b1f9-4305-8b5a-1463cf198f5d service nova] Lock "851d354c-7f20-4e72-bfd2-a781b929e8ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-d3feaa70-be75-4130-ad8d-dd2d63ac8cc3 req-81f0434c-b1f9-4305-8b5a-1463cf198f5d service nova] Lock "851d354c-7f20-4e72-bfd2-a781b929e8ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG nova.compute.manager [req-d3feaa70-be75-4130-ad8d-dd2d63ac8cc3 req-81f0434c-b1f9-4305-8b5a-1463cf198f5d service nova] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] No waiting events found dispatching network-vif-plugged-c9bd9bbe-8c0f-476d-978d-d7050876a1ab {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:21:26 user nova-compute[95467]: WARNING nova.compute.manager [req-d3feaa70-be75-4130-ad8d-dd2d63ac8cc3 req-81f0434c-b1f9-4305-8b5a-1463cf198f5d service nova] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] Received unexpected event network-vif-plugged-c9bd9bbe-8c0f-476d-978d-d7050876a1ab for instance with vm_state active and task_state deleting.
Nov 15 08:21:26 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[848fbbf7-da89-46b5-ba00-1d0ca586d75f]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:21:26 user nova-compute[95467]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:21:26 user nova-compute[95467]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802 (non-flash)
Nov 15 08:21:26 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:21:26 user nova-compute[95467]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:21:26 user nova-compute[95467]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802 (non-flash)
Nov 15 08:21:26 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:21:26 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 -p 172.16.0.220:3260 --login {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:27 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 -p 172.16.0.220:3260 --login" returned: 0 in 0.098s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:27 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[7187f8ad-d94a-4a4e-8b17-2268898a85e3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:27 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400, portal: 172.16.0.220,3260]
Nov 15 08:21:27 user nova-compute[95467]: Login to [iface: default, target: iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400, portal: 172.16.0.220,3260] successful.
Nov 15 08:21:27 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:21:27 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:27 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:27 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdfdd11a-e086-41c2-b9fd-c7063867b725]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:27 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:21:27 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:27 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:27 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[80bdcf73-0179-4386-8cf0-71fdd02cd040]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:27 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:21:27 user nova-compute[95467]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:21:27 user nova-compute[95467]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802 (non-flash)
Nov 15 08:21:27 user nova-compute[95467]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:21:27 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:21:27 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:21:27 user nova-compute[95467]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:21:27 user nova-compute[95467]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802 (non-flash)
Nov 15 08:21:27 user nova-compute[95467]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:21:27 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:21:27 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.383s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:21:27 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Connected to 172.16.0.220:3260 {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 08:21:27 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] HCTL ('35', '-', '-', 0) found on session 33 with lun 0 {{(pid=95467) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 08:21:27 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=95467) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 08:21:27 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:27 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:27 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d027f7-c06a-46b4-80b5-d7f754a527a5]: (4, ('- - 0', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:27 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Searching for a device in session 33 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:21:27 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kFxqhEAV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 08:21:27 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:21:27 user nova-compute[95467]: INFO nova.compute.manager [-] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] Took 1.33 seconds to deallocate network for instance.
Nov 15 08:21:27 user nova-compute[95467]: DEBUG nova.compute.manager [req-e9646657-31f7-4ab5-8167-e98f69d4753d req-c6578668-cdf1-49f8-8c16-b2289470bee8 service nova] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] Received event network-vif-deleted-c9bd9bbe-8c0f-476d-978d-d7050876a1ab {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:21:27 user nova-compute[95467]: INFO nova.compute.manager [req-e9646657-31f7-4ab5-8167-e98f69d4753d req-c6578668-cdf1-49f8-8c16-b2289470bee8 service nova] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] Neutron deleted interface c9bd9bbe-8c0f-476d-978d-d7050876a1ab; detaching it from the instance and deleting it from the info cache
Nov 15 08:21:27 user nova-compute[95467]: DEBUG nova.network.neutron [req-e9646657-31f7-4ab5-8167-e98f69d4753d req-c6578668-cdf1-49f8-8c16-b2289470bee8 service nova] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:21:27 user nova-compute[95467]: DEBUG nova.compute.manager [req-e9646657-31f7-4ab5-8167-e98f69d4753d req-c6578668-cdf1-49f8-8c16-b2289470bee8 service nova] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] Detach interface failed, port_id=c9bd9bbe-8c0f-476d-978d-d7050876a1ab, reason: Instance 851d354c-7f20-4e72-bfd2-a781b929e8ba could not be found. {{(pid=95467) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 08:21:28 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.433s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:21:28 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] <== connect_volume: return (1435ms) {'type': 'block', 'scsi_wwn': '23263616138323666', 'path': '/dev/sdd'} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:21:28 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23263616138323666', 'path': '/dev/sdd'} {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 08:21:28 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:21:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-884527110',display_name='tempest-ServerActionsTestOtherA-server-884527110',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-884527110',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYstiTKN6pNWftTYd849nYQtMIuEgDEUeKiw28UGbiftMSf1b7pXDFCSUnmvZj4PjTG3wPVLUk+MQqv7tZDYQ9Hh/tLAdBctcsd51z7x2h0dxB9v2l2G0kVC6Lobby9rA==',key_name='tempest-keypair-124047716',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0a1aa4f562c64545a94157d4aaf8d14e',ramdisk_id='',reservation_id='r-0emjo4p0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-937420730',owner_user_name='tempest-ServerActionsTestOtherA-937420730-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:21:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d9b34339b404facac21f500f40b1686',uuid=a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb099600-0c5c-4e0d-adfe-91a6ba3e0f08", "address": "fa:16:3e:1d:28:85", "network": {"id": "d8a362dc-0dc8-49dd-b2da-0e0749d5edca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-256373617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a1aa4f562c64545a94157d4aaf8d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb099600-0c", "ovs_interfaceid": "cb099600-0c5c-4e0d-adfe-91a6ba3e0f08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:21:28 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Converting VIF {"id": "cb099600-0c5c-4e0d-adfe-91a6ba3e0f08", "address": "fa:16:3e:1d:28:85", "network": {"id": "d8a362dc-0dc8-49dd-b2da-0e0749d5edca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-256373617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a1aa4f562c64545a94157d4aaf8d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb099600-0c", "ovs_interfaceid": "cb099600-0c5c-4e0d-adfe-91a6ba3e0f08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:21:28 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:28:85,bridge_name='br-int',has_traffic_filtering=True,id=cb099600-0c5c-4e0d-adfe-91a6ba3e0f08,network=Network(d8a362dc-0dc8-49dd-b2da-0e0749d5edca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb099600-0c') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:21:28 user nova-compute[95467]: DEBUG nova.objects.instance [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lazy-loading 'pci_devices' on Instance uuid a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:21:28 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:21:28 user nova-compute[95467]:   <uuid>a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80</uuid>
Nov 15 08:21:28 user nova-compute[95467]:   <name>instance-00000023</name>
Nov 15 08:21:28 user nova-compute[95467]:   <memory>524288</memory>
Nov 15 08:21:28 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:21:28 user nova-compute[95467]:   <metadata>
Nov 15 08:21:28 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:21:28 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:21:28 user nova-compute[95467]:       <nova:name>tempest-ServerActionsTestOtherA-server-884527110</nova:name>
Nov 15 08:21:28 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:21:26</nova:creationTime>
Nov 15 08:21:28 user nova-compute[95467]:       <nova:flavor name="m1.tiny">
Nov 15 08:21:28 user nova-compute[95467]:         <nova:memory>512</nova:memory>
Nov 15 08:21:28 user nova-compute[95467]:         <nova:disk>1</nova:disk>
Nov 15 08:21:28 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:21:28 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:21:28 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:21:28 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:21:28 user nova-compute[95467]:       <nova:owner>
Nov 15 08:21:28 user nova-compute[95467]:         <nova:user uuid="2d9b34339b404facac21f500f40b1686">tempest-ServerActionsTestOtherA-937420730-project-member</nova:user>
Nov 15 08:21:28 user nova-compute[95467]:         <nova:project uuid="0a1aa4f562c64545a94157d4aaf8d14e">tempest-ServerActionsTestOtherA-937420730</nova:project>
Nov 15 08:21:28 user nova-compute[95467]:       </nova:owner>
Nov 15 08:21:28 user nova-compute[95467]:       <nova:ports>
Nov 15 08:21:28 user nova-compute[95467]:         <nova:port uuid="cb099600-0c5c-4e0d-adfe-91a6ba3e0f08">
Nov 15 08:21:28 user nova-compute[95467]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 08:21:28 user nova-compute[95467]:         </nova:port>
Nov 15 08:21:28 user nova-compute[95467]:       </nova:ports>
Nov 15 08:21:28 user nova-compute[95467]:     </nova:instance>
Nov 15 08:21:28 user nova-compute[95467]:   </metadata>
Nov 15 08:21:28 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:21:28 user nova-compute[95467]:     <system>
Nov 15 08:21:28 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:21:28 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:21:28 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:21:28 user nova-compute[95467]:       <entry name="serial">a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80</entry>
Nov 15 08:21:28 user nova-compute[95467]:       <entry name="uuid">a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80</entry>
Nov 15 08:21:28 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:21:28 user nova-compute[95467]:     </system>
Nov 15 08:21:28 user nova-compute[95467]:   </sysinfo>
Nov 15 08:21:28 user nova-compute[95467]:   <os>
Nov 15 08:21:28 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:21:28 user nova-compute[95467]:     <boot dev="hd"/>
Nov 15 08:21:28 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:21:28 user nova-compute[95467]:   </os>
Nov 15 08:21:28 user nova-compute[95467]:   <features>
Nov 15 08:21:28 user nova-compute[95467]:     <acpi/>
Nov 15 08:21:28 user nova-compute[95467]:     <apic/>
Nov 15 08:21:28 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:21:28 user nova-compute[95467]:   </features>
Nov 15 08:21:28 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:21:28 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:21:28 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:21:28 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:21:28 user nova-compute[95467]:   </clock>
Nov 15 08:21:28 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:21:28 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:21:28 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:21:28 user nova-compute[95467]:   </cpu>
Nov 15 08:21:28 user nova-compute[95467]:   <devices>
Nov 15 08:21:28 user nova-compute[95467]:     <disk type="block" device="disk">
Nov 15 08:21:28 user nova-compute[95467]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:21:28 user nova-compute[95467]:       <source dev="/dev/sdd"/>
Nov 15 08:21:28 user nova-compute[95467]:       <target dev="vda" bus="virtio"/>
Nov 15 08:21:28 user nova-compute[95467]:       <serial>769e646a-dfe3-48d6-800c-7533bb9a7400</serial>
Nov 15 08:21:28 user nova-compute[95467]:     </disk>
Nov 15 08:21:28 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:21:28 user nova-compute[95467]:       <mac address="fa:16:3e:1d:28:85"/>
Nov 15 08:21:28 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:21:28 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:21:28 user nova-compute[95467]:       <target dev="tapcb099600-0c"/>
Nov 15 08:21:28 user nova-compute[95467]:     </interface>
Nov 15 08:21:28 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:21:28 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80/console.log" append="off"/>
Nov 15 08:21:28 user nova-compute[95467]:     </serial>
Nov 15 08:21:28 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:21:28 user nova-compute[95467]:     <video>
Nov 15 08:21:28 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:21:28 user nova-compute[95467]:     </video>
Nov 15 08:21:28 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:21:28 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:21:28 user nova-compute[95467]:     </rng>
Nov 15 08:21:28 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:21:28 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:21:28 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:21:28 user nova-compute[95467]:     </memballoon>
Nov 15 08:21:28 user nova-compute[95467]:   </devices>
Nov 15 08:21:28 user nova-compute[95467]: </domain>
Nov 15 08:21:28 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:21:28 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:21:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-884527110',display_name='tempest-ServerActionsTestOtherA-server-884527110',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-884527110',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYstiTKN6pNWftTYd849nYQtMIuEgDEUeKiw28UGbiftMSf1b7pXDFCSUnmvZj4PjTG3wPVLUk+MQqv7tZDYQ9Hh/tLAdBctcsd51z7x2h0dxB9v2l2G0kVC6Lobby9rA==',key_name='tempest-keypair-124047716',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0a1aa4f562c64545a94157d4aaf8d14e',ramdisk_id='',reservation_id='r-0emjo4p0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-937420730',owner_user_name='tempest-ServerActionsTestOtherA-937420730-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:21:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d9b34339b404facac21f500f40b1686',uuid=a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb099600-0c5c-4e0d-adfe-91a6ba3e0f08", "address": "fa:16:3e:1d:28:85", "network": {"id": "d8a362dc-0dc8-49dd-b2da-0e0749d5edca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-256373617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a1aa4f562c64545a94157d4aaf8d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb099600-0c", "ovs_interfaceid": "cb099600-0c5c-4e0d-adfe-91a6ba3e0f08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:21:28 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Converting VIF {"id": "cb099600-0c5c-4e0d-adfe-91a6ba3e0f08", "address": "fa:16:3e:1d:28:85", "network": {"id": "d8a362dc-0dc8-49dd-b2da-0e0749d5edca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-256373617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a1aa4f562c64545a94157d4aaf8d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb099600-0c", "ovs_interfaceid": "cb099600-0c5c-4e0d-adfe-91a6ba3e0f08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:21:28 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:28:85,bridge_name='br-int',has_traffic_filtering=True,id=cb099600-0c5c-4e0d-adfe-91a6ba3e0f08,network=Network(d8a362dc-0dc8-49dd-b2da-0e0749d5edca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb099600-0c') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:21:28 user nova-compute[95467]: DEBUG os_vif [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:28:85,bridge_name='br-int',has_traffic_filtering=True,id=cb099600-0c5c-4e0d-adfe-91a6ba3e0f08,network=Network(d8a362dc-0dc8-49dd-b2da-0e0749d5edca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb099600-0c') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:21:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:21:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:21:28 user nova-compute[95467]: INFO nova.compute.manager [None req-31dbfd5b-c3da-48ee-bb39-501abc6baf17 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] Took 0.77 seconds to detach 1 volumes for instance.
Nov 15 08:21:28 user nova-compute[95467]: DEBUG nova.compute.manager [None req-31dbfd5b-c3da-48ee-bb39-501abc6baf17 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 851d354c-7f20-4e72-bfd2-a781b929e8ba] Deleting volume: 3ab9aa85-da9e-4f66-aef1-c0a3864a8149 {{(pid=95467) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 08:21:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1b7c6cd8-e3d0-504a-bb8b-3116df9683a7', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:21:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:21:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcb099600-0c, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:21:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcb099600-0c, col_values=(('qos', UUID('e9076862-c2d5-478c-99a0-1593af96e95b')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:21:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcb099600-0c, col_values=(('external_ids', {'iface-id': 'cb099600-0c5c-4e0d-adfe-91a6ba3e0f08', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:28:85', 'vm-uuid': 'a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:21:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:21:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:28 user nova-compute[95467]: INFO os_vif [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:28:85,bridge_name='br-int',has_traffic_filtering=True,id=cb099600-0c5c-4e0d-adfe-91a6ba3e0f08,network=Network(d8a362dc-0dc8-49dd-b2da-0e0749d5edca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb099600-0c')
Nov 15 08:21:28 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:21:28 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] No VIF found with MAC fa:16:3e:1d:28:85, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:21:28 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-31dbfd5b-c3da-48ee-bb39-501abc6baf17 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:21:28 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-31dbfd5b-c3da-48ee-bb39-501abc6baf17 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:21:28 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-31dbfd5b-c3da-48ee-bb39-501abc6baf17 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:21:28 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-31dbfd5b-c3da-48ee-bb39-501abc6baf17 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:21:28 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-31dbfd5b-c3da-48ee-bb39-501abc6baf17 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.487s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:21:29 user nova-compute[95467]: INFO nova.scheduler.client.report [None req-31dbfd5b-c3da-48ee-bb39-501abc6baf17 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Deleted allocations for instance 851d354c-7f20-4e72-bfd2-a781b929e8ba
Nov 15 08:21:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-31dbfd5b-c3da-48ee-bb39-501abc6baf17 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "851d354c-7f20-4e72-bfd2-a781b929e8ba" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.589s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:21:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Acquiring lock "091612cf-b737-480b-984e-a05b522676b6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:21:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "091612cf-b737-480b-984e-a05b522676b6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:21:29 user nova-compute[95467]: DEBUG nova.compute.manager [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 091612cf-b737-480b-984e-a05b522676b6] Starting instance... {{(pid=95467) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 08:21:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:21:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:21:29 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=95467) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 08:21:29 user nova-compute[95467]: INFO nova.compute.claims [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 091612cf-b737-480b-984e-a05b522676b6] Claim successful on node user
Nov 15 08:21:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:30 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:30 user nova-compute[95467]: DEBUG nova.compute.manager [req-efffa740-e2ac-4791-bf03-d84af5e30706 req-ac088626-47e3-480f-a8f7-ed422b051b5f service nova] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Received event network-vif-plugged-cb099600-0c5c-4e0d-adfe-91a6ba3e0f08 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:21:30 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-efffa740-e2ac-4791-bf03-d84af5e30706 req-ac088626-47e3-480f-a8f7-ed422b051b5f service nova] Acquiring lock "a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:21:30 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-efffa740-e2ac-4791-bf03-d84af5e30706 req-ac088626-47e3-480f-a8f7-ed422b051b5f service nova] Lock "a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:21:30 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-efffa740-e2ac-4791-bf03-d84af5e30706 req-ac088626-47e3-480f-a8f7-ed422b051b5f service nova] Lock "a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:21:30 user nova-compute[95467]: DEBUG nova.compute.manager [req-efffa740-e2ac-4791-bf03-d84af5e30706 req-ac088626-47e3-480f-a8f7-ed422b051b5f service nova] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] No waiting events found dispatching network-vif-plugged-cb099600-0c5c-4e0d-adfe-91a6ba3e0f08 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:21:30 user nova-compute[95467]: WARNING nova.compute.manager [req-efffa740-e2ac-4791-bf03-d84af5e30706 req-ac088626-47e3-480f-a8f7-ed422b051b5f service nova] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Received unexpected event network-vif-plugged-cb099600-0c5c-4e0d-adfe-91a6ba3e0f08 for instance with vm_state building and task_state spawning.
Nov 15 08:21:30 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:21:30 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:21:30 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.697s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:21:30 user nova-compute[95467]: DEBUG nova.compute.manager [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 091612cf-b737-480b-984e-a05b522676b6] Start building networks asynchronously for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 08:21:30 user nova-compute[95467]: DEBUG nova.compute.manager [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 091612cf-b737-480b-984e-a05b522676b6] Allocating IP information in the background. {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 08:21:30 user nova-compute[95467]: DEBUG nova.network.neutron [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 091612cf-b737-480b-984e-a05b522676b6] allocate_for_instance() {{(pid=95467) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 08:21:30 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 091612cf-b737-480b-984e-a05b522676b6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 08:21:30 user nova-compute[95467]: DEBUG nova.compute.manager [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 091612cf-b737-480b-984e-a05b522676b6] Start building block device mappings for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 08:21:30 user nova-compute[95467]: DEBUG nova.policy [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6971581ab2604353aeb0c45c5252b4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c34d65a8000347feb2b3966b7ce0d785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95467) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 08:21:30 user nova-compute[95467]: DEBUG nova.compute.manager [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 091612cf-b737-480b-984e-a05b522676b6] Start spawning the instance on the hypervisor. {{(pid=95467) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 08:21:30 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 091612cf-b737-480b-984e-a05b522676b6] Creating instance directory {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 08:21:30 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 091612cf-b737-480b-984e-a05b522676b6] Creating image(s)
Nov 15 08:21:30 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Acquiring lock "/opt/stack/data/nova/instances/091612cf-b737-480b-984e-a05b522676b6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:21:30 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "/opt/stack/data/nova/instances/091612cf-b737-480b-984e-a05b522676b6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:21:30 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "/opt/stack/data/nova/instances/091612cf-b737-480b-984e-a05b522676b6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:21:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.258s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:30 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Acquiring lock "a3fcf60225fcefd310404971cd18ab9851c548dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:21:30 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:21:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:30 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.197s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/091612cf-b737-480b-984e-a05b522676b6/disk 1073741824 {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:31 user nova-compute[95467]: DEBUG nova.network.neutron [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 091612cf-b737-480b-984e-a05b522676b6] Successfully created port: 4880d737-2c51-4a14-bba5-f9ec720a3f18 {{(pid=95467) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 08:21:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/091612cf-b737-480b-984e-a05b522676b6/disk 1073741824" returned: 0 in 0.099s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:31 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.303s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:21:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.203s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:31 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Checking if we can resize image /opt/stack/data/nova/instances/091612cf-b737-480b-984e-a05b522676b6/disk. size=1073741824 {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 08:21:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091612cf-b737-480b-984e-a05b522676b6/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091612cf-b737-480b-984e-a05b522676b6/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:31 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Cannot resize image /opt/stack/data/nova/instances/091612cf-b737-480b-984e-a05b522676b6/disk to a smaller size. {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 08:21:31 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 091612cf-b737-480b-984e-a05b522676b6] Created local disks {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 08:21:31 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 091612cf-b737-480b-984e-a05b522676b6] Ensure instance console log exists: /opt/stack/data/nova/instances/091612cf-b737-480b-984e-a05b522676b6/console.log {{(pid=95467) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 08:21:31 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:21:31 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:21:31 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:21:31 user nova-compute[95467]: DEBUG nova.network.neutron [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 091612cf-b737-480b-984e-a05b522676b6] Successfully updated port: 4880d737-2c51-4a14-bba5-f9ec720a3f18 {{(pid=95467) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 08:21:31 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Acquiring lock "refresh_cache-091612cf-b737-480b-984e-a05b522676b6" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:21:31 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Acquired lock "refresh_cache-091612cf-b737-480b-984e-a05b522676b6" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:21:31 user nova-compute[95467]: DEBUG nova.network.neutron [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 091612cf-b737-480b-984e-a05b522676b6] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:21:31 user nova-compute[95467]: DEBUG nova.compute.manager [req-cc57e76b-c34a-4fcf-8b88-ea6c8b3ead53 req-53806f9d-acbb-424c-8c5c-a3ed7e225ff2 service nova] [instance: 091612cf-b737-480b-984e-a05b522676b6] Received event network-changed-4880d737-2c51-4a14-bba5-f9ec720a3f18 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:21:31 user nova-compute[95467]: DEBUG nova.compute.manager [req-cc57e76b-c34a-4fcf-8b88-ea6c8b3ead53 req-53806f9d-acbb-424c-8c5c-a3ed7e225ff2 service nova] [instance: 091612cf-b737-480b-984e-a05b522676b6] Refreshing instance network info cache due to event network-changed-4880d737-2c51-4a14-bba5-f9ec720a3f18. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:21:31 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-cc57e76b-c34a-4fcf-8b88-ea6c8b3ead53 req-53806f9d-acbb-424c-8c5c-a3ed7e225ff2 service nova] Acquiring lock "refresh_cache-091612cf-b737-480b-984e-a05b522676b6" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:21:31 user nova-compute[95467]: DEBUG nova.network.neutron [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 091612cf-b737-480b-984e-a05b522676b6] Instance cache missing network info. {{(pid=95467) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 08:21:32 user nova-compute[95467]: DEBUG nova.compute.manager [req-5afda495-f3b1-431b-93fc-602594659a62 req-12388af9-8041-4339-8986-3a2a28b57229 service nova] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Received event network-vif-plugged-cb099600-0c5c-4e0d-adfe-91a6ba3e0f08 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:21:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-5afda495-f3b1-431b-93fc-602594659a62 req-12388af9-8041-4339-8986-3a2a28b57229 service nova] Acquiring lock "a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:21:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-5afda495-f3b1-431b-93fc-602594659a62 req-12388af9-8041-4339-8986-3a2a28b57229 service nova] Lock "a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:21:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-5afda495-f3b1-431b-93fc-602594659a62 req-12388af9-8041-4339-8986-3a2a28b57229 service nova] Lock "a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:21:32 user nova-compute[95467]: DEBUG nova.compute.manager [req-5afda495-f3b1-431b-93fc-602594659a62 req-12388af9-8041-4339-8986-3a2a28b57229 service nova] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] No waiting events found dispatching network-vif-plugged-cb099600-0c5c-4e0d-adfe-91a6ba3e0f08 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:21:32 user nova-compute[95467]: WARNING nova.compute.manager [req-5afda495-f3b1-431b-93fc-602594659a62 req-12388af9-8041-4339-8986-3a2a28b57229 service nova] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Received unexpected event network-vif-plugged-cb099600-0c5c-4e0d-adfe-91a6ba3e0f08 for instance with vm_state building and task_state spawning.
Nov 15 08:21:32 user nova-compute[95467]: DEBUG nova.compute.manager [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Instance event wait completed in 0 seconds for  {{(pid=95467) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 08:21:32 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Guest created on hypervisor {{(pid=95467) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 08:21:32 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Instance spawned successfully.
Nov 15 08:21:32 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 08:21:32 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Found default for hw_cdrom_bus of ide {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:21:32 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Found default for hw_disk_bus of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:21:32 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Found default for hw_input_bus of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:21:32 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Found default for hw_pointer_model of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:21:32 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Found default for hw_video_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:21:32 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Found default for hw_vif_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:21:32 user nova-compute[95467]: DEBUG nova.network.neutron [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 091612cf-b737-480b-984e-a05b522676b6] Updating instance_info_cache with network_info: [{"id": "4880d737-2c51-4a14-bba5-f9ec720a3f18", "address": "fa:16:3e:21:da:50", "network": {"id": "ac9a381d-25fe-4419-b151-f03333413813", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1183680999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34d65a8000347feb2b3966b7ce0d785", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4880d737-2c", "ovs_interfaceid": "4880d737-2c51-4a14-bba5-f9ec720a3f18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:21:32 user nova-compute[95467]: INFO nova.compute.manager [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Took 5.62 seconds to spawn the instance on the hypervisor.
Nov 15 08:21:32 user nova-compute[95467]: DEBUG nova.compute.manager [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:21:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Releasing lock "refresh_cache-091612cf-b737-480b-984e-a05b522676b6" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:21:32 user nova-compute[95467]: DEBUG nova.compute.manager [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 091612cf-b737-480b-984e-a05b522676b6] Instance network_info: |[{"id": "4880d737-2c51-4a14-bba5-f9ec720a3f18", "address": "fa:16:3e:21:da:50", "network": {"id": "ac9a381d-25fe-4419-b151-f03333413813", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1183680999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34d65a8000347feb2b3966b7ce0d785", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4880d737-2c", "ovs_interfaceid": "4880d737-2c51-4a14-bba5-f9ec720a3f18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 08:21:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-cc57e76b-c34a-4fcf-8b88-ea6c8b3ead53 req-53806f9d-acbb-424c-8c5c-a3ed7e225ff2 service nova] Acquired lock "refresh_cache-091612cf-b737-480b-984e-a05b522676b6" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:21:32 user nova-compute[95467]: DEBUG nova.network.neutron [req-cc57e76b-c34a-4fcf-8b88-ea6c8b3ead53 req-53806f9d-acbb-424c-8c5c-a3ed7e225ff2 service nova] [instance: 091612cf-b737-480b-984e-a05b522676b6] Refreshing network info cache for port 4880d737-2c51-4a14-bba5-f9ec720a3f18 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:21:32 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 091612cf-b737-480b-984e-a05b522676b6] Start _get_guest_xml network_info=[{"id": "4880d737-2c51-4a14-bba5-f9ec720a3f18", "address": "fa:16:3e:21:da:50", "network": {"id": "ac9a381d-25fe-4419-b151-f03333413813", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1183680999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34d65a8000347feb2b3966b7ce0d785", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4880d737-2c", "ovs_interfaceid": "4880d737-2c51-4a14-bba5-f9ec720a3f18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'ed9c48aa-ce73-4b3b-9db1-235898be671b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:21:32 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:21:32 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:21:32 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:21:32 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:21:32 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:21:32 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:21:32 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:21:32 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:21:32 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:21:32 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:21:32 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:21:32 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:21:32 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:21:32 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:21:32 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:21:32 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:21:32 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:21:32 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:21:32 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:21:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-205049505',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-205049505',id=36,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c34d65a8000347feb2b3966b7ce0d785',ramdisk_id='',reservation_id='r-sz004h8p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1903830225',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:21:30Z,user_data=None,user_id='6971581ab2604353aeb0c45c5252b4fb',uuid=091612cf-b737-480b-984e-a05b522676b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4880d737-2c51-4a14-bba5-f9ec720a3f18", "address": "fa:16:3e:21:da:50", "network": {"id": "ac9a381d-25fe-4419-b151-f03333413813", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1183680999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34d65a8000347feb2b3966b7ce0d785", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4880d737-2c", "ovs_interfaceid": "4880d737-2c51-4a14-bba5-f9ec720a3f18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:21:32 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Converting VIF {"id": "4880d737-2c51-4a14-bba5-f9ec720a3f18", "address": "fa:16:3e:21:da:50", "network": {"id": "ac9a381d-25fe-4419-b151-f03333413813", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1183680999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34d65a8000347feb2b3966b7ce0d785", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4880d737-2c", "ovs_interfaceid": "4880d737-2c51-4a14-bba5-f9ec720a3f18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:21:32 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:da:50,bridge_name='br-int',has_traffic_filtering=True,id=4880d737-2c51-4a14-bba5-f9ec720a3f18,network=Network(ac9a381d-25fe-4419-b151-f03333413813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4880d737-2c') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:21:32 user nova-compute[95467]: DEBUG nova.objects.instance [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lazy-loading 'pci_devices' on Instance uuid 091612cf-b737-480b-984e-a05b522676b6 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:21:32 user nova-compute[95467]: INFO nova.compute.manager [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Took 13.87 seconds to build instance.
Nov 15 08:21:32 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 091612cf-b737-480b-984e-a05b522676b6] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:21:32 user nova-compute[95467]:   <uuid>091612cf-b737-480b-984e-a05b522676b6</uuid>
Nov 15 08:21:32 user nova-compute[95467]:   <name>instance-00000024</name>
Nov 15 08:21:32 user nova-compute[95467]:   <memory>524288</memory>
Nov 15 08:21:32 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:21:32 user nova-compute[95467]:   <metadata>
Nov 15 08:21:32 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:21:32 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:21:32 user nova-compute[95467]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-205049505</nova:name>
Nov 15 08:21:32 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:21:32</nova:creationTime>
Nov 15 08:21:32 user nova-compute[95467]:       <nova:flavor name="m1.tiny">
Nov 15 08:21:32 user nova-compute[95467]:         <nova:memory>512</nova:memory>
Nov 15 08:21:32 user nova-compute[95467]:         <nova:disk>1</nova:disk>
Nov 15 08:21:32 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:21:32 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:21:32 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:21:32 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:21:32 user nova-compute[95467]:       <nova:owner>
Nov 15 08:21:32 user nova-compute[95467]:         <nova:user uuid="6971581ab2604353aeb0c45c5252b4fb">tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member</nova:user>
Nov 15 08:21:32 user nova-compute[95467]:         <nova:project uuid="c34d65a8000347feb2b3966b7ce0d785">tempest-ServerBootFromVolumeStableRescueTest-1903830225</nova:project>
Nov 15 08:21:32 user nova-compute[95467]:       </nova:owner>
Nov 15 08:21:32 user nova-compute[95467]:       <nova:root type="image" uuid="ed9c48aa-ce73-4b3b-9db1-235898be671b"/>
Nov 15 08:21:32 user nova-compute[95467]:       <nova:ports>
Nov 15 08:21:32 user nova-compute[95467]:         <nova:port uuid="4880d737-2c51-4a14-bba5-f9ec720a3f18">
Nov 15 08:21:32 user nova-compute[95467]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 08:21:32 user nova-compute[95467]:         </nova:port>
Nov 15 08:21:32 user nova-compute[95467]:       </nova:ports>
Nov 15 08:21:32 user nova-compute[95467]:     </nova:instance>
Nov 15 08:21:32 user nova-compute[95467]:   </metadata>
Nov 15 08:21:32 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:21:32 user nova-compute[95467]:     <system>
Nov 15 08:21:32 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:21:32 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:21:32 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:21:32 user nova-compute[95467]:       <entry name="serial">091612cf-b737-480b-984e-a05b522676b6</entry>
Nov 15 08:21:32 user nova-compute[95467]:       <entry name="uuid">091612cf-b737-480b-984e-a05b522676b6</entry>
Nov 15 08:21:32 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:21:32 user nova-compute[95467]:     </system>
Nov 15 08:21:32 user nova-compute[95467]:   </sysinfo>
Nov 15 08:21:32 user nova-compute[95467]:   <os>
Nov 15 08:21:32 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:21:32 user nova-compute[95467]:     <boot dev="hd"/>
Nov 15 08:21:32 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:21:32 user nova-compute[95467]:   </os>
Nov 15 08:21:32 user nova-compute[95467]:   <features>
Nov 15 08:21:32 user nova-compute[95467]:     <acpi/>
Nov 15 08:21:32 user nova-compute[95467]:     <apic/>
Nov 15 08:21:32 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:21:32 user nova-compute[95467]:   </features>
Nov 15 08:21:32 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:21:32 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:21:32 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:21:32 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:21:32 user nova-compute[95467]:   </clock>
Nov 15 08:21:32 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:21:32 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:21:32 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:21:32 user nova-compute[95467]:   </cpu>
Nov 15 08:21:32 user nova-compute[95467]:   <devices>
Nov 15 08:21:32 user nova-compute[95467]:     <disk type="file" device="disk">
Nov 15 08:21:32 user nova-compute[95467]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 08:21:32 user nova-compute[95467]:       <source file="/opt/stack/data/nova/instances/091612cf-b737-480b-984e-a05b522676b6/disk"/>
Nov 15 08:21:32 user nova-compute[95467]:       <target dev="vda" bus="virtio"/>
Nov 15 08:21:32 user nova-compute[95467]:     </disk>
Nov 15 08:21:32 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:21:32 user nova-compute[95467]:       <mac address="fa:16:3e:21:da:50"/>
Nov 15 08:21:32 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:21:32 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:21:32 user nova-compute[95467]:       <target dev="tap4880d737-2c"/>
Nov 15 08:21:32 user nova-compute[95467]:     </interface>
Nov 15 08:21:32 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:21:32 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/091612cf-b737-480b-984e-a05b522676b6/console.log" append="off"/>
Nov 15 08:21:32 user nova-compute[95467]:     </serial>
Nov 15 08:21:32 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:21:32 user nova-compute[95467]:     <video>
Nov 15 08:21:32 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:21:32 user nova-compute[95467]:     </video>
Nov 15 08:21:32 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:21:32 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:21:32 user nova-compute[95467]:     </rng>
Nov 15 08:21:32 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:21:32 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:21:32 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:21:32 user nova-compute[95467]:     </memballoon>
Nov 15 08:21:32 user nova-compute[95467]:   </devices>
Nov 15 08:21:32 user nova-compute[95467]: </domain>
Nov 15 08:21:32 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:21:32 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:21:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-205049505',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-205049505',id=36,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c34d65a8000347feb2b3966b7ce0d785',ramdisk_id='',reservation_id='r-sz004h8p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1903830225',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:21:30Z,user_data=None,user_id='6971581ab2604353aeb0c45c5252b4fb',uuid=091612cf-b737-480b-984e-a05b522676b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4880d737-2c51-4a14-bba5-f9ec720a3f18", "address": "fa:16:3e:21:da:50", "network": {"id": "ac9a381d-25fe-4419-b151-f03333413813", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1183680999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34d65a8000347feb2b3966b7ce0d785", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4880d737-2c", "ovs_interfaceid": "4880d737-2c51-4a14-bba5-f9ec720a3f18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:21:32 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Converting VIF {"id": "4880d737-2c51-4a14-bba5-f9ec720a3f18", "address": "fa:16:3e:21:da:50", "network": {"id": "ac9a381d-25fe-4419-b151-f03333413813", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1183680999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34d65a8000347feb2b3966b7ce0d785", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4880d737-2c", "ovs_interfaceid": "4880d737-2c51-4a14-bba5-f9ec720a3f18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:21:32 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:da:50,bridge_name='br-int',has_traffic_filtering=True,id=4880d737-2c51-4a14-bba5-f9ec720a3f18,network=Network(ac9a381d-25fe-4419-b151-f03333413813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4880d737-2c') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:21:32 user nova-compute[95467]: DEBUG os_vif [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:da:50,bridge_name='br-int',has_traffic_filtering=True,id=4880d737-2c51-4a14-bba5-f9ec720a3f18,network=Network(ac9a381d-25fe-4419-b151-f03333413813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4880d737-2c') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:21:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:21:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:21:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a5758d60-833a-5c92-80ea-ad02a583ed73', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:21:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4880d737-2c, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:21:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4880d737-2c, col_values=(('qos', UUID('3a4038da-8ff0-4ce3-afa4-f3b804edb4c7')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:21:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4880d737-2c, col_values=(('external_ids', {'iface-id': '4880d737-2c51-4a14-bba5-f9ec720a3f18', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:da:50', 'vm-uuid': '091612cf-b737-480b-984e-a05b522676b6'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:21:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-fdf69c7f-0e4f-40b6-9453-6066e89463d0 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.978s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:21:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:21:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:32 user nova-compute[95467]: INFO os_vif [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:da:50,bridge_name='br-int',has_traffic_filtering=True,id=4880d737-2c51-4a14-bba5-f9ec720a3f18,network=Network(ac9a381d-25fe-4419-b151-f03333413813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4880d737-2c')
Nov 15 08:21:32 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:21:32 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] No VIF found with MAC fa:16:3e:21:da:50, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:21:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:32 user nova-compute[95467]: DEBUG nova.network.neutron [req-cc57e76b-c34a-4fcf-8b88-ea6c8b3ead53 req-53806f9d-acbb-424c-8c5c-a3ed7e225ff2 service nova] [instance: 091612cf-b737-480b-984e-a05b522676b6] Updated VIF entry in instance network info cache for port 4880d737-2c51-4a14-bba5-f9ec720a3f18. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:21:32 user nova-compute[95467]: DEBUG nova.network.neutron [req-cc57e76b-c34a-4fcf-8b88-ea6c8b3ead53 req-53806f9d-acbb-424c-8c5c-a3ed7e225ff2 service nova] [instance: 091612cf-b737-480b-984e-a05b522676b6] Updating instance_info_cache with network_info: [{"id": "4880d737-2c51-4a14-bba5-f9ec720a3f18", "address": "fa:16:3e:21:da:50", "network": {"id": "ac9a381d-25fe-4419-b151-f03333413813", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1183680999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34d65a8000347feb2b3966b7ce0d785", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4880d737-2c", "ovs_interfaceid": "4880d737-2c51-4a14-bba5-f9ec720a3f18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:21:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-cc57e76b-c34a-4fcf-8b88-ea6c8b3ead53 req-53806f9d-acbb-424c-8c5c-a3ed7e225ff2 service nova] Releasing lock "refresh_cache-091612cf-b737-480b-984e-a05b522676b6" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:21:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:34 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:34 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:34 user nova-compute[95467]: DEBUG nova.compute.manager [req-3a0060b6-6a64-4346-a9d8-8747acf9c9c2 req-01bd0984-cb2d-496e-9ffe-bce299095322 service nova] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Received event network-changed-d9b8cd88-c40b-4437-afd9-403eb882e80c {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:21:34 user nova-compute[95467]: DEBUG nova.compute.manager [req-3a0060b6-6a64-4346-a9d8-8747acf9c9c2 req-01bd0984-cb2d-496e-9ffe-bce299095322 service nova] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Refreshing instance network info cache due to event network-changed-d9b8cd88-c40b-4437-afd9-403eb882e80c. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:21:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-3a0060b6-6a64-4346-a9d8-8747acf9c9c2 req-01bd0984-cb2d-496e-9ffe-bce299095322 service nova] Acquiring lock "refresh_cache-a1a155e6-0ee2-4728-a526-17c149107ab0" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:21:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-3a0060b6-6a64-4346-a9d8-8747acf9c9c2 req-01bd0984-cb2d-496e-9ffe-bce299095322 service nova] Acquired lock "refresh_cache-a1a155e6-0ee2-4728-a526-17c149107ab0" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:21:34 user nova-compute[95467]: DEBUG nova.network.neutron [req-3a0060b6-6a64-4346-a9d8-8747acf9c9c2 req-01bd0984-cb2d-496e-9ffe-bce299095322 service nova] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Refreshing network info cache for port d9b8cd88-c40b-4437-afd9-403eb882e80c {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:21:34 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:34 user nova-compute[95467]: DEBUG nova.network.neutron [req-3a0060b6-6a64-4346-a9d8-8747acf9c9c2 req-01bd0984-cb2d-496e-9ffe-bce299095322 service nova] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Updated VIF entry in instance network info cache for port d9b8cd88-c40b-4437-afd9-403eb882e80c. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:21:34 user nova-compute[95467]: DEBUG nova.network.neutron [req-3a0060b6-6a64-4346-a9d8-8747acf9c9c2 req-01bd0984-cb2d-496e-9ffe-bce299095322 service nova] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Updating instance_info_cache with network_info: [{"id": "d9b8cd88-c40b-4437-afd9-403eb882e80c", "address": "fa:16:3e:83:dc:7a", "network": {"id": "34c396ed-35f3-4c64-ae71-fec43375e75b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-631332774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f9b647fefc431099e9f77370b00e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9b8cd88-c4", "ovs_interfaceid": "d9b8cd88-c40b-4437-afd9-403eb882e80c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:21:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-3a0060b6-6a64-4346-a9d8-8747acf9c9c2 req-01bd0984-cb2d-496e-9ffe-bce299095322 service nova] Releasing lock "refresh_cache-a1a155e6-0ee2-4728-a526-17c149107ab0" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:21:34 user nova-compute[95467]: DEBUG nova.compute.manager [req-3a0060b6-6a64-4346-a9d8-8747acf9c9c2 req-01bd0984-cb2d-496e-9ffe-bce299095322 service nova] [instance: 091612cf-b737-480b-984e-a05b522676b6] Received event network-vif-plugged-4880d737-2c51-4a14-bba5-f9ec720a3f18 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:21:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-3a0060b6-6a64-4346-a9d8-8747acf9c9c2 req-01bd0984-cb2d-496e-9ffe-bce299095322 service nova] Acquiring lock "091612cf-b737-480b-984e-a05b522676b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:21:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-3a0060b6-6a64-4346-a9d8-8747acf9c9c2 req-01bd0984-cb2d-496e-9ffe-bce299095322 service nova] Lock "091612cf-b737-480b-984e-a05b522676b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:21:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-3a0060b6-6a64-4346-a9d8-8747acf9c9c2 req-01bd0984-cb2d-496e-9ffe-bce299095322 service nova] Lock "091612cf-b737-480b-984e-a05b522676b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:21:34 user nova-compute[95467]: DEBUG nova.compute.manager [req-3a0060b6-6a64-4346-a9d8-8747acf9c9c2 req-01bd0984-cb2d-496e-9ffe-bce299095322 service nova] [instance: 091612cf-b737-480b-984e-a05b522676b6] No waiting events found dispatching network-vif-plugged-4880d737-2c51-4a14-bba5-f9ec720a3f18 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:21:34 user nova-compute[95467]: WARNING nova.compute.manager [req-3a0060b6-6a64-4346-a9d8-8747acf9c9c2 req-01bd0984-cb2d-496e-9ffe-bce299095322 service nova] [instance: 091612cf-b737-480b-984e-a05b522676b6] Received unexpected event network-vif-plugged-4880d737-2c51-4a14-bba5-f9ec720a3f18 for instance with vm_state building and task_state spawning.
Nov 15 08:21:35 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-2b069e4d-f7e9-4c82-a5fc-acd499cd1ee8 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Acquiring lock "a1a155e6-0ee2-4728-a526-17c149107ab0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:21:35 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-2b069e4d-f7e9-4c82-a5fc-acd499cd1ee8 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lock "a1a155e6-0ee2-4728-a526-17c149107ab0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:21:35 user nova-compute[95467]: DEBUG nova.objects.instance [None req-2b069e4d-f7e9-4c82-a5fc-acd499cd1ee8 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lazy-loading 'flavor' on Instance uuid a1a155e6-0ee2-4728-a526-17c149107ab0 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:21:35 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-2b069e4d-f7e9-4c82-a5fc-acd499cd1ee8 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lock "a1a155e6-0ee2-4728-a526-17c149107ab0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:21:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-2b069e4d-f7e9-4c82-a5fc-acd499cd1ee8 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Acquiring lock "a1a155e6-0ee2-4728-a526-17c149107ab0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:21:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-2b069e4d-f7e9-4c82-a5fc-acd499cd1ee8 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lock "a1a155e6-0ee2-4728-a526-17c149107ab0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:21:36 user nova-compute[95467]: INFO nova.compute.manager [None req-2b069e4d-f7e9-4c82-a5fc-acd499cd1ee8 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Attaching volume 7bd52f6c-f10a-491b-a827-97d3400abb54 to /dev/vdb
Nov 15 08:21:36 user nova-compute[95467]: DEBUG os_brick.utils [None req-2b069e4d-f7e9-4c82-a5fc-acd499cd1ee8 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:21:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:36 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab2ffdc7-75cd-4e0a-a605-8939aa9631df]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:882ae90641f\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:36 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad82974d-4e27-4ea2-a8db-17b6f7fe84d2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:36 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f970db9-cac2-4a8f-a8f3-8df39b5b3040]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:36 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f6fd04-ef7a-415b-a6e3-4926930b62de]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-2b069e4d-f7e9-4c82-a5fc-acd499cd1ee8 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Running cmd (subprocess): nvme version {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-2b069e4d-f7e9-4c82-a5fc-acd499cd1ee8 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] 'nvme version' failed. Not Retrying. {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:21:36 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2b069e4d-f7e9-4c82-a5fc-acd499cd1ee8 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] nvme not present on system {{(pid=95467) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 08:21:36 user nova-compute[95467]: DEBUG nova.compute.manager [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 091612cf-b737-480b-984e-a05b522676b6] Instance event wait completed in 0 seconds for  {{(pid=95467) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 08:21:36 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 091612cf-b737-480b-984e-a05b522676b6] Guest created on hypervisor {{(pid=95467) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 08:21:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:36 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 091612cf-b737-480b-984e-a05b522676b6] Instance spawned successfully.
Nov 15 08:21:36 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 091612cf-b737-480b-984e-a05b522676b6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 08:21:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:21:36 user nova-compute[95467]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 08:21:36 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ce5f01-4c71-4d2a-ba8f-926532e47c11]: (4, '') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:36 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-2b069e4d-f7e9-4c82-a5fc-acd499cd1ee8 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=95467) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 08:21:36 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-2b069e4d-f7e9-4c82-a5fc-acd499cd1ee8 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 08:21:36 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-2b069e4d-f7e9-4c82-a5fc-acd499cd1ee8 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] LIGHTOS: no hostnqn found. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 08:21:36 user nova-compute[95467]: DEBUG os_brick.utils [None req-2b069e4d-f7e9-4c82-a5fc-acd499cd1ee8 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:882ae90641f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:21:36 user nova-compute[95467]: DEBUG nova.virt.block_device [None req-2b069e4d-f7e9-4c82-a5fc-acd499cd1ee8 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Updating existing volume attachment record: a5d90bca-3ac4-4265-a3f4-f8874ac4659c {{(pid=95467) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 08:21:36 user nova-compute[95467]: DEBUG nova.compute.manager [req-126d56ca-7677-4f75-9d1d-dd7c16a2c4a8 req-1dca4e60-f849-459e-8101-7bb493e4993b service nova] [instance: 091612cf-b737-480b-984e-a05b522676b6] Received event network-vif-plugged-4880d737-2c51-4a14-bba5-f9ec720a3f18 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:21:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-126d56ca-7677-4f75-9d1d-dd7c16a2c4a8 req-1dca4e60-f849-459e-8101-7bb493e4993b service nova] Acquiring lock "091612cf-b737-480b-984e-a05b522676b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:21:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-126d56ca-7677-4f75-9d1d-dd7c16a2c4a8 req-1dca4e60-f849-459e-8101-7bb493e4993b service nova] Lock "091612cf-b737-480b-984e-a05b522676b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:21:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-126d56ca-7677-4f75-9d1d-dd7c16a2c4a8 req-1dca4e60-f849-459e-8101-7bb493e4993b service nova] Lock "091612cf-b737-480b-984e-a05b522676b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:21:36 user nova-compute[95467]: DEBUG nova.compute.manager [req-126d56ca-7677-4f75-9d1d-dd7c16a2c4a8 req-1dca4e60-f849-459e-8101-7bb493e4993b service nova] [instance: 091612cf-b737-480b-984e-a05b522676b6] No waiting events found dispatching network-vif-plugged-4880d737-2c51-4a14-bba5-f9ec720a3f18 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:21:36 user nova-compute[95467]: WARNING nova.compute.manager [req-126d56ca-7677-4f75-9d1d-dd7c16a2c4a8 req-1dca4e60-f849-459e-8101-7bb493e4993b service nova] [instance: 091612cf-b737-480b-984e-a05b522676b6] Received unexpected event network-vif-plugged-4880d737-2c51-4a14-bba5-f9ec720a3f18 for instance with vm_state building and task_state spawning.
Nov 15 08:21:36 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 091612cf-b737-480b-984e-a05b522676b6] Found default for hw_cdrom_bus of ide {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:21:36 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 091612cf-b737-480b-984e-a05b522676b6] Found default for hw_disk_bus of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:21:36 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 091612cf-b737-480b-984e-a05b522676b6] Found default for hw_input_bus of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:21:36 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 091612cf-b737-480b-984e-a05b522676b6] Found default for hw_pointer_model of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:21:36 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 091612cf-b737-480b-984e-a05b522676b6] Found default for hw_video_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:21:36 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 091612cf-b737-480b-984e-a05b522676b6] Found default for hw_vif_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:21:36 user nova-compute[95467]: INFO nova.compute.manager [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 091612cf-b737-480b-984e-a05b522676b6] Took 5.78 seconds to spawn the instance on the hypervisor.
Nov 15 08:21:36 user nova-compute[95467]: DEBUG nova.compute.manager [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 091612cf-b737-480b-984e-a05b522676b6] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:21:36 user nova-compute[95467]: INFO nova.compute.manager [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 091612cf-b737-480b-984e-a05b522676b6] Took 6.89 seconds to build instance.
Nov 15 08:21:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-fb02f77a-8c47-4b7c-98fb-5e88e342dc10 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "091612cf-b737-480b-984e-a05b522676b6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.986s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:21:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:38 user nova-compute[95467]: INFO nova.compute.manager [None req-3c66282b-7621-446d-8ae6-6e47f1e776a0 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Unrescuing
Nov 15 08:21:38 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3c66282b-7621-446d-8ae6-6e47f1e776a0 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Acquiring lock "refresh_cache-b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:21:38 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3c66282b-7621-446d-8ae6-6e47f1e776a0 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Acquired lock "refresh_cache-b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:21:38 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3c66282b-7621-446d-8ae6-6e47f1e776a0 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:21:38 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3c66282b-7621-446d-8ae6-6e47f1e776a0 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Updating instance_info_cache with network_info: [{"id": "1436eae1-0899-4fc5-8bbe-575fa2c70d42", "address": "fa:16:3e:08:e7:36", "network": {"id": "369d2a6f-60b7-4c92-8b2d-1f3828f6698b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1491709218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd281be4e94a4d31a47a13267d51d9b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1436eae1-08", "ovs_interfaceid": "1436eae1-0899-4fc5-8bbe-575fa2c70d42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:21:38 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3c66282b-7621-446d-8ae6-6e47f1e776a0 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Releasing lock "refresh_cache-b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:21:38 user nova-compute[95467]: DEBUG nova.objects.instance [None req-3c66282b-7621-446d-8ae6-6e47f1e776a0 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lazy-loading 'flavor' on Instance uuid b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:21:38 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:39 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:39 user nova-compute[95467]: DEBUG nova.compute.manager [req-58227000-ac34-49ac-9a22-d1918145358f req-cded3c3b-9c1e-450c-9cea-0244a286f07f service nova] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Received event network-vif-unplugged-1436eae1-0899-4fc5-8bbe-575fa2c70d42 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:21:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-58227000-ac34-49ac-9a22-d1918145358f req-cded3c3b-9c1e-450c-9cea-0244a286f07f service nova] Acquiring lock "b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:21:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-58227000-ac34-49ac-9a22-d1918145358f req-cded3c3b-9c1e-450c-9cea-0244a286f07f service nova] Lock "b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:21:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-58227000-ac34-49ac-9a22-d1918145358f req-cded3c3b-9c1e-450c-9cea-0244a286f07f service nova] Lock "b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:21:39 user nova-compute[95467]: DEBUG nova.compute.manager [req-58227000-ac34-49ac-9a22-d1918145358f req-cded3c3b-9c1e-450c-9cea-0244a286f07f service nova] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] No waiting events found dispatching network-vif-unplugged-1436eae1-0899-4fc5-8bbe-575fa2c70d42 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:21:39 user nova-compute[95467]: WARNING nova.compute.manager [req-58227000-ac34-49ac-9a22-d1918145358f req-cded3c3b-9c1e-450c-9cea-0244a286f07f service nova] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Received unexpected event network-vif-unplugged-1436eae1-0899-4fc5-8bbe-575fa2c70d42 for instance with vm_state rescued and task_state unrescuing.
Nov 15 08:21:39 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:39 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:39 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Instance destroyed successfully.
Nov 15 08:21:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:41 user nova-compute[95467]: DEBUG nova.compute.manager [req-663979ca-0f06-48f1-9548-c635d77e1cad req-98b23600-0295-4a97-ac26-87e4fd05ab8f service nova] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Received event network-vif-plugged-1436eae1-0899-4fc5-8bbe-575fa2c70d42 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:21:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-663979ca-0f06-48f1-9548-c635d77e1cad req-98b23600-0295-4a97-ac26-87e4fd05ab8f service nova] Acquiring lock "b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:21:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-663979ca-0f06-48f1-9548-c635d77e1cad req-98b23600-0295-4a97-ac26-87e4fd05ab8f service nova] Lock "b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:21:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-663979ca-0f06-48f1-9548-c635d77e1cad req-98b23600-0295-4a97-ac26-87e4fd05ab8f service nova] Lock "b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:21:41 user nova-compute[95467]: DEBUG nova.compute.manager [req-663979ca-0f06-48f1-9548-c635d77e1cad req-98b23600-0295-4a97-ac26-87e4fd05ab8f service nova] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] No waiting events found dispatching network-vif-plugged-1436eae1-0899-4fc5-8bbe-575fa2c70d42 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:21:41 user nova-compute[95467]: WARNING nova.compute.manager [req-663979ca-0f06-48f1-9548-c635d77e1cad req-98b23600-0295-4a97-ac26-87e4fd05ab8f service nova] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Received unexpected event network-vif-plugged-1436eae1-0899-4fc5-8bbe-575fa2c70d42 for instance with vm_state rescued and task_state unrescuing.
Nov 15 08:21:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:41 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b069e4d-f7e9-4c82-a5fc-acd499cd1ee8 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Calling os-brick to attach iSCSI Volume {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 08:21:41 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b069e4d-f7e9-4c82-a5fc-acd499cd1ee8 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wocCRvNY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:21:41 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-2b069e4d-f7e9-4c82-a5fc-acd499cd1ee8 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:21:41 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-2b069e4d-f7e9-4c82-a5fc-acd499cd1ee8 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:21:41 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-2b069e4d-f7e9-4c82-a5fc-acd499cd1ee8 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:21:41 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-2b069e4d-f7e9-4c82-a5fc-acd499cd1ee8 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:21:41 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-2b069e4d-f7e9-4c82-a5fc-acd499cd1ee8 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:21:41 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-2b069e4d-f7e9-4c82-a5fc-acd499cd1ee8 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:21:41 user nova-compute[95467]: INFO os_brick.initiator.connectors.iscsi [None req-2b069e4d-f7e9-4c82-a5fc-acd499cd1ee8 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 08:21:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54 -p 172.16.0.220:3260 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:41 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f871cdc4-e6a2-440d-9ad7-8a1cc72a8f28]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:41 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b069e4d-f7e9-4c82-a5fc-acd499cd1ee8 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 08:21:41 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:21:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54 -p 172.16.0.220:3260 --interface default --op new {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:41 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff02c75-4de9-4e88-af4a-014fb5c3db12]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54] added\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:41 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b069e4d-f7e9-4c82-a5fc-acd499cd1ee8 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54] added
Nov 15 08:21:41 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:21:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:41 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[2966f639-a8b9-48f5-bf54-b07e651506ca]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:41 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b069e4d-f7e9-4c82-a5fc-acd499cd1ee8 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:21:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:41 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ff45ac-a54c-4be0-8b30-aafd56635553]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:41 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b069e4d-f7e9-4c82-a5fc-acd499cd1ee8 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:21:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wocCRvNY {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wocCRvNY" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:41 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[013f2b86-3d73-4056-bd11-dc87f6450a8f]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:41 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b069e4d-f7e9-4c82-a5fc-acd499cd1ee8 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wocCRvNY'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:21:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:41 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d048c94-65cc-4002-9633-4440e968532d]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:41 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b069e4d-f7e9-4c82-a5fc-acd499cd1ee8 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:21:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:41 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[be107fca-6018-45d5-ba01-62089f6de854]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:41 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b069e4d-f7e9-4c82-a5fc-acd499cd1ee8 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:21:41 user nova-compute[95467]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:21:41 user nova-compute[95467]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802 (non-flash)
Nov 15 08:21:41 user nova-compute[95467]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:21:41 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:21:41 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b069e4d-f7e9-4c82-a5fc-acd499cd1ee8 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:21:41 user nova-compute[95467]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:21:41 user nova-compute[95467]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802 (non-flash)
Nov 15 08:21:41 user nova-compute[95467]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:21:41 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:21:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54 -p 172.16.0.220:3260 --login {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:42 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7625c5-5f94-4e9c-9214-c0a04ad2df63]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b069e4d-f7e9-4c82-a5fc-acd499cd1ee8 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54, portal: 172.16.0.220,3260]
Nov 15 08:21:42 user nova-compute[95467]: Login to [iface: default, target: iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54, portal: 172.16.0.220,3260] successful.
Nov 15 08:21:42 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:21:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:42 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[891969f8-8536-46d7-87a8-6f664a40e500]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b069e4d-f7e9-4c82-a5fc-acd499cd1ee8 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:21:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:42 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[157d62a4-5796-4641-a259-af0d961b59e8]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b069e4d-f7e9-4c82-a5fc-acd499cd1ee8 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:21:42 user nova-compute[95467]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:21:42 user nova-compute[95467]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802 (non-flash)
Nov 15 08:21:42 user nova-compute[95467]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:21:42 user nova-compute[95467]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54 (non-flash)
Nov 15 08:21:42 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:21:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b069e4d-f7e9-4c82-a5fc-acd499cd1ee8 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:21:42 user nova-compute[95467]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:21:42 user nova-compute[95467]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802 (non-flash)
Nov 15 08:21:42 user nova-compute[95467]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:21:42 user nova-compute[95467]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54 (non-flash)
Nov 15 08:21:42 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:21:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-2b069e4d-f7e9-4c82-a5fc-acd499cd1ee8 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:21:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b069e4d-f7e9-4c82-a5fc-acd499cd1ee8 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Connected to 172.16.0.220:3260 {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 08:21:42 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-2b069e4d-f7e9-4c82-a5fc-acd499cd1ee8 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] HCTL ('36', '-', '-', 0) found on session 34 with lun 0 {{(pid=95467) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 08:21:42 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-2b069e4d-f7e9-4c82-a5fc-acd499cd1ee8 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=95467) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 08:21:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:42 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[62843d27-4490-40e7-82d5-79ab92d788a1]: (4, ('- - 0', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:42 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-2b069e4d-f7e9-4c82-a5fc-acd499cd1ee8 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Searching for a device in session 34 and hctl ['36', '*', '*', 0] yield: sde {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:21:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b069e4d-f7e9-4c82-a5fc-acd499cd1ee8 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wocCRvNY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 08:21:42 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:42 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-2b069e4d-f7e9-4c82-a5fc-acd499cd1ee8 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:21:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b069e4d-f7e9-4c82-a5fc-acd499cd1ee8 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '23666613738626633', 'path': '/dev/sde'} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:21:43 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b069e4d-f7e9-4c82-a5fc-acd499cd1ee8 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23666613738626633', 'path': '/dev/sde'} {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 08:21:43 user nova-compute[95467]: DEBUG nova.objects.instance [None req-2b069e4d-f7e9-4c82-a5fc-acd499cd1ee8 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lazy-loading 'flavor' on Instance uuid a1a155e6-0ee2-4728-a526-17c149107ab0 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:21:43 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-2b069e4d-f7e9-4c82-a5fc-acd499cd1ee8 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 08:21:43 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:21:43 user nova-compute[95467]:   <source dev="/dev/sde"/>
Nov 15 08:21:43 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:21:43 user nova-compute[95467]:   <serial>7bd52f6c-f10a-491b-a827-97d3400abb54</serial>
Nov 15 08:21:43 user nova-compute[95467]: </disk>
Nov 15 08:21:43 user nova-compute[95467]:  {{(pid=95467) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 08:21:43 user nova-compute[95467]: DEBUG nova.compute.manager [req-a2267a8a-55c4-4559-8626-28d6b5a0be17 req-4cbf1d81-0ed8-472d-b5bf-34015b532c60 service nova] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Received event network-vif-plugged-1436eae1-0899-4fc5-8bbe-575fa2c70d42 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:21:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-a2267a8a-55c4-4559-8626-28d6b5a0be17 req-4cbf1d81-0ed8-472d-b5bf-34015b532c60 service nova] Acquiring lock "b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:21:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-a2267a8a-55c4-4559-8626-28d6b5a0be17 req-4cbf1d81-0ed8-472d-b5bf-34015b532c60 service nova] Lock "b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:21:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-a2267a8a-55c4-4559-8626-28d6b5a0be17 req-4cbf1d81-0ed8-472d-b5bf-34015b532c60 service nova] Lock "b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.007s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:21:43 user nova-compute[95467]: DEBUG nova.compute.manager [req-a2267a8a-55c4-4559-8626-28d6b5a0be17 req-4cbf1d81-0ed8-472d-b5bf-34015b532c60 service nova] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] No waiting events found dispatching network-vif-plugged-1436eae1-0899-4fc5-8bbe-575fa2c70d42 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:21:43 user nova-compute[95467]: WARNING nova.compute.manager [req-a2267a8a-55c4-4559-8626-28d6b5a0be17 req-4cbf1d81-0ed8-472d-b5bf-34015b532c60 service nova] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Received unexpected event network-vif-plugged-1436eae1-0899-4fc5-8bbe-575fa2c70d42 for instance with vm_state rescued and task_state unrescuing.
Nov 15 08:21:43 user nova-compute[95467]: DEBUG nova.compute.manager [req-a2267a8a-55c4-4559-8626-28d6b5a0be17 req-4cbf1d81-0ed8-472d-b5bf-34015b532c60 service nova] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Received event network-vif-plugged-1436eae1-0899-4fc5-8bbe-575fa2c70d42 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:21:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-a2267a8a-55c4-4559-8626-28d6b5a0be17 req-4cbf1d81-0ed8-472d-b5bf-34015b532c60 service nova] Acquiring lock "b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:21:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-a2267a8a-55c4-4559-8626-28d6b5a0be17 req-4cbf1d81-0ed8-472d-b5bf-34015b532c60 service nova] Lock "b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:21:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-a2267a8a-55c4-4559-8626-28d6b5a0be17 req-4cbf1d81-0ed8-472d-b5bf-34015b532c60 service nova] Lock "b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:21:43 user nova-compute[95467]: DEBUG nova.compute.manager [req-a2267a8a-55c4-4559-8626-28d6b5a0be17 req-4cbf1d81-0ed8-472d-b5bf-34015b532c60 service nova] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] No waiting events found dispatching network-vif-plugged-1436eae1-0899-4fc5-8bbe-575fa2c70d42 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:21:43 user nova-compute[95467]: WARNING nova.compute.manager [req-a2267a8a-55c4-4559-8626-28d6b5a0be17 req-4cbf1d81-0ed8-472d-b5bf-34015b532c60 service nova] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Received unexpected event network-vif-plugged-1436eae1-0899-4fc5-8bbe-575fa2c70d42 for instance with vm_state rescued and task_state unrescuing.
Nov 15 08:21:43 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3c66282b-7621-446d-8ae6-6e47f1e776a0 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:21:43 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager.update_available_resource {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:21:43 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-2b069e4d-f7e9-4c82-a5fc-acd499cd1ee8 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:21:43 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-2b069e4d-f7e9-4c82-a5fc-acd499cd1ee8 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] No BDM found with device name vdb, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:21:43 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-2b069e4d-f7e9-4c82-a5fc-acd499cd1ee8 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] No VIF found with MAC fa:16:3e:83:dc:7a, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:21:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:21:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:21:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:21:43 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Auditing locally available compute resources for user (node: user) {{(pid=95467) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 08:21:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-2b069e4d-f7e9-4c82-a5fc-acd499cd1ee8 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lock "a1a155e6-0ee2-4728-a526-17c149107ab0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.805s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:21:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:44 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:21:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a155e6-0ee2-4728-a526-17c149107ab0/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a155e6-0ee2-4728-a526-17c149107ab0/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a155e6-0ee2-4728-a526-17c149107ab0/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a155e6-0ee2-4728-a526-17c149107ab0/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:45 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:21:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7805e5c-1777-4b0c-95c7-b232be66528c/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7805e5c-1777-4b0c-95c7-b232be66528c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7805e5c-1777-4b0c-95c7-b232be66528c/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7805e5c-1777-4b0c-95c7-b232be66528c/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091612cf-b737-480b-984e-a05b522676b6/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091612cf-b737-480b-984e-a05b522676b6/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091612cf-b737-480b-984e-a05b522676b6/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:46 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-47f37b7a-e236-4e88-a34d-07df73a09355 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a is timed out.
Nov 15 08:21:46 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-47f37b7a-e236-4e88-a34d-07df73a09355 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Successfully detached device vdb from instance ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a from the live domain config.
Nov 15 08:21:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091612cf-b737-480b-984e-a05b522676b6/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:46 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47f37b7a-e236-4e88-a34d-07df73a09355 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] calling os-brick to detach iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 08:21:46 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f37b7a-e236-4e88-a34d-07df73a09355 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, {'target_iqn': 'iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AkGWsugt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:21:46 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-47f37b7a-e236-4e88-a34d-07df73a09355 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:21:46 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-47f37b7a-e236-4e88-a34d-07df73a09355 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:21:46 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-47f37b7a-e236-4e88-a34d-07df73a09355 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:21:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.036s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:46 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f117acf2-ed36-42aa-a348-06de184f3724]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:46 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f37b7a-e236-4e88-a34d-07df73a09355 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 08:21:46 user nova-compute[95467]: No targets found.
Nov 15 08:21:46 user nova-compute[95467]: iSNS:
Nov 15 08:21:46 user nova-compute[95467]: No targets found.
Nov 15 08:21:46 user nova-compute[95467]: STATIC:
Nov 15 08:21:46 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802
Nov 15 08:21:46 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:21:46 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:21:46 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e
Nov 15 08:21:46 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:21:46 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:21:46 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775
Nov 15 08:21:46 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:21:46 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:21:46 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54
Nov 15 08:21:46 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:21:46 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:21:46 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400
Nov 15 08:21:46 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:21:46 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:21:46 user nova-compute[95467]: FIRMWARE:
Nov 15 08:21:46 user nova-compute[95467]: No targets found.
Nov 15 08:21:46 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:21:46 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f37b7a-e236-4e88-a34d-07df73a09355 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 08:21:46 user nova-compute[95467]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 08:21:46 user nova-compute[95467]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=95467) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 08:21:46 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f37b7a-e236-4e88-a34d-07df73a09355 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802', 0)] {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 08:21:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:46 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f86ad61-5b7d-42ca-ae46-bed344d6b828]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:46 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed785d6c-6d13-4fc3-a4b7-718be3e3143c]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:46 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f37b7a-e236-4e88-a34d-07df73a09355 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:21:46 user nova-compute[95467]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:21:46 user nova-compute[95467]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802 (non-flash)
Nov 15 08:21:46 user nova-compute[95467]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:21:46 user nova-compute[95467]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54 (non-flash)
Nov 15 08:21:46 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:21:46 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f37b7a-e236-4e88-a34d-07df73a09355 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:21:46 user nova-compute[95467]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:21:46 user nova-compute[95467]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802 (non-flash)
Nov 15 08:21:46 user nova-compute[95467]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:21:46 user nova-compute[95467]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54 (non-flash)
Nov 15 08:21:46 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:21:46 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f37b7a-e236-4e88-a34d-07df73a09355 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efed8436050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802'): ({'sdc'}, set())}) {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 08:21:46 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-47f37b7a-e236-4e88-a34d-07df73a09355 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Removing single pathed devices sdc {{(pid=95467) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 08:21:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:46 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e4bf7e-0e4a-41d1-8d11-a67e87b7ae28]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:46 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a734b0-8ff6-4a1f-9f4d-fd93cc78e863]: (4, ('ok\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:46 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-47f37b7a-e236-4e88-a34d-07df73a09355 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Flushing IO for device /dev/sdc {{(pid=95467) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 08:21:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:46 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa0e61e-1923-4e82-9d50-48c17bd7723f]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:46 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-47f37b7a-e236-4e88-a34d-07df73a09355 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=95467) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 08:21:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:46 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f2a432a-a676-4d2e-b60f-12800f1782e1]: (4, ('1', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:46 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-47f37b7a-e236-4e88-a34d-07df73a09355 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 08:21:46 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-47f37b7a-e236-4e88-a34d-07df73a09355 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] SCSI volumes sdc have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 08:21:46 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f37b7a-e236-4e88-a34d-07df73a09355 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802')] {{(pid=95467) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 08:21:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:46 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8e8ada-8b37-4123-ab47-718f64a1cab2]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:46 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f37b7a-e236-4e88-a34d-07df73a09355 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:21:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802 -p 172.16.0.220:3260 --logout {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:46 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[31918084-4c0d-419d-aa09-66d8744763a6]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:46 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f37b7a-e236-4e88-a34d-07df73a09355 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802, portal: 172.16.0.220,3260]
Nov 15 08:21:46 user nova-compute[95467]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802, portal: 172.16.0.220,3260] successful.
Nov 15 08:21:46 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:21:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802 -p 172.16.0.220:3260 --op delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:46 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda3cfbe-532b-417c-8d41-36bc539185b1]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:46 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f37b7a-e236-4e88-a34d-07df73a09355 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:21:46 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-47f37b7a-e236-4e88-a34d-07df73a09355 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.469s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:21:46 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f37b7a-e236-4e88-a34d-07df73a09355 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] <== disconnect_volume: return (471ms) None {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:21:46 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47f37b7a-e236-4e88-a34d-07df73a09355 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] Disconnected iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 08:21:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:47 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:21:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0edcb81b-d8fe-482c-a7ca-6b76455cfe33/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:47 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0edcb81b-d8fe-482c-a7ca-6b76455cfe33/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0edcb81b-d8fe-482c-a7ca-6b76455cfe33/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:47 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0edcb81b-d8fe-482c-a7ca-6b76455cfe33/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk.rescue --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk.rescue --force-share --output=json" returned: 0 in 0.211s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk.rescue --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk.rescue --force-share --output=json" returned: 0 in 0.274s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:48 user nova-compute[95467]: DEBUG nova.objects.instance [None req-47f37b7a-e236-4e88-a34d-07df73a09355 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lazy-loading 'flavor' on Instance uuid ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:21:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-47f37b7a-e236-4e88-a34d-07df73a09355 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lock "ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.998s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:21:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e7cdc0aa-6045-4d4f-9203-06684ddac663 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lock "ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 22.862s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:21:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e7cdc0aa-6045-4d4f-9203-06684ddac663 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Acquiring lock "ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:21:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e7cdc0aa-6045-4d4f-9203-06684ddac663 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lock "ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:21:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e7cdc0aa-6045-4d4f-9203-06684ddac663 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lock "ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:21:48 user nova-compute[95467]: INFO nova.compute.manager [None req-e7cdc0aa-6045-4d4f-9203-06684ddac663 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] Terminating instance
Nov 15 08:21:48 user nova-compute[95467]: DEBUG nova.compute.manager [None req-e7cdc0aa-6045-4d4f-9203-06684ddac663 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] Start destroying the instance on the hypervisor. {{(pid=95467) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 08:21:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:48 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Acquiring lock "d22eb02b-7e8d-4755-9f1e-3eee56ddec0c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:21:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Lock "d22eb02b-7e8d-4755-9f1e-3eee56ddec0c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:21:48 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:48 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:48 user nova-compute[95467]: DEBUG nova.compute.manager [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Starting instance... {{(pid=95467) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 08:21:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:48 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:21:49 user nova-compute[95467]: DEBUG nova.compute.manager [req-7c8d2c38-5c3b-4828-a879-e60f5dde30b2 req-de894919-c203-4087-bf71-c61989afb854 service nova] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] Received event network-vif-unplugged-e998bcd4-3b5b-4cb1-9b31-7b44f124f51f {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:21:49 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-7c8d2c38-5c3b-4828-a879-e60f5dde30b2 req-de894919-c203-4087-bf71-c61989afb854 service nova] Acquiring lock "ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:21:49 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-7c8d2c38-5c3b-4828-a879-e60f5dde30b2 req-de894919-c203-4087-bf71-c61989afb854 service nova] Lock "ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:21:49 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-7c8d2c38-5c3b-4828-a879-e60f5dde30b2 req-de894919-c203-4087-bf71-c61989afb854 service nova] Lock "ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:21:49 user nova-compute[95467]: DEBUG nova.compute.manager [req-7c8d2c38-5c3b-4828-a879-e60f5dde30b2 req-de894919-c203-4087-bf71-c61989afb854 service nova] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] No waiting events found dispatching network-vif-unplugged-e998bcd4-3b5b-4cb1-9b31-7b44f124f51f {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:21:49 user nova-compute[95467]: DEBUG nova.compute.manager [req-7c8d2c38-5c3b-4828-a879-e60f5dde30b2 req-de894919-c203-4087-bf71-c61989afb854 service nova] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] Received event network-vif-unplugged-e998bcd4-3b5b-4cb1-9b31-7b44f124f51f for instance with task_state deleting. {{(pid=95467) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 08:21:49 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:21:49 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:21:49 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Hypervisor/Node resource view: name=user free_ram=7361MB free_disk=25.12166976928711GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=95467) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 08:21:49 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:21:49 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:21:49 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] Instance destroyed successfully.
Nov 15 08:21:49 user nova-compute[95467]: DEBUG nova.objects.instance [None req-e7cdc0aa-6045-4d4f-9203-06684ddac663 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lazy-loading 'resources' on Instance uuid ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:21:49 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:21:49 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-e7cdc0aa-6045-4d4f-9203-06684ddac663 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:19:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-9504693',display_name='tempest-VolumesSnapshotTestJSON-instance-9504693',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-9504693',id=31,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE3U8SysIZB5CghQ0nTVG7TnMbRSpJwwUZ7XeChV+5Q8vhF8isngbOAHIETwQqC01asp6Fsz/SmPvfmCoBDLhtXpUeP+9o5shnpMf18bO7hmEleO3iLjUUqI86IkZswW/w==',key_name='tempest-keypair-1199575254',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:19:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b1fa68347914efe87ae8edd3901e11a',ramdisk_id='',reservation_id='r-0kk1yzjs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-151902651',owner_user_name='tempest-VolumesSnapshotTestJSON-151902651-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:19:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='993622d17e1848a0980fd759e248edda',uuid=ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e998bcd4-3b5b-4cb1-9b31-7b44f124f51f", "address": "fa:16:3e:a6:60:b2", "network": {"id": "8220309c-e09f-4c20-8f74-abdf4688fe64", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-160547739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b1fa68347914efe87ae8edd3901e11a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape998bcd4-3b", "ovs_interfaceid": "e998bcd4-3b5b-4cb1-9b31-7b44f124f51f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:21:49 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-e7cdc0aa-6045-4d4f-9203-06684ddac663 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Converting VIF {"id": "e998bcd4-3b5b-4cb1-9b31-7b44f124f51f", "address": "fa:16:3e:a6:60:b2", "network": {"id": "8220309c-e09f-4c20-8f74-abdf4688fe64", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-160547739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b1fa68347914efe87ae8edd3901e11a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape998bcd4-3b", "ovs_interfaceid": "e998bcd4-3b5b-4cb1-9b31-7b44f124f51f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:21:49 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-e7cdc0aa-6045-4d4f-9203-06684ddac663 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a6:60:b2,bridge_name='br-int',has_traffic_filtering=True,id=e998bcd4-3b5b-4cb1-9b31-7b44f124f51f,network=Network(8220309c-e09f-4c20-8f74-abdf4688fe64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape998bcd4-3b') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:21:49 user nova-compute[95467]: DEBUG os_vif [None req-e7cdc0aa-6045-4d4f-9203-06684ddac663 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:60:b2,bridge_name='br-int',has_traffic_filtering=True,id=e998bcd4-3b5b-4cb1-9b31-7b44f124f51f,network=Network(8220309c-e09f-4c20-8f74-abdf4688fe64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape998bcd4-3b') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:21:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape998bcd4-3b, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:21:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=af851bb6-604b-4af5-aa77-2c15f9074106) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:21:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:21:49 user nova-compute[95467]: INFO os_vif [None req-e7cdc0aa-6045-4d4f-9203-06684ddac663 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:60:b2,bridge_name='br-int',has_traffic_filtering=True,id=e998bcd4-3b5b-4cb1-9b31-7b44f124f51f,network=Network(8220309c-e09f-4c20-8f74-abdf4688fe64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape998bcd4-3b')
Nov 15 08:21:49 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7cdc0aa-6045-4d4f-9203-06684ddac663 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] calling os-brick to detach iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 08:21:49 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7cdc0aa-6045-4d4f-9203-06684ddac663 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, {'target_iqn': 'iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AkGWsugt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:21:49 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-e7cdc0aa-6045-4d4f-9203-06684ddac663 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:21:49 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-e7cdc0aa-6045-4d4f-9203-06684ddac663 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:21:49 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-e7cdc0aa-6045-4d4f-9203-06684ddac663 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:21:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:49 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[9734348e-f031-4acf-9936-d8d0abaffa36]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:49 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7cdc0aa-6045-4d4f-9203-06684ddac663 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 08:21:49 user nova-compute[95467]: No targets found.
Nov 15 08:21:49 user nova-compute[95467]: iSNS:
Nov 15 08:21:49 user nova-compute[95467]: No targets found.
Nov 15 08:21:49 user nova-compute[95467]: STATIC:
Nov 15 08:21:49 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e
Nov 15 08:21:49 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:21:49 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:21:49 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775
Nov 15 08:21:49 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:21:49 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:21:49 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54
Nov 15 08:21:49 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:21:49 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:21:49 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400
Nov 15 08:21:49 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:21:49 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:21:49 user nova-compute[95467]: FIRMWARE:
Nov 15 08:21:49 user nova-compute[95467]: No targets found.
Nov 15 08:21:49 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:21:49 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7cdc0aa-6045-4d4f-9203-06684ddac663 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 08:21:49 user nova-compute[95467]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 08:21:49 user nova-compute[95467]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=95467) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 08:21:49 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7cdc0aa-6045-4d4f-9203-06684ddac663 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6e2b3d2-26f3-4a80-a8cf-5fc07c558802', 0)] {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 08:21:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:49 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[6761dc61-53a5-4800-806e-6a23b00daece]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:49 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e54e900-93f9-45b8-af29-a6e1babbb4e1]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:21:49 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7cdc0aa-6045-4d4f-9203-06684ddac663 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:21:49 user nova-compute[95467]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:21:49 user nova-compute[95467]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:21:49 user nova-compute[95467]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54 (non-flash)
Nov 15 08:21:49 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:21:49 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7cdc0aa-6045-4d4f-9203-06684ddac663 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:21:49 user nova-compute[95467]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:21:49 user nova-compute[95467]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:21:49 user nova-compute[95467]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54 (non-flash)
Nov 15 08:21:49 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:21:49 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7cdc0aa-6045-4d4f-9203-06684ddac663 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efed8449480>, {}) {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 08:21:49 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7cdc0aa-6045-4d4f-9203-06684ddac663 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Disconnecting from: [] {{(pid=95467) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 08:21:49 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-e7cdc0aa-6045-4d4f-9203-06684ddac663 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.086s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:21:49 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7cdc0aa-6045-4d4f-9203-06684ddac663 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] <== disconnect_volume: return (87ms) None {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:21:49 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7cdc0aa-6045-4d4f-9203-06684ddac663 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] Disconnected iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 08:21:49 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-e7cdc0aa-6045-4d4f-9203-06684ddac663 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] Deleting instance files /opt/stack/data/nova/instances/ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a_del
Nov 15 08:21:49 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-e7cdc0aa-6045-4d4f-9203-06684ddac663 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] Deletion of /opt/stack/data/nova/instances/ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a_del complete
Nov 15 08:21:49 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 73fe8852-c47a-47ab-a56f-6864c8ed5479 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:21:49 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 21cf2ada-b15c-490d-ac37-96e9c87e9056 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:21:49 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:21:49 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 10d73b73-ca65-4192-8954-288dc1df9f24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:21:49 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 3825a691-ac5c-4c06-b4a4-2a0b40c638c4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:21:49 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:21:49 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance a1a155e6-0ee2-4728-a526-17c149107ab0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:21:49 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:21:49 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 0edcb81b-d8fe-482c-a7ca-6b76455cfe33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:21:49 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance e7805e5c-1777-4b0c-95c7-b232be66528c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:21:49 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:21:49 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 091612cf-b737-480b-984e-a05b522676b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:21:49 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance d22eb02b-7e8d-4755-9f1e-3eee56ddec0c has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 15 08:21:49 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 08:21:49 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 08:21:49 user nova-compute[95467]: INFO nova.compute.manager [None req-e7cdc0aa-6045-4d4f-9203-06684ddac663 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] Took 1.28 seconds to destroy the instance on the hypervisor.
Nov 15 08:21:49 user nova-compute[95467]: DEBUG oslo.service.loopingcall [None req-e7cdc0aa-6045-4d4f-9203-06684ddac663 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=95467) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 08:21:49 user nova-compute[95467]: DEBUG nova.compute.manager [-] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] Deallocating network for instance {{(pid=95467) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 08:21:49 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] deallocate_for_instance() {{(pid=95467) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 08:21:50 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:21:50 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:21:50 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Compute_service record updated for user:user {{(pid=95467) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 08:21:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.659s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:21:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.644s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:21:50 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=95467) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 08:21:50 user nova-compute[95467]: INFO nova.compute.claims [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Claim successful on node user
Nov 15 08:21:50 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:21:50 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:21:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.636s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:21:50 user nova-compute[95467]: DEBUG nova.compute.manager [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Start building networks asynchronously for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 08:21:50 user nova-compute[95467]: DEBUG nova.compute.manager [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Allocating IP information in the background. {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 08:21:50 user nova-compute[95467]: DEBUG nova.network.neutron [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] allocate_for_instance() {{(pid=95467) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 08:21:50 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 08:21:50 user nova-compute[95467]: DEBUG nova.compute.manager [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Start building block device mappings for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 08:21:50 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:50 user nova-compute[95467]: DEBUG nova.policy [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '53a0c2be5d1f4831961aa1cc29c4d46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f46c4dc5bf438cad677a366bdd5b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95467) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 08:21:51 user nova-compute[95467]: DEBUG nova.compute.manager [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Start spawning the instance on the hypervisor. {{(pid=95467) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 08:21:51 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Creating instance directory {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 08:21:51 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Creating image(s)
Nov 15 08:21:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Acquiring lock "/opt/stack/data/nova/instances/d22eb02b-7e8d-4755-9f1e-3eee56ddec0c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:21:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Lock "/opt/stack/data/nova/instances/d22eb02b-7e8d-4755-9f1e-3eee56ddec0c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:21:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Lock "/opt/stack/data/nova/instances/d22eb02b-7e8d-4755-9f1e-3eee56ddec0c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:21:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:51 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:21:51 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:21:51 user nova-compute[95467]: DEBUG nova.compute.manager [req-c7acc043-b096-40f5-aa7e-573fe3188aa6 req-de4d1857-2b7e-458e-80fd-be172eaec9d6 service nova] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] Received event network-vif-plugged-e998bcd4-3b5b-4cb1-9b31-7b44f124f51f {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:21:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-c7acc043-b096-40f5-aa7e-573fe3188aa6 req-de4d1857-2b7e-458e-80fd-be172eaec9d6 service nova] Acquiring lock "ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:21:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-c7acc043-b096-40f5-aa7e-573fe3188aa6 req-de4d1857-2b7e-458e-80fd-be172eaec9d6 service nova] Lock "ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:21:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-c7acc043-b096-40f5-aa7e-573fe3188aa6 req-de4d1857-2b7e-458e-80fd-be172eaec9d6 service nova] Lock "ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:21:51 user nova-compute[95467]: DEBUG nova.compute.manager [req-c7acc043-b096-40f5-aa7e-573fe3188aa6 req-de4d1857-2b7e-458e-80fd-be172eaec9d6 service nova] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] No waiting events found dispatching network-vif-plugged-e998bcd4-3b5b-4cb1-9b31-7b44f124f51f {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:21:51 user nova-compute[95467]: WARNING nova.compute.manager [req-c7acc043-b096-40f5-aa7e-573fe3188aa6 req-de4d1857-2b7e-458e-80fd-be172eaec9d6 service nova] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] Received unexpected event network-vif-plugged-e998bcd4-3b5b-4cb1-9b31-7b44f124f51f for instance with vm_state active and task_state deleting.
Nov 15 08:21:51 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:21:51 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:21:51 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:21:51 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:21:51 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:21:51 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:21:51 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=95467) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 08:21:51 user nova-compute[95467]: INFO nova.compute.manager [-] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] Took 1.56 seconds to deallocate network for instance.
Nov 15 08:21:51 user nova-compute[95467]: WARNING nova.volume.cinder [None req-e7cdc0aa-6045-4d4f-9203-06684ddac663 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Attachment fc12e1bb-ba4c-40e7-b330-237b0336408f does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = fc12e1bb-ba4c-40e7-b330-237b0336408f. (HTTP 404) (Request-ID: req-c02b6930-22ce-4e3c-8f71-01743faffc2c)
Nov 15 08:21:51 user nova-compute[95467]: INFO nova.compute.manager [None req-e7cdc0aa-6045-4d4f-9203-06684ddac663 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] Took 0.03 seconds to detach 1 volumes for instance.
Nov 15 08:21:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.206s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Acquiring lock "a3fcf60225fcefd310404971cd18ab9851c548dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:21:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:21:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e7cdc0aa-6045-4d4f-9203-06684ddac663 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:21:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e7cdc0aa-6045-4d4f-9203-06684ddac663 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:21:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.213s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/d22eb02b-7e8d-4755-9f1e-3eee56ddec0c/disk 1073741824 {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/d22eb02b-7e8d-4755-9f1e-3eee56ddec0c/disk 1073741824" returned: 0 in 0.073s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.292s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:21:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:51 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:21:51 user nova-compute[95467]: DEBUG nova.network.neutron [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Successfully created port: 62cba8e1-074b-41db-bb58-3363138fb060 {{(pid=95467) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 08:21:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.194s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:51 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d22eb02b-7e8d-4755-9f1e-3eee56ddec0c/disk. size=1073741824 {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 08:21:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d22eb02b-7e8d-4755-9f1e-3eee56ddec0c/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:21:51 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-e7cdc0aa-6045-4d4f-9203-06684ddac663 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:21:51 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-e7cdc0aa-6045-4d4f-9203-06684ddac663 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:21:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e7cdc0aa-6045-4d4f-9203-06684ddac663 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.612s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:21:51 user nova-compute[95467]: INFO nova.scheduler.client.report [None req-e7cdc0aa-6045-4d4f-9203-06684ddac663 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Deleted allocations for instance ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a
Nov 15 08:21:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d22eb02b-7e8d-4755-9f1e-3eee56ddec0c/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:21:51 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Cannot resize image /opt/stack/data/nova/instances/d22eb02b-7e8d-4755-9f1e-3eee56ddec0c/disk to a smaller size. {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 08:21:51 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Created local disks {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 08:21:51 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Ensure instance console log exists: /opt/stack/data/nova/instances/d22eb02b-7e8d-4755-9f1e-3eee56ddec0c/console.log {{(pid=95467) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 08:21:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:21:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:21:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:21:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e7cdc0aa-6045-4d4f-9203-06684ddac663 tempest-VolumesSnapshotTestJSON-151902651 tempest-VolumesSnapshotTestJSON-151902651-project-member] Lock "ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.666s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:21:52 user nova-compute[95467]: DEBUG nova.network.neutron [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Successfully updated port: 62cba8e1-074b-41db-bb58-3363138fb060 {{(pid=95467) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 08:21:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Acquiring lock "refresh_cache-d22eb02b-7e8d-4755-9f1e-3eee56ddec0c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:21:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Acquired lock "refresh_cache-d22eb02b-7e8d-4755-9f1e-3eee56ddec0c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:21:52 user nova-compute[95467]: DEBUG nova.network.neutron [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:21:52 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:52 user nova-compute[95467]: DEBUG nova.compute.manager [req-17f82daa-1e4c-4ff0-95d9-f042fc822ffc req-acbd541a-73f9-43e8-97c9-45e432c8f5a2 service nova] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Received event network-changed-62cba8e1-074b-41db-bb58-3363138fb060 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:21:52 user nova-compute[95467]: DEBUG nova.compute.manager [req-17f82daa-1e4c-4ff0-95d9-f042fc822ffc req-acbd541a-73f9-43e8-97c9-45e432c8f5a2 service nova] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Refreshing instance network info cache due to event network-changed-62cba8e1-074b-41db-bb58-3363138fb060. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:21:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-17f82daa-1e4c-4ff0-95d9-f042fc822ffc req-acbd541a-73f9-43e8-97c9-45e432c8f5a2 service nova] Acquiring lock "refresh_cache-d22eb02b-7e8d-4755-9f1e-3eee56ddec0c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:21:52 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:21:52 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Starting heal instance info cache {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 08:21:52 user nova-compute[95467]: DEBUG nova.network.neutron [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Instance cache missing network info. {{(pid=95467) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 08:21:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "refresh_cache-b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:21:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquired lock "refresh_cache-b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:21:52 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Forcefully refreshing network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 08:21:53 user nova-compute[95467]: DEBUG nova.network.neutron [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Updating instance_info_cache with network_info: [{"id": "62cba8e1-074b-41db-bb58-3363138fb060", "address": "fa:16:3e:e4:27:f3", "network": {"id": "439fd8f9-3cf0-449d-b7e1-eba4d33109f9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-399225774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7f46c4dc5bf438cad677a366bdd5b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62cba8e1-07", "ovs_interfaceid": "62cba8e1-074b-41db-bb58-3363138fb060", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:21:53 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Releasing lock "refresh_cache-d22eb02b-7e8d-4755-9f1e-3eee56ddec0c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:21:53 user nova-compute[95467]: DEBUG nova.compute.manager [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Instance network_info: |[{"id": "62cba8e1-074b-41db-bb58-3363138fb060", "address": "fa:16:3e:e4:27:f3", "network": {"id": "439fd8f9-3cf0-449d-b7e1-eba4d33109f9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-399225774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7f46c4dc5bf438cad677a366bdd5b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62cba8e1-07", "ovs_interfaceid": "62cba8e1-074b-41db-bb58-3363138fb060", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 08:21:53 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-17f82daa-1e4c-4ff0-95d9-f042fc822ffc req-acbd541a-73f9-43e8-97c9-45e432c8f5a2 service nova] Acquired lock "refresh_cache-d22eb02b-7e8d-4755-9f1e-3eee56ddec0c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:21:53 user nova-compute[95467]: DEBUG nova.network.neutron [req-17f82daa-1e4c-4ff0-95d9-f042fc822ffc req-acbd541a-73f9-43e8-97c9-45e432c8f5a2 service nova] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Refreshing network info cache for port 62cba8e1-074b-41db-bb58-3363138fb060 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:21:53 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Start _get_guest_xml network_info=[{"id": "62cba8e1-074b-41db-bb58-3363138fb060", "address": "fa:16:3e:e4:27:f3", "network": {"id": "439fd8f9-3cf0-449d-b7e1-eba4d33109f9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-399225774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7f46c4dc5bf438cad677a366bdd5b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62cba8e1-07", "ovs_interfaceid": "62cba8e1-074b-41db-bb58-3363138fb060", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'ed9c48aa-ce73-4b3b-9db1-235898be671b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:21:53 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:21:53 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:21:53 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:21:53 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:21:53 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:21:53 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:21:53 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:21:53 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:21:53 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:21:53 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:21:53 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:21:53 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:21:53 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:21:53 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:21:53 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:21:53 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:21:53 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:21:53 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:21:53 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:21:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-748321325',display_name='tempest-ServerActionsTestOtherB-server-748321325',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-748321325',id=37,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4fkN7k+peQ5MHRVAmSWsJ4XWACmBTaERqxpnxcsdjwMrROQbOXtjSL/x5jDo9fewvV0xuNQFNzIDf7IiXE/hxIrMO+qPlCpDl2ne6370CaB1c+V4MsUeGSWpmCOrmyfA==',key_name='tempest-keypair-1354708686',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7f46c4dc5bf438cad677a366bdd5b5f',ramdisk_id='',reservation_id='r-1rd2gc25',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-220421987',owner_user_name='tempest-ServerActionsTestOtherB-220421987-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:21:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53a0c2be5d1f4831961aa1cc29c4d46f',uuid=d22eb02b-7e8d-4755-9f1e-3eee56ddec0c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62cba8e1-074b-41db-bb58-3363138fb060", "address": "fa:16:3e:e4:27:f3", "network": {"id": "439fd8f9-3cf0-449d-b7e1-eba4d33109f9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-399225774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7f46c4dc5bf438cad677a366bdd5b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62cba8e1-07", "ovs_interfaceid": "62cba8e1-074b-41db-bb58-3363138fb060", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:21:53 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Converting VIF {"id": "62cba8e1-074b-41db-bb58-3363138fb060", "address": "fa:16:3e:e4:27:f3", "network": {"id": "439fd8f9-3cf0-449d-b7e1-eba4d33109f9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-399225774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7f46c4dc5bf438cad677a366bdd5b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62cba8e1-07", "ovs_interfaceid": "62cba8e1-074b-41db-bb58-3363138fb060", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:21:53 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:27:f3,bridge_name='br-int',has_traffic_filtering=True,id=62cba8e1-074b-41db-bb58-3363138fb060,network=Network(439fd8f9-3cf0-449d-b7e1-eba4d33109f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62cba8e1-07') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:21:53 user nova-compute[95467]: DEBUG nova.objects.instance [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Lazy-loading 'pci_devices' on Instance uuid d22eb02b-7e8d-4755-9f1e-3eee56ddec0c {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:21:53 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:21:53 user nova-compute[95467]:   <uuid>d22eb02b-7e8d-4755-9f1e-3eee56ddec0c</uuid>
Nov 15 08:21:53 user nova-compute[95467]:   <name>instance-00000025</name>
Nov 15 08:21:53 user nova-compute[95467]:   <memory>524288</memory>
Nov 15 08:21:53 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:21:53 user nova-compute[95467]:   <metadata>
Nov 15 08:21:53 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:21:53 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:21:53 user nova-compute[95467]:       <nova:name>tempest-ServerActionsTestOtherB-server-748321325</nova:name>
Nov 15 08:21:53 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:21:53</nova:creationTime>
Nov 15 08:21:53 user nova-compute[95467]:       <nova:flavor name="m1.tiny">
Nov 15 08:21:53 user nova-compute[95467]:         <nova:memory>512</nova:memory>
Nov 15 08:21:53 user nova-compute[95467]:         <nova:disk>1</nova:disk>
Nov 15 08:21:53 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:21:53 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:21:53 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:21:53 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:21:53 user nova-compute[95467]:       <nova:owner>
Nov 15 08:21:53 user nova-compute[95467]:         <nova:user uuid="53a0c2be5d1f4831961aa1cc29c4d46f">tempest-ServerActionsTestOtherB-220421987-project-member</nova:user>
Nov 15 08:21:53 user nova-compute[95467]:         <nova:project uuid="b7f46c4dc5bf438cad677a366bdd5b5f">tempest-ServerActionsTestOtherB-220421987</nova:project>
Nov 15 08:21:53 user nova-compute[95467]:       </nova:owner>
Nov 15 08:21:53 user nova-compute[95467]:       <nova:root type="image" uuid="ed9c48aa-ce73-4b3b-9db1-235898be671b"/>
Nov 15 08:21:53 user nova-compute[95467]:       <nova:ports>
Nov 15 08:21:53 user nova-compute[95467]:         <nova:port uuid="62cba8e1-074b-41db-bb58-3363138fb060">
Nov 15 08:21:53 user nova-compute[95467]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 15 08:21:53 user nova-compute[95467]:         </nova:port>
Nov 15 08:21:53 user nova-compute[95467]:       </nova:ports>
Nov 15 08:21:53 user nova-compute[95467]:     </nova:instance>
Nov 15 08:21:53 user nova-compute[95467]:   </metadata>
Nov 15 08:21:53 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:21:53 user nova-compute[95467]:     <system>
Nov 15 08:21:53 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:21:53 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:21:53 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:21:53 user nova-compute[95467]:       <entry name="serial">d22eb02b-7e8d-4755-9f1e-3eee56ddec0c</entry>
Nov 15 08:21:53 user nova-compute[95467]:       <entry name="uuid">d22eb02b-7e8d-4755-9f1e-3eee56ddec0c</entry>
Nov 15 08:21:53 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:21:53 user nova-compute[95467]:     </system>
Nov 15 08:21:53 user nova-compute[95467]:   </sysinfo>
Nov 15 08:21:53 user nova-compute[95467]:   <os>
Nov 15 08:21:53 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:21:53 user nova-compute[95467]:     <boot dev="hd"/>
Nov 15 08:21:53 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:21:53 user nova-compute[95467]:   </os>
Nov 15 08:21:53 user nova-compute[95467]:   <features>
Nov 15 08:21:53 user nova-compute[95467]:     <acpi/>
Nov 15 08:21:53 user nova-compute[95467]:     <apic/>
Nov 15 08:21:53 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:21:53 user nova-compute[95467]:   </features>
Nov 15 08:21:53 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:21:53 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:21:53 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:21:53 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:21:53 user nova-compute[95467]:   </clock>
Nov 15 08:21:53 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:21:53 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:21:53 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:21:53 user nova-compute[95467]:   </cpu>
Nov 15 08:21:53 user nova-compute[95467]:   <devices>
Nov 15 08:21:53 user nova-compute[95467]:     <disk type="file" device="disk">
Nov 15 08:21:53 user nova-compute[95467]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 08:21:53 user nova-compute[95467]:       <source file="/opt/stack/data/nova/instances/d22eb02b-7e8d-4755-9f1e-3eee56ddec0c/disk"/>
Nov 15 08:21:53 user nova-compute[95467]:       <target dev="vda" bus="virtio"/>
Nov 15 08:21:53 user nova-compute[95467]:     </disk>
Nov 15 08:21:53 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:21:53 user nova-compute[95467]:       <mac address="fa:16:3e:e4:27:f3"/>
Nov 15 08:21:53 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:21:53 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:21:53 user nova-compute[95467]:       <target dev="tap62cba8e1-07"/>
Nov 15 08:21:53 user nova-compute[95467]:     </interface>
Nov 15 08:21:53 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:21:53 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/d22eb02b-7e8d-4755-9f1e-3eee56ddec0c/console.log" append="off"/>
Nov 15 08:21:53 user nova-compute[95467]:     </serial>
Nov 15 08:21:53 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:21:53 user nova-compute[95467]:     <video>
Nov 15 08:21:53 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:21:53 user nova-compute[95467]:     </video>
Nov 15 08:21:53 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:21:53 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:21:53 user nova-compute[95467]:     </rng>
Nov 15 08:21:53 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:21:53 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:21:53 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:21:53 user nova-compute[95467]:     </memballoon>
Nov 15 08:21:53 user nova-compute[95467]:   </devices>
Nov 15 08:21:53 user nova-compute[95467]: </domain>
Nov 15 08:21:53 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:21:53 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:21:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-748321325',display_name='tempest-ServerActionsTestOtherB-server-748321325',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-748321325',id=37,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4fkN7k+peQ5MHRVAmSWsJ4XWACmBTaERqxpnxcsdjwMrROQbOXtjSL/x5jDo9fewvV0xuNQFNzIDf7IiXE/hxIrMO+qPlCpDl2ne6370CaB1c+V4MsUeGSWpmCOrmyfA==',key_name='tempest-keypair-1354708686',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7f46c4dc5bf438cad677a366bdd5b5f',ramdisk_id='',reservation_id='r-1rd2gc25',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-220421987',owner_user_name='tempest-ServerActionsTestOtherB-220421987-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:21:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53a0c2be5d1f4831961aa1cc29c4d46f',uuid=d22eb02b-7e8d-4755-9f1e-3eee56ddec0c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62cba8e1-074b-41db-bb58-3363138fb060", "address": "fa:16:3e:e4:27:f3", "network": {"id": "439fd8f9-3cf0-449d-b7e1-eba4d33109f9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-399225774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7f46c4dc5bf438cad677a366bdd5b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62cba8e1-07", "ovs_interfaceid": "62cba8e1-074b-41db-bb58-3363138fb060", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:21:53 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Converting VIF {"id": "62cba8e1-074b-41db-bb58-3363138fb060", "address": "fa:16:3e:e4:27:f3", "network": {"id": "439fd8f9-3cf0-449d-b7e1-eba4d33109f9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-399225774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7f46c4dc5bf438cad677a366bdd5b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62cba8e1-07", "ovs_interfaceid": "62cba8e1-074b-41db-bb58-3363138fb060", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:21:53 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:27:f3,bridge_name='br-int',has_traffic_filtering=True,id=62cba8e1-074b-41db-bb58-3363138fb060,network=Network(439fd8f9-3cf0-449d-b7e1-eba4d33109f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62cba8e1-07') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:21:53 user nova-compute[95467]: DEBUG os_vif [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:27:f3,bridge_name='br-int',has_traffic_filtering=True,id=62cba8e1-074b-41db-bb58-3363138fb060,network=Network(439fd8f9-3cf0-449d-b7e1-eba4d33109f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62cba8e1-07') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:21:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:21:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:21:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f5d761f3-0679-5756-b53a-16721bb0b0f8', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:21:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:21:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap62cba8e1-07, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:21:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap62cba8e1-07, col_values=(('qos', UUID('d88d175b-3ff7-43b0-a796-76d7ae4c1435')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:21:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap62cba8e1-07, col_values=(('external_ids', {'iface-id': '62cba8e1-074b-41db-bb58-3363138fb060', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:27:f3', 'vm-uuid': 'd22eb02b-7e8d-4755-9f1e-3eee56ddec0c'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:21:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:21:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:53 user nova-compute[95467]: INFO os_vif [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:27:f3,bridge_name='br-int',has_traffic_filtering=True,id=62cba8e1-074b-41db-bb58-3363138fb060,network=Network(439fd8f9-3cf0-449d-b7e1-eba4d33109f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62cba8e1-07')
Nov 15 08:21:53 user nova-compute[95467]: DEBUG nova.compute.manager [req-d1107bfe-a0be-4c87-8f0d-8bba8902b0c2 req-84f30db0-3236-4d2c-b1cb-e62f97dacb3b service nova] [instance: ebe2f1ec-c90b-4c48-90db-4ff0ec541a1a] Received event network-vif-deleted-e998bcd4-3b5b-4cb1-9b31-7b44f124f51f {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:21:53 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:21:53 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] No VIF found with MAC fa:16:3e:e4:27:f3, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:21:53 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Updating instance_info_cache with network_info: [{"id": "1436eae1-0899-4fc5-8bbe-575fa2c70d42", "address": "fa:16:3e:08:e7:36", "network": {"id": "369d2a6f-60b7-4c92-8b2d-1f3828f6698b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1491709218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd281be4e94a4d31a47a13267d51d9b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1436eae1-08", "ovs_interfaceid": "1436eae1-0899-4fc5-8bbe-575fa2c70d42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:21:53 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Releasing lock "refresh_cache-b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:21:53 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Updated the network info_cache for instance {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 08:21:53 user nova-compute[95467]: DEBUG nova.network.neutron [req-17f82daa-1e4c-4ff0-95d9-f042fc822ffc req-acbd541a-73f9-43e8-97c9-45e432c8f5a2 service nova] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Updated VIF entry in instance network info cache for port 62cba8e1-074b-41db-bb58-3363138fb060. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:21:53 user nova-compute[95467]: DEBUG nova.network.neutron [req-17f82daa-1e4c-4ff0-95d9-f042fc822ffc req-acbd541a-73f9-43e8-97c9-45e432c8f5a2 service nova] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Updating instance_info_cache with network_info: [{"id": "62cba8e1-074b-41db-bb58-3363138fb060", "address": "fa:16:3e:e4:27:f3", "network": {"id": "439fd8f9-3cf0-449d-b7e1-eba4d33109f9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-399225774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7f46c4dc5bf438cad677a366bdd5b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62cba8e1-07", "ovs_interfaceid": "62cba8e1-074b-41db-bb58-3363138fb060", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:21:53 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-17f82daa-1e4c-4ff0-95d9-f042fc822ffc req-acbd541a-73f9-43e8-97c9-45e432c8f5a2 service nova] Releasing lock "refresh_cache-d22eb02b-7e8d-4755-9f1e-3eee56ddec0c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:21:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:55 user nova-compute[95467]: DEBUG nova.compute.manager [req-85a92c2f-5ccb-4538-9a20-6e11b5a3b969 req-f72820b7-3b19-4a0a-a1bd-03bac1614133 service nova] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Received event network-vif-plugged-62cba8e1-074b-41db-bb58-3363138fb060 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:21:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-85a92c2f-5ccb-4538-9a20-6e11b5a3b969 req-f72820b7-3b19-4a0a-a1bd-03bac1614133 service nova] Acquiring lock "d22eb02b-7e8d-4755-9f1e-3eee56ddec0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:21:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-85a92c2f-5ccb-4538-9a20-6e11b5a3b969 req-f72820b7-3b19-4a0a-a1bd-03bac1614133 service nova] Lock "d22eb02b-7e8d-4755-9f1e-3eee56ddec0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:21:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-85a92c2f-5ccb-4538-9a20-6e11b5a3b969 req-f72820b7-3b19-4a0a-a1bd-03bac1614133 service nova] Lock "d22eb02b-7e8d-4755-9f1e-3eee56ddec0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:21:55 user nova-compute[95467]: DEBUG nova.compute.manager [req-85a92c2f-5ccb-4538-9a20-6e11b5a3b969 req-f72820b7-3b19-4a0a-a1bd-03bac1614133 service nova] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] No waiting events found dispatching network-vif-plugged-62cba8e1-074b-41db-bb58-3363138fb060 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:21:55 user nova-compute[95467]: WARNING nova.compute.manager [req-85a92c2f-5ccb-4538-9a20-6e11b5a3b969 req-f72820b7-3b19-4a0a-a1bd-03bac1614133 service nova] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Received unexpected event network-vif-plugged-62cba8e1-074b-41db-bb58-3363138fb060 for instance with vm_state building and task_state spawning.
Nov 15 08:21:55 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:55 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:55 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:55 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:55 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0375edea-3561-473b-bff0-6f6006fddcd3 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Acquiring lock "a1a155e6-0ee2-4728-a526-17c149107ab0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:21:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0375edea-3561-473b-bff0-6f6006fddcd3 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lock "a1a155e6-0ee2-4728-a526-17c149107ab0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:21:55 user nova-compute[95467]: INFO nova.compute.manager [None req-0375edea-3561-473b-bff0-6f6006fddcd3 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Detaching volume 7bd52f6c-f10a-491b-a827-97d3400abb54
Nov 15 08:21:55 user nova-compute[95467]: INFO nova.virt.block_device [None req-0375edea-3561-473b-bff0-6f6006fddcd3 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Attempting to driver detach volume 7bd52f6c-f10a-491b-a827-97d3400abb54 from mountpoint /dev/vdb
Nov 15 08:21:55 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-0375edea-3561-473b-bff0-6f6006fddcd3 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Attempting to detach device vdb from instance a1a155e6-0ee2-4728-a526-17c149107ab0 from the persistent domain config. {{(pid=95467) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 08:21:55 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-0375edea-3561-473b-bff0-6f6006fddcd3 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 08:21:55 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:21:55 user nova-compute[95467]:   <source dev="/dev/sde"/>
Nov 15 08:21:55 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:21:55 user nova-compute[95467]:   <serial>7bd52f6c-f10a-491b-a827-97d3400abb54</serial>
Nov 15 08:21:55 user nova-compute[95467]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 08:21:55 user nova-compute[95467]: </disk>
Nov 15 08:21:55 user nova-compute[95467]:  {{(pid=95467) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 08:21:55 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-0375edea-3561-473b-bff0-6f6006fddcd3 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Successfully detached device vdb from instance a1a155e6-0ee2-4728-a526-17c149107ab0 from the persistent domain config.
Nov 15 08:21:55 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-0375edea-3561-473b-bff0-6f6006fddcd3 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a1a155e6-0ee2-4728-a526-17c149107ab0 from the live domain config. {{(pid=95467) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 08:21:55 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-0375edea-3561-473b-bff0-6f6006fddcd3 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 08:21:55 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:21:55 user nova-compute[95467]:   <source dev="/dev/sde"/>
Nov 15 08:21:55 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:21:55 user nova-compute[95467]:   <serial>7bd52f6c-f10a-491b-a827-97d3400abb54</serial>
Nov 15 08:21:55 user nova-compute[95467]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 08:21:55 user nova-compute[95467]: </disk>
Nov 15 08:21:55 user nova-compute[95467]:  {{(pid=95467) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 08:21:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-0375edea-3561-473b-bff0-6f6006fddcd3 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a1a155e6-0ee2-4728-a526-17c149107ab0 {{(pid=95467) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 08:21:56 user nova-compute[95467]: DEBUG nova.compute.manager [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Instance event wait completed in 0 seconds for  {{(pid=95467) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 08:21:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Guest created on hypervisor {{(pid=95467) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 08:21:56 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Instance spawned successfully.
Nov 15 08:21:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 08:21:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Found default for hw_cdrom_bus of ide {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:21:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Found default for hw_disk_bus of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:21:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Found default for hw_input_bus of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:21:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Found default for hw_pointer_model of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:21:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Found default for hw_video_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:21:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Found default for hw_vif_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:21:56 user nova-compute[95467]: INFO nova.compute.manager [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Took 5.80 seconds to spawn the instance on the hypervisor.
Nov 15 08:21:56 user nova-compute[95467]: DEBUG nova.compute.manager [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:21:57 user nova-compute[95467]: INFO nova.compute.manager [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Took 7.63 seconds to build instance.
Nov 15 08:21:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8e28d2e8-797a-49c9-a059-a53f61fee9a1 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Lock "d22eb02b-7e8d-4755-9f1e-3eee56ddec0c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.502s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:21:57 user nova-compute[95467]: DEBUG nova.compute.manager [req-52e34a96-32df-4b3e-8761-a3324093ae89 req-9d8b988b-f097-4051-bf8e-1d4ebd3052f6 service nova] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Received event network-vif-plugged-62cba8e1-074b-41db-bb58-3363138fb060 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:21:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-52e34a96-32df-4b3e-8761-a3324093ae89 req-9d8b988b-f097-4051-bf8e-1d4ebd3052f6 service nova] Acquiring lock "d22eb02b-7e8d-4755-9f1e-3eee56ddec0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:21:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-52e34a96-32df-4b3e-8761-a3324093ae89 req-9d8b988b-f097-4051-bf8e-1d4ebd3052f6 service nova] Lock "d22eb02b-7e8d-4755-9f1e-3eee56ddec0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:21:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-52e34a96-32df-4b3e-8761-a3324093ae89 req-9d8b988b-f097-4051-bf8e-1d4ebd3052f6 service nova] Lock "d22eb02b-7e8d-4755-9f1e-3eee56ddec0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:21:57 user nova-compute[95467]: DEBUG nova.compute.manager [req-52e34a96-32df-4b3e-8761-a3324093ae89 req-9d8b988b-f097-4051-bf8e-1d4ebd3052f6 service nova] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] No waiting events found dispatching network-vif-plugged-62cba8e1-074b-41db-bb58-3363138fb060 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:21:57 user nova-compute[95467]: WARNING nova.compute.manager [req-52e34a96-32df-4b3e-8761-a3324093ae89 req-9d8b988b-f097-4051-bf8e-1d4ebd3052f6 service nova] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Received unexpected event network-vif-plugged-62cba8e1-074b-41db-bb58-3363138fb060 for instance with vm_state active and task_state None.
Nov 15 08:21:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:21:59 user nova-compute[95467]: DEBUG nova.compute.manager [req-793679b0-5410-42f4-90f4-7f16919f9eb8 req-ce733293-9af5-40e3-bf04-df9b18cfff84 service nova] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Received event network-changed-93a4c2ed-b2a8-471c-8173-d221f7251e8b {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:21:59 user nova-compute[95467]: DEBUG nova.compute.manager [req-793679b0-5410-42f4-90f4-7f16919f9eb8 req-ce733293-9af5-40e3-bf04-df9b18cfff84 service nova] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Refreshing instance network info cache due to event network-changed-93a4c2ed-b2a8-471c-8173-d221f7251e8b. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:21:59 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-793679b0-5410-42f4-90f4-7f16919f9eb8 req-ce733293-9af5-40e3-bf04-df9b18cfff84 service nova] Acquiring lock "refresh_cache-6a551521-28cf-4b4e-94e8-5f5ecc0c37f7" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:21:59 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-793679b0-5410-42f4-90f4-7f16919f9eb8 req-ce733293-9af5-40e3-bf04-df9b18cfff84 service nova] Acquired lock "refresh_cache-6a551521-28cf-4b4e-94e8-5f5ecc0c37f7" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:21:59 user nova-compute[95467]: DEBUG nova.network.neutron [req-793679b0-5410-42f4-90f4-7f16919f9eb8 req-ce733293-9af5-40e3-bf04-df9b18cfff84 service nova] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Refreshing network info cache for port 93a4c2ed-b2a8-471c-8173-d221f7251e8b {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:21:59 user nova-compute[95467]: DEBUG nova.network.neutron [req-793679b0-5410-42f4-90f4-7f16919f9eb8 req-ce733293-9af5-40e3-bf04-df9b18cfff84 service nova] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Updated VIF entry in instance network info cache for port 93a4c2ed-b2a8-471c-8173-d221f7251e8b. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:21:59 user nova-compute[95467]: DEBUG nova.network.neutron [req-793679b0-5410-42f4-90f4-7f16919f9eb8 req-ce733293-9af5-40e3-bf04-df9b18cfff84 service nova] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Updating instance_info_cache with network_info: [{"id": "93a4c2ed-b2a8-471c-8173-d221f7251e8b", "address": "fa:16:3e:9b:81:50", "network": {"id": "44a920f2-9a44-480e-bbd4-82afd3303a7f", "bridge": "br-int", "label": "tempest-TestShelveInstance-57422602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7182b78b65480eb2e51db102fd9c2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93a4c2ed-b2", "ovs_interfaceid": "93a4c2ed-b2a8-471c-8173-d221f7251e8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:21:59 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-793679b0-5410-42f4-90f4-7f16919f9eb8 req-ce733293-9af5-40e3-bf04-df9b18cfff84 service nova] Releasing lock "refresh_cache-6a551521-28cf-4b4e-94e8-5f5ecc0c37f7" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:22:00 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4408481c-77c3-4d2d-9d3e-25330e63a501 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Acquiring lock "6a551521-28cf-4b4e-94e8-5f5ecc0c37f7" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:22:00 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4408481c-77c3-4d2d-9d3e-25330e63a501 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Lock "6a551521-28cf-4b4e-94e8-5f5ecc0c37f7" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:22:00 user nova-compute[95467]: INFO nova.compute.manager [None req-4408481c-77c3-4d2d-9d3e-25330e63a501 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Shelve offloading
Nov 15 08:22:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:22:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:22:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:22:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:22:00 user nova-compute[95467]: DEBUG nova.compute.manager [req-8e8110d4-e2f4-4cf6-941f-5ccffb196de5 req-6cd31093-2d46-4fd0-99e1-c44533726cec service nova] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Received event network-vif-unplugged-93a4c2ed-b2a8-471c-8173-d221f7251e8b {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:22:00 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-8e8110d4-e2f4-4cf6-941f-5ccffb196de5 req-6cd31093-2d46-4fd0-99e1-c44533726cec service nova] Acquiring lock "6a551521-28cf-4b4e-94e8-5f5ecc0c37f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:22:00 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-8e8110d4-e2f4-4cf6-941f-5ccffb196de5 req-6cd31093-2d46-4fd0-99e1-c44533726cec service nova] Lock "6a551521-28cf-4b4e-94e8-5f5ecc0c37f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:22:00 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-8e8110d4-e2f4-4cf6-941f-5ccffb196de5 req-6cd31093-2d46-4fd0-99e1-c44533726cec service nova] Lock "6a551521-28cf-4b4e-94e8-5f5ecc0c37f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:22:00 user nova-compute[95467]: DEBUG nova.compute.manager [req-8e8110d4-e2f4-4cf6-941f-5ccffb196de5 req-6cd31093-2d46-4fd0-99e1-c44533726cec service nova] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] No waiting events found dispatching network-vif-unplugged-93a4c2ed-b2a8-471c-8173-d221f7251e8b {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:22:00 user nova-compute[95467]: WARNING nova.compute.manager [req-8e8110d4-e2f4-4cf6-941f-5ccffb196de5 req-6cd31093-2d46-4fd0-99e1-c44533726cec service nova] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Received unexpected event network-vif-unplugged-93a4c2ed-b2a8-471c-8173-d221f7251e8b for instance with vm_state active and task_state shelving.
Nov 15 08:22:01 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Instance destroyed successfully.
Nov 15 08:22:01 user nova-compute[95467]: DEBUG nova.compute.manager [None req-4408481c-77c3-4d2d-9d3e-25330e63a501 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:22:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4408481c-77c3-4d2d-9d3e-25330e63a501 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Acquiring lock "refresh_cache-6a551521-28cf-4b4e-94e8-5f5ecc0c37f7" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:22:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4408481c-77c3-4d2d-9d3e-25330e63a501 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Acquired lock "refresh_cache-6a551521-28cf-4b4e-94e8-5f5ecc0c37f7" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:22:01 user nova-compute[95467]: DEBUG nova.network.neutron [None req-4408481c-77c3-4d2d-9d3e-25330e63a501 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:22:01 user nova-compute[95467]: DEBUG nova.compute.manager [req-af590af9-75d3-45c5-afdc-fa6a0d63c6dd req-4160189f-fcb2-4d59-9512-9bd339372e57 service nova] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] Received event network-changed-0469b401-fc62-46e8-bdd0-b00f131d4821 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:22:01 user nova-compute[95467]: DEBUG nova.compute.manager [req-af590af9-75d3-45c5-afdc-fa6a0d63c6dd req-4160189f-fcb2-4d59-9512-9bd339372e57 service nova] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] Refreshing instance network info cache due to event network-changed-0469b401-fc62-46e8-bdd0-b00f131d4821. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:22:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-af590af9-75d3-45c5-afdc-fa6a0d63c6dd req-4160189f-fcb2-4d59-9512-9bd339372e57 service nova] Acquiring lock "refresh_cache-0edcb81b-d8fe-482c-a7ca-6b76455cfe33" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:22:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-af590af9-75d3-45c5-afdc-fa6a0d63c6dd req-4160189f-fcb2-4d59-9512-9bd339372e57 service nova] Acquired lock "refresh_cache-0edcb81b-d8fe-482c-a7ca-6b76455cfe33" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:22:01 user nova-compute[95467]: DEBUG nova.network.neutron [req-af590af9-75d3-45c5-afdc-fa6a0d63c6dd req-4160189f-fcb2-4d59-9512-9bd339372e57 service nova] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] Refreshing network info cache for port 0469b401-fc62-46e8-bdd0-b00f131d4821 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:22:01 user nova-compute[95467]: DEBUG nova.network.neutron [None req-4408481c-77c3-4d2d-9d3e-25330e63a501 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Updating instance_info_cache with network_info: [{"id": "93a4c2ed-b2a8-471c-8173-d221f7251e8b", "address": "fa:16:3e:9b:81:50", "network": {"id": "44a920f2-9a44-480e-bbd4-82afd3303a7f", "bridge": "br-int", "label": "tempest-TestShelveInstance-57422602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7182b78b65480eb2e51db102fd9c2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93a4c2ed-b2", "ovs_interfaceid": "93a4c2ed-b2a8-471c-8173-d221f7251e8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:22:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4408481c-77c3-4d2d-9d3e-25330e63a501 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Releasing lock "refresh_cache-6a551521-28cf-4b4e-94e8-5f5ecc0c37f7" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG nova.network.neutron [req-af590af9-75d3-45c5-afdc-fa6a0d63c6dd req-4160189f-fcb2-4d59-9512-9bd339372e57 service nova] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] Updated VIF entry in instance network info cache for port 0469b401-fc62-46e8-bdd0-b00f131d4821. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG nova.network.neutron [req-af590af9-75d3-45c5-afdc-fa6a0d63c6dd req-4160189f-fcb2-4d59-9512-9bd339372e57 service nova] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] Updating instance_info_cache with network_info: [{"id": "0469b401-fc62-46e8-bdd0-b00f131d4821", "address": "fa:16:3e:7d:e4:86", "network": {"id": "27fd2b0f-65bd-4ae4-b5c8-dfca91668078", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1310727750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50e2fec6a90a41a5a586c6da227caacc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0469b401-fc", "ovs_interfaceid": "0469b401-fc62-46e8-bdd0-b00f131d4821", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-af590af9-75d3-45c5-afdc-fa6a0d63c6dd req-4160189f-fcb2-4d59-9512-9bd339372e57 service nova] Releasing lock "refresh_cache-0edcb81b-d8fe-482c-a7ca-6b76455cfe33" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:22:02 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Instance destroyed successfully.
Nov 15 08:22:02 user nova-compute[95467]: DEBUG nova.objects.instance [None req-4408481c-77c3-4d2d-9d3e-25330e63a501 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Lazy-loading 'resources' on Instance uuid 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-4408481c-77c3-4d2d-9d3e-25330e63a501 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:20:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-177934737',display_name='tempest-TestShelveInstance-server-177934737',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-177934737',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJC4LZpX54Ka4CeYP7mgSTaMm2Q0taurdpd9b7can1Ul1AsTpY2sRQ536DDEYxtxG0i1vSLR8KRvCVHbBH9pBlB10+jQxss4INx8+NUQcLORFtrp/d3ty3KPezfHsZOFw==',key_name='tempest-TestShelveInstance-347903963',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:20:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dd7182b78b65480eb2e51db102fd9c2d',ramdisk_id='',reservation_id='r-8qvr6rl5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-668674769',owner_user_name='tempest-TestShelveInstance-668674769-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:20:19Z,user_data=None,user_id='354af2d9fe0e4fa4be1d9b851773e8d9',uuid=6a551521-28cf-4b4e-94e8-5f5ecc0c37f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "93a4c2ed-b2a8-471c-8173-d221f7251e8b", "address": "fa:16:3e:9b:81:50", "network": {"id": "44a920f2-9a44-480e-bbd4-82afd3303a7f", "bridge": "br-int", "label": "tempest-TestShelveInstance-57422602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7182b78b65480eb2e51db102fd9c2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93a4c2ed-b2", "ovs_interfaceid": "93a4c2ed-b2a8-471c-8173-d221f7251e8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-4408481c-77c3-4d2d-9d3e-25330e63a501 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Converting VIF {"id": "93a4c2ed-b2a8-471c-8173-d221f7251e8b", "address": "fa:16:3e:9b:81:50", "network": {"id": "44a920f2-9a44-480e-bbd4-82afd3303a7f", "bridge": "br-int", "label": "tempest-TestShelveInstance-57422602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7182b78b65480eb2e51db102fd9c2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93a4c2ed-b2", "ovs_interfaceid": "93a4c2ed-b2a8-471c-8173-d221f7251e8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-4408481c-77c3-4d2d-9d3e-25330e63a501 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:81:50,bridge_name='br-int',has_traffic_filtering=True,id=93a4c2ed-b2a8-471c-8173-d221f7251e8b,network=Network(44a920f2-9a44-480e-bbd4-82afd3303a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93a4c2ed-b2') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG os_vif [None req-4408481c-77c3-4d2d-9d3e-25330e63a501 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:81:50,bridge_name='br-int',has_traffic_filtering=True,id=93a4c2ed-b2a8-471c-8173-d221f7251e8b,network=Network(44a920f2-9a44-480e-bbd4-82afd3303a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93a4c2ed-b2') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap93a4c2ed-b2, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e0a29230-7af4-4dd4-8f1b-034c7e253d54) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:22:02 user nova-compute[95467]: INFO os_vif [None req-4408481c-77c3-4d2d-9d3e-25330e63a501 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:81:50,bridge_name='br-int',has_traffic_filtering=True,id=93a4c2ed-b2a8-471c-8173-d221f7251e8b,network=Network(44a920f2-9a44-480e-bbd4-82afd3303a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93a4c2ed-b2')
Nov 15 08:22:02 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4408481c-77c3-4d2d-9d3e-25330e63a501 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] calling os-brick to detach iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-4408481c-77c3-4d2d-9d3e-25330e63a501 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, {'target_iqn': 'iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yDMrVtcn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:22:02 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-4408481c-77c3-4d2d-9d3e-25330e63a501 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:22:02 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-4408481c-77c3-4d2d-9d3e-25330e63a501 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-4408481c-77c3-4d2d-9d3e-25330e63a501 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6a8942-8072-4301-8e78-1fb301d73238]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-4408481c-77c3-4d2d-9d3e-25330e63a501 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 08:22:02 user nova-compute[95467]: No targets found.
Nov 15 08:22:02 user nova-compute[95467]: iSNS:
Nov 15 08:22:02 user nova-compute[95467]: No targets found.
Nov 15 08:22:02 user nova-compute[95467]: STATIC:
Nov 15 08:22:02 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e
Nov 15 08:22:02 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:22:02 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:22:02 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775
Nov 15 08:22:02 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:22:02 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:22:02 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54
Nov 15 08:22:02 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:22:02 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:22:02 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400
Nov 15 08:22:02 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:22:02 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:22:02 user nova-compute[95467]: FIRMWARE:
Nov 15 08:22:02 user nova-compute[95467]: No targets found.
Nov 15 08:22:02 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-4408481c-77c3-4d2d-9d3e-25330e63a501 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 08:22:02 user nova-compute[95467]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 08:22:02 user nova-compute[95467]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=95467) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-4408481c-77c3-4d2d-9d3e-25330e63a501 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775', 0)] {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0688607-396f-4504-9359-890565114ea2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7e639a-3f9a-48fb-a2d0-b783d82e6a18]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-4408481c-77c3-4d2d-9d3e-25330e63a501 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:22:02 user nova-compute[95467]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:22:02 user nova-compute[95467]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:22:02 user nova-compute[95467]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54 (non-flash)
Nov 15 08:22:02 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-4408481c-77c3-4d2d-9d3e-25330e63a501 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:22:02 user nova-compute[95467]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:22:02 user nova-compute[95467]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:22:02 user nova-compute[95467]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54 (non-flash)
Nov 15 08:22:02 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-4408481c-77c3-4d2d-9d3e-25330e63a501 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efec83077f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775'): ({'sdi'}, set())}) {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-4408481c-77c3-4d2d-9d3e-25330e63a501 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Removing single pathed devices sdi {{(pid=95467) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[476d315c-90c1-4879-b3d2-5fdc81811b8f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3cc8632-b9ce-44b5-91d7-772987883623]: (4, ('ok\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-4408481c-77c3-4d2d-9d3e-25330e63a501 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Flushing IO for device /dev/sdi {{(pid=95467) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[98912c55-c52b-4df2-b340-3a0f8943bd12]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-4408481c-77c3-4d2d-9d3e-25330e63a501 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=95467) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.054s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[17055d44-33fd-49c1-9a24-dfd33e845f21]: (4, ('1', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-4408481c-77c3-4d2d-9d3e-25330e63a501 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-4408481c-77c3-4d2d-9d3e-25330e63a501 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] SCSI volumes sdi have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-4408481c-77c3-4d2d-9d3e-25330e63a501 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775')] {{(pid=95467) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca83fd4-f842-41a3-b798-8ad6b09a6353]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-4408481c-77c3-4d2d-9d3e-25330e63a501 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 -p 172.16.0.220:3260 --logout {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG nova.compute.manager [req-3d5d47cc-c5ef-47c5-a3e4-0615993ee45e req-5d920c87-be48-4d92-86ad-5bb66caebf71 service nova] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Received event network-vif-plugged-93a4c2ed-b2a8-471c-8173-d221f7251e8b {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-3d5d47cc-c5ef-47c5-a3e4-0615993ee45e req-5d920c87-be48-4d92-86ad-5bb66caebf71 service nova] Acquiring lock "6a551521-28cf-4b4e-94e8-5f5ecc0c37f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-3d5d47cc-c5ef-47c5-a3e4-0615993ee45e req-5d920c87-be48-4d92-86ad-5bb66caebf71 service nova] Lock "6a551521-28cf-4b4e-94e8-5f5ecc0c37f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-3d5d47cc-c5ef-47c5-a3e4-0615993ee45e req-5d920c87-be48-4d92-86ad-5bb66caebf71 service nova] Lock "6a551521-28cf-4b4e-94e8-5f5ecc0c37f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG nova.compute.manager [req-3d5d47cc-c5ef-47c5-a3e4-0615993ee45e req-5d920c87-be48-4d92-86ad-5bb66caebf71 service nova] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] No waiting events found dispatching network-vif-plugged-93a4c2ed-b2a8-471c-8173-d221f7251e8b {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:22:02 user nova-compute[95467]: WARNING nova.compute.manager [req-3d5d47cc-c5ef-47c5-a3e4-0615993ee45e req-5d920c87-be48-4d92-86ad-5bb66caebf71 service nova] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Received unexpected event network-vif-plugged-93a4c2ed-b2a8-471c-8173-d221f7251e8b for instance with vm_state active and task_state shelving.
Nov 15 08:22:02 user nova-compute[95467]: DEBUG nova.compute.manager [req-3d5d47cc-c5ef-47c5-a3e4-0615993ee45e req-5d920c87-be48-4d92-86ad-5bb66caebf71 service nova] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Received event network-changed-93a4c2ed-b2a8-471c-8173-d221f7251e8b {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG nova.compute.manager [req-3d5d47cc-c5ef-47c5-a3e4-0615993ee45e req-5d920c87-be48-4d92-86ad-5bb66caebf71 service nova] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Refreshing instance network info cache due to event network-changed-93a4c2ed-b2a8-471c-8173-d221f7251e8b. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-3d5d47cc-c5ef-47c5-a3e4-0615993ee45e req-5d920c87-be48-4d92-86ad-5bb66caebf71 service nova] Acquiring lock "refresh_cache-6a551521-28cf-4b4e-94e8-5f5ecc0c37f7" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-3d5d47cc-c5ef-47c5-a3e4-0615993ee45e req-5d920c87-be48-4d92-86ad-5bb66caebf71 service nova] Acquired lock "refresh_cache-6a551521-28cf-4b4e-94e8-5f5ecc0c37f7" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG nova.network.neutron [req-3d5d47cc-c5ef-47c5-a3e4-0615993ee45e req-5d920c87-be48-4d92-86ad-5bb66caebf71 service nova] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Refreshing network info cache for port 93a4c2ed-b2a8-471c-8173-d221f7251e8b {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[71cc1703-6674-4aeb-9adc-64d7f3971b54]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-4408481c-77c3-4d2d-9d3e-25330e63a501 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775, portal: 172.16.0.220,3260]
Nov 15 08:22:02 user nova-compute[95467]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775, portal: 172.16.0.220,3260] successful.
Nov 15 08:22:02 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 -p 172.16.0.220:3260 --op delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c6c847-c8e4-4fd4-9572-d93c33a01997]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-4408481c-77c3-4d2d-9d3e-25330e63a501 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-4408481c-77c3-4d2d-9d3e-25330e63a501 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-4408481c-77c3-4d2d-9d3e-25330e63a501 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] <== disconnect_volume: return (355ms) None {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:22:02 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4408481c-77c3-4d2d-9d3e-25330e63a501 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Disconnected iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 08:22:02 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-4408481c-77c3-4d2d-9d3e-25330e63a501 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Deleting instance files /opt/stack/data/nova/instances/6a551521-28cf-4b4e-94e8-5f5ecc0c37f7_del
Nov 15 08:22:02 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-4408481c-77c3-4d2d-9d3e-25330e63a501 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Deletion of /opt/stack/data/nova/instances/6a551521-28cf-4b4e-94e8-5f5ecc0c37f7_del complete
Nov 15 08:22:03 user nova-compute[95467]: DEBUG nova.network.neutron [req-3d5d47cc-c5ef-47c5-a3e4-0615993ee45e req-5d920c87-be48-4d92-86ad-5bb66caebf71 service nova] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Updated VIF entry in instance network info cache for port 93a4c2ed-b2a8-471c-8173-d221f7251e8b. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:22:03 user nova-compute[95467]: DEBUG nova.network.neutron [req-3d5d47cc-c5ef-47c5-a3e4-0615993ee45e req-5d920c87-be48-4d92-86ad-5bb66caebf71 service nova] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Updating instance_info_cache with network_info: [{"id": "93a4c2ed-b2a8-471c-8173-d221f7251e8b", "address": "fa:16:3e:9b:81:50", "network": {"id": "44a920f2-9a44-480e-bbd4-82afd3303a7f", "bridge": null, "label": "tempest-TestShelveInstance-57422602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7182b78b65480eb2e51db102fd9c2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap93a4c2ed-b2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:22:03 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-3d5d47cc-c5ef-47c5-a3e4-0615993ee45e req-5d920c87-be48-4d92-86ad-5bb66caebf71 service nova] Releasing lock "refresh_cache-6a551521-28cf-4b4e-94e8-5f5ecc0c37f7" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:22:03 user nova-compute[95467]: INFO nova.scheduler.client.report [None req-4408481c-77c3-4d2d-9d3e-25330e63a501 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Deleted allocations for instance 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7
Nov 15 08:22:03 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4408481c-77c3-4d2d-9d3e-25330e63a501 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:22:03 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4408481c-77c3-4d2d-9d3e-25330e63a501 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:22:03 user nova-compute[95467]: DEBUG nova.objects.instance [None req-4408481c-77c3-4d2d-9d3e-25330e63a501 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Lazy-loading 'numa_topology' on Instance uuid 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:22:03 user nova-compute[95467]: DEBUG nova.objects.base [None req-4408481c-77c3-4d2d-9d3e-25330e63a501 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Object Instance<6a551521-28cf-4b4e-94e8-5f5ecc0c37f7> lazy-loaded attributes: resources,numa_topology {{(pid=95467) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 08:22:04 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-c79c6daf-17fb-4529-a704-c6ce845da00f tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Acquiring lock "0edcb81b-d8fe-482c-a7ca-6b76455cfe33" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:22:04 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-c79c6daf-17fb-4529-a704-c6ce845da00f tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "0edcb81b-d8fe-482c-a7ca-6b76455cfe33" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:22:04 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-4408481c-77c3-4d2d-9d3e-25330e63a501 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:22:04 user nova-compute[95467]: DEBUG nova.objects.instance [None req-c79c6daf-17fb-4529-a704-c6ce845da00f tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lazy-loading 'flavor' on Instance uuid 0edcb81b-d8fe-482c-a7ca-6b76455cfe33 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:22:04 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-4408481c-77c3-4d2d-9d3e-25330e63a501 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:22:04 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-c79c6daf-17fb-4529-a704-c6ce845da00f tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "0edcb81b-d8fe-482c-a7ca-6b76455cfe33" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.247s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:22:04 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4408481c-77c3-4d2d-9d3e-25330e63a501 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.523s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:22:04 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4408481c-77c3-4d2d-9d3e-25330e63a501 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Lock "6a551521-28cf-4b4e-94e8-5f5ecc0c37f7" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.139s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:22:04 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-c79c6daf-17fb-4529-a704-c6ce845da00f tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Acquiring lock "0edcb81b-d8fe-482c-a7ca-6b76455cfe33" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:22:04 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-c79c6daf-17fb-4529-a704-c6ce845da00f tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "0edcb81b-d8fe-482c-a7ca-6b76455cfe33" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:22:04 user nova-compute[95467]: INFO nova.compute.manager [None req-c79c6daf-17fb-4529-a704-c6ce845da00f tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] Attaching volume 41c02927-eac0-4e18-b881-5edea58a3166 to /dev/vdb
Nov 15 08:22:04 user nova-compute[95467]: DEBUG os_brick.utils [None req-c79c6daf-17fb-4529-a704-c6ce845da00f tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:22:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:04 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[57123d6a-fbac-4d80-870f-40de11900fd0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:882ae90641f\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:04 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5d46e3-4ea3-43d7-bd7c-ab4d652320e5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:04 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[52404134-469b-4942-ac3a-b2b68760fc43]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:04 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[49819098-2840-40b5-a914-c7f2e94a7a06]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-c79c6daf-17fb-4529-a704-c6ce845da00f tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Running cmd (subprocess): nvme version {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-c79c6daf-17fb-4529-a704-c6ce845da00f tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] 'nvme version' failed. Not Retrying. {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:22:04 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c79c6daf-17fb-4529-a704-c6ce845da00f tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] nvme not present on system {{(pid=95467) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 08:22:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:22:04 user nova-compute[95467]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 08:22:04 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0289f45-0f71-44c4-aaaa-456484a4f31d]: (4, '') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:04 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-c79c6daf-17fb-4529-a704-c6ce845da00f tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=95467) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 08:22:04 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-c79c6daf-17fb-4529-a704-c6ce845da00f tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 08:22:04 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-c79c6daf-17fb-4529-a704-c6ce845da00f tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] LIGHTOS: no hostnqn found. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 08:22:04 user nova-compute[95467]: DEBUG os_brick.utils [None req-c79c6daf-17fb-4529-a704-c6ce845da00f tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:882ae90641f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:22:04 user nova-compute[95467]: DEBUG nova.virt.block_device [None req-c79c6daf-17fb-4529-a704-c6ce845da00f tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] Updating existing volume attachment record: 96eff4d3-51be-45e7-9291-94caf373c3e8 {{(pid=95467) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 08:22:07 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:22:07 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:22:09 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c79c6daf-17fb-4529-a704-c6ce845da00f tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] Calling os-brick to attach iSCSI Volume {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 08:22:09 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79c6daf-17fb-4529-a704-c6ce845da00f tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:41c02927-eac0-4e18-b881-5edea58a3166', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RFmuhOGB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:22:09 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-c79c6daf-17fb-4529-a704-c6ce845da00f tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:22:09 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-c79c6daf-17fb-4529-a704-c6ce845da00f tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:22:09 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-c79c6daf-17fb-4529-a704-c6ce845da00f tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:22:09 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-c79c6daf-17fb-4529-a704-c6ce845da00f tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:22:09 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-c79c6daf-17fb-4529-a704-c6ce845da00f tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41c02927-eac0-4e18-b881-5edea58a3166" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:22:09 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-c79c6daf-17fb-4529-a704-c6ce845da00f tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41c02927-eac0-4e18-b881-5edea58a3166" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:22:09 user nova-compute[95467]: INFO os_brick.initiator.connectors.iscsi [None req-c79c6daf-17fb-4529-a704-c6ce845da00f tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 08:22:09 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41c02927-eac0-4e18-b881-5edea58a3166 -p 172.16.0.220:3260 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:09 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41c02927-eac0-4e18-b881-5edea58a3166 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:09 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2402a0c-c9a8-43b2-9ead-4d87a457418b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:09 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79c6daf-17fb-4529-a704-c6ce845da00f tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 08:22:09 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:22:09 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41c02927-eac0-4e18-b881-5edea58a3166 -p 172.16.0.220:3260 --interface default --op new {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:09 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41c02927-eac0-4e18-b881-5edea58a3166 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:09 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee30231-586b-430c-9149-8d7e63a8db4b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:41c02927-eac0-4e18-b881-5edea58a3166] added\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:09 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79c6daf-17fb-4529-a704-c6ce845da00f tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:41c02927-eac0-4e18-b881-5edea58a3166] added
Nov 15 08:22:09 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:22:09 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41c02927-eac0-4e18-b881-5edea58a3166 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:09 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41c02927-eac0-4e18-b881-5edea58a3166 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:09 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7918d85-91b6-4aac-a04d-fffc89032741]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:09 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79c6daf-17fb-4529-a704-c6ce845da00f tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:22:09 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41c02927-eac0-4e18-b881-5edea58a3166 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:09 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41c02927-eac0-4e18-b881-5edea58a3166 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:09 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e7c380-c722-41bc-946a-d918deedd805]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:09 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79c6daf-17fb-4529-a704-c6ce845da00f tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:22:09 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41c02927-eac0-4e18-b881-5edea58a3166 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RFmuhOGB {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:09 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41c02927-eac0-4e18-b881-5edea58a3166 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RFmuhOGB" returned: 0 in 0.100s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:09 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5f3bea-12dc-4662-81f4-44456939c850]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:09 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79c6daf-17fb-4529-a704-c6ce845da00f tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RFmuhOGB'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:22:09 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41c02927-eac0-4e18-b881-5edea58a3166 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:09 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41c02927-eac0-4e18-b881-5edea58a3166 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:09 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b178fac-ca1a-401b-82d6-83e4617cf22b]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:09 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79c6daf-17fb-4529-a704-c6ce845da00f tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:22:09 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:09 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:09 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be69401-08fd-4541-9a33-e3268d47fd10]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:09 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79c6daf-17fb-4529-a704-c6ce845da00f tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:22:09 user nova-compute[95467]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:22:09 user nova-compute[95467]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54 (non-flash)
Nov 15 08:22:09 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:22:09 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79c6daf-17fb-4529-a704-c6ce845da00f tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:22:09 user nova-compute[95467]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:22:09 user nova-compute[95467]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54 (non-flash)
Nov 15 08:22:09 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:22:09 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41c02927-eac0-4e18-b881-5edea58a3166 -p 172.16.0.220:3260 --login {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:09 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41c02927-eac0-4e18-b881-5edea58a3166 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:09 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f722df8-b75b-4a51-8689-e78b2a8bfbd9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:41c02927-eac0-4e18-b881-5edea58a3166, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:41c02927-eac0-4e18-b881-5edea58a3166, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:09 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79c6daf-17fb-4529-a704-c6ce845da00f tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:41c02927-eac0-4e18-b881-5edea58a3166, portal: 172.16.0.220,3260]
Nov 15 08:22:09 user nova-compute[95467]: Login to [iface: default, target: iqn.2010-10.org.openstack:41c02927-eac0-4e18-b881-5edea58a3166, portal: 172.16.0.220,3260] successful.
Nov 15 08:22:09 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:22:09 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41c02927-eac0-4e18-b881-5edea58a3166 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:09 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41c02927-eac0-4e18-b881-5edea58a3166 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:09 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e63b6d-0d30-439c-9606-dad5b1e2fcb4]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:09 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79c6daf-17fb-4529-a704-c6ce845da00f tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:22:09 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:10 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:10 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed8417bc-fed0-49f7-adaf-fca7a5322607]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41c02927-eac0-4e18-b881-5edea58a3166 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:10 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79c6daf-17fb-4529-a704-c6ce845da00f tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:22:10 user nova-compute[95467]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:22:10 user nova-compute[95467]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54 (non-flash)
Nov 15 08:22:10 user nova-compute[95467]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41c02927-eac0-4e18-b881-5edea58a3166 (non-flash)
Nov 15 08:22:10 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:22:10 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79c6daf-17fb-4529-a704-c6ce845da00f tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:22:10 user nova-compute[95467]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:22:10 user nova-compute[95467]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54 (non-flash)
Nov 15 08:22:10 user nova-compute[95467]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41c02927-eac0-4e18-b881-5edea58a3166 (non-flash)
Nov 15 08:22:10 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:22:10 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-c79c6daf-17fb-4529-a704-c6ce845da00f tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41c02927-eac0-4e18-b881-5edea58a3166" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.396s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:22:10 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79c6daf-17fb-4529-a704-c6ce845da00f tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Connected to 172.16.0.220:3260 {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 08:22:10 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-c79c6daf-17fb-4529-a704-c6ce845da00f tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] HCTL ('34', '-', '-', 0) found on session 35 with lun 0 {{(pid=95467) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 08:22:10 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-c79c6daf-17fb-4529-a704-c6ce845da00f tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=95467) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 08:22:10 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:10 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.027s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:10 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3313cc-dc9d-4256-bbe2-e8845fa32c0a]: (4, ('- - 0', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:10 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-c79c6daf-17fb-4529-a704-c6ce845da00f tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Searching for a device in session 35 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:22:10 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79c6daf-17fb-4529-a704-c6ce845da00f tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:41c02927-eac0-4e18-b881-5edea58a3166', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RFmuhOGB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 08:22:11 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-c79c6daf-17fb-4529-a704-c6ce845da00f tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.448s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:22:11 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79c6daf-17fb-4529-a704-c6ce845da00f tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] <== connect_volume: return (1450ms) {'type': 'block', 'scsi_wwn': '26338666638626366', 'path': '/dev/sdc'} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:22:11 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c79c6daf-17fb-4529-a704-c6ce845da00f tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338666638626366', 'path': '/dev/sdc'} {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 08:22:11 user nova-compute[95467]: DEBUG nova.objects.instance [None req-c79c6daf-17fb-4529-a704-c6ce845da00f tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lazy-loading 'flavor' on Instance uuid 0edcb81b-d8fe-482c-a7ca-6b76455cfe33 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:22:11 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-c79c6daf-17fb-4529-a704-c6ce845da00f tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 08:22:11 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:22:11 user nova-compute[95467]:   <source dev="/dev/sdc"/>
Nov 15 08:22:11 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:22:11 user nova-compute[95467]:   <serial>41c02927-eac0-4e18-b881-5edea58a3166</serial>
Nov 15 08:22:11 user nova-compute[95467]: </disk>
Nov 15 08:22:11 user nova-compute[95467]:  {{(pid=95467) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 08:22:11 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-c79c6daf-17fb-4529-a704-c6ce845da00f tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:22:11 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-c79c6daf-17fb-4529-a704-c6ce845da00f tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] No BDM found with device name vdb, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:22:11 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-c79c6daf-17fb-4529-a704-c6ce845da00f tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] No VIF found with MAC fa:16:3e:7d:e4:86, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:22:11 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-c79c6daf-17fb-4529-a704-c6ce845da00f tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "0edcb81b-d8fe-482c-a7ca-6b76455cfe33" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.232s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:22:12 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a9aceb4a-ac17-434a-97c9-20a2d25b91ee tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Acquiring lock "0edcb81b-d8fe-482c-a7ca-6b76455cfe33" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:22:12 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a9aceb4a-ac17-434a-97c9-20a2d25b91ee tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "0edcb81b-d8fe-482c-a7ca-6b76455cfe33" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:22:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:22:12 user nova-compute[95467]: INFO nova.compute.manager [None req-a9aceb4a-ac17-434a-97c9-20a2d25b91ee tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] Detaching volume 41c02927-eac0-4e18-b881-5edea58a3166
Nov 15 08:22:12 user nova-compute[95467]: INFO nova.virt.block_device [None req-a9aceb4a-ac17-434a-97c9-20a2d25b91ee tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] Attempting to driver detach volume 41c02927-eac0-4e18-b881-5edea58a3166 from mountpoint /dev/vdb
Nov 15 08:22:12 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a9aceb4a-ac17-434a-97c9-20a2d25b91ee tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Attempting to detach device vdb from instance 0edcb81b-d8fe-482c-a7ca-6b76455cfe33 from the persistent domain config. {{(pid=95467) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 08:22:12 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-a9aceb4a-ac17-434a-97c9-20a2d25b91ee tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 08:22:12 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:22:12 user nova-compute[95467]:   <source dev="/dev/sdc"/>
Nov 15 08:22:12 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:22:12 user nova-compute[95467]:   <serial>41c02927-eac0-4e18-b881-5edea58a3166</serial>
Nov 15 08:22:12 user nova-compute[95467]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 08:22:12 user nova-compute[95467]: </disk>
Nov 15 08:22:12 user nova-compute[95467]:  {{(pid=95467) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 08:22:12 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-a9aceb4a-ac17-434a-97c9-20a2d25b91ee tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Successfully detached device vdb from instance 0edcb81b-d8fe-482c-a7ca-6b76455cfe33 from the persistent domain config.
Nov 15 08:22:12 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a9aceb4a-ac17-434a-97c9-20a2d25b91ee tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0edcb81b-d8fe-482c-a7ca-6b76455cfe33 from the live domain config. {{(pid=95467) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 08:22:12 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-a9aceb4a-ac17-434a-97c9-20a2d25b91ee tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 08:22:12 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:22:12 user nova-compute[95467]:   <source dev="/dev/sdc"/>
Nov 15 08:22:12 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:22:12 user nova-compute[95467]:   <serial>41c02927-eac0-4e18-b881-5edea58a3166</serial>
Nov 15 08:22:12 user nova-compute[95467]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 08:22:12 user nova-compute[95467]: </disk>
Nov 15 08:22:12 user nova-compute[95467]:  {{(pid=95467) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 08:22:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:22:13 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a9aceb4a-ac17-434a-97c9-20a2d25b91ee tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0edcb81b-d8fe-482c-a7ca-6b76455cfe33 {{(pid=95467) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 08:22:16 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-0375edea-3561-473b-bff0-6f6006fddcd3 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a1a155e6-0ee2-4728-a526-17c149107ab0 is timed out.
Nov 15 08:22:16 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-0375edea-3561-473b-bff0-6f6006fddcd3 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Successfully detached device vdb from instance a1a155e6-0ee2-4728-a526-17c149107ab0 from the live domain config.
Nov 15 08:22:16 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0375edea-3561-473b-bff0-6f6006fddcd3 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] calling os-brick to detach iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 08:22:16 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0375edea-3561-473b-bff0-6f6006fddcd3 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, {'target_iqn': 'iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wocCRvNY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:22:16 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-0375edea-3561-473b-bff0-6f6006fddcd3 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:22:16 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-0375edea-3561-473b-bff0-6f6006fddcd3 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:22:16 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-0375edea-3561-473b-bff0-6f6006fddcd3 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:22:16 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:16 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:16 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8470658e-e68f-4f10-af0a-499010554ef1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:41c02927-eac0-4e18-b881-5edea58a3166\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:16 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0375edea-3561-473b-bff0-6f6006fddcd3 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 08:22:16 user nova-compute[95467]: No targets found.
Nov 15 08:22:16 user nova-compute[95467]: iSNS:
Nov 15 08:22:16 user nova-compute[95467]: No targets found.
Nov 15 08:22:16 user nova-compute[95467]: STATIC:
Nov 15 08:22:16 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e
Nov 15 08:22:16 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:22:16 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:22:16 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54
Nov 15 08:22:16 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:22:16 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:22:16 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400
Nov 15 08:22:16 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:22:16 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:22:16 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:41c02927-eac0-4e18-b881-5edea58a3166
Nov 15 08:22:16 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:22:16 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:22:16 user nova-compute[95467]: FIRMWARE:
Nov 15 08:22:16 user nova-compute[95467]: No targets found.
Nov 15 08:22:16 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:22:16 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0375edea-3561-473b-bff0-6f6006fddcd3 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 08:22:16 user nova-compute[95467]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 08:22:16 user nova-compute[95467]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=95467) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 08:22:16 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0375edea-3561-473b-bff0-6f6006fddcd3 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54', 0)] {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 08:22:16 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:16 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:16 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bdf0ff3-e269-4e32-b0ff-caa662c9d16c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41c02927-eac0-4e18-b881-5edea58a3166\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:16 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:16 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:16 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[9575288c-aa44-43b9-91e1-25642ca78550]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41c02927-eac0-4e18-b881-5edea58a3166 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:16 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0375edea-3561-473b-bff0-6f6006fddcd3 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:22:16 user nova-compute[95467]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:22:16 user nova-compute[95467]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54 (non-flash)
Nov 15 08:22:16 user nova-compute[95467]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41c02927-eac0-4e18-b881-5edea58a3166 (non-flash)
Nov 15 08:22:16 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:22:16 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0375edea-3561-473b-bff0-6f6006fddcd3 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:22:16 user nova-compute[95467]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:22:16 user nova-compute[95467]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54 (non-flash)
Nov 15 08:22:16 user nova-compute[95467]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41c02927-eac0-4e18-b881-5edea58a3166 (non-flash)
Nov 15 08:22:16 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:22:16 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0375edea-3561-473b-bff0-6f6006fddcd3 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efec86e7640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54'): ({'sde'}, set())}) {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 08:22:16 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-0375edea-3561-473b-bff0-6f6006fddcd3 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Removing single pathed devices sde {{(pid=95467) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 08:22:16 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:16 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:16 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8f5529-704a-4c64-ba85-238f53653d79]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:16 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:16 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:16 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd980c4f-e133-431c-afe8-8180f48fab25]: (4, ('ok\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:16 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-0375edea-3561-473b-bff0-6f6006fddcd3 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Flushing IO for device /dev/sde {{(pid=95467) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 08:22:16 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:16 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:16 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2950a9-169a-4d54-a703-4a75774dbbd7]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:16 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-0375edea-3561-473b-bff0-6f6006fddcd3 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=95467) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 08:22:16 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:16 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:16 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[9efe145c-4d77-4336-b811-59982bf78886]: (4, ('1', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:16 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-0375edea-3561-473b-bff0-6f6006fddcd3 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 08:22:16 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-0375edea-3561-473b-bff0-6f6006fddcd3 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] SCSI volumes sde have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 08:22:16 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0375edea-3561-473b-bff0-6f6006fddcd3 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54')] {{(pid=95467) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 08:22:16 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:16 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:16 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f9bac7-b7df-47b6-961c-f6349d28841a]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:16 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0375edea-3561-473b-bff0-6f6006fddcd3 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:22:16 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54 -p 172.16.0.220:3260 --logout {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:16 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:16 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a8eb54-5066-4d6e-82d2-3a3f933df5aa]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:16 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0375edea-3561-473b-bff0-6f6006fddcd3 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54, portal: 172.16.0.220,3260]
Nov 15 08:22:16 user nova-compute[95467]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54, portal: 172.16.0.220,3260] successful.
Nov 15 08:22:16 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:22:16 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54 -p 172.16.0.220:3260 --op delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:16 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:22:16 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bd52f6c-f10a-491b-a827-97d3400abb54 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:16 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[032339df-879b-4160-ad16-5b1e4943e94a]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:16 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0375edea-3561-473b-bff0-6f6006fddcd3 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:22:16 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-0375edea-3561-473b-bff0-6f6006fddcd3 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:22:16 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0375edea-3561-473b-bff0-6f6006fddcd3 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] <== disconnect_volume: return (329ms) None {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:22:16 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0375edea-3561-473b-bff0-6f6006fddcd3 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Disconnected iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 08:22:17 user nova-compute[95467]: DEBUG nova.objects.instance [None req-0375edea-3561-473b-bff0-6f6006fddcd3 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lazy-loading 'flavor' on Instance uuid a1a155e6-0ee2-4728-a526-17c149107ab0 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:22:17 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0375edea-3561-473b-bff0-6f6006fddcd3 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lock "a1a155e6-0ee2-4728-a526-17c149107ab0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.903s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:22:17 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:22:17 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:22:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:22:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:22:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Acquiring lock "710d9598-1d36-4fdb-aa62-e7ff0b5ababe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:22:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "710d9598-1d36-4fdb-aa62-e7ff0b5ababe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:22:24 user nova-compute[95467]: DEBUG nova.compute.manager [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] Starting instance... {{(pid=95467) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 08:22:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:22:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:22:24 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=95467) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 08:22:24 user nova-compute[95467]: INFO nova.compute.claims [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] Claim successful on node user
Nov 15 08:22:24 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:22:24 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:22:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.427s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:22:24 user nova-compute[95467]: DEBUG nova.compute.manager [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] Start building networks asynchronously for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 08:22:24 user nova-compute[95467]: DEBUG nova.compute.manager [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] Allocating IP information in the background. {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 08:22:24 user nova-compute[95467]: DEBUG nova.network.neutron [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] allocate_for_instance() {{(pid=95467) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 08:22:24 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 08:22:24 user nova-compute[95467]: DEBUG nova.compute.manager [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] Start building block device mappings for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 08:22:24 user nova-compute[95467]: INFO nova.virt.block_device [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] Booting with volume 56e4d788-8159-47c4-bbea-a4b90cb6170b at /dev/vda
Nov 15 08:22:24 user nova-compute[95467]: DEBUG nova.policy [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '11bbbd3ef322402cb5dc60455a54319b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7791bd92c7c488aa72474ecde2e1155', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95467) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 08:22:24 user nova-compute[95467]: DEBUG os_brick.utils [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:22:24 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:24 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:24 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab8376a-37dd-4222-afe9-d410da7a1d24]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:882ae90641f\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:24 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:24 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:24 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8151687-0373-4987-847d-6442ffe1efec]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:24 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:24 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:24 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea2dad4-8a21-449f-91cb-d01da4e5c038]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:24 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d91b5ab-aa64-432e-8f62-ede419cae778]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:24 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Running cmd (subprocess): nvme version {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:24 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] 'nvme version' failed. Not Retrying. {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:22:24 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.nvmeof [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] nvme not present on system {{(pid=95467) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 08:22:24 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:24 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:22:24 user nova-compute[95467]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 08:22:24 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[758a9778-28d9-46b7-b809-163b859c59dc]: (4, '') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:24 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=95467) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 08:22:24 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 08:22:24 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] LIGHTOS: no hostnqn found. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 08:22:24 user nova-compute[95467]: DEBUG os_brick.utils [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:882ae90641f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:22:24 user nova-compute[95467]: DEBUG nova.virt.block_device [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] Updating existing volume attachment record: 39534906-a5b7-4649-b5aa-a03ca30c526f {{(pid=95467) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 08:22:25 user nova-compute[95467]: DEBUG nova.network.neutron [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] Successfully created port: 0c59c093-b66f-4b70-997f-90d68d08091b {{(pid=95467) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 08:22:26 user nova-compute[95467]: DEBUG nova.network.neutron [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] Successfully updated port: 0c59c093-b66f-4b70-997f-90d68d08091b {{(pid=95467) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 08:22:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Acquiring lock "refresh_cache-710d9598-1d36-4fdb-aa62-e7ff0b5ababe" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:22:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Acquired lock "refresh_cache-710d9598-1d36-4fdb-aa62-e7ff0b5ababe" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:22:26 user nova-compute[95467]: DEBUG nova.network.neutron [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:22:26 user nova-compute[95467]: DEBUG nova.compute.manager [req-3ddea696-142a-476c-875c-1908d5df7b49 req-a431f97e-93f4-4eed-8195-18151dcc1b03 service nova] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] Received event network-changed-0c59c093-b66f-4b70-997f-90d68d08091b {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:22:26 user nova-compute[95467]: DEBUG nova.compute.manager [req-3ddea696-142a-476c-875c-1908d5df7b49 req-a431f97e-93f4-4eed-8195-18151dcc1b03 service nova] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] Refreshing instance network info cache due to event network-changed-0c59c093-b66f-4b70-997f-90d68d08091b. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:22:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-3ddea696-142a-476c-875c-1908d5df7b49 req-a431f97e-93f4-4eed-8195-18151dcc1b03 service nova] Acquiring lock "refresh_cache-710d9598-1d36-4fdb-aa62-e7ff0b5ababe" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:22:26 user nova-compute[95467]: DEBUG nova.network.neutron [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] Instance cache missing network info. {{(pid=95467) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 08:22:26 user nova-compute[95467]: DEBUG nova.network.neutron [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] Updating instance_info_cache with network_info: [{"id": "0c59c093-b66f-4b70-997f-90d68d08091b", "address": "fa:16:3e:b2:d1:09", "network": {"id": "96d9262b-11fb-497d-8e38-fa46076c010f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2069167691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7791bd92c7c488aa72474ecde2e1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c59c093-b6", "ovs_interfaceid": "0c59c093-b66f-4b70-997f-90d68d08091b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:22:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Releasing lock "refresh_cache-710d9598-1d36-4fdb-aa62-e7ff0b5ababe" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:22:26 user nova-compute[95467]: DEBUG nova.compute.manager [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] Instance network_info: |[{"id": "0c59c093-b66f-4b70-997f-90d68d08091b", "address": "fa:16:3e:b2:d1:09", "network": {"id": "96d9262b-11fb-497d-8e38-fa46076c010f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2069167691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7791bd92c7c488aa72474ecde2e1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c59c093-b6", "ovs_interfaceid": "0c59c093-b66f-4b70-997f-90d68d08091b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 08:22:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-3ddea696-142a-476c-875c-1908d5df7b49 req-a431f97e-93f4-4eed-8195-18151dcc1b03 service nova] Acquired lock "refresh_cache-710d9598-1d36-4fdb-aa62-e7ff0b5ababe" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:22:26 user nova-compute[95467]: DEBUG nova.network.neutron [req-3ddea696-142a-476c-875c-1908d5df7b49 req-a431f97e-93f4-4eed-8195-18151dcc1b03 service nova] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] Refreshing network info cache for port 0c59c093-b66f-4b70-997f-90d68d08091b {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:22:27 user nova-compute[95467]: DEBUG nova.network.neutron [req-3ddea696-142a-476c-875c-1908d5df7b49 req-a431f97e-93f4-4eed-8195-18151dcc1b03 service nova] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] Updated VIF entry in instance network info cache for port 0c59c093-b66f-4b70-997f-90d68d08091b. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:22:27 user nova-compute[95467]: DEBUG nova.network.neutron [req-3ddea696-142a-476c-875c-1908d5df7b49 req-a431f97e-93f4-4eed-8195-18151dcc1b03 service nova] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] Updating instance_info_cache with network_info: [{"id": "0c59c093-b66f-4b70-997f-90d68d08091b", "address": "fa:16:3e:b2:d1:09", "network": {"id": "96d9262b-11fb-497d-8e38-fa46076c010f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2069167691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7791bd92c7c488aa72474ecde2e1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c59c093-b6", "ovs_interfaceid": "0c59c093-b66f-4b70-997f-90d68d08091b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:22:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-3ddea696-142a-476c-875c-1908d5df7b49 req-a431f97e-93f4-4eed-8195-18151dcc1b03 service nova] Releasing lock "refresh_cache-710d9598-1d36-4fdb-aa62-e7ff0b5ababe" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:22:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:22:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG nova.compute.manager [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] Start spawning the instance on the hypervisor. {{(pid=95467) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] Creating instance directory {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 08:22:30 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] Creating image(s)
Nov 15 08:22:30 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] Did not create local disks {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] Ensure instance console log exists: /opt/stack/data/nova/instances/710d9598-1d36-4fdb-aa62-e7ff0b5ababe/console.log {{(pid=95467) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] Start _get_guest_xml network_info=[{"id": "0c59c093-b66f-4b70-997f-90d68d08091b", "address": "fa:16:3e:b2:d1:09", "network": {"id": "96d9262b-11fb-497d-8e38-fa46076c010f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2069167691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7791bd92c7c488aa72474ecde2e1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c59c093-b6", "ovs_interfaceid": "0c59c093-b66f-4b70-997f-90d68d08091b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '39534906-a5b7-4649-b5aa-a03ca30c526f', 'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AmMxUCDH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '710d9598-1d36-4fdb-aa62-e7ff0b5ababe', 'attached_at': '', 'detached_at': '', 'volume_id': '56e4d788-8159-47c4-bbea-a4b90cb6170b', 'serial': '56e4d788-8159-47c4-bbea-a4b90cb6170b'}, 'volume_type': None} {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:22:30 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:22:30 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:22:30 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] Calling os-brick to attach iSCSI Volume {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AmMxUCDH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:22:30 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:22:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:22:30 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:22:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:22:30 user nova-compute[95467]: INFO os_brick.initiator.connectors.iscsi [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 08:22:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b -p 172.16.0.220:3260 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe108235-3ab8-4755-8af9-1398c8f27048]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 08:22:30 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b -p 172.16.0.220:3260 --interface default --op new {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[61efffb8-e046-43d7-9ebf-f086a33d12d1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b] added\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b] added
Nov 15 08:22:30 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[2122df47-d70b-433a-a049-4581fd44e427]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8f971c-399b-4381-a25a-1e72e3f907c6]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AmMxUCDH {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AmMxUCDH" returned: 0 in 0.026s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[5824d1aa-9230-4269-bc0e-0780d48d742b]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AmMxUCDH'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df33469-70bb-4252-8a3c-eb24012cab1a]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[3771898f-cfb1-43dc-8a03-0f4b9e8eef44]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41c02927-eac0-4e18-b881-5edea58a3166 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:22:30 user nova-compute[95467]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:22:30 user nova-compute[95467]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41c02927-eac0-4e18-b881-5edea58a3166 (non-flash)
Nov 15 08:22:30 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:22:30 user nova-compute[95467]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:22:30 user nova-compute[95467]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41c02927-eac0-4e18-b881-5edea58a3166 (non-flash)
Nov 15 08:22:30 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b -p 172.16.0.220:3260 --login {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[806d11cd-7819-41b8-8db3-125d0c04e29e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b, portal: 172.16.0.220,3260]
Nov 15 08:22:30 user nova-compute[95467]: Login to [iface: default, target: iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b, portal: 172.16.0.220,3260] successful.
Nov 15 08:22:30 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c681ef3-f36b-4b69-b1ad-48457cdc2217]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2d7115-c999-4096-8d3b-b936eb96891e]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41c02927-eac0-4e18-b881-5edea58a3166 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:22:30 user nova-compute[95467]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:22:30 user nova-compute[95467]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41c02927-eac0-4e18-b881-5edea58a3166 (non-flash)
Nov 15 08:22:30 user nova-compute[95467]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:22:30 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:22:30 user nova-compute[95467]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:22:30 user nova-compute[95467]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41c02927-eac0-4e18-b881-5edea58a3166 (non-flash)
Nov 15 08:22:30 user nova-compute[95467]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:22:30 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Connected to 172.16.0.220:3260 {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] HCTL ('36', '-', '-', 0) found on session 36 with lun 0 {{(pid=95467) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=95467) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4315ad-0cce-4d19-a98b-4fe835bd69a6]: (4, ('- - 0', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Searching for a device in session 36 and hctl ['36', '*', '*', 0] yield: sde {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:22:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AmMxUCDH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 08:22:31 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:22:31 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '23130393335336366', 'path': '/dev/sde'} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:22:31 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130393335336366', 'path': '/dev/sde'} {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 08:22:31 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:22:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1931377887',display_name='tempest-TestVolumeBootPattern-server-1931377887',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1931377887',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGn1slhlv/lpfM2oYeApx9piTNh8psQp9CpZOaXQ+Ydt2JJikCfOrBRqv7qZ3oUV5yn53tl6dDTEsiUIm5m/x3Q62LZpqk25/AJiUoLr4SnG2Qg5vjpEqPX27JlljHO+ew==',key_name='tempest-TestVolumeBootPattern-1986786502',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7791bd92c7c488aa72474ecde2e1155',ramdisk_id='',reservation_id='r-tnnhyram',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-978207351',owner_user_name='tempest-TestVolumeBootPattern-978207351-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:22:25Z,user_data=None,user_id='11bbbd3ef322402cb5dc60455a54319b',uuid=710d9598-1d36-4fdb-aa62-e7ff0b5ababe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c59c093-b66f-4b70-997f-90d68d08091b", "address": "fa:16:3e:b2:d1:09", "network": {"id": "96d9262b-11fb-497d-8e38-fa46076c010f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2069167691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7791bd92c7c488aa72474ecde2e1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c59c093-b6", "ovs_interfaceid": "0c59c093-b66f-4b70-997f-90d68d08091b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:22:31 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Converting VIF {"id": "0c59c093-b66f-4b70-997f-90d68d08091b", "address": "fa:16:3e:b2:d1:09", "network": {"id": "96d9262b-11fb-497d-8e38-fa46076c010f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2069167691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7791bd92c7c488aa72474ecde2e1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c59c093-b6", "ovs_interfaceid": "0c59c093-b66f-4b70-997f-90d68d08091b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:22:31 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:d1:09,bridge_name='br-int',has_traffic_filtering=True,id=0c59c093-b66f-4b70-997f-90d68d08091b,network=Network(96d9262b-11fb-497d-8e38-fa46076c010f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c59c093-b6') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:22:31 user nova-compute[95467]: DEBUG nova.objects.instance [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lazy-loading 'pci_devices' on Instance uuid 710d9598-1d36-4fdb-aa62-e7ff0b5ababe {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:22:31 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:22:31 user nova-compute[95467]:   <uuid>710d9598-1d36-4fdb-aa62-e7ff0b5ababe</uuid>
Nov 15 08:22:31 user nova-compute[95467]:   <name>instance-00000026</name>
Nov 15 08:22:31 user nova-compute[95467]:   <memory>524288</memory>
Nov 15 08:22:31 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:22:31 user nova-compute[95467]:   <metadata>
Nov 15 08:22:31 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:22:31 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:22:31 user nova-compute[95467]:       <nova:name>tempest-TestVolumeBootPattern-server-1931377887</nova:name>
Nov 15 08:22:31 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:22:30</nova:creationTime>
Nov 15 08:22:31 user nova-compute[95467]:       <nova:flavor name="m1.tiny">
Nov 15 08:22:31 user nova-compute[95467]:         <nova:memory>512</nova:memory>
Nov 15 08:22:31 user nova-compute[95467]:         <nova:disk>1</nova:disk>
Nov 15 08:22:31 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:22:31 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:22:31 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:22:31 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:22:31 user nova-compute[95467]:       <nova:owner>
Nov 15 08:22:31 user nova-compute[95467]:         <nova:user uuid="11bbbd3ef322402cb5dc60455a54319b">tempest-TestVolumeBootPattern-978207351-project-member</nova:user>
Nov 15 08:22:31 user nova-compute[95467]:         <nova:project uuid="e7791bd92c7c488aa72474ecde2e1155">tempest-TestVolumeBootPattern-978207351</nova:project>
Nov 15 08:22:31 user nova-compute[95467]:       </nova:owner>
Nov 15 08:22:31 user nova-compute[95467]:       <nova:ports>
Nov 15 08:22:31 user nova-compute[95467]:         <nova:port uuid="0c59c093-b66f-4b70-997f-90d68d08091b">
Nov 15 08:22:31 user nova-compute[95467]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 08:22:31 user nova-compute[95467]:         </nova:port>
Nov 15 08:22:31 user nova-compute[95467]:       </nova:ports>
Nov 15 08:22:31 user nova-compute[95467]:     </nova:instance>
Nov 15 08:22:31 user nova-compute[95467]:   </metadata>
Nov 15 08:22:31 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:22:31 user nova-compute[95467]:     <system>
Nov 15 08:22:31 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:22:31 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:22:31 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:22:31 user nova-compute[95467]:       <entry name="serial">710d9598-1d36-4fdb-aa62-e7ff0b5ababe</entry>
Nov 15 08:22:31 user nova-compute[95467]:       <entry name="uuid">710d9598-1d36-4fdb-aa62-e7ff0b5ababe</entry>
Nov 15 08:22:31 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:22:31 user nova-compute[95467]:     </system>
Nov 15 08:22:31 user nova-compute[95467]:   </sysinfo>
Nov 15 08:22:31 user nova-compute[95467]:   <os>
Nov 15 08:22:31 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:22:31 user nova-compute[95467]:     <boot dev="hd"/>
Nov 15 08:22:31 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:22:31 user nova-compute[95467]:   </os>
Nov 15 08:22:31 user nova-compute[95467]:   <features>
Nov 15 08:22:31 user nova-compute[95467]:     <acpi/>
Nov 15 08:22:31 user nova-compute[95467]:     <apic/>
Nov 15 08:22:31 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:22:31 user nova-compute[95467]:   </features>
Nov 15 08:22:31 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:22:31 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:22:31 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:22:31 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:22:31 user nova-compute[95467]:   </clock>
Nov 15 08:22:31 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:22:31 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:22:31 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:22:31 user nova-compute[95467]:   </cpu>
Nov 15 08:22:31 user nova-compute[95467]:   <devices>
Nov 15 08:22:31 user nova-compute[95467]:     <disk type="block" device="disk">
Nov 15 08:22:31 user nova-compute[95467]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:22:31 user nova-compute[95467]:       <source dev="/dev/sde"/>
Nov 15 08:22:31 user nova-compute[95467]:       <target dev="vda" bus="virtio"/>
Nov 15 08:22:31 user nova-compute[95467]:       <serial>56e4d788-8159-47c4-bbea-a4b90cb6170b</serial>
Nov 15 08:22:31 user nova-compute[95467]:     </disk>
Nov 15 08:22:31 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:22:31 user nova-compute[95467]:       <mac address="fa:16:3e:b2:d1:09"/>
Nov 15 08:22:31 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:22:31 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:22:31 user nova-compute[95467]:       <target dev="tap0c59c093-b6"/>
Nov 15 08:22:31 user nova-compute[95467]:     </interface>
Nov 15 08:22:31 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:22:31 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/710d9598-1d36-4fdb-aa62-e7ff0b5ababe/console.log" append="off"/>
Nov 15 08:22:31 user nova-compute[95467]:     </serial>
Nov 15 08:22:31 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:22:31 user nova-compute[95467]:     <video>
Nov 15 08:22:31 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:22:31 user nova-compute[95467]:     </video>
Nov 15 08:22:31 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:22:31 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:22:31 user nova-compute[95467]:     </rng>
Nov 15 08:22:31 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:22:31 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:22:31 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:22:31 user nova-compute[95467]:     </memballoon>
Nov 15 08:22:31 user nova-compute[95467]:   </devices>
Nov 15 08:22:31 user nova-compute[95467]: </domain>
Nov 15 08:22:31 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:22:31 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:22:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1931377887',display_name='tempest-TestVolumeBootPattern-server-1931377887',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1931377887',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGn1slhlv/lpfM2oYeApx9piTNh8psQp9CpZOaXQ+Ydt2JJikCfOrBRqv7qZ3oUV5yn53tl6dDTEsiUIm5m/x3Q62LZpqk25/AJiUoLr4SnG2Qg5vjpEqPX27JlljHO+ew==',key_name='tempest-TestVolumeBootPattern-1986786502',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7791bd92c7c488aa72474ecde2e1155',ramdisk_id='',reservation_id='r-tnnhyram',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-978207351',owner_user_name='tempest-TestVolumeBootPattern-978207351-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:22:25Z,user_data=None,user_id='11bbbd3ef322402cb5dc60455a54319b',uuid=710d9598-1d36-4fdb-aa62-e7ff0b5ababe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c59c093-b66f-4b70-997f-90d68d08091b", "address": "fa:16:3e:b2:d1:09", "network": {"id": "96d9262b-11fb-497d-8e38-fa46076c010f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2069167691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7791bd92c7c488aa72474ecde2e1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c59c093-b6", "ovs_interfaceid": "0c59c093-b66f-4b70-997f-90d68d08091b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:22:31 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Converting VIF {"id": "0c59c093-b66f-4b70-997f-90d68d08091b", "address": "fa:16:3e:b2:d1:09", "network": {"id": "96d9262b-11fb-497d-8e38-fa46076c010f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2069167691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7791bd92c7c488aa72474ecde2e1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c59c093-b6", "ovs_interfaceid": "0c59c093-b66f-4b70-997f-90d68d08091b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:22:31 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:d1:09,bridge_name='br-int',has_traffic_filtering=True,id=0c59c093-b66f-4b70-997f-90d68d08091b,network=Network(96d9262b-11fb-497d-8e38-fa46076c010f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c59c093-b6') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:22:31 user nova-compute[95467]: DEBUG os_vif [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:d1:09,bridge_name='br-int',has_traffic_filtering=True,id=0c59c093-b66f-4b70-997f-90d68d08091b,network=Network(96d9262b-11fb-497d-8e38-fa46076c010f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c59c093-b6') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:22:31 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:22:31 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:22:31 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:22:31 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:22:31 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0447ec79-67f5-5fe2-9da9-bee15b9ca941', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:22:31 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:22:31 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:22:31 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:22:31 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0c59c093-b6, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:22:31 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0c59c093-b6, col_values=(('qos', UUID('327b1bf8-e176-4c8f-95ac-dc970566f747')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:22:31 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0c59c093-b6, col_values=(('external_ids', {'iface-id': '0c59c093-b66f-4b70-997f-90d68d08091b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:d1:09', 'vm-uuid': '710d9598-1d36-4fdb-aa62-e7ff0b5ababe'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:22:31 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:22:31 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:22:31 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:22:31 user nova-compute[95467]: INFO os_vif [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:d1:09,bridge_name='br-int',has_traffic_filtering=True,id=0c59c093-b66f-4b70-997f-90d68d08091b,network=Network(96d9262b-11fb-497d-8e38-fa46076c010f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c59c093-b6')
Nov 15 08:22:31 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:22:31 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] No VIF found with MAC fa:16:3e:b2:d1:09, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:22:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:22:33 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-a9aceb4a-ac17-434a-97c9-20a2d25b91ee tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0edcb81b-d8fe-482c-a7ca-6b76455cfe33 is timed out.
Nov 15 08:22:33 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-a9aceb4a-ac17-434a-97c9-20a2d25b91ee tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Successfully detached device vdb from instance 0edcb81b-d8fe-482c-a7ca-6b76455cfe33 from the live domain config.
Nov 15 08:22:33 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9aceb4a-ac17-434a-97c9-20a2d25b91ee tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] calling os-brick to detach iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 08:22:33 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9aceb4a-ac17-434a-97c9-20a2d25b91ee tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, {'target_iqn': 'iqn.2010-10.org.openstack:41c02927-eac0-4e18-b881-5edea58a3166', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RFmuhOGB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:22:33 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-a9aceb4a-ac17-434a-97c9-20a2d25b91ee tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:22:33 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-a9aceb4a-ac17-434a-97c9-20a2d25b91ee tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:22:33 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-a9aceb4a-ac17-434a-97c9-20a2d25b91ee tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:22:33 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:33 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:33 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a725f28d-c82b-41fd-9d90-d207626f3111]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:41c02927-eac0-4e18-b881-5edea58a3166\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:33 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9aceb4a-ac17-434a-97c9-20a2d25b91ee tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 08:22:33 user nova-compute[95467]: No targets found.
Nov 15 08:22:33 user nova-compute[95467]: iSNS:
Nov 15 08:22:33 user nova-compute[95467]: No targets found.
Nov 15 08:22:33 user nova-compute[95467]: STATIC:
Nov 15 08:22:33 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b
Nov 15 08:22:33 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:22:33 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:22:33 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e
Nov 15 08:22:33 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:22:33 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:22:33 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400
Nov 15 08:22:33 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:22:33 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:22:33 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:41c02927-eac0-4e18-b881-5edea58a3166
Nov 15 08:22:33 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:22:33 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:22:33 user nova-compute[95467]: FIRMWARE:
Nov 15 08:22:33 user nova-compute[95467]: No targets found.
Nov 15 08:22:33 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:22:33 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9aceb4a-ac17-434a-97c9-20a2d25b91ee tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 08:22:33 user nova-compute[95467]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 08:22:33 user nova-compute[95467]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=95467) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 08:22:33 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9aceb4a-ac17-434a-97c9-20a2d25b91ee tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41c02927-eac0-4e18-b881-5edea58a3166', 0)] {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 08:22:33 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:33 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:33 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ceca9de-1637-44ee-850e-2cad24f59c96]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41c02927-eac0-4e18-b881-5edea58a3166\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:33 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:22:33 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:33 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[64eaef4e-ff64-445e-8a79-243ac91bb703]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41c02927-eac0-4e18-b881-5edea58a3166 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:33 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9aceb4a-ac17-434a-97c9-20a2d25b91ee tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:22:33 user nova-compute[95467]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:22:33 user nova-compute[95467]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41c02927-eac0-4e18-b881-5edea58a3166 (non-flash)
Nov 15 08:22:33 user nova-compute[95467]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:22:33 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:22:33 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9aceb4a-ac17-434a-97c9-20a2d25b91ee tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:22:33 user nova-compute[95467]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:22:33 user nova-compute[95467]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41c02927-eac0-4e18-b881-5edea58a3166 (non-flash)
Nov 15 08:22:33 user nova-compute[95467]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:22:33 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:22:33 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9aceb4a-ac17-434a-97c9-20a2d25b91ee tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efec836ef80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41c02927-eac0-4e18-b881-5edea58a3166'): ({'sdc'}, set())}) {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 08:22:33 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-a9aceb4a-ac17-434a-97c9-20a2d25b91ee tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Removing single pathed devices sdc {{(pid=95467) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 08:22:33 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:22:33 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:33 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aeb7f22-d9ff-4c78-a65c-4cca31bb258d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:33 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:33 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:33 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37c0dcf-df68-4a21-a822-2e31484d7400]: (4, ('ok\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:33 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-a9aceb4a-ac17-434a-97c9-20a2d25b91ee tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Flushing IO for device /dev/sdc {{(pid=95467) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 08:22:33 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:33 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:33 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a81a0a-930d-4f05-8803-f3857c57be27]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:33 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-a9aceb4a-ac17-434a-97c9-20a2d25b91ee tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=95467) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 08:22:33 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:33 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:33 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[948f1ab0-2bfc-479c-9410-a54cc431cc88]: (4, ('1', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:33 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-a9aceb4a-ac17-434a-97c9-20a2d25b91ee tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 08:22:33 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-a9aceb4a-ac17-434a-97c9-20a2d25b91ee tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] SCSI volumes sdc have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 08:22:33 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9aceb4a-ac17-434a-97c9-20a2d25b91ee tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41c02927-eac0-4e18-b881-5edea58a3166')] {{(pid=95467) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 08:22:33 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41c02927-eac0-4e18-b881-5edea58a3166 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:33 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41c02927-eac0-4e18-b881-5edea58a3166 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:33 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf61546-474f-4e12-a891-a9de4bde4103]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:33 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9aceb4a-ac17-434a-97c9-20a2d25b91ee tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:22:33 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41c02927-eac0-4e18-b881-5edea58a3166 -p 172.16.0.220:3260 --logout {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:33 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41c02927-eac0-4e18-b881-5edea58a3166 -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:33 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[df98a5a7-7336-4c9b-a84f-0bfa42f80930]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:41c02927-eac0-4e18-b881-5edea58a3166, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:41c02927-eac0-4e18-b881-5edea58a3166, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:33 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9aceb4a-ac17-434a-97c9-20a2d25b91ee tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:41c02927-eac0-4e18-b881-5edea58a3166, portal: 172.16.0.220,3260]
Nov 15 08:22:33 user nova-compute[95467]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:41c02927-eac0-4e18-b881-5edea58a3166, portal: 172.16.0.220,3260] successful.
Nov 15 08:22:33 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:22:33 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41c02927-eac0-4e18-b881-5edea58a3166 -p 172.16.0.220:3260 --op delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:33 user nova-compute[95467]: DEBUG nova.compute.manager [req-53ec4d0a-fe69-4fa9-927f-6fee2ea428e9 req-22b79d1d-1ddc-4437-9883-cc7534c46de6 service nova] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] Received event network-vif-plugged-0c59c093-b66f-4b70-997f-90d68d08091b {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:22:33 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-53ec4d0a-fe69-4fa9-927f-6fee2ea428e9 req-22b79d1d-1ddc-4437-9883-cc7534c46de6 service nova] Acquiring lock "710d9598-1d36-4fdb-aa62-e7ff0b5ababe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:22:33 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-53ec4d0a-fe69-4fa9-927f-6fee2ea428e9 req-22b79d1d-1ddc-4437-9883-cc7534c46de6 service nova] Lock "710d9598-1d36-4fdb-aa62-e7ff0b5ababe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:22:33 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-53ec4d0a-fe69-4fa9-927f-6fee2ea428e9 req-22b79d1d-1ddc-4437-9883-cc7534c46de6 service nova] Lock "710d9598-1d36-4fdb-aa62-e7ff0b5ababe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:22:33 user nova-compute[95467]: DEBUG nova.compute.manager [req-53ec4d0a-fe69-4fa9-927f-6fee2ea428e9 req-22b79d1d-1ddc-4437-9883-cc7534c46de6 service nova] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] No waiting events found dispatching network-vif-plugged-0c59c093-b66f-4b70-997f-90d68d08091b {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:22:33 user nova-compute[95467]: WARNING nova.compute.manager [req-53ec4d0a-fe69-4fa9-927f-6fee2ea428e9 req-22b79d1d-1ddc-4437-9883-cc7534c46de6 service nova] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] Received unexpected event network-vif-plugged-0c59c093-b66f-4b70-997f-90d68d08091b for instance with vm_state building and task_state spawning.
Nov 15 08:22:33 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41c02927-eac0-4e18-b881-5edea58a3166 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:33 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[6056f128-a78f-4770-b087-2670945e72ce]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:33 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9aceb4a-ac17-434a-97c9-20a2d25b91ee tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:22:33 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-a9aceb4a-ac17-434a-97c9-20a2d25b91ee tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.407s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:22:33 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9aceb4a-ac17-434a-97c9-20a2d25b91ee tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] <== disconnect_volume: return (408ms) None {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:22:33 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9aceb4a-ac17-434a-97c9-20a2d25b91ee tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] Disconnected iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 08:22:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:22:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:22:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:22:34 user nova-compute[95467]: DEBUG nova.objects.instance [None req-a9aceb4a-ac17-434a-97c9-20a2d25b91ee tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lazy-loading 'flavor' on Instance uuid 0edcb81b-d8fe-482c-a7ca-6b76455cfe33 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:22:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a9aceb4a-ac17-434a-97c9-20a2d25b91ee tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "0edcb81b-d8fe-482c-a7ca-6b76455cfe33" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.009s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:22:35 user nova-compute[95467]: DEBUG nova.compute.manager [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] Instance event wait completed in 0 seconds for  {{(pid=95467) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 08:22:35 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] Guest created on hypervisor {{(pid=95467) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 08:22:35 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] Instance spawned successfully.
Nov 15 08:22:35 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 08:22:35 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] Found default for hw_cdrom_bus of ide {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:22:35 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] Found default for hw_disk_bus of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:22:35 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] Found default for hw_input_bus of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:22:35 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] Found default for hw_pointer_model of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:22:35 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] Found default for hw_video_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:22:35 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] Found default for hw_vif_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:22:35 user nova-compute[95467]: INFO nova.compute.manager [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] Took 5.10 seconds to spawn the instance on the hypervisor.
Nov 15 08:22:35 user nova-compute[95467]: DEBUG nova.compute.manager [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:22:35 user nova-compute[95467]: DEBUG nova.compute.manager [req-7380b317-8843-493e-8a85-59bd7b5bc747 req-122be77a-7ef9-41ff-b4d7-69d66e218c8c service nova] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] Received event network-vif-plugged-0c59c093-b66f-4b70-997f-90d68d08091b {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:22:35 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-7380b317-8843-493e-8a85-59bd7b5bc747 req-122be77a-7ef9-41ff-b4d7-69d66e218c8c service nova] Acquiring lock "710d9598-1d36-4fdb-aa62-e7ff0b5ababe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:22:35 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-7380b317-8843-493e-8a85-59bd7b5bc747 req-122be77a-7ef9-41ff-b4d7-69d66e218c8c service nova] Lock "710d9598-1d36-4fdb-aa62-e7ff0b5ababe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:22:35 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-7380b317-8843-493e-8a85-59bd7b5bc747 req-122be77a-7ef9-41ff-b4d7-69d66e218c8c service nova] Lock "710d9598-1d36-4fdb-aa62-e7ff0b5ababe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:22:35 user nova-compute[95467]: DEBUG nova.compute.manager [req-7380b317-8843-493e-8a85-59bd7b5bc747 req-122be77a-7ef9-41ff-b4d7-69d66e218c8c service nova] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] No waiting events found dispatching network-vif-plugged-0c59c093-b66f-4b70-997f-90d68d08091b {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:22:35 user nova-compute[95467]: WARNING nova.compute.manager [req-7380b317-8843-493e-8a85-59bd7b5bc747 req-122be77a-7ef9-41ff-b4d7-69d66e218c8c service nova] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] Received unexpected event network-vif-plugged-0c59c093-b66f-4b70-997f-90d68d08091b for instance with vm_state active and task_state None.
Nov 15 08:22:35 user nova-compute[95467]: INFO nova.compute.manager [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] Took 11.40 seconds to build instance.
Nov 15 08:22:35 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-14c60a99-3cb1-43ab-9c45-67857e32f313 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "710d9598-1d36-4fdb-aa62-e7ff0b5ababe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.506s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:22:36 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:22:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:22:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:22:44 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:22:44 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=95467) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 08:22:45 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:22:45 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager.update_available_resource {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:22:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:22:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:22:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:22:45 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Auditing locally available compute resources for user (node: user) {{(pid=95467) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 08:22:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:46 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:22:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a155e6-0ee2-4728-a526-17c149107ab0/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:46 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:22:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a155e6-0ee2-4728-a526-17c149107ab0/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a155e6-0ee2-4728-a526-17c149107ab0/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a155e6-0ee2-4728-a526-17c149107ab0/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7805e5c-1777-4b0c-95c7-b232be66528c/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7805e5c-1777-4b0c-95c7-b232be66528c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7805e5c-1777-4b0c-95c7-b232be66528c/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7805e5c-1777-4b0c-95c7-b232be66528c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091612cf-b737-480b-984e-a05b522676b6/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091612cf-b737-480b-984e-a05b522676b6/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091612cf-b737-480b-984e-a05b522676b6/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:47 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:22:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091612cf-b737-480b-984e-a05b522676b6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:48 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:22:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0edcb81b-d8fe-482c-a7ca-6b76455cfe33/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0edcb81b-d8fe-482c-a7ca-6b76455cfe33/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0edcb81b-d8fe-482c-a7ca-6b76455cfe33/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-ae528bfd-adb1-4f57-8eff-d4f1d39870b4 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Acquiring lock "a1a155e6-0ee2-4728-a526-17c149107ab0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:22:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-ae528bfd-adb1-4f57-8eff-d4f1d39870b4 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lock "a1a155e6-0ee2-4728-a526-17c149107ab0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:22:48 user nova-compute[95467]: DEBUG nova.objects.instance [None req-ae528bfd-adb1-4f57-8eff-d4f1d39870b4 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lazy-loading 'flavor' on Instance uuid a1a155e6-0ee2-4728-a526-17c149107ab0 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:22:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0edcb81b-d8fe-482c-a7ca-6b76455cfe33/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk.rescue --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-ae528bfd-adb1-4f57-8eff-d4f1d39870b4 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lock "a1a155e6-0ee2-4728-a526-17c149107ab0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.111s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:22:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk.rescue --force-share --output=json" returned: 0 in 0.221s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk.rescue --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:49 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-ae528bfd-adb1-4f57-8eff-d4f1d39870b4 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Acquiring lock "a1a155e6-0ee2-4728-a526-17c149107ab0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:22:49 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-ae528bfd-adb1-4f57-8eff-d4f1d39870b4 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lock "a1a155e6-0ee2-4728-a526-17c149107ab0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:22:49 user nova-compute[95467]: INFO nova.compute.manager [None req-ae528bfd-adb1-4f57-8eff-d4f1d39870b4 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Attaching volume 9df081f2-6e31-4922-94d2-8b02bd168789 to /dev/vdb
Nov 15 08:22:49 user nova-compute[95467]: DEBUG os_brick.utils [None req-ae528bfd-adb1-4f57-8eff-d4f1d39870b4 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:22:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:49 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a5011d-04e8-4a4c-bdf6-1344ab5d5890]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:882ae90641f\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:49 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb26728-18e4-42f2-b14b-fad1703c2b5d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:49 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[445686c6-9027-4fd1-bb00-caaf1cf6fa14]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:49 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b01e13-a74a-4427-916c-be759ccdbe55]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-ae528bfd-adb1-4f57-8eff-d4f1d39870b4 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Running cmd (subprocess): nvme version {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-ae528bfd-adb1-4f57-8eff-d4f1d39870b4 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] 'nvme version' failed. Not Retrying. {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:22:49 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ae528bfd-adb1-4f57-8eff-d4f1d39870b4 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] nvme not present on system {{(pid=95467) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 08:22:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:22:49 user nova-compute[95467]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 08:22:49 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[3877fb23-271c-4398-a132-a22cc68d39bd]: (4, '') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:49 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-ae528bfd-adb1-4f57-8eff-d4f1d39870b4 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=95467) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 08:22:49 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-ae528bfd-adb1-4f57-8eff-d4f1d39870b4 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 08:22:49 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-ae528bfd-adb1-4f57-8eff-d4f1d39870b4 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] LIGHTOS: no hostnqn found. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 08:22:49 user nova-compute[95467]: DEBUG os_brick.utils [None req-ae528bfd-adb1-4f57-8eff-d4f1d39870b4 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] <== get_connector_properties: return (180ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:882ae90641f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:22:49 user nova-compute[95467]: DEBUG nova.virt.block_device [None req-ae528bfd-adb1-4f57-8eff-d4f1d39870b4 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Updating existing volume attachment record: 0d955e33-0082-43a5-be86-3afe4b9372c9 {{(pid=95467) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 08:22:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d22eb02b-7e8d-4755-9f1e-3eee56ddec0c/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d22eb02b-7e8d-4755-9f1e-3eee56ddec0c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d22eb02b-7e8d-4755-9f1e-3eee56ddec0c/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d22eb02b-7e8d-4755-9f1e-3eee56ddec0c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:49 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:22:50 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:22:50 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:22:50 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Hypervisor/Node resource view: name=user free_ram=7202MB free_disk=25.077754974365234GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=95467) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 08:22:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:22:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:22:50 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 73fe8852-c47a-47ab-a56f-6864c8ed5479 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:22:50 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 21cf2ada-b15c-490d-ac37-96e9c87e9056 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:22:50 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:22:50 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 10d73b73-ca65-4192-8954-288dc1df9f24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:22:50 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 3825a691-ac5c-4c06-b4a4-2a0b40c638c4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:22:50 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance a1a155e6-0ee2-4728-a526-17c149107ab0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:22:50 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 0edcb81b-d8fe-482c-a7ca-6b76455cfe33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:22:50 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance e7805e5c-1777-4b0c-95c7-b232be66528c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:22:50 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:22:50 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 091612cf-b737-480b-984e-a05b522676b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:22:50 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance d22eb02b-7e8d-4755-9f1e-3eee56ddec0c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:22:50 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 710d9598-1d36-4fdb-aa62-e7ff0b5ababe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:22:50 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 08:22:50 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 08:22:51 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:22:51 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:22:51 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Compute_service record updated for user:user {{(pid=95467) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 08:22:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.620s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:22:51 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:22:52 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:22:52 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:22:52 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:22:52 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:22:52 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:22:52 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:22:54 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:22:54 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Starting heal instance info cache {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 08:22:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "refresh_cache-10d73b73-ca65-4192-8954-288dc1df9f24" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:22:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquired lock "refresh_cache-10d73b73-ca65-4192-8954-288dc1df9f24" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:22:54 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Forcefully refreshing network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 08:22:55 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Updating instance_info_cache with network_info: [{"id": "b88ee27b-7174-45f5-a5a5-45db71caac08", "address": "fa:16:3e:a0:3b:16", "network": {"id": "369d2a6f-60b7-4c92-8b2d-1f3828f6698b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1491709218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd281be4e94a4d31a47a13267d51d9b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb88ee27b-71", "ovs_interfaceid": "b88ee27b-7174-45f5-a5a5-45db71caac08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:22:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Releasing lock "refresh_cache-10d73b73-ca65-4192-8954-288dc1df9f24" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:22:55 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Updated the network info_cache for instance {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 08:22:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d4e9b66d-c8f7-428c-a0ab-422ebe24349d tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Acquiring lock "e7805e5c-1777-4b0c-95c7-b232be66528c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:22:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d4e9b66d-c8f7-428c-a0ab-422ebe24349d tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "e7805e5c-1777-4b0c-95c7-b232be66528c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:22:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d4e9b66d-c8f7-428c-a0ab-422ebe24349d tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Acquiring lock "e7805e5c-1777-4b0c-95c7-b232be66528c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:22:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d4e9b66d-c8f7-428c-a0ab-422ebe24349d tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "e7805e5c-1777-4b0c-95c7-b232be66528c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:22:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d4e9b66d-c8f7-428c-a0ab-422ebe24349d tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "e7805e5c-1777-4b0c-95c7-b232be66528c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:22:55 user nova-compute[95467]: INFO nova.compute.manager [None req-d4e9b66d-c8f7-428c-a0ab-422ebe24349d tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Terminating instance
Nov 15 08:22:55 user nova-compute[95467]: DEBUG nova.compute.manager [None req-d4e9b66d-c8f7-428c-a0ab-422ebe24349d tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Start destroying the instance on the hypervisor. {{(pid=95467) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 08:22:55 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:22:55 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:22:55 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:22:55 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:22:55 user nova-compute[95467]: DEBUG nova.compute.manager [req-107d855d-c7e6-4ca4-b220-8720a85464ed req-9140f243-3486-4676-968f-498a0b8178f1 service nova] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Received event network-vif-unplugged-7f8e69fc-628f-4a31-9ba0-db0b320dff09 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:22:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-107d855d-c7e6-4ca4-b220-8720a85464ed req-9140f243-3486-4676-968f-498a0b8178f1 service nova] Acquiring lock "e7805e5c-1777-4b0c-95c7-b232be66528c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:22:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-107d855d-c7e6-4ca4-b220-8720a85464ed req-9140f243-3486-4676-968f-498a0b8178f1 service nova] Lock "e7805e5c-1777-4b0c-95c7-b232be66528c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:22:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-107d855d-c7e6-4ca4-b220-8720a85464ed req-9140f243-3486-4676-968f-498a0b8178f1 service nova] Lock "e7805e5c-1777-4b0c-95c7-b232be66528c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:22:55 user nova-compute[95467]: DEBUG nova.compute.manager [req-107d855d-c7e6-4ca4-b220-8720a85464ed req-9140f243-3486-4676-968f-498a0b8178f1 service nova] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] No waiting events found dispatching network-vif-unplugged-7f8e69fc-628f-4a31-9ba0-db0b320dff09 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:22:55 user nova-compute[95467]: DEBUG nova.compute.manager [req-107d855d-c7e6-4ca4-b220-8720a85464ed req-9140f243-3486-4676-968f-498a0b8178f1 service nova] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Received event network-vif-unplugged-7f8e69fc-628f-4a31-9ba0-db0b320dff09 for instance with task_state deleting. {{(pid=95467) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 08:22:56 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Instance destroyed successfully.
Nov 15 08:22:56 user nova-compute[95467]: DEBUG nova.objects.instance [None req-d4e9b66d-c8f7-428c-a0ab-422ebe24349d tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lazy-loading 'resources' on Instance uuid e7805e5c-1777-4b0c-95c7-b232be66528c {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:22:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-d4e9b66d-c8f7-428c-a0ab-422ebe24349d tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T08:17:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2096143899',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2096143899',id=28,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBJ4d3/P/W4IM4c/SDFdf9+rwPXC3NZ0eghDPz0brXh+NeL91puTUjJZ6Wd0+WEV7wlTz3Y4+T858B8rzcbTbkNawWiCCL5nZHqbWqmnXBZ63bY9/9J2fUPSgv/Bhxp1g==',key_name='tempest-keypair-559293739',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:21:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='94b04c448c61451d8d46ebc7a61a5e6e',ramdisk_id='',reservation_id='r-1r9tzmt8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1251988905',owner_user_name='tempest-AttachVolumeShelveTestJSON-1251988905-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:21:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b03564d022e84f5cb133b9771e76bae8',uuid=e7805e5c-1777-4b0c-95c7-b232be66528c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f8e69fc-628f-4a31-9ba0-db0b320dff09", "address": "fa:16:3e:46:f0:15", "network": {"id": "f7871b75-73b3-4f0a-8e6c-814bc61ebd6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-945672014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b04c448c61451d8d46ebc7a61a5e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f8e69fc-62", "ovs_interfaceid": "7f8e69fc-628f-4a31-9ba0-db0b320dff09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:22:56 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-d4e9b66d-c8f7-428c-a0ab-422ebe24349d tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Converting VIF {"id": "7f8e69fc-628f-4a31-9ba0-db0b320dff09", "address": "fa:16:3e:46:f0:15", "network": {"id": "f7871b75-73b3-4f0a-8e6c-814bc61ebd6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-945672014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b04c448c61451d8d46ebc7a61a5e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f8e69fc-62", "ovs_interfaceid": "7f8e69fc-628f-4a31-9ba0-db0b320dff09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:22:56 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-d4e9b66d-c8f7-428c-a0ab-422ebe24349d tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:f0:15,bridge_name='br-int',has_traffic_filtering=True,id=7f8e69fc-628f-4a31-9ba0-db0b320dff09,network=Network(f7871b75-73b3-4f0a-8e6c-814bc61ebd6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f8e69fc-62') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:22:56 user nova-compute[95467]: DEBUG os_vif [None req-d4e9b66d-c8f7-428c-a0ab-422ebe24349d tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:f0:15,bridge_name='br-int',has_traffic_filtering=True,id=7f8e69fc-628f-4a31-9ba0-db0b320dff09,network=Network(f7871b75-73b3-4f0a-8e6c-814bc61ebd6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f8e69fc-62') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:22:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:22:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7f8e69fc-62, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:22:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:22:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:22:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:22:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f0740673-3b76-43ca-ab3b-e0f081035059) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:22:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:22:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:22:56 user nova-compute[95467]: INFO os_vif [None req-d4e9b66d-c8f7-428c-a0ab-422ebe24349d tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:f0:15,bridge_name='br-int',has_traffic_filtering=True,id=7f8e69fc-628f-4a31-9ba0-db0b320dff09,network=Network(f7871b75-73b3-4f0a-8e6c-814bc61ebd6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f8e69fc-62')
Nov 15 08:22:56 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-d4e9b66d-c8f7-428c-a0ab-422ebe24349d tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Deleting instance files /opt/stack/data/nova/instances/e7805e5c-1777-4b0c-95c7-b232be66528c_del
Nov 15 08:22:56 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-d4e9b66d-c8f7-428c-a0ab-422ebe24349d tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Deletion of /opt/stack/data/nova/instances/e7805e5c-1777-4b0c-95c7-b232be66528c_del complete
Nov 15 08:22:56 user nova-compute[95467]: INFO nova.compute.manager [None req-d4e9b66d-c8f7-428c-a0ab-422ebe24349d tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 15 08:22:56 user nova-compute[95467]: DEBUG oslo.service.loopingcall [None req-d4e9b66d-c8f7-428c-a0ab-422ebe24349d tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=95467) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 08:22:56 user nova-compute[95467]: DEBUG nova.compute.manager [-] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Deallocating network for instance {{(pid=95467) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 08:22:56 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] deallocate_for_instance() {{(pid=95467) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 08:22:57 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:22:57 user nova-compute[95467]: INFO nova.compute.manager [-] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Took 0.84 seconds to deallocate network for instance.
Nov 15 08:22:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d4e9b66d-c8f7-428c-a0ab-422ebe24349d tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:22:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d4e9b66d-c8f7-428c-a0ab-422ebe24349d tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:22:57 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-d4e9b66d-c8f7-428c-a0ab-422ebe24349d tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:22:57 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-d4e9b66d-c8f7-428c-a0ab-422ebe24349d tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:22:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d4e9b66d-c8f7-428c-a0ab-422ebe24349d tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.403s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:22:57 user nova-compute[95467]: INFO nova.scheduler.client.report [None req-d4e9b66d-c8f7-428c-a0ab-422ebe24349d tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Deleted allocations for instance e7805e5c-1777-4b0c-95c7-b232be66528c
Nov 15 08:22:57 user nova-compute[95467]: DEBUG nova.compute.manager [req-77605ecf-d929-4765-90d6-a5b3421ab926 req-b94913d9-0ee1-45c3-bbba-31955376c526 service nova] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Received event network-vif-plugged-7f8e69fc-628f-4a31-9ba0-db0b320dff09 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:22:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-77605ecf-d929-4765-90d6-a5b3421ab926 req-b94913d9-0ee1-45c3-bbba-31955376c526 service nova] Acquiring lock "e7805e5c-1777-4b0c-95c7-b232be66528c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:22:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-77605ecf-d929-4765-90d6-a5b3421ab926 req-b94913d9-0ee1-45c3-bbba-31955376c526 service nova] Lock "e7805e5c-1777-4b0c-95c7-b232be66528c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:22:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-77605ecf-d929-4765-90d6-a5b3421ab926 req-b94913d9-0ee1-45c3-bbba-31955376c526 service nova] Lock "e7805e5c-1777-4b0c-95c7-b232be66528c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:22:57 user nova-compute[95467]: DEBUG nova.compute.manager [req-77605ecf-d929-4765-90d6-a5b3421ab926 req-b94913d9-0ee1-45c3-bbba-31955376c526 service nova] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] No waiting events found dispatching network-vif-plugged-7f8e69fc-628f-4a31-9ba0-db0b320dff09 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:22:57 user nova-compute[95467]: WARNING nova.compute.manager [req-77605ecf-d929-4765-90d6-a5b3421ab926 req-b94913d9-0ee1-45c3-bbba-31955376c526 service nova] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Received unexpected event network-vif-plugged-7f8e69fc-628f-4a31-9ba0-db0b320dff09 for instance with vm_state deleted and task_state None.
Nov 15 08:22:57 user nova-compute[95467]: DEBUG nova.compute.manager [req-77605ecf-d929-4765-90d6-a5b3421ab926 req-b94913d9-0ee1-45c3-bbba-31955376c526 service nova] [instance: e7805e5c-1777-4b0c-95c7-b232be66528c] Received event network-vif-deleted-7f8e69fc-628f-4a31-9ba0-db0b320dff09 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:22:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:22:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d4e9b66d-c8f7-428c-a0ab-422ebe24349d tempest-AttachVolumeShelveTestJSON-1251988905 tempest-AttachVolumeShelveTestJSON-1251988905-project-member] Lock "e7805e5c-1777-4b0c-95c7-b232be66528c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.351s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:22:58 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae528bfd-adb1-4f57-8eff-d4f1d39870b4 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Calling os-brick to attach iSCSI Volume {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 08:22:58 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae528bfd-adb1-4f57-8eff-d4f1d39870b4 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9df081f2-6e31-4922-94d2-8b02bd168789', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oNzVvKdy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:22:58 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-ae528bfd-adb1-4f57-8eff-d4f1d39870b4 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:22:58 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-ae528bfd-adb1-4f57-8eff-d4f1d39870b4 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:22:58 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-ae528bfd-adb1-4f57-8eff-d4f1d39870b4 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:22:58 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-ae528bfd-adb1-4f57-8eff-d4f1d39870b4 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:22:58 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-ae528bfd-adb1-4f57-8eff-d4f1d39870b4 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9df081f2-6e31-4922-94d2-8b02bd168789" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:22:58 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-ae528bfd-adb1-4f57-8eff-d4f1d39870b4 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9df081f2-6e31-4922-94d2-8b02bd168789" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:22:58 user nova-compute[95467]: INFO os_brick.initiator.connectors.iscsi [None req-ae528bfd-adb1-4f57-8eff-d4f1d39870b4 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 08:22:58 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9df081f2-6e31-4922-94d2-8b02bd168789 -p 172.16.0.220:3260 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:58 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9df081f2-6e31-4922-94d2-8b02bd168789 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:58 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b73d89-d898-4e6b-8971-4edc52c03d9e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:58 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae528bfd-adb1-4f57-8eff-d4f1d39870b4 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 08:22:58 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:22:58 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9df081f2-6e31-4922-94d2-8b02bd168789 -p 172.16.0.220:3260 --interface default --op new {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:58 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9df081f2-6e31-4922-94d2-8b02bd168789 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:58 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a69ae237-84eb-4917-9960-f290a0447e65]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9df081f2-6e31-4922-94d2-8b02bd168789] added\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:58 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae528bfd-adb1-4f57-8eff-d4f1d39870b4 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9df081f2-6e31-4922-94d2-8b02bd168789] added
Nov 15 08:22:58 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:22:58 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9df081f2-6e31-4922-94d2-8b02bd168789 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:58 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9df081f2-6e31-4922-94d2-8b02bd168789 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:58 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c9d380-1a1a-411f-8753-9cbc826807a5]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:58 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae528bfd-adb1-4f57-8eff-d4f1d39870b4 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:22:58 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9df081f2-6e31-4922-94d2-8b02bd168789 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:58 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9df081f2-6e31-4922-94d2-8b02bd168789 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:58 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ac99f4-5fed-4c11-9aa2-ddd1b39a9ee4]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:58 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae528bfd-adb1-4f57-8eff-d4f1d39870b4 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:22:58 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9df081f2-6e31-4922-94d2-8b02bd168789 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oNzVvKdy {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:58 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9df081f2-6e31-4922-94d2-8b02bd168789 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oNzVvKdy" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:58 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dbf62d0-506f-40f8-ac1a-786bf8b921f0]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:58 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae528bfd-adb1-4f57-8eff-d4f1d39870b4 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oNzVvKdy'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:22:58 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9df081f2-6e31-4922-94d2-8b02bd168789 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:58 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9df081f2-6e31-4922-94d2-8b02bd168789 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:58 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f2f42b-6746-4f95-9c8a-1ac878fed290]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:58 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae528bfd-adb1-4f57-8eff-d4f1d39870b4 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:22:58 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:59 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:59 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c006c32-7f20-4ca2-a0be-b9d7739af079]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:59 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae528bfd-adb1-4f57-8eff-d4f1d39870b4 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:22:59 user nova-compute[95467]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:22:59 user nova-compute[95467]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:22:59 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:22:59 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae528bfd-adb1-4f57-8eff-d4f1d39870b4 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:22:59 user nova-compute[95467]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:22:59 user nova-compute[95467]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:22:59 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:22:59 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9df081f2-6e31-4922-94d2-8b02bd168789 -p 172.16.0.220:3260 --login {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:59 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9df081f2-6e31-4922-94d2-8b02bd168789 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:59 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a391e4a7-a72e-4a09-8cb0-58d8f9e0f1dc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9df081f2-6e31-4922-94d2-8b02bd168789, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9df081f2-6e31-4922-94d2-8b02bd168789, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:59 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae528bfd-adb1-4f57-8eff-d4f1d39870b4 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9df081f2-6e31-4922-94d2-8b02bd168789, portal: 172.16.0.220,3260]
Nov 15 08:22:59 user nova-compute[95467]: Login to [iface: default, target: iqn.2010-10.org.openstack:9df081f2-6e31-4922-94d2-8b02bd168789, portal: 172.16.0.220,3260] successful.
Nov 15 08:22:59 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:22:59 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9df081f2-6e31-4922-94d2-8b02bd168789 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:59 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9df081f2-6e31-4922-94d2-8b02bd168789 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:59 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[686c83c9-c73b-4755-8687-d4f2a866a396]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:59 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae528bfd-adb1-4f57-8eff-d4f1d39870b4 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:22:59 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:59 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:59 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[16cf2a43-0c77-47c9-bcf6-1abb7497da27]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df081f2-6e31-4922-94d2-8b02bd168789 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:59 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae528bfd-adb1-4f57-8eff-d4f1d39870b4 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:22:59 user nova-compute[95467]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:22:59 user nova-compute[95467]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:22:59 user nova-compute[95467]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df081f2-6e31-4922-94d2-8b02bd168789 (non-flash)
Nov 15 08:22:59 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:22:59 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae528bfd-adb1-4f57-8eff-d4f1d39870b4 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:22:59 user nova-compute[95467]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:22:59 user nova-compute[95467]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:22:59 user nova-compute[95467]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df081f2-6e31-4922-94d2-8b02bd168789 (non-flash)
Nov 15 08:22:59 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:22:59 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-ae528bfd-adb1-4f57-8eff-d4f1d39870b4 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9df081f2-6e31-4922-94d2-8b02bd168789" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:22:59 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae528bfd-adb1-4f57-8eff-d4f1d39870b4 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Connected to 172.16.0.220:3260 {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 08:22:59 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-ae528bfd-adb1-4f57-8eff-d4f1d39870b4 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] HCTL ('34', '-', '-', 0) found on session 37 with lun 0 {{(pid=95467) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 08:22:59 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-ae528bfd-adb1-4f57-8eff-d4f1d39870b4 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=95467) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 08:22:59 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:22:59 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:22:59 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[552b7c68-57c8-4942-bc4d-9f4cd8784e1c]: (4, ('- - 0', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:22:59 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-ae528bfd-adb1-4f57-8eff-d4f1d39870b4 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Searching for a device in session 37 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:22:59 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae528bfd-adb1-4f57-8eff-d4f1d39870b4 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9df081f2-6e31-4922-94d2-8b02bd168789', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oNzVvKdy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 08:23:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-ae528bfd-adb1-4f57-8eff-d4f1d39870b4 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:23:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae528bfd-adb1-4f57-8eff-d4f1d39870b4 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '26536613938356633', 'path': '/dev/sdc'} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:23:00 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae528bfd-adb1-4f57-8eff-d4f1d39870b4 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26536613938356633', 'path': '/dev/sdc'} {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 08:23:00 user nova-compute[95467]: DEBUG nova.objects.instance [None req-ae528bfd-adb1-4f57-8eff-d4f1d39870b4 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lazy-loading 'flavor' on Instance uuid a1a155e6-0ee2-4728-a526-17c149107ab0 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:23:00 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-ae528bfd-adb1-4f57-8eff-d4f1d39870b4 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 08:23:00 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:23:00 user nova-compute[95467]:   <source dev="/dev/sdc"/>
Nov 15 08:23:00 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:23:00 user nova-compute[95467]:   <serial>9df081f2-6e31-4922-94d2-8b02bd168789</serial>
Nov 15 08:23:00 user nova-compute[95467]: </disk>
Nov 15 08:23:00 user nova-compute[95467]:  {{(pid=95467) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 08:23:00 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-ae528bfd-adb1-4f57-8eff-d4f1d39870b4 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:23:00 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-ae528bfd-adb1-4f57-8eff-d4f1d39870b4 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] No BDM found with device name vdb, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:23:00 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-ae528bfd-adb1-4f57-8eff-d4f1d39870b4 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] No VIF found with MAC fa:16:3e:83:dc:7a, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:23:00 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-ae528bfd-adb1-4f57-8eff-d4f1d39870b4 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lock "a1a155e6-0ee2-4728-a526-17c149107ab0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.752s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:23:01 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-09714f86-e690-481f-b81d-218415755881 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Acquiring lock "a1a155e6-0ee2-4728-a526-17c149107ab0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:23:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-09714f86-e690-481f-b81d-218415755881 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lock "a1a155e6-0ee2-4728-a526-17c149107ab0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:23:02 user nova-compute[95467]: INFO nova.compute.manager [None req-09714f86-e690-481f-b81d-218415755881 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Detaching volume 9df081f2-6e31-4922-94d2-8b02bd168789
Nov 15 08:23:02 user nova-compute[95467]: INFO nova.virt.block_device [None req-09714f86-e690-481f-b81d-218415755881 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Attempting to driver detach volume 9df081f2-6e31-4922-94d2-8b02bd168789 from mountpoint /dev/vdb
Nov 15 08:23:02 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-09714f86-e690-481f-b81d-218415755881 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Attempting to detach device vdb from instance a1a155e6-0ee2-4728-a526-17c149107ab0 from the persistent domain config. {{(pid=95467) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 08:23:02 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-09714f86-e690-481f-b81d-218415755881 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 08:23:02 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:23:02 user nova-compute[95467]:   <source dev="/dev/sdc"/>
Nov 15 08:23:02 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:23:02 user nova-compute[95467]:   <serial>9df081f2-6e31-4922-94d2-8b02bd168789</serial>
Nov 15 08:23:02 user nova-compute[95467]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 08:23:02 user nova-compute[95467]: </disk>
Nov 15 08:23:02 user nova-compute[95467]:  {{(pid=95467) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 08:23:02 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-09714f86-e690-481f-b81d-218415755881 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Successfully detached device vdb from instance a1a155e6-0ee2-4728-a526-17c149107ab0 from the persistent domain config.
Nov 15 08:23:02 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-09714f86-e690-481f-b81d-218415755881 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a1a155e6-0ee2-4728-a526-17c149107ab0 from the live domain config. {{(pid=95467) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 08:23:02 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-09714f86-e690-481f-b81d-218415755881 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 08:23:02 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:23:02 user nova-compute[95467]:   <source dev="/dev/sdc"/>
Nov 15 08:23:02 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:23:02 user nova-compute[95467]:   <serial>9df081f2-6e31-4922-94d2-8b02bd168789</serial>
Nov 15 08:23:02 user nova-compute[95467]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 08:23:02 user nova-compute[95467]: </disk>
Nov 15 08:23:02 user nova-compute[95467]:  {{(pid=95467) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 08:23:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-2f9b7182-53ab-4f93-bb34-9af2995b6e65 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Acquiring lock "0edcb81b-d8fe-482c-a7ca-6b76455cfe33" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:23:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-2f9b7182-53ab-4f93-bb34-9af2995b6e65 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "0edcb81b-d8fe-482c-a7ca-6b76455cfe33" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:23:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-2f9b7182-53ab-4f93-bb34-9af2995b6e65 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Acquiring lock "0edcb81b-d8fe-482c-a7ca-6b76455cfe33-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:23:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-2f9b7182-53ab-4f93-bb34-9af2995b6e65 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "0edcb81b-d8fe-482c-a7ca-6b76455cfe33-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:23:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-2f9b7182-53ab-4f93-bb34-9af2995b6e65 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "0edcb81b-d8fe-482c-a7ca-6b76455cfe33-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:23:02 user nova-compute[95467]: INFO nova.compute.manager [None req-2f9b7182-53ab-4f93-bb34-9af2995b6e65 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] Terminating instance
Nov 15 08:23:02 user nova-compute[95467]: DEBUG nova.compute.manager [None req-2f9b7182-53ab-4f93-bb34-9af2995b6e65 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] Start destroying the instance on the hypervisor. {{(pid=95467) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 08:23:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:02 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-09714f86-e690-481f-b81d-218415755881 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a1a155e6-0ee2-4728-a526-17c149107ab0 {{(pid=95467) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 08:23:03 user nova-compute[95467]: DEBUG nova.compute.manager [req-27a9c049-b56d-4e24-9a01-7728e4583c19 req-65d1d5b5-8a73-4a41-9dec-6726ac78c1e2 service nova] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] Received event network-vif-unplugged-0469b401-fc62-46e8-bdd0-b00f131d4821 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:23:03 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-27a9c049-b56d-4e24-9a01-7728e4583c19 req-65d1d5b5-8a73-4a41-9dec-6726ac78c1e2 service nova] Acquiring lock "0edcb81b-d8fe-482c-a7ca-6b76455cfe33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:23:03 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-27a9c049-b56d-4e24-9a01-7728e4583c19 req-65d1d5b5-8a73-4a41-9dec-6726ac78c1e2 service nova] Lock "0edcb81b-d8fe-482c-a7ca-6b76455cfe33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:23:03 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-27a9c049-b56d-4e24-9a01-7728e4583c19 req-65d1d5b5-8a73-4a41-9dec-6726ac78c1e2 service nova] Lock "0edcb81b-d8fe-482c-a7ca-6b76455cfe33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:23:03 user nova-compute[95467]: DEBUG nova.compute.manager [req-27a9c049-b56d-4e24-9a01-7728e4583c19 req-65d1d5b5-8a73-4a41-9dec-6726ac78c1e2 service nova] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] No waiting events found dispatching network-vif-unplugged-0469b401-fc62-46e8-bdd0-b00f131d4821 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:23:03 user nova-compute[95467]: DEBUG nova.compute.manager [req-27a9c049-b56d-4e24-9a01-7728e4583c19 req-65d1d5b5-8a73-4a41-9dec-6726ac78c1e2 service nova] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] Received event network-vif-unplugged-0469b401-fc62-46e8-bdd0-b00f131d4821 for instance with task_state deleting. {{(pid=95467) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 08:23:03 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] Instance destroyed successfully.
Nov 15 08:23:03 user nova-compute[95467]: DEBUG nova.objects.instance [None req-2f9b7182-53ab-4f93-bb34-9af2995b6e65 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lazy-loading 'resources' on Instance uuid 0edcb81b-d8fe-482c-a7ca-6b76455cfe33 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:23:03 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-2f9b7182-53ab-4f93-bb34-9af2995b6e65 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:20:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1162489474',display_name='tempest-AttachVolumeNegativeTest-server-1162489474',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1162489474',id=34,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIv7hodxe5fWEgdAzwMU7vQn9xo8GZj3pJDEddbIIa2NzBqjcwsD2M3KQemXfSW+TDNkp8Mb76eCGpMtGW5a0/2F3/tNNgjp8zYjkURclJix9zn6R08z8YJPwue6BGgOxw==',key_name='tempest-keypair-1313226940',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:20:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='50e2fec6a90a41a5a586c6da227caacc',ramdisk_id='',reservation_id='r-91hnjbo8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1750086293',owner_user_name='tempest-AttachVolumeNegativeTest-1750086293-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:20:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='acce273b07b64e44af6e062175afa92d',uuid=0edcb81b-d8fe-482c-a7ca-6b76455cfe33,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0469b401-fc62-46e8-bdd0-b00f131d4821", "address": "fa:16:3e:7d:e4:86", "network": {"id": "27fd2b0f-65bd-4ae4-b5c8-dfca91668078", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1310727750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50e2fec6a90a41a5a586c6da227caacc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0469b401-fc", "ovs_interfaceid": "0469b401-fc62-46e8-bdd0-b00f131d4821", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:23:03 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-2f9b7182-53ab-4f93-bb34-9af2995b6e65 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Converting VIF {"id": "0469b401-fc62-46e8-bdd0-b00f131d4821", "address": "fa:16:3e:7d:e4:86", "network": {"id": "27fd2b0f-65bd-4ae4-b5c8-dfca91668078", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1310727750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50e2fec6a90a41a5a586c6da227caacc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0469b401-fc", "ovs_interfaceid": "0469b401-fc62-46e8-bdd0-b00f131d4821", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:23:03 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-2f9b7182-53ab-4f93-bb34-9af2995b6e65 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:e4:86,bridge_name='br-int',has_traffic_filtering=True,id=0469b401-fc62-46e8-bdd0-b00f131d4821,network=Network(27fd2b0f-65bd-4ae4-b5c8-dfca91668078),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0469b401-fc') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:23:03 user nova-compute[95467]: DEBUG os_vif [None req-2f9b7182-53ab-4f93-bb34-9af2995b6e65 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:e4:86,bridge_name='br-int',has_traffic_filtering=True,id=0469b401-fc62-46e8-bdd0-b00f131d4821,network=Network(27fd2b0f-65bd-4ae4-b5c8-dfca91668078),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0469b401-fc') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:23:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0469b401-fc, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:23:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:23:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=57b0e9bd-eaf0-41be-9f70-1b5a5ea06f5c) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:23:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:23:03 user nova-compute[95467]: INFO os_vif [None req-2f9b7182-53ab-4f93-bb34-9af2995b6e65 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:e4:86,bridge_name='br-int',has_traffic_filtering=True,id=0469b401-fc62-46e8-bdd0-b00f131d4821,network=Network(27fd2b0f-65bd-4ae4-b5c8-dfca91668078),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0469b401-fc')
Nov 15 08:23:03 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-2f9b7182-53ab-4f93-bb34-9af2995b6e65 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] Deleting instance files /opt/stack/data/nova/instances/0edcb81b-d8fe-482c-a7ca-6b76455cfe33_del
Nov 15 08:23:03 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-2f9b7182-53ab-4f93-bb34-9af2995b6e65 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] Deletion of /opt/stack/data/nova/instances/0edcb81b-d8fe-482c-a7ca-6b76455cfe33_del complete
Nov 15 08:23:03 user nova-compute[95467]: INFO nova.compute.manager [None req-2f9b7182-53ab-4f93-bb34-9af2995b6e65 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 15 08:23:03 user nova-compute[95467]: DEBUG oslo.service.loopingcall [None req-2f9b7182-53ab-4f93-bb34-9af2995b6e65 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=95467) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 08:23:03 user nova-compute[95467]: DEBUG nova.compute.manager [-] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] Deallocating network for instance {{(pid=95467) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 08:23:03 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] deallocate_for_instance() {{(pid=95467) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 08:23:04 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:23:04 user nova-compute[95467]: INFO nova.compute.manager [-] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] Took 0.80 seconds to deallocate network for instance.
Nov 15 08:23:04 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-2f9b7182-53ab-4f93-bb34-9af2995b6e65 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:23:04 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-2f9b7182-53ab-4f93-bb34-9af2995b6e65 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:23:04 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-2f9b7182-53ab-4f93-bb34-9af2995b6e65 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:23:04 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-2f9b7182-53ab-4f93-bb34-9af2995b6e65 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:23:04 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-2f9b7182-53ab-4f93-bb34-9af2995b6e65 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.485s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:23:04 user nova-compute[95467]: INFO nova.scheduler.client.report [None req-2f9b7182-53ab-4f93-bb34-9af2995b6e65 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Deleted allocations for instance 0edcb81b-d8fe-482c-a7ca-6b76455cfe33
Nov 15 08:23:05 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-2f9b7182-53ab-4f93-bb34-9af2995b6e65 tempest-AttachVolumeNegativeTest-1750086293 tempest-AttachVolumeNegativeTest-1750086293-project-member] Lock "0edcb81b-d8fe-482c-a7ca-6b76455cfe33" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.319s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:23:05 user nova-compute[95467]: DEBUG nova.compute.manager [req-4b257b7d-acbb-48a3-84b5-31ce6d7d606a req-980a98b3-1953-4da6-8e25-91bde7f5581f service nova] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] Received event network-vif-plugged-0469b401-fc62-46e8-bdd0-b00f131d4821 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:23:05 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-4b257b7d-acbb-48a3-84b5-31ce6d7d606a req-980a98b3-1953-4da6-8e25-91bde7f5581f service nova] Acquiring lock "0edcb81b-d8fe-482c-a7ca-6b76455cfe33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:23:05 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-4b257b7d-acbb-48a3-84b5-31ce6d7d606a req-980a98b3-1953-4da6-8e25-91bde7f5581f service nova] Lock "0edcb81b-d8fe-482c-a7ca-6b76455cfe33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:23:05 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-4b257b7d-acbb-48a3-84b5-31ce6d7d606a req-980a98b3-1953-4da6-8e25-91bde7f5581f service nova] Lock "0edcb81b-d8fe-482c-a7ca-6b76455cfe33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:23:05 user nova-compute[95467]: DEBUG nova.compute.manager [req-4b257b7d-acbb-48a3-84b5-31ce6d7d606a req-980a98b3-1953-4da6-8e25-91bde7f5581f service nova] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] No waiting events found dispatching network-vif-plugged-0469b401-fc62-46e8-bdd0-b00f131d4821 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:23:05 user nova-compute[95467]: WARNING nova.compute.manager [req-4b257b7d-acbb-48a3-84b5-31ce6d7d606a req-980a98b3-1953-4da6-8e25-91bde7f5581f service nova] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] Received unexpected event network-vif-plugged-0469b401-fc62-46e8-bdd0-b00f131d4821 for instance with vm_state deleted and task_state None.
Nov 15 08:23:05 user nova-compute[95467]: DEBUG nova.compute.manager [req-4b257b7d-acbb-48a3-84b5-31ce6d7d606a req-980a98b3-1953-4da6-8e25-91bde7f5581f service nova] [instance: 0edcb81b-d8fe-482c-a7ca-6b76455cfe33] Received event network-vif-deleted-0469b401-fc62-46e8-bdd0-b00f131d4821 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:23:07 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:08 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:09 user nova-compute[95467]: DEBUG nova.compute.manager [req-fdef415a-9681-4616-acb9-dda097ff3d4a req-d83aa18d-08ce-457b-8fb6-a5afd6a2e765 service nova] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] Received event network-changed-d7e5ca44-eee3-4452-9649-5fcbfe5ed5ad {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:23:09 user nova-compute[95467]: DEBUG nova.compute.manager [req-fdef415a-9681-4616-acb9-dda097ff3d4a req-d83aa18d-08ce-457b-8fb6-a5afd6a2e765 service nova] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] Refreshing instance network info cache due to event network-changed-d7e5ca44-eee3-4452-9649-5fcbfe5ed5ad. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:23:09 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-fdef415a-9681-4616-acb9-dda097ff3d4a req-d83aa18d-08ce-457b-8fb6-a5afd6a2e765 service nova] Acquiring lock "refresh_cache-73fe8852-c47a-47ab-a56f-6864c8ed5479" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:23:09 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-fdef415a-9681-4616-acb9-dda097ff3d4a req-d83aa18d-08ce-457b-8fb6-a5afd6a2e765 service nova] Acquired lock "refresh_cache-73fe8852-c47a-47ab-a56f-6864c8ed5479" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:23:09 user nova-compute[95467]: DEBUG nova.network.neutron [req-fdef415a-9681-4616-acb9-dda097ff3d4a req-d83aa18d-08ce-457b-8fb6-a5afd6a2e765 service nova] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] Refreshing network info cache for port d7e5ca44-eee3-4452-9649-5fcbfe5ed5ad {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:23:09 user nova-compute[95467]: DEBUG nova.network.neutron [req-fdef415a-9681-4616-acb9-dda097ff3d4a req-d83aa18d-08ce-457b-8fb6-a5afd6a2e765 service nova] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] Updated VIF entry in instance network info cache for port d7e5ca44-eee3-4452-9649-5fcbfe5ed5ad. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:23:09 user nova-compute[95467]: DEBUG nova.network.neutron [req-fdef415a-9681-4616-acb9-dda097ff3d4a req-d83aa18d-08ce-457b-8fb6-a5afd6a2e765 service nova] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] Updating instance_info_cache with network_info: [{"id": "d7e5ca44-eee3-4452-9649-5fcbfe5ed5ad", "address": "fa:16:3e:e5:16:8b", "network": {"id": "d8a362dc-0dc8-49dd-b2da-0e0749d5edca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-256373617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a1aa4f562c64545a94157d4aaf8d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7e5ca44-ee", "ovs_interfaceid": "d7e5ca44-eee3-4452-9649-5fcbfe5ed5ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:23:09 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-fdef415a-9681-4616-acb9-dda097ff3d4a req-d83aa18d-08ce-457b-8fb6-a5afd6a2e765 service nova] Releasing lock "refresh_cache-73fe8852-c47a-47ab-a56f-6864c8ed5479" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:23:11 user nova-compute[95467]: DEBUG nova.compute.manager [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Stashing vm_state: active {{(pid=95467) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 15 08:23:11 user nova-compute[95467]: DEBUG nova.compute.manager [req-24d35330-a7fb-4c33-bb1c-a6baa949ca7d req-7c3493ca-a44b-4374-aee1-9bdf937bab48 service nova] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Received event network-changed-cb099600-0c5c-4e0d-adfe-91a6ba3e0f08 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:23:11 user nova-compute[95467]: DEBUG nova.compute.manager [req-24d35330-a7fb-4c33-bb1c-a6baa949ca7d req-7c3493ca-a44b-4374-aee1-9bdf937bab48 service nova] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Refreshing instance network info cache due to event network-changed-cb099600-0c5c-4e0d-adfe-91a6ba3e0f08. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:23:11 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-24d35330-a7fb-4c33-bb1c-a6baa949ca7d req-7c3493ca-a44b-4374-aee1-9bdf937bab48 service nova] Acquiring lock "refresh_cache-a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:23:11 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-24d35330-a7fb-4c33-bb1c-a6baa949ca7d req-7c3493ca-a44b-4374-aee1-9bdf937bab48 service nova] Acquired lock "refresh_cache-a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:23:11 user nova-compute[95467]: DEBUG nova.network.neutron [req-24d35330-a7fb-4c33-bb1c-a6baa949ca7d req-7c3493ca-a44b-4374-aee1-9bdf937bab48 service nova] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Refreshing network info cache for port cb099600-0c5c-4e0d-adfe-91a6ba3e0f08 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:23:11 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:23:11 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:23:11 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=95467) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 08:23:11 user nova-compute[95467]: INFO nova.compute.claims [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Claim successful on node user
Nov 15 08:23:11 user nova-compute[95467]: INFO nova.compute.resource_tracker [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Updating resource usage from migration 8fe2f3a2-0317-41fd-bdca-8be49a9a3d90
Nov 15 08:23:11 user nova-compute[95467]: DEBUG nova.network.neutron [req-24d35330-a7fb-4c33-bb1c-a6baa949ca7d req-7c3493ca-a44b-4374-aee1-9bdf937bab48 service nova] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Updated VIF entry in instance network info cache for port cb099600-0c5c-4e0d-adfe-91a6ba3e0f08. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:23:11 user nova-compute[95467]: DEBUG nova.network.neutron [req-24d35330-a7fb-4c33-bb1c-a6baa949ca7d req-7c3493ca-a44b-4374-aee1-9bdf937bab48 service nova] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Updating instance_info_cache with network_info: [{"id": "cb099600-0c5c-4e0d-adfe-91a6ba3e0f08", "address": "fa:16:3e:1d:28:85", "network": {"id": "d8a362dc-0dc8-49dd-b2da-0e0749d5edca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-256373617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a1aa4f562c64545a94157d4aaf8d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb099600-0c", "ovs_interfaceid": "cb099600-0c5c-4e0d-adfe-91a6ba3e0f08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:23:11 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-24d35330-a7fb-4c33-bb1c-a6baa949ca7d req-7c3493ca-a44b-4374-aee1-9bdf937bab48 service nova] Releasing lock "refresh_cache-a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:23:11 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:23:11 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:23:12 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.414s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:23:12 user nova-compute[95467]: INFO nova.compute.manager [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Migrating
Nov 15 08:23:12 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:23:12 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Acquired lock "compute-rpcapi-router" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:23:12 user nova-compute[95467]: INFO nova.compute.rpcapi [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 15 08:23:12 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Releasing lock "compute-rpcapi-router" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:23:12 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Acquiring lock "refresh_cache-a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:23:12 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Acquired lock "refresh_cache-a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:23:12 user nova-compute[95467]: DEBUG nova.network.neutron [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:23:12 user nova-compute[95467]: DEBUG nova.network.neutron [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Updating instance_info_cache with network_info: [{"id": "cb099600-0c5c-4e0d-adfe-91a6ba3e0f08", "address": "fa:16:3e:1d:28:85", "network": {"id": "d8a362dc-0dc8-49dd-b2da-0e0749d5edca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-256373617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a1aa4f562c64545a94157d4aaf8d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb099600-0c", "ovs_interfaceid": "cb099600-0c5c-4e0d-adfe-91a6ba3e0f08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:23:12 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Releasing lock "refresh_cache-a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:23:12 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Starting migrate_disk_and_power_off {{(pid=95467) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 15 08:23:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:13 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Instance destroyed successfully.
Nov 15 08:23:13 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:21:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-884527110',display_name='tempest-ServerActionsTestOtherA-server-884527110',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-884527110',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYstiTKN6pNWftTYd849nYQtMIuEgDEUeKiw28UGbiftMSf1b7pXDFCSUnmvZj4PjTG3wPVLUk+MQqv7tZDYQ9Hh/tLAdBctcsd51z7x2h0dxB9v2l2G0kVC6Lobby9rA==',key_name='tempest-keypair-124047716',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:21:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0a1aa4f562c64545a94157d4aaf8d14e',ramdisk_id='',reservation_id='r-0emjo4p0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-937420730',owner_user_name='tempest-ServerActionsTestOtherA-937420730-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:23:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d9b34339b404facac21f500f40b1686',uuid=a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb099600-0c5c-4e0d-adfe-91a6ba3e0f08", "address": "fa:16:3e:1d:28:85", "network": {"id": "d8a362dc-0dc8-49dd-b2da-0e0749d5edca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-256373617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-256373617-network", "vif_mac": "fa:16:3e:1d:28:85"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a1aa4f562c64545a94157d4aaf8d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb099600-0c", "ovs_interfaceid": "cb099600-0c5c-4e0d-adfe-91a6ba3e0f08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Converting VIF {"id": "cb099600-0c5c-4e0d-adfe-91a6ba3e0f08", "address": "fa:16:3e:1d:28:85", "network": {"id": "d8a362dc-0dc8-49dd-b2da-0e0749d5edca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-256373617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-256373617-network", "vif_mac": "fa:16:3e:1d:28:85"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a1aa4f562c64545a94157d4aaf8d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb099600-0c", "ovs_interfaceid": "cb099600-0c5c-4e0d-adfe-91a6ba3e0f08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1d:28:85,bridge_name='br-int',has_traffic_filtering=True,id=cb099600-0c5c-4e0d-adfe-91a6ba3e0f08,network=Network(d8a362dc-0dc8-49dd-b2da-0e0749d5edca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb099600-0c') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG os_vif [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:28:85,bridge_name='br-int',has_traffic_filtering=True,id=cb099600-0c5c-4e0d-adfe-91a6ba3e0f08,network=Network(d8a362dc-0dc8-49dd-b2da-0e0749d5edca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb099600-0c') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcb099600-0c, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e9076862-c2d5-478c-99a0-1593af96e95b) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:13 user nova-compute[95467]: INFO os_vif [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:28:85,bridge_name='br-int',has_traffic_filtering=True,id=cb099600-0c5c-4e0d-adfe-91a6ba3e0f08,network=Network(d8a362dc-0dc8-49dd-b2da-0e0749d5edca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb099600-0c')
Nov 15 08:23:13 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] calling os-brick to detach iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, {'target_iqn': 'iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kFxqhEAV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:23:13 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:23:13 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b71306-339b-4eda-8837-75495cc60f0b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9df081f2-6e31-4922-94d2-8b02bd168789\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 08:23:13 user nova-compute[95467]: No targets found.
Nov 15 08:23:13 user nova-compute[95467]: iSNS:
Nov 15 08:23:13 user nova-compute[95467]: No targets found.
Nov 15 08:23:13 user nova-compute[95467]: STATIC:
Nov 15 08:23:13 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b
Nov 15 08:23:13 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:23:13 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:23:13 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e
Nov 15 08:23:13 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:23:13 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:23:13 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:9df081f2-6e31-4922-94d2-8b02bd168789
Nov 15 08:23:13 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:23:13 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:23:13 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400
Nov 15 08:23:13 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:23:13 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:23:13 user nova-compute[95467]: FIRMWARE:
Nov 15 08:23:13 user nova-compute[95467]: No targets found.
Nov 15 08:23:13 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 08:23:13 user nova-compute[95467]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 08:23:13 user nova-compute[95467]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=95467) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400', 0)] {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG nova.compute.manager [req-723a0744-b64f-408c-bcee-3fcae4a37a95 req-f430db1f-a79a-4978-bd7a-2f750e191761 service nova] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Received event network-vif-unplugged-cb099600-0c5c-4e0d-adfe-91a6ba3e0f08 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-723a0744-b64f-408c-bcee-3fcae4a37a95 req-f430db1f-a79a-4978-bd7a-2f750e191761 service nova] Acquiring lock "a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-723a0744-b64f-408c-bcee-3fcae4a37a95 req-f430db1f-a79a-4978-bd7a-2f750e191761 service nova] Lock "a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-723a0744-b64f-408c-bcee-3fcae4a37a95 req-f430db1f-a79a-4978-bd7a-2f750e191761 service nova] Lock "a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG nova.compute.manager [req-723a0744-b64f-408c-bcee-3fcae4a37a95 req-f430db1f-a79a-4978-bd7a-2f750e191761 service nova] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] No waiting events found dispatching network-vif-unplugged-cb099600-0c5c-4e0d-adfe-91a6ba3e0f08 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:23:13 user nova-compute[95467]: WARNING nova.compute.manager [req-723a0744-b64f-408c-bcee-3fcae4a37a95 req-f430db1f-a79a-4978-bd7a-2f750e191761 service nova] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Received unexpected event network-vif-unplugged-cb099600-0c5c-4e0d-adfe-91a6ba3e0f08 for instance with vm_state active and task_state resize_migrating.
Nov 15 08:23:13 user nova-compute[95467]: DEBUG nova.compute.manager [req-723a0744-b64f-408c-bcee-3fcae4a37a95 req-f430db1f-a79a-4978-bd7a-2f750e191761 service nova] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Received event network-vif-plugged-cb099600-0c5c-4e0d-adfe-91a6ba3e0f08 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-723a0744-b64f-408c-bcee-3fcae4a37a95 req-f430db1f-a79a-4978-bd7a-2f750e191761 service nova] Acquiring lock "a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-723a0744-b64f-408c-bcee-3fcae4a37a95 req-f430db1f-a79a-4978-bd7a-2f750e191761 service nova] Lock "a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-723a0744-b64f-408c-bcee-3fcae4a37a95 req-f430db1f-a79a-4978-bd7a-2f750e191761 service nova] Lock "a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG nova.compute.manager [req-723a0744-b64f-408c-bcee-3fcae4a37a95 req-f430db1f-a79a-4978-bd7a-2f750e191761 service nova] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] No waiting events found dispatching network-vif-plugged-cb099600-0c5c-4e0d-adfe-91a6ba3e0f08 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:23:13 user nova-compute[95467]: WARNING nova.compute.manager [req-723a0744-b64f-408c-bcee-3fcae4a37a95 req-f430db1f-a79a-4978-bd7a-2f750e191761 service nova] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Received unexpected event network-vif-plugged-cb099600-0c5c-4e0d-adfe-91a6ba3e0f08 for instance with vm_state active and task_state resize_migrating.
Nov 15 08:23:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7867622-df88-41bc-ac36-058999cdc87c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9df081f2-6e31-4922-94d2-8b02bd168789\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0ce8b5-f24c-4dc1-8f04-1dd2922ecefb]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df081f2-6e31-4922-94d2-8b02bd168789 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:23:13 user nova-compute[95467]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:23:13 user nova-compute[95467]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:23:13 user nova-compute[95467]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df081f2-6e31-4922-94d2-8b02bd168789 (non-flash)
Nov 15 08:23:13 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:23:13 user nova-compute[95467]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:23:13 user nova-compute[95467]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:23:13 user nova-compute[95467]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df081f2-6e31-4922-94d2-8b02bd168789 (non-flash)
Nov 15 08:23:13 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efec82f3880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400'): ({'sdd'}, set())}) {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Removing single pathed devices sdd {{(pid=95467) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3179b4-aaf9-4394-8975-07c2a0bbaf62]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[af457c91-4521-44ac-8b85-a51c39908652]: (4, ('ok\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Flushing IO for device /dev/sdd {{(pid=95467) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[53739520-e5d2-4c9f-826f-eaf2b5566d80]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=95467) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.054s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4060d7-2370-4ca1-ac8f-a5f0b47a910a]: (4, ('1', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] SCSI volumes sdd have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400')] {{(pid=95467) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b40ae1-d257-4c38-87d2-28d9b9386447]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 -p 172.16.0.220:3260 --logout {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[9998057a-1075-43e6-85f5-ebe1bb688a64]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400, portal: 172.16.0.220,3260]
Nov 15 08:23:13 user nova-compute[95467]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400, portal: 172.16.0.220,3260] successful.
Nov 15 08:23:13 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 -p 172.16.0.220:3260 --op delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f829dd-6941-4d80-bc68-dd3c97af5ed9]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] <== disconnect_volume: return (357ms) None {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Disconnected iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 08:23:13 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] skipping disk /dev/sdd (vda) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:23:14 user nova-compute[95467]: DEBUG nova.network.neutron [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Port cb099600-0c5c-4e0d-adfe-91a6ba3e0f08 binding to destination host user is already ACTIVE {{(pid=95467) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 15 08:23:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Acquiring lock "a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:23:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:23:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:23:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Acquiring lock "refresh_cache-a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:23:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Acquired lock "refresh_cache-a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:23:15 user nova-compute[95467]: DEBUG nova.network.neutron [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:23:15 user nova-compute[95467]: DEBUG nova.network.neutron [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Updating instance_info_cache with network_info: [{"id": "cb099600-0c5c-4e0d-adfe-91a6ba3e0f08", "address": "fa:16:3e:1d:28:85", "network": {"id": "d8a362dc-0dc8-49dd-b2da-0e0749d5edca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-256373617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a1aa4f562c64545a94157d4aaf8d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb099600-0c", "ovs_interfaceid": "cb099600-0c5c-4e0d-adfe-91a6ba3e0f08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:23:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Releasing lock "refresh_cache-a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:23:15 user nova-compute[95467]: DEBUG os_brick.utils [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:23:15 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:15 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:15 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c373ece-8810-46b5-a324-1d72c72ebc74]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:882ae90641f\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:23:15 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:15 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:15 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[2309ab57-cb7a-4390-a484-5180313445a2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:23:15 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:15 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:15 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9b5eb9-2533-4799-b7cd-71e46b79fa69]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:23:15 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[204c3ecd-6c1e-44da-9b28-5285b418dde6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:23:15 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Running cmd (subprocess): nvme version {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:16 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] 'nvme version' failed. Not Retrying. {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:23:16 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] nvme not present on system {{(pid=95467) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 08:23:16 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:16 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:23:16 user nova-compute[95467]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 08:23:16 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d932539-efde-4f94-97bd-22d1275e8111]: (4, '') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:23:16 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=95467) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 08:23:16 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 08:23:16 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] LIGHTOS: no hostnqn found. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 08:23:16 user nova-compute[95467]: DEBUG os_brick.utils [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:882ae90641f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:23:17 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:18 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:20 user nova-compute[95467]: DEBUG nova.compute.manager [None req-34665c69-0cd3-4d96-b223-86a77180ce2e tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 091612cf-b737-480b-984e-a05b522676b6] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:23:20 user nova-compute[95467]: INFO nova.compute.manager [None req-34665c69-0cd3-4d96-b223-86a77180ce2e tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 091612cf-b737-480b-984e-a05b522676b6] instance snapshotting
Nov 15 08:23:20 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-34665c69-0cd3-4d96-b223-86a77180ce2e tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 091612cf-b737-480b-984e-a05b522676b6] Beginning live snapshot process
Nov 15 08:23:20 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-34665c69-0cd3-4d96-b223-86a77180ce2e tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091612cf-b737-480b-984e-a05b522676b6/disk --force-share --output=json -f qcow2 {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-34665c69-0cd3-4d96-b223-86a77180ce2e tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091612cf-b737-480b-984e-a05b522676b6/disk --force-share --output=json -f qcow2" returned: 0 in 0.184s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-34665c69-0cd3-4d96-b223-86a77180ce2e tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091612cf-b737-480b-984e-a05b522676b6/disk --force-share --output=json -f qcow2 {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Starting finish_migration {{(pid=95467) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Instance directory exists: not creating {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 08:23:21 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Creating image(s)
Nov 15 08:23:21 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Did not create local disks {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Ensure instance console log exists: /opt/stack/data/nova/instances/a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80/console.log {{(pid=95467) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Start _get_guest_xml network_info=[{"id": "cb099600-0c5c-4e0d-adfe-91a6ba3e0f08", "address": "fa:16:3e:1d:28:85", "network": {"id": "d8a362dc-0dc8-49dd-b2da-0e0749d5edca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-256373617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-256373617-network", "vif_mac": "fa:16:3e:1d:28:85"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a1aa4f562c64545a94157d4aaf8d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb099600-0c", "ovs_interfaceid": "cb099600-0c5c-4e0d-adfe-91a6ba3e0f08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '40f2b4a6-1296-473b-bd8f-08c5e4fe395c', 'delete_on_termination': True, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kFxqhEAV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80', 'attached_at': '2023-11-15T08:23:21.000000', 'detached_at': '', 'volume_id': '769e646a-dfe3-48d6-800c-7533bb9a7400', 'serial': '769e646a-dfe3-48d6-800c-7533bb9a7400'}, 'volume_type': None} {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:23:21 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:23:21 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:23:21 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Calling os-brick to attach iSCSI Volume {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kFxqhEAV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:23:21 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:23:21 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:23:21 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:23:21 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:23:21 user nova-compute[95467]: INFO os_brick.initiator.connectors.iscsi [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 08:23:21 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 -p 172.16.0.220:3260 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[03366489-c60b-4c5c-97b8-d5d3febce994]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 08:23:21 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 -p 172.16.0.220:3260 --interface default --op new {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-34665c69-0cd3-4d96-b223-86a77180ce2e tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091612cf-b737-480b-984e-a05b522676b6/disk --force-share --output=json -f qcow2" returned: 0 in 0.173s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-34665c69-0cd3-4d96-b223-86a77180ce2e tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ec3fe7-d57f-4e13-be0d-4b4cb5467060]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400] added\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400] added
Nov 15 08:23:21 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e8a895-a4b0-48a3-9ec9-22d9bff786cc]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46c649c-5b9d-44ba-bb1e-4fcf186566c8]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kFxqhEAV {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kFxqhEAV" returned: 0 in 0.028s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d9b510-8327-41b9-966c-2bd146abe4b6]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kFxqhEAV'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f6399e-51e4-432f-90f3-ba530db5f62e]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[260e458f-36f5-4b35-9277-70aa30adcdd7]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df081f2-6e31-4922-94d2-8b02bd168789 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:23:21 user nova-compute[95467]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:23:21 user nova-compute[95467]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df081f2-6e31-4922-94d2-8b02bd168789 (non-flash)
Nov 15 08:23:21 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:23:21 user nova-compute[95467]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:23:21 user nova-compute[95467]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df081f2-6e31-4922-94d2-8b02bd168789 (non-flash)
Nov 15 08:23:21 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 -p 172.16.0.220:3260 --login {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-34665c69-0cd3-4d96-b223-86a77180ce2e tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.191s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-34665c69-0cd3-4d96-b223-86a77180ce2e tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpg11mrxg5/4583f82a8b124e708632ea36dd23b55a.delta 1073741824 {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-34665c69-0cd3-4d96-b223-86a77180ce2e tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpg11mrxg5/4583f82a8b124e708632ea36dd23b55a.delta 1073741824" returned: 0 in 0.052s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:21 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-34665c69-0cd3-4d96-b223-86a77180ce2e tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 091612cf-b737-480b-984e-a05b522676b6] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 15 08:23:21 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55a1fa3-eb6d-44c6-a580-da229100fadc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400, portal: 172.16.0.220,3260]
Nov 15 08:23:21 user nova-compute[95467]: Login to [iface: default, target: iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400, portal: 172.16.0.220,3260] successful.
Nov 15 08:23:21 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b7f581-b432-4269-8250-c4f7a80dbcc5]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[047ce7f4-27df-4a59-b1aa-286849564876]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df081f2-6e31-4922-94d2-8b02bd168789 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:23:21 user nova-compute[95467]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:23:21 user nova-compute[95467]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df081f2-6e31-4922-94d2-8b02bd168789 (non-flash)
Nov 15 08:23:21 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:23:21 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:23:21 user nova-compute[95467]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:23:21 user nova-compute[95467]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df081f2-6e31-4922-94d2-8b02bd168789 (non-flash)
Nov 15 08:23:21 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:23:21 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Connected to 172.16.0.220:3260 {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] HCTL ('35', '-', '-', 0) found on session 38 with lun 0 {{(pid=95467) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=95467) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.024s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6641cf2-5c66-4259-9414-36bf023d7ca2]: (4, ('- - 0', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Searching for a device in session 38 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kFxqhEAV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 08:23:21 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:22 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-34665c69-0cd3-4d96-b223-86a77180ce2e tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=95467) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 08:23:22 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:23:22 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] <== connect_volume: return (1383ms) {'type': 'block', 'scsi_wwn': '23263616138323666', 'path': '/dev/sdd'} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:23:22 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23263616138323666', 'path': '/dev/sdd'} {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 08:23:22 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:21:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-884527110',display_name='tempest-ServerActionsTestOtherA-server-884527110',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-884527110',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYstiTKN6pNWftTYd849nYQtMIuEgDEUeKiw28UGbiftMSf1b7pXDFCSUnmvZj4PjTG3wPVLUk+MQqv7tZDYQ9Hh/tLAdBctcsd51z7x2h0dxB9v2l2G0kVC6Lobby9rA==',key_name='tempest-keypair-124047716',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:21:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0a1aa4f562c64545a94157d4aaf8d14e',ramdisk_id='',reservation_id='r-0emjo4p0',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-937420730',owner_user_name='tempest-ServerActionsTestOtherA-937420730-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:23:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d9b34339b404facac21f500f40b1686',uuid=a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb099600-0c5c-4e0d-adfe-91a6ba3e0f08", "address": "fa:16:3e:1d:28:85", "network": {"id": "d8a362dc-0dc8-49dd-b2da-0e0749d5edca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-256373617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-256373617-network", "vif_mac": "fa:16:3e:1d:28:85"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a1aa4f562c64545a94157d4aaf8d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb099600-0c", "ovs_interfaceid": "cb099600-0c5c-4e0d-adfe-91a6ba3e0f08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:23:22 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Converting VIF {"id": "cb099600-0c5c-4e0d-adfe-91a6ba3e0f08", "address": "fa:16:3e:1d:28:85", "network": {"id": "d8a362dc-0dc8-49dd-b2da-0e0749d5edca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-256373617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-256373617-network", "vif_mac": "fa:16:3e:1d:28:85"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a1aa4f562c64545a94157d4aaf8d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb099600-0c", "ovs_interfaceid": "cb099600-0c5c-4e0d-adfe-91a6ba3e0f08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:23:22 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:28:85,bridge_name='br-int',has_traffic_filtering=True,id=cb099600-0c5c-4e0d-adfe-91a6ba3e0f08,network=Network(d8a362dc-0dc8-49dd-b2da-0e0749d5edca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb099600-0c') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:23:22 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:23:22 user nova-compute[95467]:   <uuid>a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80</uuid>
Nov 15 08:23:22 user nova-compute[95467]:   <name>instance-00000023</name>
Nov 15 08:23:22 user nova-compute[95467]:   <memory>2097152</memory>
Nov 15 08:23:22 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:23:22 user nova-compute[95467]:   <metadata>
Nov 15 08:23:22 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:23:22 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:23:22 user nova-compute[95467]:       <nova:name>tempest-ServerActionsTestOtherA-server-884527110</nova:name>
Nov 15 08:23:22 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:23:21</nova:creationTime>
Nov 15 08:23:22 user nova-compute[95467]:       <nova:flavor name="m1.small">
Nov 15 08:23:22 user nova-compute[95467]:         <nova:memory>2048</nova:memory>
Nov 15 08:23:22 user nova-compute[95467]:         <nova:disk>20</nova:disk>
Nov 15 08:23:22 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:23:22 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:23:22 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:23:22 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:23:22 user nova-compute[95467]:       <nova:owner>
Nov 15 08:23:22 user nova-compute[95467]:         <nova:user uuid="2d9b34339b404facac21f500f40b1686">tempest-ServerActionsTestOtherA-937420730-project-member</nova:user>
Nov 15 08:23:22 user nova-compute[95467]:         <nova:project uuid="0a1aa4f562c64545a94157d4aaf8d14e">tempest-ServerActionsTestOtherA-937420730</nova:project>
Nov 15 08:23:22 user nova-compute[95467]:       </nova:owner>
Nov 15 08:23:22 user nova-compute[95467]:       <nova:ports>
Nov 15 08:23:22 user nova-compute[95467]:         <nova:port uuid="cb099600-0c5c-4e0d-adfe-91a6ba3e0f08">
Nov 15 08:23:22 user nova-compute[95467]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 08:23:22 user nova-compute[95467]:         </nova:port>
Nov 15 08:23:22 user nova-compute[95467]:       </nova:ports>
Nov 15 08:23:22 user nova-compute[95467]:     </nova:instance>
Nov 15 08:23:22 user nova-compute[95467]:   </metadata>
Nov 15 08:23:22 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:23:22 user nova-compute[95467]:     <system>
Nov 15 08:23:22 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:23:22 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:23:22 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:23:22 user nova-compute[95467]:       <entry name="serial">a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80</entry>
Nov 15 08:23:22 user nova-compute[95467]:       <entry name="uuid">a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80</entry>
Nov 15 08:23:22 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:23:22 user nova-compute[95467]:     </system>
Nov 15 08:23:22 user nova-compute[95467]:   </sysinfo>
Nov 15 08:23:22 user nova-compute[95467]:   <os>
Nov 15 08:23:22 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:23:22 user nova-compute[95467]:     <boot dev="hd"/>
Nov 15 08:23:22 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:23:22 user nova-compute[95467]:   </os>
Nov 15 08:23:22 user nova-compute[95467]:   <features>
Nov 15 08:23:22 user nova-compute[95467]:     <acpi/>
Nov 15 08:23:22 user nova-compute[95467]:     <apic/>
Nov 15 08:23:22 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:23:22 user nova-compute[95467]:   </features>
Nov 15 08:23:22 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:23:22 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:23:22 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:23:22 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:23:22 user nova-compute[95467]:   </clock>
Nov 15 08:23:22 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:23:22 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:23:22 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:23:22 user nova-compute[95467]:   </cpu>
Nov 15 08:23:22 user nova-compute[95467]:   <devices>
Nov 15 08:23:22 user nova-compute[95467]:     <disk type="block" device="disk">
Nov 15 08:23:22 user nova-compute[95467]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:23:22 user nova-compute[95467]:       <source dev="/dev/sdd"/>
Nov 15 08:23:22 user nova-compute[95467]:       <target dev="vda" bus="virtio"/>
Nov 15 08:23:22 user nova-compute[95467]:       <serial>769e646a-dfe3-48d6-800c-7533bb9a7400</serial>
Nov 15 08:23:22 user nova-compute[95467]:     </disk>
Nov 15 08:23:22 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:23:22 user nova-compute[95467]:       <mac address="fa:16:3e:1d:28:85"/>
Nov 15 08:23:22 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:23:22 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:23:22 user nova-compute[95467]:       <target dev="tapcb099600-0c"/>
Nov 15 08:23:22 user nova-compute[95467]:     </interface>
Nov 15 08:23:22 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:23:22 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80/console.log" append="off"/>
Nov 15 08:23:22 user nova-compute[95467]:     </serial>
Nov 15 08:23:22 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:23:22 user nova-compute[95467]:     <video>
Nov 15 08:23:22 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:23:22 user nova-compute[95467]:     </video>
Nov 15 08:23:22 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:23:22 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:23:22 user nova-compute[95467]:     </rng>
Nov 15 08:23:22 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:23:22 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:23:22 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:23:22 user nova-compute[95467]:     </memballoon>
Nov 15 08:23:22 user nova-compute[95467]:   </devices>
Nov 15 08:23:22 user nova-compute[95467]: </domain>
Nov 15 08:23:22 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:23:22 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:21:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-884527110',display_name='tempest-ServerActionsTestOtherA-server-884527110',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-884527110',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYstiTKN6pNWftTYd849nYQtMIuEgDEUeKiw28UGbiftMSf1b7pXDFCSUnmvZj4PjTG3wPVLUk+MQqv7tZDYQ9Hh/tLAdBctcsd51z7x2h0dxB9v2l2G0kVC6Lobby9rA==',key_name='tempest-keypair-124047716',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:21:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0a1aa4f562c64545a94157d4aaf8d14e',ramdisk_id='',reservation_id='r-0emjo4p0',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-937420730',owner_user_name='tempest-ServerActionsTestOtherA-937420730-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:23:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d9b34339b404facac21f500f40b1686',uuid=a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb099600-0c5c-4e0d-adfe-91a6ba3e0f08", "address": "fa:16:3e:1d:28:85", "network": {"id": "d8a362dc-0dc8-49dd-b2da-0e0749d5edca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-256373617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-256373617-network", "vif_mac": "fa:16:3e:1d:28:85"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a1aa4f562c64545a94157d4aaf8d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb099600-0c", "ovs_interfaceid": "cb099600-0c5c-4e0d-adfe-91a6ba3e0f08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:23:22 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Converting VIF {"id": "cb099600-0c5c-4e0d-adfe-91a6ba3e0f08", "address": "fa:16:3e:1d:28:85", "network": {"id": "d8a362dc-0dc8-49dd-b2da-0e0749d5edca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-256373617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-256373617-network", "vif_mac": "fa:16:3e:1d:28:85"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a1aa4f562c64545a94157d4aaf8d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb099600-0c", "ovs_interfaceid": "cb099600-0c5c-4e0d-adfe-91a6ba3e0f08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:23:22 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:28:85,bridge_name='br-int',has_traffic_filtering=True,id=cb099600-0c5c-4e0d-adfe-91a6ba3e0f08,network=Network(d8a362dc-0dc8-49dd-b2da-0e0749d5edca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb099600-0c') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:23:22 user nova-compute[95467]: DEBUG os_vif [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:28:85,bridge_name='br-int',has_traffic_filtering=True,id=cb099600-0c5c-4e0d-adfe-91a6ba3e0f08,network=Network(d8a362dc-0dc8-49dd-b2da-0e0749d5edca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb099600-0c') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:23:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:23:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:23:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1b7c6cd8-e3d0-504a-bb8b-3116df9683a7', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:23:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcb099600-0c, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:23:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcb099600-0c, col_values=(('qos', UUID('c6a771e1-f484-4e5c-908e-f1d884e6ee3c')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:23:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcb099600-0c, col_values=(('external_ids', {'iface-id': 'cb099600-0c5c-4e0d-adfe-91a6ba3e0f08', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:28:85', 'vm-uuid': 'a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:23:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:23:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:22 user nova-compute[95467]: INFO os_vif [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:28:85,bridge_name='br-int',has_traffic_filtering=True,id=cb099600-0c5c-4e0d-adfe-91a6ba3e0f08,network=Network(d8a362dc-0dc8-49dd-b2da-0e0749d5edca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb099600-0c')
Nov 15 08:23:22 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-34665c69-0cd3-4d96-b223-86a77180ce2e tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] COPY block job progress, current cursor: 24051712 final cursor: 75497472 {{(pid=95467) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 08:23:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:22 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:23:22 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] No VIF found with MAC fa:16:3e:1d:28:85, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:23:22 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-09714f86-e690-481f-b81d-218415755881 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a1a155e6-0ee2-4728-a526-17c149107ab0 is timed out.
Nov 15 08:23:22 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-09714f86-e690-481f-b81d-218415755881 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Successfully detached device vdb from instance a1a155e6-0ee2-4728-a526-17c149107ab0 from the live domain config.
Nov 15 08:23:22 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09714f86-e690-481f-b81d-218415755881 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] calling os-brick to detach iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 08:23:22 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-09714f86-e690-481f-b81d-218415755881 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, {'target_iqn': 'iqn.2010-10.org.openstack:9df081f2-6e31-4922-94d2-8b02bd168789', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oNzVvKdy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:23:23 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-09714f86-e690-481f-b81d-218415755881 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:23:23 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-09714f86-e690-481f-b81d-218415755881 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:23:23 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-09714f86-e690-481f-b81d-218415755881 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:23:23 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:23 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:23 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6282c1-670f-4f24-af3c-d4c5aad0514e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9df081f2-6e31-4922-94d2-8b02bd168789\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:23:23 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-09714f86-e690-481f-b81d-218415755881 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 08:23:23 user nova-compute[95467]: No targets found.
Nov 15 08:23:23 user nova-compute[95467]: iSNS:
Nov 15 08:23:23 user nova-compute[95467]: No targets found.
Nov 15 08:23:23 user nova-compute[95467]: STATIC:
Nov 15 08:23:23 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b
Nov 15 08:23:23 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:23:23 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:23:23 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e
Nov 15 08:23:23 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:23:23 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:23:23 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:9df081f2-6e31-4922-94d2-8b02bd168789
Nov 15 08:23:23 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:23:23 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:23:23 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400
Nov 15 08:23:23 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:23:23 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:23:23 user nova-compute[95467]: FIRMWARE:
Nov 15 08:23:23 user nova-compute[95467]: No targets found.
Nov 15 08:23:23 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:23:23 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-09714f86-e690-481f-b81d-218415755881 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 08:23:23 user nova-compute[95467]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 08:23:23 user nova-compute[95467]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=95467) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 08:23:23 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-09714f86-e690-481f-b81d-218415755881 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9df081f2-6e31-4922-94d2-8b02bd168789', 0)] {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 08:23:23 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:23 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:23 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3661e9c-5d41-48b4-9add-ec86de39996c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9df081f2-6e31-4922-94d2-8b02bd168789\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:23:23 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:23 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:23 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2c930a-1ed5-4f89-b621-cb2e654010c5]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df081f2-6e31-4922-94d2-8b02bd168789 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:23:23 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-09714f86-e690-481f-b81d-218415755881 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:23:23 user nova-compute[95467]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:23:23 user nova-compute[95467]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df081f2-6e31-4922-94d2-8b02bd168789 (non-flash)
Nov 15 08:23:23 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:23:23 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:23:23 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-09714f86-e690-481f-b81d-218415755881 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:23:23 user nova-compute[95467]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:23:23 user nova-compute[95467]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df081f2-6e31-4922-94d2-8b02bd168789 (non-flash)
Nov 15 08:23:23 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:23:23 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:23:23 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-09714f86-e690-481f-b81d-218415755881 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efec84425f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9df081f2-6e31-4922-94d2-8b02bd168789'): ({'sdc'}, set())}) {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 08:23:23 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-09714f86-e690-481f-b81d-218415755881 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Removing single pathed devices sdc {{(pid=95467) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 08:23:23 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:23 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:23 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[863898e5-d4f7-4da5-ba89-1a574ae45dae]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:23:23 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:23 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:23 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[92149e98-c6a2-497b-89ec-3de9dd4c6721]: (4, ('ok\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:23:23 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-09714f86-e690-481f-b81d-218415755881 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Flushing IO for device /dev/sdc {{(pid=95467) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 08:23:23 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:23 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:23 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9fb7ad-3403-44e5-baef-882f5864b85e]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:23:23 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-09714f86-e690-481f-b81d-218415755881 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=95467) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 08:23:23 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:23 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-34665c69-0cd3-4d96-b223-86a77180ce2e tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=95467) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 08:23:23 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-34665c69-0cd3-4d96-b223-86a77180ce2e tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 091612cf-b737-480b-984e-a05b522676b6] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 15 08:23:23 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:23 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e729980-95b2-4447-8faf-2a9643d26cdf]: (4, ('1', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:23:23 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-09714f86-e690-481f-b81d-218415755881 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 08:23:23 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-09714f86-e690-481f-b81d-218415755881 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] SCSI volumes sdc have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 08:23:23 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-09714f86-e690-481f-b81d-218415755881 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9df081f2-6e31-4922-94d2-8b02bd168789')] {{(pid=95467) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 08:23:23 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9df081f2-6e31-4922-94d2-8b02bd168789 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:23 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9df081f2-6e31-4922-94d2-8b02bd168789 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:23 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e08342-9a2d-4c3a-914e-2012f9163b09]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:23:23 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-09714f86-e690-481f-b81d-218415755881 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:23:23 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9df081f2-6e31-4922-94d2-8b02bd168789 -p 172.16.0.220:3260 --logout {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:23 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9df081f2-6e31-4922-94d2-8b02bd168789 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:23 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c78f9a3-9285-4966-b087-7b1a78b83d7a]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:9df081f2-6e31-4922-94d2-8b02bd168789, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:9df081f2-6e31-4922-94d2-8b02bd168789, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:23:23 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-09714f86-e690-481f-b81d-218415755881 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:9df081f2-6e31-4922-94d2-8b02bd168789, portal: 172.16.0.220,3260]
Nov 15 08:23:23 user nova-compute[95467]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:9df081f2-6e31-4922-94d2-8b02bd168789, portal: 172.16.0.220,3260] successful.
Nov 15 08:23:23 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:23:23 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9df081f2-6e31-4922-94d2-8b02bd168789 -p 172.16.0.220:3260 --op delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:23 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9df081f2-6e31-4922-94d2-8b02bd168789 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:23 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f537b0-5a1f-4b80-8f56-8128c8091547]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:23:23 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-09714f86-e690-481f-b81d-218415755881 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:23:23 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-09714f86-e690-481f-b81d-218415755881 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:23:23 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-09714f86-e690-481f-b81d-218415755881 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] <== disconnect_volume: return (317ms) None {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:23:23 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09714f86-e690-481f-b81d-218415755881 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Disconnected iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 08:23:23 user nova-compute[95467]: DEBUG nova.privsep.utils [None req-34665c69-0cd3-4d96-b223-86a77180ce2e tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=95467) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 08:23:23 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-34665c69-0cd3-4d96-b223-86a77180ce2e tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpg11mrxg5/4583f82a8b124e708632ea36dd23b55a.delta /opt/stack/data/nova/instances/snapshots/tmpg11mrxg5/4583f82a8b124e708632ea36dd23b55a {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:23 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:23 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-34665c69-0cd3-4d96-b223-86a77180ce2e tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpg11mrxg5/4583f82a8b124e708632ea36dd23b55a.delta /opt/stack/data/nova/instances/snapshots/tmpg11mrxg5/4583f82a8b124e708632ea36dd23b55a" returned: 0 in 0.542s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:23 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-34665c69-0cd3-4d96-b223-86a77180ce2e tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 091612cf-b737-480b-984e-a05b522676b6] Snapshot extracted, beginning image upload
Nov 15 08:23:24 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:24 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:24 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:24 user nova-compute[95467]: DEBUG nova.compute.manager [req-4f3d3b18-8f34-4e7a-b2e4-d7872141e39f req-1d223674-3693-4fea-bfd6-9693380e7b88 service nova] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Received event network-vif-plugged-cb099600-0c5c-4e0d-adfe-91a6ba3e0f08 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:23:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-4f3d3b18-8f34-4e7a-b2e4-d7872141e39f req-1d223674-3693-4fea-bfd6-9693380e7b88 service nova] Acquiring lock "a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:23:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-4f3d3b18-8f34-4e7a-b2e4-d7872141e39f req-1d223674-3693-4fea-bfd6-9693380e7b88 service nova] Lock "a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:23:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-4f3d3b18-8f34-4e7a-b2e4-d7872141e39f req-1d223674-3693-4fea-bfd6-9693380e7b88 service nova] Lock "a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:23:24 user nova-compute[95467]: DEBUG nova.compute.manager [req-4f3d3b18-8f34-4e7a-b2e4-d7872141e39f req-1d223674-3693-4fea-bfd6-9693380e7b88 service nova] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] No waiting events found dispatching network-vif-plugged-cb099600-0c5c-4e0d-adfe-91a6ba3e0f08 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:23:24 user nova-compute[95467]: WARNING nova.compute.manager [req-4f3d3b18-8f34-4e7a-b2e4-d7872141e39f req-1d223674-3693-4fea-bfd6-9693380e7b88 service nova] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Received unexpected event network-vif-plugged-cb099600-0c5c-4e0d-adfe-91a6ba3e0f08 for instance with vm_state active and task_state resize_finish.
Nov 15 08:23:24 user nova-compute[95467]: DEBUG nova.objects.instance [None req-09714f86-e690-481f-b81d-218415755881 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lazy-loading 'flavor' on Instance uuid a1a155e6-0ee2-4728-a526-17c149107ab0 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:23:24 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-09714f86-e690-481f-b81d-218415755881 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lock "a1a155e6-0ee2-4728-a526-17c149107ab0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.948s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:23:26 user nova-compute[95467]: DEBUG nova.compute.manager [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Instance event wait completed in 0 seconds for  {{(pid=95467) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 08:23:26 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Instance running successfully.
Nov 15 08:23:26 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Failed to set time: agent not configured {{(pid=95467) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 15 08:23:26 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-1f29b847-d2a1-4059-addc-3b3aa011bcbe tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] finish_migration finished successfully. {{(pid=95467) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 15 08:23:26 user nova-compute[95467]: DEBUG nova.compute.manager [req-04d37c56-4c03-4e75-bc0b-3762d07a7dec req-b1f94f39-7a5b-4eec-803c-03c5d804c1ec service nova] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Received event network-vif-plugged-cb099600-0c5c-4e0d-adfe-91a6ba3e0f08 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:23:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-04d37c56-4c03-4e75-bc0b-3762d07a7dec req-b1f94f39-7a5b-4eec-803c-03c5d804c1ec service nova] Acquiring lock "a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:23:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-04d37c56-4c03-4e75-bc0b-3762d07a7dec req-b1f94f39-7a5b-4eec-803c-03c5d804c1ec service nova] Lock "a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:23:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-04d37c56-4c03-4e75-bc0b-3762d07a7dec req-b1f94f39-7a5b-4eec-803c-03c5d804c1ec service nova] Lock "a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:23:26 user nova-compute[95467]: DEBUG nova.compute.manager [req-04d37c56-4c03-4e75-bc0b-3762d07a7dec req-b1f94f39-7a5b-4eec-803c-03c5d804c1ec service nova] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] No waiting events found dispatching network-vif-plugged-cb099600-0c5c-4e0d-adfe-91a6ba3e0f08 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:23:26 user nova-compute[95467]: WARNING nova.compute.manager [req-04d37c56-4c03-4e75-bc0b-3762d07a7dec req-b1f94f39-7a5b-4eec-803c-03c5d804c1ec service nova] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Received unexpected event network-vif-plugged-cb099600-0c5c-4e0d-adfe-91a6ba3e0f08 for instance with vm_state active and task_state resize_finish.
Nov 15 08:23:26 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-34665c69-0cd3-4d96-b223-86a77180ce2e tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 091612cf-b737-480b-984e-a05b522676b6] Snapshot image upload complete
Nov 15 08:23:26 user nova-compute[95467]: INFO nova.compute.manager [None req-34665c69-0cd3-4d96-b223-86a77180ce2e tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 091612cf-b737-480b-984e-a05b522676b6] Took 5.97 seconds to snapshot the instance on the hypervisor.
Nov 15 08:23:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:30 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:33 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Acquiring lock "843b778c-f823-4bee-aa76-ab44345be9a7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:23:33 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Lock "843b778c-f823-4bee-aa76-ab44345be9a7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:23:33 user nova-compute[95467]: DEBUG nova.compute.manager [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Starting instance... {{(pid=95467) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 08:23:33 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Acquiring lock "739645e6-9952-40db-a876-f23d02d4e411" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:23:33 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "739645e6-9952-40db-a876-f23d02d4e411" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:23:33 user nova-compute[95467]: DEBUG nova.compute.manager [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Starting instance... {{(pid=95467) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 08:23:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:23:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:23:34 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=95467) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 08:23:34 user nova-compute[95467]: INFO nova.compute.claims [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Claim successful on node user
Nov 15 08:23:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:23:34 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:23:34 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:23:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.492s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:23:34 user nova-compute[95467]: DEBUG nova.compute.manager [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Start building networks asynchronously for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 08:23:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.478s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:23:34 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=95467) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 08:23:34 user nova-compute[95467]: INFO nova.compute.claims [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Claim successful on node user
Nov 15 08:23:34 user nova-compute[95467]: DEBUG nova.compute.manager [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Allocating IP information in the background. {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 08:23:34 user nova-compute[95467]: DEBUG nova.network.neutron [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 739645e6-9952-40db-a876-f23d02d4e411] allocate_for_instance() {{(pid=95467) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 08:23:34 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 08:23:34 user nova-compute[95467]: DEBUG nova.compute.manager [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Start building block device mappings for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 08:23:34 user nova-compute[95467]: DEBUG nova.policy [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c07f8dbc38004ecd973f61bba63606d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd281be4e94a4d31a47a13267d51d9b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95467) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 08:23:34 user nova-compute[95467]: DEBUG nova.compute.manager [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Start spawning the instance on the hypervisor. {{(pid=95467) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 08:23:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Creating instance directory {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 08:23:34 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Creating image(s)
Nov 15 08:23:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Acquiring lock "/opt/stack/data/nova/instances/739645e6-9952-40db-a876-f23d02d4e411/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:23:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "/opt/stack/data/nova/instances/739645e6-9952-40db-a876-f23d02d4e411/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:23:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "/opt/stack/data/nova/instances/739645e6-9952-40db-a876-f23d02d4e411/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:23:34 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:34 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.193s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Acquiring lock "a3fcf60225fcefd310404971cd18ab9851c548dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:23:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:23:34 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:35 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:23:35 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:23:35 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.575s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:23:35 user nova-compute[95467]: DEBUG nova.compute.manager [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Start building networks asynchronously for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 08:23:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.176s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/739645e6-9952-40db-a876-f23d02d4e411/disk 1073741824 {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/739645e6-9952-40db-a876-f23d02d4e411/disk 1073741824" returned: 0 in 0.126s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:35 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.308s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:23:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:35 user nova-compute[95467]: DEBUG nova.compute.manager [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Allocating IP information in the background. {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 08:23:35 user nova-compute[95467]: DEBUG nova.network.neutron [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] allocate_for_instance() {{(pid=95467) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 08:23:35 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 08:23:35 user nova-compute[95467]: DEBUG nova.compute.manager [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Start building block device mappings for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 08:23:35 user nova-compute[95467]: DEBUG nova.policy [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5b6b2de671674fa8b9f2489fcbba90f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fb970c784b4c3c8e64abd04523885a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95467) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 08:23:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.181s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:35 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Checking if we can resize image /opt/stack/data/nova/instances/739645e6-9952-40db-a876-f23d02d4e411/disk. size=1073741824 {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 08:23:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/739645e6-9952-40db-a876-f23d02d4e411/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:35 user nova-compute[95467]: DEBUG nova.network.neutron [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Successfully created port: a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae {{(pid=95467) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 08:23:35 user nova-compute[95467]: DEBUG nova.compute.manager [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Start spawning the instance on the hypervisor. {{(pid=95467) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 08:23:35 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Creating instance directory {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 08:23:35 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Creating image(s)
Nov 15 08:23:35 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Acquiring lock "/opt/stack/data/nova/instances/843b778c-f823-4bee-aa76-ab44345be9a7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:23:35 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Lock "/opt/stack/data/nova/instances/843b778c-f823-4bee-aa76-ab44345be9a7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:23:35 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Lock "/opt/stack/data/nova/instances/843b778c-f823-4bee-aa76-ab44345be9a7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:23:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/739645e6-9952-40db-a876-f23d02d4e411/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:35 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Cannot resize image /opt/stack/data/nova/instances/739645e6-9952-40db-a876-f23d02d4e411/disk to a smaller size. {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 08:23:35 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Created local disks {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 08:23:35 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Ensure instance console log exists: /opt/stack/data/nova/instances/739645e6-9952-40db-a876-f23d02d4e411/console.log {{(pid=95467) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 08:23:35 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:23:35 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:23:35 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:23:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.170s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:35 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Acquiring lock "a3fcf60225fcefd310404971cd18ab9851c548dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:23:35 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:23:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.181s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/843b778c-f823-4bee-aa76-ab44345be9a7/disk 1073741824 {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/843b778c-f823-4bee-aa76-ab44345be9a7/disk 1073741824" returned: 0 in 0.054s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:35 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:23:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:36 user nova-compute[95467]: DEBUG nova.network.neutron [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Successfully created port: 4572a8d9-9e56-47da-b59d-013b88b32e8b {{(pid=95467) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 08:23:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.206s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:36 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Checking if we can resize image /opt/stack/data/nova/instances/843b778c-f823-4bee-aa76-ab44345be9a7/disk. size=1073741824 {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 08:23:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/843b778c-f823-4bee-aa76-ab44345be9a7/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:36 user nova-compute[95467]: DEBUG nova.network.neutron [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Successfully updated port: a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae {{(pid=95467) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 08:23:36 user nova-compute[95467]: DEBUG nova.compute.manager [req-3ecf4ec4-a7b7-4e6f-b622-8e432688cbca req-1c081a9d-1b3c-4d2f-a409-a34321296607 service nova] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Received event network-changed-a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:23:36 user nova-compute[95467]: DEBUG nova.compute.manager [req-3ecf4ec4-a7b7-4e6f-b622-8e432688cbca req-1c081a9d-1b3c-4d2f-a409-a34321296607 service nova] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Refreshing instance network info cache due to event network-changed-a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:23:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-3ecf4ec4-a7b7-4e6f-b622-8e432688cbca req-1c081a9d-1b3c-4d2f-a409-a34321296607 service nova] Acquiring lock "refresh_cache-739645e6-9952-40db-a876-f23d02d4e411" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:23:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-3ecf4ec4-a7b7-4e6f-b622-8e432688cbca req-1c081a9d-1b3c-4d2f-a409-a34321296607 service nova] Acquired lock "refresh_cache-739645e6-9952-40db-a876-f23d02d4e411" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:23:36 user nova-compute[95467]: DEBUG nova.network.neutron [req-3ecf4ec4-a7b7-4e6f-b622-8e432688cbca req-1c081a9d-1b3c-4d2f-a409-a34321296607 service nova] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Refreshing network info cache for port a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:23:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Acquiring lock "refresh_cache-739645e6-9952-40db-a876-f23d02d4e411" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:23:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/843b778c-f823-4bee-aa76-ab44345be9a7/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:36 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Cannot resize image /opt/stack/data/nova/instances/843b778c-f823-4bee-aa76-ab44345be9a7/disk to a smaller size. {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 08:23:36 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Created local disks {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 08:23:36 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Ensure instance console log exists: /opt/stack/data/nova/instances/843b778c-f823-4bee-aa76-ab44345be9a7/console.log {{(pid=95467) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 08:23:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:23:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:23:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:23:36 user nova-compute[95467]: DEBUG nova.network.neutron [req-3ecf4ec4-a7b7-4e6f-b622-8e432688cbca req-1c081a9d-1b3c-4d2f-a409-a34321296607 service nova] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Instance cache missing network info. {{(pid=95467) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 08:23:36 user nova-compute[95467]: DEBUG nova.network.neutron [req-3ecf4ec4-a7b7-4e6f-b622-8e432688cbca req-1c081a9d-1b3c-4d2f-a409-a34321296607 service nova] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:23:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-3ecf4ec4-a7b7-4e6f-b622-8e432688cbca req-1c081a9d-1b3c-4d2f-a409-a34321296607 service nova] Releasing lock "refresh_cache-739645e6-9952-40db-a876-f23d02d4e411" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:23:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Acquired lock "refresh_cache-739645e6-9952-40db-a876-f23d02d4e411" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:23:36 user nova-compute[95467]: DEBUG nova.network.neutron [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG nova.network.neutron [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Successfully updated port: 4572a8d9-9e56-47da-b59d-013b88b32e8b {{(pid=95467) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG nova.network.neutron [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Instance cache missing network info. {{(pid=95467) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG nova.compute.manager [req-ce1f6f93-4f95-4c1c-a533-ed65c633dc33 req-22b7546c-53a1-4b98-9881-bc0a5623c2a8 service nova] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Received event network-changed-4572a8d9-9e56-47da-b59d-013b88b32e8b {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG nova.compute.manager [req-ce1f6f93-4f95-4c1c-a533-ed65c633dc33 req-22b7546c-53a1-4b98-9881-bc0a5623c2a8 service nova] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Refreshing instance network info cache due to event network-changed-4572a8d9-9e56-47da-b59d-013b88b32e8b. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ce1f6f93-4f95-4c1c-a533-ed65c633dc33 req-22b7546c-53a1-4b98-9881-bc0a5623c2a8 service nova] Acquiring lock "refresh_cache-843b778c-f823-4bee-aa76-ab44345be9a7" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ce1f6f93-4f95-4c1c-a533-ed65c633dc33 req-22b7546c-53a1-4b98-9881-bc0a5623c2a8 service nova] Acquired lock "refresh_cache-843b778c-f823-4bee-aa76-ab44345be9a7" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG nova.network.neutron [req-ce1f6f93-4f95-4c1c-a533-ed65c633dc33 req-22b7546c-53a1-4b98-9881-bc0a5623c2a8 service nova] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Refreshing network info cache for port 4572a8d9-9e56-47da-b59d-013b88b32e8b {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Acquiring lock "refresh_cache-843b778c-f823-4bee-aa76-ab44345be9a7" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG nova.network.neutron [req-ce1f6f93-4f95-4c1c-a533-ed65c633dc33 req-22b7546c-53a1-4b98-9881-bc0a5623c2a8 service nova] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Instance cache missing network info. {{(pid=95467) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG nova.network.neutron [req-ce1f6f93-4f95-4c1c-a533-ed65c633dc33 req-22b7546c-53a1-4b98-9881-bc0a5623c2a8 service nova] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ce1f6f93-4f95-4c1c-a533-ed65c633dc33 req-22b7546c-53a1-4b98-9881-bc0a5623c2a8 service nova] Releasing lock "refresh_cache-843b778c-f823-4bee-aa76-ab44345be9a7" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Acquired lock "refresh_cache-843b778c-f823-4bee-aa76-ab44345be9a7" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG nova.network.neutron [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG nova.network.neutron [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Updating instance_info_cache with network_info: [{"id": "a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae", "address": "fa:16:3e:13:89:c0", "network": {"id": "369d2a6f-60b7-4c92-8b2d-1f3828f6698b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1491709218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd281be4e94a4d31a47a13267d51d9b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6f2f30d-af", "ovs_interfaceid": "a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Releasing lock "refresh_cache-739645e6-9952-40db-a876-f23d02d4e411" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG nova.compute.manager [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Instance network_info: |[{"id": "a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae", "address": "fa:16:3e:13:89:c0", "network": {"id": "369d2a6f-60b7-4c92-8b2d-1f3828f6698b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1491709218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd281be4e94a4d31a47a13267d51d9b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6f2f30d-af", "ovs_interfaceid": "a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Start _get_guest_xml network_info=[{"id": "a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae", "address": "fa:16:3e:13:89:c0", "network": {"id": "369d2a6f-60b7-4c92-8b2d-1f3828f6698b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1491709218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd281be4e94a4d31a47a13267d51d9b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6f2f30d-af", "ovs_interfaceid": "a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'ed9c48aa-ce73-4b3b-9db1-235898be671b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:23:37 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:23:37 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:23:37 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:23:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1308444358',display_name='tempest-ServerRescueNegativeTestJSON-server-1308444358',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1308444358',id=40,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKzoLkdMobeNcNbHKHSz6pf9KB3mnqKkGNlpbsfMF936yySn1GMTRgtnj4EoSqGo09dnRTYgYgXqxoNmiTwq5Zdq5EmI5cdClHP/6DwnQRnc+u/69gFrqzMpVc0XcKHOQ==',key_name='tempest-keypair-573508882',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd281be4e94a4d31a47a13267d51d9b6',ramdisk_id='',reservation_id='r-qs39ggxa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1148442534',owner_user_name='tempest-ServerRescueNegativeTestJSON-1148442534-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:23:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c07f8dbc38004ecd973f61bba63606d4',uuid=739645e6-9952-40db-a876-f23d02d4e411,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae", "address": "fa:16:3e:13:89:c0", "network": {"id": "369d2a6f-60b7-4c92-8b2d-1f3828f6698b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1491709218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd281be4e94a4d31a47a13267d51d9b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6f2f30d-af", "ovs_interfaceid": "a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Converting VIF {"id": "a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae", "address": "fa:16:3e:13:89:c0", "network": {"id": "369d2a6f-60b7-4c92-8b2d-1f3828f6698b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1491709218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd281be4e94a4d31a47a13267d51d9b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6f2f30d-af", "ovs_interfaceid": "a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:89:c0,bridge_name='br-int',has_traffic_filtering=True,id=a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae,network=Network(369d2a6f-60b7-4c92-8b2d-1f3828f6698b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6f2f30d-af') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG nova.objects.instance [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lazy-loading 'pci_devices' on Instance uuid 739645e6-9952-40db-a876-f23d02d4e411 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG nova.network.neutron [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Instance cache missing network info. {{(pid=95467) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 739645e6-9952-40db-a876-f23d02d4e411] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:23:37 user nova-compute[95467]:   <uuid>739645e6-9952-40db-a876-f23d02d4e411</uuid>
Nov 15 08:23:37 user nova-compute[95467]:   <name>instance-00000028</name>
Nov 15 08:23:37 user nova-compute[95467]:   <memory>524288</memory>
Nov 15 08:23:37 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:23:37 user nova-compute[95467]:   <metadata>
Nov 15 08:23:37 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:23:37 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:23:37 user nova-compute[95467]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1308444358</nova:name>
Nov 15 08:23:37 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:23:37</nova:creationTime>
Nov 15 08:23:37 user nova-compute[95467]:       <nova:flavor name="m1.tiny">
Nov 15 08:23:37 user nova-compute[95467]:         <nova:memory>512</nova:memory>
Nov 15 08:23:37 user nova-compute[95467]:         <nova:disk>1</nova:disk>
Nov 15 08:23:37 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:23:37 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:23:37 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:23:37 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:23:37 user nova-compute[95467]:       <nova:owner>
Nov 15 08:23:37 user nova-compute[95467]:         <nova:user uuid="c07f8dbc38004ecd973f61bba63606d4">tempest-ServerRescueNegativeTestJSON-1148442534-project-member</nova:user>
Nov 15 08:23:37 user nova-compute[95467]:         <nova:project uuid="bd281be4e94a4d31a47a13267d51d9b6">tempest-ServerRescueNegativeTestJSON-1148442534</nova:project>
Nov 15 08:23:37 user nova-compute[95467]:       </nova:owner>
Nov 15 08:23:37 user nova-compute[95467]:       <nova:root type="image" uuid="ed9c48aa-ce73-4b3b-9db1-235898be671b"/>
Nov 15 08:23:37 user nova-compute[95467]:       <nova:ports>
Nov 15 08:23:37 user nova-compute[95467]:         <nova:port uuid="a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae">
Nov 15 08:23:37 user nova-compute[95467]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 08:23:37 user nova-compute[95467]:         </nova:port>
Nov 15 08:23:37 user nova-compute[95467]:       </nova:ports>
Nov 15 08:23:37 user nova-compute[95467]:     </nova:instance>
Nov 15 08:23:37 user nova-compute[95467]:   </metadata>
Nov 15 08:23:37 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:23:37 user nova-compute[95467]:     <system>
Nov 15 08:23:37 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:23:37 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:23:37 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:23:37 user nova-compute[95467]:       <entry name="serial">739645e6-9952-40db-a876-f23d02d4e411</entry>
Nov 15 08:23:37 user nova-compute[95467]:       <entry name="uuid">739645e6-9952-40db-a876-f23d02d4e411</entry>
Nov 15 08:23:37 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:23:37 user nova-compute[95467]:     </system>
Nov 15 08:23:37 user nova-compute[95467]:   </sysinfo>
Nov 15 08:23:37 user nova-compute[95467]:   <os>
Nov 15 08:23:37 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:23:37 user nova-compute[95467]:     <boot dev="hd"/>
Nov 15 08:23:37 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:23:37 user nova-compute[95467]:   </os>
Nov 15 08:23:37 user nova-compute[95467]:   <features>
Nov 15 08:23:37 user nova-compute[95467]:     <acpi/>
Nov 15 08:23:37 user nova-compute[95467]:     <apic/>
Nov 15 08:23:37 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:23:37 user nova-compute[95467]:   </features>
Nov 15 08:23:37 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:23:37 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:23:37 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:23:37 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:23:37 user nova-compute[95467]:   </clock>
Nov 15 08:23:37 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:23:37 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:23:37 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:23:37 user nova-compute[95467]:   </cpu>
Nov 15 08:23:37 user nova-compute[95467]:   <devices>
Nov 15 08:23:37 user nova-compute[95467]:     <disk type="file" device="disk">
Nov 15 08:23:37 user nova-compute[95467]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 08:23:37 user nova-compute[95467]:       <source file="/opt/stack/data/nova/instances/739645e6-9952-40db-a876-f23d02d4e411/disk"/>
Nov 15 08:23:37 user nova-compute[95467]:       <target dev="vda" bus="virtio"/>
Nov 15 08:23:37 user nova-compute[95467]:     </disk>
Nov 15 08:23:37 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:23:37 user nova-compute[95467]:       <mac address="fa:16:3e:13:89:c0"/>
Nov 15 08:23:37 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:23:37 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:23:37 user nova-compute[95467]:       <target dev="tapa6f2f30d-af"/>
Nov 15 08:23:37 user nova-compute[95467]:     </interface>
Nov 15 08:23:37 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:23:37 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/739645e6-9952-40db-a876-f23d02d4e411/console.log" append="off"/>
Nov 15 08:23:37 user nova-compute[95467]:     </serial>
Nov 15 08:23:37 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:23:37 user nova-compute[95467]:     <video>
Nov 15 08:23:37 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:23:37 user nova-compute[95467]:     </video>
Nov 15 08:23:37 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:23:37 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:23:37 user nova-compute[95467]:     </rng>
Nov 15 08:23:37 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:23:37 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:23:37 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:23:37 user nova-compute[95467]:     </memballoon>
Nov 15 08:23:37 user nova-compute[95467]:   </devices>
Nov 15 08:23:37 user nova-compute[95467]: </domain>
Nov 15 08:23:37 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:23:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1308444358',display_name='tempest-ServerRescueNegativeTestJSON-server-1308444358',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1308444358',id=40,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKzoLkdMobeNcNbHKHSz6pf9KB3mnqKkGNlpbsfMF936yySn1GMTRgtnj4EoSqGo09dnRTYgYgXqxoNmiTwq5Zdq5EmI5cdClHP/6DwnQRnc+u/69gFrqzMpVc0XcKHOQ==',key_name='tempest-keypair-573508882',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd281be4e94a4d31a47a13267d51d9b6',ramdisk_id='',reservation_id='r-qs39ggxa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1148442534',owner_user_name='tempest-ServerRescueNegativeTestJSON-1148442534-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:23:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c07f8dbc38004ecd973f61bba63606d4',uuid=739645e6-9952-40db-a876-f23d02d4e411,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae", "address": "fa:16:3e:13:89:c0", "network": {"id": "369d2a6f-60b7-4c92-8b2d-1f3828f6698b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1491709218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd281be4e94a4d31a47a13267d51d9b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6f2f30d-af", "ovs_interfaceid": "a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Converting VIF {"id": "a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae", "address": "fa:16:3e:13:89:c0", "network": {"id": "369d2a6f-60b7-4c92-8b2d-1f3828f6698b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1491709218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd281be4e94a4d31a47a13267d51d9b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6f2f30d-af", "ovs_interfaceid": "a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:89:c0,bridge_name='br-int',has_traffic_filtering=True,id=a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae,network=Network(369d2a6f-60b7-4c92-8b2d-1f3828f6698b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6f2f30d-af') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG os_vif [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:89:c0,bridge_name='br-int',has_traffic_filtering=True,id=a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae,network=Network(369d2a6f-60b7-4c92-8b2d-1f3828f6698b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6f2f30d-af') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '36f8a11b-30b9-5d2d-b511-39631a9a0341', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa6f2f30d-af, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa6f2f30d-af, col_values=(('qos', UUID('075c05ed-04fd-4ef8-8da5-a782a4036c04')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa6f2f30d-af, col_values=(('external_ids', {'iface-id': 'a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:89:c0', 'vm-uuid': '739645e6-9952-40db-a876-f23d02d4e411'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:37 user nova-compute[95467]: INFO os_vif [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:89:c0,bridge_name='br-int',has_traffic_filtering=True,id=a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae,network=Network(369d2a6f-60b7-4c92-8b2d-1f3828f6698b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6f2f30d-af')
Nov 15 08:23:37 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] No VIF found with MAC fa:16:3e:13:89:c0, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG nova.network.neutron [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Updating instance_info_cache with network_info: [{"id": "4572a8d9-9e56-47da-b59d-013b88b32e8b", "address": "fa:16:3e:08:74:0a", "network": {"id": "bdae4fa0-34fd-4b85-8c8b-7d68b7e80282", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-680251229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6fb970c784b4c3c8e64abd04523885a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4572a8d9-9e", "ovs_interfaceid": "4572a8d9-9e56-47da-b59d-013b88b32e8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Releasing lock "refresh_cache-843b778c-f823-4bee-aa76-ab44345be9a7" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG nova.compute.manager [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Instance network_info: |[{"id": "4572a8d9-9e56-47da-b59d-013b88b32e8b", "address": "fa:16:3e:08:74:0a", "network": {"id": "bdae4fa0-34fd-4b85-8c8b-7d68b7e80282", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-680251229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6fb970c784b4c3c8e64abd04523885a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4572a8d9-9e", "ovs_interfaceid": "4572a8d9-9e56-47da-b59d-013b88b32e8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Start _get_guest_xml network_info=[{"id": "4572a8d9-9e56-47da-b59d-013b88b32e8b", "address": "fa:16:3e:08:74:0a", "network": {"id": "bdae4fa0-34fd-4b85-8c8b-7d68b7e80282", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-680251229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6fb970c784b4c3c8e64abd04523885a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4572a8d9-9e", "ovs_interfaceid": "4572a8d9-9e56-47da-b59d-013b88b32e8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'ed9c48aa-ce73-4b3b-9db1-235898be671b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:23:37 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:23:37 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:23:37 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:23:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-217296366',display_name='tempest-TestServerVolumeAttachmentScenario-server-217296366',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-217296366',id=39,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF+lcfu/nvHsnk/6Gwk8D0QBtWBp//jnxtatY7hRUCnEPCIyXaUj7LZd5fLikSO7hUHx6NJ8dIROzhkOIJrdZab7uyAVcRNKmEbdjc8IDIMXo7ULTlpxCEMNToBrSYGAIA==',key_name='tempest-keypair-1977680203',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6fb970c784b4c3c8e64abd04523885a',ramdisk_id='',reservation_id='r-v5u24366',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1144112499',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1144112499-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:23:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b6b2de671674fa8b9f2489fcbba90f4',uuid=843b778c-f823-4bee-aa76-ab44345be9a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4572a8d9-9e56-47da-b59d-013b88b32e8b", "address": "fa:16:3e:08:74:0a", "network": {"id": "bdae4fa0-34fd-4b85-8c8b-7d68b7e80282", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-680251229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6fb970c784b4c3c8e64abd04523885a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4572a8d9-9e", "ovs_interfaceid": "4572a8d9-9e56-47da-b59d-013b88b32e8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Converting VIF {"id": "4572a8d9-9e56-47da-b59d-013b88b32e8b", "address": "fa:16:3e:08:74:0a", "network": {"id": "bdae4fa0-34fd-4b85-8c8b-7d68b7e80282", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-680251229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6fb970c784b4c3c8e64abd04523885a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4572a8d9-9e", "ovs_interfaceid": "4572a8d9-9e56-47da-b59d-013b88b32e8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:74:0a,bridge_name='br-int',has_traffic_filtering=True,id=4572a8d9-9e56-47da-b59d-013b88b32e8b,network=Network(bdae4fa0-34fd-4b85-8c8b-7d68b7e80282),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4572a8d9-9e') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG nova.objects.instance [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Lazy-loading 'pci_devices' on Instance uuid 843b778c-f823-4bee-aa76-ab44345be9a7 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:23:37 user nova-compute[95467]:   <uuid>843b778c-f823-4bee-aa76-ab44345be9a7</uuid>
Nov 15 08:23:37 user nova-compute[95467]:   <name>instance-00000027</name>
Nov 15 08:23:37 user nova-compute[95467]:   <memory>524288</memory>
Nov 15 08:23:37 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:23:37 user nova-compute[95467]:   <metadata>
Nov 15 08:23:37 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:23:37 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:23:37 user nova-compute[95467]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-217296366</nova:name>
Nov 15 08:23:37 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:23:37</nova:creationTime>
Nov 15 08:23:37 user nova-compute[95467]:       <nova:flavor name="m1.tiny">
Nov 15 08:23:37 user nova-compute[95467]:         <nova:memory>512</nova:memory>
Nov 15 08:23:37 user nova-compute[95467]:         <nova:disk>1</nova:disk>
Nov 15 08:23:37 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:23:37 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:23:37 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:23:37 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:23:37 user nova-compute[95467]:       <nova:owner>
Nov 15 08:23:37 user nova-compute[95467]:         <nova:user uuid="5b6b2de671674fa8b9f2489fcbba90f4">tempest-TestServerVolumeAttachmentScenario-1144112499-project-member</nova:user>
Nov 15 08:23:37 user nova-compute[95467]:         <nova:project uuid="a6fb970c784b4c3c8e64abd04523885a">tempest-TestServerVolumeAttachmentScenario-1144112499</nova:project>
Nov 15 08:23:37 user nova-compute[95467]:       </nova:owner>
Nov 15 08:23:37 user nova-compute[95467]:       <nova:root type="image" uuid="ed9c48aa-ce73-4b3b-9db1-235898be671b"/>
Nov 15 08:23:37 user nova-compute[95467]:       <nova:ports>
Nov 15 08:23:37 user nova-compute[95467]:         <nova:port uuid="4572a8d9-9e56-47da-b59d-013b88b32e8b">
Nov 15 08:23:37 user nova-compute[95467]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 08:23:37 user nova-compute[95467]:         </nova:port>
Nov 15 08:23:37 user nova-compute[95467]:       </nova:ports>
Nov 15 08:23:37 user nova-compute[95467]:     </nova:instance>
Nov 15 08:23:37 user nova-compute[95467]:   </metadata>
Nov 15 08:23:37 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:23:37 user nova-compute[95467]:     <system>
Nov 15 08:23:37 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:23:37 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:23:37 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:23:37 user nova-compute[95467]:       <entry name="serial">843b778c-f823-4bee-aa76-ab44345be9a7</entry>
Nov 15 08:23:37 user nova-compute[95467]:       <entry name="uuid">843b778c-f823-4bee-aa76-ab44345be9a7</entry>
Nov 15 08:23:37 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:23:37 user nova-compute[95467]:     </system>
Nov 15 08:23:37 user nova-compute[95467]:   </sysinfo>
Nov 15 08:23:37 user nova-compute[95467]:   <os>
Nov 15 08:23:37 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:23:37 user nova-compute[95467]:     <boot dev="hd"/>
Nov 15 08:23:37 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:23:37 user nova-compute[95467]:   </os>
Nov 15 08:23:37 user nova-compute[95467]:   <features>
Nov 15 08:23:37 user nova-compute[95467]:     <acpi/>
Nov 15 08:23:37 user nova-compute[95467]:     <apic/>
Nov 15 08:23:37 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:23:37 user nova-compute[95467]:   </features>
Nov 15 08:23:37 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:23:37 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:23:37 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:23:37 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:23:37 user nova-compute[95467]:   </clock>
Nov 15 08:23:37 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:23:37 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:23:37 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:23:37 user nova-compute[95467]:   </cpu>
Nov 15 08:23:37 user nova-compute[95467]:   <devices>
Nov 15 08:23:37 user nova-compute[95467]:     <disk type="file" device="disk">
Nov 15 08:23:37 user nova-compute[95467]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 08:23:37 user nova-compute[95467]:       <source file="/opt/stack/data/nova/instances/843b778c-f823-4bee-aa76-ab44345be9a7/disk"/>
Nov 15 08:23:37 user nova-compute[95467]:       <target dev="vda" bus="virtio"/>
Nov 15 08:23:37 user nova-compute[95467]:     </disk>
Nov 15 08:23:37 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:23:37 user nova-compute[95467]:       <mac address="fa:16:3e:08:74:0a"/>
Nov 15 08:23:37 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:23:37 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:23:37 user nova-compute[95467]:       <target dev="tap4572a8d9-9e"/>
Nov 15 08:23:37 user nova-compute[95467]:     </interface>
Nov 15 08:23:37 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:23:37 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/843b778c-f823-4bee-aa76-ab44345be9a7/console.log" append="off"/>
Nov 15 08:23:37 user nova-compute[95467]:     </serial>
Nov 15 08:23:37 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:23:37 user nova-compute[95467]:     <video>
Nov 15 08:23:37 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:23:37 user nova-compute[95467]:     </video>
Nov 15 08:23:37 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:23:37 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:23:37 user nova-compute[95467]:     </rng>
Nov 15 08:23:37 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:23:37 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:23:37 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:23:37 user nova-compute[95467]:     </memballoon>
Nov 15 08:23:37 user nova-compute[95467]:   </devices>
Nov 15 08:23:37 user nova-compute[95467]: </domain>
Nov 15 08:23:37 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:23:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-217296366',display_name='tempest-TestServerVolumeAttachmentScenario-server-217296366',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-217296366',id=39,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF+lcfu/nvHsnk/6Gwk8D0QBtWBp//jnxtatY7hRUCnEPCIyXaUj7LZd5fLikSO7hUHx6NJ8dIROzhkOIJrdZab7uyAVcRNKmEbdjc8IDIMXo7ULTlpxCEMNToBrSYGAIA==',key_name='tempest-keypair-1977680203',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6fb970c784b4c3c8e64abd04523885a',ramdisk_id='',reservation_id='r-v5u24366',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1144112499',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1144112499-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:23:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b6b2de671674fa8b9f2489fcbba90f4',uuid=843b778c-f823-4bee-aa76-ab44345be9a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4572a8d9-9e56-47da-b59d-013b88b32e8b", "address": "fa:16:3e:08:74:0a", "network": {"id": "bdae4fa0-34fd-4b85-8c8b-7d68b7e80282", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-680251229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6fb970c784b4c3c8e64abd04523885a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4572a8d9-9e", "ovs_interfaceid": "4572a8d9-9e56-47da-b59d-013b88b32e8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Converting VIF {"id": "4572a8d9-9e56-47da-b59d-013b88b32e8b", "address": "fa:16:3e:08:74:0a", "network": {"id": "bdae4fa0-34fd-4b85-8c8b-7d68b7e80282", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-680251229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6fb970c784b4c3c8e64abd04523885a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4572a8d9-9e", "ovs_interfaceid": "4572a8d9-9e56-47da-b59d-013b88b32e8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:74:0a,bridge_name='br-int',has_traffic_filtering=True,id=4572a8d9-9e56-47da-b59d-013b88b32e8b,network=Network(bdae4fa0-34fd-4b85-8c8b-7d68b7e80282),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4572a8d9-9e') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG os_vif [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:74:0a,bridge_name='br-int',has_traffic_filtering=True,id=4572a8d9-9e56-47da-b59d-013b88b32e8b,network=Network(bdae4fa0-34fd-4b85-8c8b-7d68b7e80282),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4572a8d9-9e') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3adaeb68-e0d4-5697-851c-caba7a7f1807', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4572a8d9-9e, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4572a8d9-9e, col_values=(('qos', UUID('71da8768-9a1c-4259-b034-892fea1c3b0b')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4572a8d9-9e, col_values=(('external_ids', {'iface-id': '4572a8d9-9e56-47da-b59d-013b88b32e8b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:74:0a', 'vm-uuid': '843b778c-f823-4bee-aa76-ab44345be9a7'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:37 user nova-compute[95467]: INFO os_vif [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:74:0a,bridge_name='br-int',has_traffic_filtering=True,id=4572a8d9-9e56-47da-b59d-013b88b32e8b,network=Network(bdae4fa0-34fd-4b85-8c8b-7d68b7e80282),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4572a8d9-9e')
Nov 15 08:23:37 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:23:37 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] No VIF found with MAC fa:16:3e:08:74:0a, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:23:39 user nova-compute[95467]: DEBUG nova.compute.manager [req-dae563b1-7800-41b6-bba7-ad46b6b49d4f req-5f9e2183-6f71-43bd-a66f-81b9e6555e82 service nova] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Received event network-changed-62cba8e1-074b-41db-bb58-3363138fb060 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:23:39 user nova-compute[95467]: DEBUG nova.compute.manager [req-dae563b1-7800-41b6-bba7-ad46b6b49d4f req-5f9e2183-6f71-43bd-a66f-81b9e6555e82 service nova] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Refreshing instance network info cache due to event network-changed-62cba8e1-074b-41db-bb58-3363138fb060. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:23:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-dae563b1-7800-41b6-bba7-ad46b6b49d4f req-5f9e2183-6f71-43bd-a66f-81b9e6555e82 service nova] Acquiring lock "refresh_cache-d22eb02b-7e8d-4755-9f1e-3eee56ddec0c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:23:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-dae563b1-7800-41b6-bba7-ad46b6b49d4f req-5f9e2183-6f71-43bd-a66f-81b9e6555e82 service nova] Acquired lock "refresh_cache-d22eb02b-7e8d-4755-9f1e-3eee56ddec0c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:23:39 user nova-compute[95467]: DEBUG nova.network.neutron [req-dae563b1-7800-41b6-bba7-ad46b6b49d4f req-5f9e2183-6f71-43bd-a66f-81b9e6555e82 service nova] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Refreshing network info cache for port 62cba8e1-074b-41db-bb58-3363138fb060 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:23:39 user nova-compute[95467]: DEBUG nova.network.neutron [req-dae563b1-7800-41b6-bba7-ad46b6b49d4f req-5f9e2183-6f71-43bd-a66f-81b9e6555e82 service nova] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Updated VIF entry in instance network info cache for port 62cba8e1-074b-41db-bb58-3363138fb060. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:23:39 user nova-compute[95467]: DEBUG nova.network.neutron [req-dae563b1-7800-41b6-bba7-ad46b6b49d4f req-5f9e2183-6f71-43bd-a66f-81b9e6555e82 service nova] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Updating instance_info_cache with network_info: [{"id": "62cba8e1-074b-41db-bb58-3363138fb060", "address": "fa:16:3e:e4:27:f3", "network": {"id": "439fd8f9-3cf0-449d-b7e1-eba4d33109f9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-399225774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7f46c4dc5bf438cad677a366bdd5b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62cba8e1-07", "ovs_interfaceid": "62cba8e1-074b-41db-bb58-3363138fb060", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:23:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-dae563b1-7800-41b6-bba7-ad46b6b49d4f req-5f9e2183-6f71-43bd-a66f-81b9e6555e82 service nova] Releasing lock "refresh_cache-d22eb02b-7e8d-4755-9f1e-3eee56ddec0c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:23:39 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:39 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:39 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:39 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:41 user nova-compute[95467]: DEBUG nova.compute.manager [req-d6aa1556-9115-4a3c-ae48-09ec6f4a91fa req-b23fb6a2-cae4-4ca2-80ad-081597c10961 service nova] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Received event network-vif-plugged-a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:23:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-d6aa1556-9115-4a3c-ae48-09ec6f4a91fa req-b23fb6a2-cae4-4ca2-80ad-081597c10961 service nova] Acquiring lock "739645e6-9952-40db-a876-f23d02d4e411-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:23:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-d6aa1556-9115-4a3c-ae48-09ec6f4a91fa req-b23fb6a2-cae4-4ca2-80ad-081597c10961 service nova] Lock "739645e6-9952-40db-a876-f23d02d4e411-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:23:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-d6aa1556-9115-4a3c-ae48-09ec6f4a91fa req-b23fb6a2-cae4-4ca2-80ad-081597c10961 service nova] Lock "739645e6-9952-40db-a876-f23d02d4e411-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:23:41 user nova-compute[95467]: DEBUG nova.compute.manager [req-d6aa1556-9115-4a3c-ae48-09ec6f4a91fa req-b23fb6a2-cae4-4ca2-80ad-081597c10961 service nova] [instance: 739645e6-9952-40db-a876-f23d02d4e411] No waiting events found dispatching network-vif-plugged-a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:23:41 user nova-compute[95467]: WARNING nova.compute.manager [req-d6aa1556-9115-4a3c-ae48-09ec6f4a91fa req-b23fb6a2-cae4-4ca2-80ad-081597c10961 service nova] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Received unexpected event network-vif-plugged-a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae for instance with vm_state building and task_state spawning.
Nov 15 08:23:41 user nova-compute[95467]: DEBUG nova.compute.manager [req-d6aa1556-9115-4a3c-ae48-09ec6f4a91fa req-b23fb6a2-cae4-4ca2-80ad-081597c10961 service nova] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Received event network-vif-plugged-a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:23:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-d6aa1556-9115-4a3c-ae48-09ec6f4a91fa req-b23fb6a2-cae4-4ca2-80ad-081597c10961 service nova] Acquiring lock "739645e6-9952-40db-a876-f23d02d4e411-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:23:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-d6aa1556-9115-4a3c-ae48-09ec6f4a91fa req-b23fb6a2-cae4-4ca2-80ad-081597c10961 service nova] Lock "739645e6-9952-40db-a876-f23d02d4e411-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:23:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-d6aa1556-9115-4a3c-ae48-09ec6f4a91fa req-b23fb6a2-cae4-4ca2-80ad-081597c10961 service nova] Lock "739645e6-9952-40db-a876-f23d02d4e411-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:23:41 user nova-compute[95467]: DEBUG nova.compute.manager [req-d6aa1556-9115-4a3c-ae48-09ec6f4a91fa req-b23fb6a2-cae4-4ca2-80ad-081597c10961 service nova] [instance: 739645e6-9952-40db-a876-f23d02d4e411] No waiting events found dispatching network-vif-plugged-a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:23:41 user nova-compute[95467]: WARNING nova.compute.manager [req-d6aa1556-9115-4a3c-ae48-09ec6f4a91fa req-b23fb6a2-cae4-4ca2-80ad-081597c10961 service nova] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Received unexpected event network-vif-plugged-a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae for instance with vm_state building and task_state spawning.
Nov 15 08:23:41 user nova-compute[95467]: DEBUG nova.compute.manager [req-d6aa1556-9115-4a3c-ae48-09ec6f4a91fa req-b23fb6a2-cae4-4ca2-80ad-081597c10961 service nova] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Received event network-vif-plugged-4572a8d9-9e56-47da-b59d-013b88b32e8b {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:23:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-d6aa1556-9115-4a3c-ae48-09ec6f4a91fa req-b23fb6a2-cae4-4ca2-80ad-081597c10961 service nova] Acquiring lock "843b778c-f823-4bee-aa76-ab44345be9a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:23:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-d6aa1556-9115-4a3c-ae48-09ec6f4a91fa req-b23fb6a2-cae4-4ca2-80ad-081597c10961 service nova] Lock "843b778c-f823-4bee-aa76-ab44345be9a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:23:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-d6aa1556-9115-4a3c-ae48-09ec6f4a91fa req-b23fb6a2-cae4-4ca2-80ad-081597c10961 service nova] Lock "843b778c-f823-4bee-aa76-ab44345be9a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:23:41 user nova-compute[95467]: DEBUG nova.compute.manager [req-d6aa1556-9115-4a3c-ae48-09ec6f4a91fa req-b23fb6a2-cae4-4ca2-80ad-081597c10961 service nova] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] No waiting events found dispatching network-vif-plugged-4572a8d9-9e56-47da-b59d-013b88b32e8b {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:23:41 user nova-compute[95467]: WARNING nova.compute.manager [req-d6aa1556-9115-4a3c-ae48-09ec6f4a91fa req-b23fb6a2-cae4-4ca2-80ad-081597c10961 service nova] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Received unexpected event network-vif-plugged-4572a8d9-9e56-47da-b59d-013b88b32e8b for instance with vm_state building and task_state spawning.
Nov 15 08:23:41 user nova-compute[95467]: DEBUG nova.compute.manager [req-d6aa1556-9115-4a3c-ae48-09ec6f4a91fa req-b23fb6a2-cae4-4ca2-80ad-081597c10961 service nova] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Received event network-vif-plugged-4572a8d9-9e56-47da-b59d-013b88b32e8b {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:23:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-d6aa1556-9115-4a3c-ae48-09ec6f4a91fa req-b23fb6a2-cae4-4ca2-80ad-081597c10961 service nova] Acquiring lock "843b778c-f823-4bee-aa76-ab44345be9a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:23:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-d6aa1556-9115-4a3c-ae48-09ec6f4a91fa req-b23fb6a2-cae4-4ca2-80ad-081597c10961 service nova] Lock "843b778c-f823-4bee-aa76-ab44345be9a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:23:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-d6aa1556-9115-4a3c-ae48-09ec6f4a91fa req-b23fb6a2-cae4-4ca2-80ad-081597c10961 service nova] Lock "843b778c-f823-4bee-aa76-ab44345be9a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:23:41 user nova-compute[95467]: DEBUG nova.compute.manager [req-d6aa1556-9115-4a3c-ae48-09ec6f4a91fa req-b23fb6a2-cae4-4ca2-80ad-081597c10961 service nova] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] No waiting events found dispatching network-vif-plugged-4572a8d9-9e56-47da-b59d-013b88b32e8b {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:23:41 user nova-compute[95467]: WARNING nova.compute.manager [req-d6aa1556-9115-4a3c-ae48-09ec6f4a91fa req-b23fb6a2-cae4-4ca2-80ad-081597c10961 service nova] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Received unexpected event network-vif-plugged-4572a8d9-9e56-47da-b59d-013b88b32e8b for instance with vm_state building and task_state spawning.
Nov 15 08:23:42 user nova-compute[95467]: DEBUG nova.compute.manager [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Instance event wait completed in 0 seconds for  {{(pid=95467) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 08:23:42 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Guest created on hypervisor {{(pid=95467) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 08:23:42 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Instance spawned successfully.
Nov 15 08:23:42 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 08:23:42 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Found default for hw_cdrom_bus of ide {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:23:42 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Found default for hw_disk_bus of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:23:42 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Found default for hw_input_bus of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:23:42 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Found default for hw_pointer_model of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:23:42 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Found default for hw_video_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:23:42 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Found default for hw_vif_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:23:42 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:42 user nova-compute[95467]: DEBUG nova.compute.manager [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Instance event wait completed in 0 seconds for  {{(pid=95467) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 08:23:42 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Guest created on hypervisor {{(pid=95467) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 08:23:42 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Instance spawned successfully.
Nov 15 08:23:42 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 08:23:42 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Found default for hw_cdrom_bus of ide {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:23:42 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Found default for hw_disk_bus of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:23:42 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Found default for hw_input_bus of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:23:42 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Found default for hw_pointer_model of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:23:42 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Found default for hw_video_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:23:42 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Found default for hw_vif_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:23:42 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:42 user nova-compute[95467]: INFO nova.compute.manager [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Took 7.29 seconds to spawn the instance on the hypervisor.
Nov 15 08:23:42 user nova-compute[95467]: DEBUG nova.compute.manager [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:23:42 user nova-compute[95467]: INFO nova.compute.manager [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Took 8.08 seconds to spawn the instance on the hypervisor.
Nov 15 08:23:42 user nova-compute[95467]: DEBUG nova.compute.manager [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:23:42 user nova-compute[95467]: INFO nova.compute.manager [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Took 8.92 seconds to build instance.
Nov 15 08:23:42 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7ffb8942-af2c-4a6f-8a14-f2eb817c6a39 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "739645e6-9952-40db-a876-f23d02d4e411" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.026s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:23:42 user nova-compute[95467]: INFO nova.compute.manager [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Took 8.93 seconds to build instance.
Nov 15 08:23:42 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-841526c7-eb35-4a81-857a-faf066568ff9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Lock "843b778c-f823-4bee-aa76-ab44345be9a7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.071s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:23:45 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:23:45 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=95467) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 08:23:46 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager.update_available_resource {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:23:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:23:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:23:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:23:46 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Auditing locally available compute resources for user (node: user) {{(pid=95467) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 08:23:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:47 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:23:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:47 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a155e6-0ee2-4728-a526-17c149107ab0/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:47 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a155e6-0ee2-4728-a526-17c149107ab0/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a155e6-0ee2-4728-a526-17c149107ab0/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a155e6-0ee2-4728-a526-17c149107ab0/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/739645e6-9952-40db-a876-f23d02d4e411/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/739645e6-9952-40db-a876-f23d02d4e411/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/739645e6-9952-40db-a876-f23d02d4e411/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/739645e6-9952-40db-a876-f23d02d4e411/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091612cf-b737-480b-984e-a05b522676b6/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091612cf-b737-480b-984e-a05b522676b6/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091612cf-b737-480b-984e-a05b522676b6/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091612cf-b737-480b-984e-a05b522676b6/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:49 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:23:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/843b778c-f823-4bee-aa76-ab44345be9a7/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/843b778c-f823-4bee-aa76-ab44345be9a7/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/843b778c-f823-4bee-aa76-ab44345be9a7/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/843b778c-f823-4bee-aa76-ab44345be9a7/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk.rescue --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk.rescue --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d22eb02b-7e8d-4755-9f1e-3eee56ddec0c/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d22eb02b-7e8d-4755-9f1e-3eee56ddec0c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d22eb02b-7e8d-4755-9f1e-3eee56ddec0c/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d22eb02b-7e8d-4755-9f1e-3eee56ddec0c/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:50 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:23:51 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:23:51 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:23:51 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Hypervisor/Node resource view: name=user free_ram=7444MB free_disk=25.069244384765625GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=95467) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 08:23:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:23:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:23:51 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Applying migration context for instance a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80 as it has an incoming, in-progress migration 8fe2f3a2-0317-41fd-bdca-8be49a9a3d90. Migration status is finished {{(pid=95467) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 15 08:23:51 user nova-compute[95467]: INFO nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Updating resource usage from migration 8fe2f3a2-0317-41fd-bdca-8be49a9a3d90
Nov 15 08:23:51 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 73fe8852-c47a-47ab-a56f-6864c8ed5479 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:23:51 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 21cf2ada-b15c-490d-ac37-96e9c87e9056 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:23:51 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:23:51 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 10d73b73-ca65-4192-8954-288dc1df9f24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:23:51 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 3825a691-ac5c-4c06-b4a4-2a0b40c638c4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:23:51 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance a1a155e6-0ee2-4728-a526-17c149107ab0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:23:51 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 091612cf-b737-480b-984e-a05b522676b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:23:51 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance d22eb02b-7e8d-4755-9f1e-3eee56ddec0c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:23:51 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 710d9598-1d36-4fdb-aa62-e7ff0b5ababe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:23:51 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Migration 8fe2f3a2-0317-41fd-bdca-8be49a9a3d90 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 15 08:23:51 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:23:51 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 843b778c-f823-4bee-aa76-ab44345be9a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:23:51 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 739645e6-9952-40db-a876-f23d02d4e411 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:23:51 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 08:23:51 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 08:23:51 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:23:52 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:23:52 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Compute_service record updated for user:user {{(pid=95467) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 08:23:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.613s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:23:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Acquiring lock "6a551521-28cf-4b4e-94e8-5f5ecc0c37f7" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:23:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Lock "6a551521-28cf-4b4e-94e8-5f5ecc0c37f7" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:23:52 user nova-compute[95467]: INFO nova.compute.manager [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Unshelving
Nov 15 08:23:52 user nova-compute[95467]: INFO nova.virt.block_device [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Booting with volume 965f0947-8c2b-4f39-a814-22493fb16775 at /dev/vda
Nov 15 08:23:52 user nova-compute[95467]: DEBUG os_brick.utils [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:23:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:52 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c640c2b9-2749-4f60-a25e-995c006a2256]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:882ae90641f\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:23:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:52 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12a3697-22e9-4704-a3c6-a0b14a937d7a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:23:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:52 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ff3733-72ec-4be7-9fa9-69720b7ed7a9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:23:52 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[65edff28-dc90-4014-9e6d-924af523937d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:23:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Running cmd (subprocess): nvme version {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] 'nvme version' failed. Not Retrying. {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:23:52 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] nvme not present on system {{(pid=95467) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 08:23:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:23:52 user nova-compute[95467]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 08:23:52 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[623a861d-bf57-4406-b118-71cac5f8bf34]: (4, '') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:23:52 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=95467) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 08:23:52 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 08:23:52 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] LIGHTOS: no hostnqn found. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 08:23:52 user nova-compute[95467]: DEBUG os_brick.utils [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:882ae90641f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:23:52 user nova-compute[95467]: DEBUG nova.virt.block_device [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Updating existing volume attachment record: ae5f084d-4969-49a6-a4c1-57b86560a8f7 {{(pid=95467) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 08:23:52 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:52 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:53 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:23:53 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:23:53 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:23:53 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:23:53 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:23:53 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:23:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-342e33a9-8d3a-4fca-9289-55d339eb47fa tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Acquiring lock "a1a155e6-0ee2-4728-a526-17c149107ab0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:23:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-342e33a9-8d3a-4fca-9289-55d339eb47fa tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lock "a1a155e6-0ee2-4728-a526-17c149107ab0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:23:54 user nova-compute[95467]: DEBUG nova.objects.instance [None req-342e33a9-8d3a-4fca-9289-55d339eb47fa tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lazy-loading 'flavor' on Instance uuid a1a155e6-0ee2-4728-a526-17c149107ab0 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:23:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-342e33a9-8d3a-4fca-9289-55d339eb47fa tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lock "a1a155e6-0ee2-4728-a526-17c149107ab0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.082s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:23:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-342e33a9-8d3a-4fca-9289-55d339eb47fa tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Acquiring lock "a1a155e6-0ee2-4728-a526-17c149107ab0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:23:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-342e33a9-8d3a-4fca-9289-55d339eb47fa tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lock "a1a155e6-0ee2-4728-a526-17c149107ab0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:23:54 user nova-compute[95467]: INFO nova.compute.manager [None req-342e33a9-8d3a-4fca-9289-55d339eb47fa tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Attaching volume c277482a-0dfd-44ff-aae4-fd6c8a855c41 to /dev/vdb
Nov 15 08:23:54 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:23:54 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Starting heal instance info cache {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 08:23:54 user nova-compute[95467]: DEBUG os_brick.utils [None req-342e33a9-8d3a-4fca-9289-55d339eb47fa tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:23:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:54 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd838b6a-7110-4738-96f8-3d2ca9f5f09d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:882ae90641f\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:23:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:54 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47c1f72-4c4b-4239-acff-2e740023d028]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:23:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "refresh_cache-3825a691-ac5c-4c06-b4a4-2a0b40c638c4" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:23:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquired lock "refresh_cache-3825a691-ac5c-4c06-b4a4-2a0b40c638c4" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:23:54 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Forcefully refreshing network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 08:23:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:54 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5faf60f-2f71-48e5-9cc1-e59fc8e74f3e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:23:54 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[88db8e58-4668-472d-9966-9ad454dfb340]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:23:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-342e33a9-8d3a-4fca-9289-55d339eb47fa tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Running cmd (subprocess): nvme version {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-342e33a9-8d3a-4fca-9289-55d339eb47fa tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] 'nvme version' failed. Not Retrying. {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:23:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.nvmeof [None req-342e33a9-8d3a-4fca-9289-55d339eb47fa tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] nvme not present on system {{(pid=95467) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 08:23:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:23:54 user nova-compute[95467]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 08:23:54 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9329e68-b603-4c12-8a8c-2c454f34eb39]: (4, '') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:23:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-342e33a9-8d3a-4fca-9289-55d339eb47fa tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=95467) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 08:23:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-342e33a9-8d3a-4fca-9289-55d339eb47fa tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 08:23:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-342e33a9-8d3a-4fca-9289-55d339eb47fa tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] LIGHTOS: no hostnqn found. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 08:23:54 user nova-compute[95467]: DEBUG os_brick.utils [None req-342e33a9-8d3a-4fca-9289-55d339eb47fa tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:882ae90641f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:23:54 user nova-compute[95467]: DEBUG nova.virt.block_device [None req-342e33a9-8d3a-4fca-9289-55d339eb47fa tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Updating existing volume attachment record: 7fe55b1c-a739-4d91-95ec-e4b9410212fc {{(pid=95467) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 08:23:55 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Updating instance_info_cache with network_info: [{"id": "3fddc7dd-48af-4964-bc1a-a54623453f62", "address": "fa:16:3e:c6:49:ac", "network": {"id": "ac9a381d-25fe-4419-b151-f03333413813", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1183680999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34d65a8000347feb2b3966b7ce0d785", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fddc7dd-48", "ovs_interfaceid": "3fddc7dd-48af-4964-bc1a-a54623453f62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:23:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Releasing lock "refresh_cache-3825a691-ac5c-4c06-b4a4-2a0b40c638c4" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:23:55 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Updated the network info_cache for instance {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 08:23:55 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:23:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:23:58 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:23:58 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:23:58 user nova-compute[95467]: DEBUG nova.objects.instance [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Lazy-loading 'pci_requests' on Instance uuid 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:23:58 user nova-compute[95467]: DEBUG nova.objects.instance [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Lazy-loading 'numa_topology' on Instance uuid 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:23:58 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=95467) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 08:23:58 user nova-compute[95467]: INFO nova.compute.claims [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Claim successful on node user
Nov 15 08:23:58 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:23:58 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:23:58 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.575s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:23:58 user nova-compute[95467]: INFO nova.network.neutron [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Updating port 93a4c2ed-b2a8-471c-8173-d221f7251e8b with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 15 08:23:59 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Acquiring lock "refresh_cache-6a551521-28cf-4b4e-94e8-5f5ecc0c37f7" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:23:59 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Acquired lock "refresh_cache-6a551521-28cf-4b4e-94e8-5f5ecc0c37f7" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:23:59 user nova-compute[95467]: DEBUG nova.network.neutron [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:23:59 user nova-compute[95467]: DEBUG nova.compute.manager [req-3f710bbf-7044-4002-b2c5-24173fb07ebc req-9b7d7429-9aef-4d82-9703-305e76a9db87 service nova] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Received event network-changed-93a4c2ed-b2a8-471c-8173-d221f7251e8b {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:23:59 user nova-compute[95467]: DEBUG nova.compute.manager [req-3f710bbf-7044-4002-b2c5-24173fb07ebc req-9b7d7429-9aef-4d82-9703-305e76a9db87 service nova] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Refreshing instance network info cache due to event network-changed-93a4c2ed-b2a8-471c-8173-d221f7251e8b. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:23:59 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-3f710bbf-7044-4002-b2c5-24173fb07ebc req-9b7d7429-9aef-4d82-9703-305e76a9db87 service nova] Acquiring lock "refresh_cache-6a551521-28cf-4b4e-94e8-5f5ecc0c37f7" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:23:59 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-342e33a9-8d3a-4fca-9289-55d339eb47fa tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Calling os-brick to attach iSCSI Volume {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 08:23:59 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-342e33a9-8d3a-4fca-9289-55d339eb47fa tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c277482a-0dfd-44ff-aae4-fd6c8a855c41', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dTWkhsfL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:23:59 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-342e33a9-8d3a-4fca-9289-55d339eb47fa tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:23:59 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-342e33a9-8d3a-4fca-9289-55d339eb47fa tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:23:59 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-342e33a9-8d3a-4fca-9289-55d339eb47fa tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:23:59 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-342e33a9-8d3a-4fca-9289-55d339eb47fa tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:23:59 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-342e33a9-8d3a-4fca-9289-55d339eb47fa tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c277482a-0dfd-44ff-aae4-fd6c8a855c41" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:23:59 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-342e33a9-8d3a-4fca-9289-55d339eb47fa tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c277482a-0dfd-44ff-aae4-fd6c8a855c41" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:23:59 user nova-compute[95467]: INFO os_brick.initiator.connectors.iscsi [None req-342e33a9-8d3a-4fca-9289-55d339eb47fa tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 08:23:59 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c277482a-0dfd-44ff-aae4-fd6c8a855c41 -p 172.16.0.220:3260 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:59 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c277482a-0dfd-44ff-aae4-fd6c8a855c41 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:59 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f446018c-c451-404d-8812-8d7f53f266ef]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:23:59 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-342e33a9-8d3a-4fca-9289-55d339eb47fa tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 08:23:59 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:23:59 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c277482a-0dfd-44ff-aae4-fd6c8a855c41 -p 172.16.0.220:3260 --interface default --op new {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:59 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c277482a-0dfd-44ff-aae4-fd6c8a855c41 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:23:59 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb457f17-b1d6-48a0-8739-020e45bb42a4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c277482a-0dfd-44ff-aae4-fd6c8a855c41] added\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:23:59 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-342e33a9-8d3a-4fca-9289-55d339eb47fa tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c277482a-0dfd-44ff-aae4-fd6c8a855c41] added
Nov 15 08:23:59 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:23:59 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c277482a-0dfd-44ff-aae4-fd6c8a855c41 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:23:59 user nova-compute[95467]: DEBUG nova.network.neutron [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Updating instance_info_cache with network_info: [{"id": "93a4c2ed-b2a8-471c-8173-d221f7251e8b", "address": "fa:16:3e:9b:81:50", "network": {"id": "44a920f2-9a44-480e-bbd4-82afd3303a7f", "bridge": "br-int", "label": "tempest-TestShelveInstance-57422602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7182b78b65480eb2e51db102fd9c2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93a4c2ed-b2", "ovs_interfaceid": "93a4c2ed-b2a8-471c-8173-d221f7251e8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c277482a-0dfd-44ff-aae4-fd6c8a855c41 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[46735fb3-0701-43a4-bb35-639215e52fb1]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-342e33a9-8d3a-4fca-9289-55d339eb47fa tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Releasing lock "refresh_cache-6a551521-28cf-4b4e-94e8-5f5ecc0c37f7" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Creating instance directory {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 08:24:00 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Creating image(s)
Nov 15 08:24:00 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Did not create local disks {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Ensure instance console log exists: /opt/stack/data/nova/instances/6a551521-28cf-4b4e-94e8-5f5ecc0c37f7/console.log {{(pid=95467) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Start _get_guest_xml network_info=[{"id": "93a4c2ed-b2a8-471c-8173-d221f7251e8b", "address": "fa:16:3e:9b:81:50", "network": {"id": "44a920f2-9a44-480e-bbd4-82afd3303a7f", "bridge": "br-int", "label": "tempest-TestShelveInstance-57422602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7182b78b65480eb2e51db102fd9c2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93a4c2ed-b2", "ovs_interfaceid": "93a4c2ed-b2a8-471c-8173-d221f7251e8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'ae5f084d-4969-49a6-a4c1-57b86560a8f7', 'delete_on_termination': True, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yDMrVtcn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6a551521-28cf-4b4e-94e8-5f5ecc0c37f7', 'attached_at': '', 'detached_at': '', 'volume_id': '965f0947-8c2b-4f39-a814-22493fb16775', 'serial': '965f0947-8c2b-4f39-a814-22493fb16775'}, 'volume_type': None} {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c277482a-0dfd-44ff-aae4-fd6c8a855c41 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-3f710bbf-7044-4002-b2c5-24173fb07ebc req-9b7d7429-9aef-4d82-9703-305e76a9db87 service nova] Acquired lock "refresh_cache-6a551521-28cf-4b4e-94e8-5f5ecc0c37f7" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG nova.network.neutron [req-3f710bbf-7044-4002-b2c5-24173fb07ebc req-9b7d7429-9aef-4d82-9703-305e76a9db87 service nova] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Refreshing network info cache for port 93a4c2ed-b2a8-471c-8173-d221f7251e8b {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c277482a-0dfd-44ff-aae4-fd6c8a855c41 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab117e3-e631-4793-a9df-42be9afc5af6]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-342e33a9-8d3a-4fca-9289-55d339eb47fa tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c277482a-0dfd-44ff-aae4-fd6c8a855c41 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dTWkhsfL {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:00 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:24:00 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:24:00 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG nova.objects.instance [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c277482a-0dfd-44ff-aae4-fd6c8a855c41 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dTWkhsfL" returned: 0 in 0.025s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c3524b-36d4-402d-b782-2897d3339a73]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-342e33a9-8d3a-4fca-9289-55d339eb47fa tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dTWkhsfL'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c277482a-0dfd-44ff-aae4-fd6c8a855c41 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG nova.objects.base [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Object Instance<6a551521-28cf-4b4e-94e8-5f5ecc0c37f7> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=95467) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Calling os-brick to attach iSCSI Volume {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yDMrVtcn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:24:00 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:24:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c277482a-0dfd-44ff-aae4-fd6c8a855c41 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1a39ee-8d27-4fc0-a900-0528deab8420]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-342e33a9-8d3a-4fca-9289-55d339eb47fa tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2635f3-85cb-46b3-a4f9-1492982f3a64]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-342e33a9-8d3a-4fca-9289-55d339eb47fa tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:24:00 user nova-compute[95467]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:24:00 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:24:00 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-342e33a9-8d3a-4fca-9289-55d339eb47fa tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:24:00 user nova-compute[95467]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:24:00 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:24:00 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c277482a-0dfd-44ff-aae4-fd6c8a855c41 -p 172.16.0.220:3260 --login {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c277482a-0dfd-44ff-aae4-fd6c8a855c41 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78a6893-7097-47cf-bb34-75a52d3a48f2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c277482a-0dfd-44ff-aae4-fd6c8a855c41, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c277482a-0dfd-44ff-aae4-fd6c8a855c41, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-342e33a9-8d3a-4fca-9289-55d339eb47fa tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c277482a-0dfd-44ff-aae4-fd6c8a855c41, portal: 172.16.0.220,3260]
Nov 15 08:24:00 user nova-compute[95467]: Login to [iface: default, target: iqn.2010-10.org.openstack:c277482a-0dfd-44ff-aae4-fd6c8a855c41, portal: 172.16.0.220,3260] successful.
Nov 15 08:24:00 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c277482a-0dfd-44ff-aae4-fd6c8a855c41 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c277482a-0dfd-44ff-aae4-fd6c8a855c41 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff4da95-e6e6-464f-b749-d78d144493bf]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-342e33a9-8d3a-4fca-9289-55d339eb47fa tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[304750ed-a401-4e3d-8d17-e761f3e3d1ea]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c277482a-0dfd-44ff-aae4-fd6c8a855c41 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-342e33a9-8d3a-4fca-9289-55d339eb47fa tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:24:00 user nova-compute[95467]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:24:00 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:24:00 user nova-compute[95467]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c277482a-0dfd-44ff-aae4-fd6c8a855c41 (non-flash)
Nov 15 08:24:00 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-342e33a9-8d3a-4fca-9289-55d339eb47fa tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:24:00 user nova-compute[95467]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:24:00 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:24:00 user nova-compute[95467]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c277482a-0dfd-44ff-aae4-fd6c8a855c41 (non-flash)
Nov 15 08:24:00 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-342e33a9-8d3a-4fca-9289-55d339eb47fa tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c277482a-0dfd-44ff-aae4-fd6c8a855c41" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.364s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-342e33a9-8d3a-4fca-9289-55d339eb47fa tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Connected to 172.16.0.220:3260 {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-342e33a9-8d3a-4fca-9289-55d339eb47fa tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] HCTL ('34', '-', '-', 0) found on session 39 with lun 0 {{(pid=95467) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-342e33a9-8d3a-4fca-9289-55d339eb47fa tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=95467) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[41186e9b-8b8c-4da3-babf-9477301ac42a]: (4, ('- - 0', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-342e33a9-8d3a-4fca-9289-55d339eb47fa tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: None {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG nova.network.neutron [req-3f710bbf-7044-4002-b2c5-24173fb07ebc req-9b7d7429-9aef-4d82-9703-305e76a9db87 service nova] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Updated VIF entry in instance network info cache for port 93a4c2ed-b2a8-471c-8173-d221f7251e8b. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG nova.network.neutron [req-3f710bbf-7044-4002-b2c5-24173fb07ebc req-9b7d7429-9aef-4d82-9703-305e76a9db87 service nova] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Updating instance_info_cache with network_info: [{"id": "93a4c2ed-b2a8-471c-8173-d221f7251e8b", "address": "fa:16:3e:9b:81:50", "network": {"id": "44a920f2-9a44-480e-bbd4-82afd3303a7f", "bridge": "br-int", "label": "tempest-TestShelveInstance-57422602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7182b78b65480eb2e51db102fd9c2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93a4c2ed-b2", "ovs_interfaceid": "93a4c2ed-b2a8-471c-8173-d221f7251e8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:24:00 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-3f710bbf-7044-4002-b2c5-24173fb07ebc req-9b7d7429-9aef-4d82-9703-305e76a9db87 service nova] Releasing lock "refresh_cache-6a551521-28cf-4b4e-94e8-5f5ecc0c37f7" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:24:01 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-342e33a9-8d3a-4fca-9289-55d339eb47fa tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:24:01 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-342e33a9-8d3a-4fca-9289-55d339eb47fa tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c277482a-0dfd-44ff-aae4-fd6c8a855c41', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dTWkhsfL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 08:24:01 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-342e33a9-8d3a-4fca-9289-55d339eb47fa tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.396s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:24:01 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-342e33a9-8d3a-4fca-9289-55d339eb47fa tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] <== connect_volume: return (1397ms) {'type': 'block', 'scsi_wwn': '23965626339306635', 'path': '/dev/sdc'} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:24:01 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-342e33a9-8d3a-4fca-9289-55d339eb47fa tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965626339306635', 'path': '/dev/sdc'} {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 08:24:01 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.196s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:24:01 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:24:01 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:24:01 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:24:01 user nova-compute[95467]: INFO os_brick.initiator.connectors.iscsi [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 08:24:01 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 -p 172.16.0.220:3260 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:01 user nova-compute[95467]: DEBUG nova.objects.instance [None req-342e33a9-8d3a-4fca-9289-55d339eb47fa tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lazy-loading 'flavor' on Instance uuid a1a155e6-0ee2-4728-a526-17c149107ab0 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:24:01 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:01 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[6023225d-89d5-444b-ac6c-6659257f58c7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:24:01 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 08:24:01 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:24:01 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 -p 172.16.0.220:3260 --interface default --op new {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:01 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-342e33a9-8d3a-4fca-9289-55d339eb47fa tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 08:24:01 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:24:01 user nova-compute[95467]:   <source dev="/dev/sdc"/>
Nov 15 08:24:01 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:24:01 user nova-compute[95467]:   <serial>c277482a-0dfd-44ff-aae4-fd6c8a855c41</serial>
Nov 15 08:24:01 user nova-compute[95467]: </disk>
Nov 15 08:24:01 user nova-compute[95467]:  {{(pid=95467) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 08:24:01 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:01 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23d8c2a-7a64-48c4-9de7-e5c6d07b9fa1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775] added\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:24:01 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775] added
Nov 15 08:24:01 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:24:01 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:01 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:01 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd4300ec-b1ba-42e4-bc9e-885e5305df68]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:24:01 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:24:01 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:01 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:01 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[27607493-10c2-4029-b6cb-ce36b39dc530]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:24:01 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:24:01 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yDMrVtcn {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:01 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yDMrVtcn" returned: 0 in 0.070s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:01 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[06cc4172-2587-4054-b247-74f37872d714]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:24:01 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yDMrVtcn'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:24:01 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:01 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:01 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[901906f6-1fca-41a3-95b7-8a77c287c059]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:24:01 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:24:01 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:01 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:01 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b81818-b8de-4a89-b1b3-7d05c5a3dce0]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c277482a-0dfd-44ff-aae4-fd6c8a855c41 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:24:01 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:24:01 user nova-compute[95467]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:24:01 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:24:01 user nova-compute[95467]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c277482a-0dfd-44ff-aae4-fd6c8a855c41 (non-flash)
Nov 15 08:24:01 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:24:01 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:24:01 user nova-compute[95467]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:24:01 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:24:01 user nova-compute[95467]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c277482a-0dfd-44ff-aae4-fd6c8a855c41 (non-flash)
Nov 15 08:24:01 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:24:01 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 -p 172.16.0.220:3260 --login {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:01 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:01 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d70933e-05d2-4f11-bad7-a4ec16f0a5d9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:24:01 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775, portal: 172.16.0.220,3260]
Nov 15 08:24:01 user nova-compute[95467]: Login to [iface: default, target: iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775, portal: 172.16.0.220,3260] successful.
Nov 15 08:24:01 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:24:01 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:01 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:01 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9d6e94-9856-436f-aba7-5b6790d2b71b]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:24:01 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:24:01 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:01 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:01 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91ded56-7342-4759-8577-316207d6f5e1]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c277482a-0dfd-44ff-aae4-fd6c8a855c41 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:24:01 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:24:01 user nova-compute[95467]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:24:01 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:24:01 user nova-compute[95467]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c277482a-0dfd-44ff-aae4-fd6c8a855c41 (non-flash)
Nov 15 08:24:01 user nova-compute[95467]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:24:01 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:24:01 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:24:01 user nova-compute[95467]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:24:01 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:24:01 user nova-compute[95467]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c277482a-0dfd-44ff-aae4-fd6c8a855c41 (non-flash)
Nov 15 08:24:01 user nova-compute[95467]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:24:01 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:24:01 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.373s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:24:01 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Connected to 172.16.0.220:3260 {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 08:24:01 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] HCTL ('37', '-', '-', 0) found on session 40 with lun 0 {{(pid=95467) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 08:24:01 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=95467) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 08:24:01 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:01 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.022s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:01 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2263f53-d977-4c8b-8677-abaf4cb6cce1]: (4, ('- - 0', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:24:01 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Searching for a device in session 40 and hctl ['37', '*', '*', 0] yield: None {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:24:01 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-342e33a9-8d3a-4fca-9289-55d339eb47fa tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:24:01 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-342e33a9-8d3a-4fca-9289-55d339eb47fa tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] No BDM found with device name vdb, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:24:01 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-342e33a9-8d3a-4fca-9289-55d339eb47fa tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] No VIF found with MAC fa:16:3e:83:dc:7a, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:24:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-342e33a9-8d3a-4fca-9289-55d339eb47fa tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lock "a1a155e6-0ee2-4728-a526-17c149107ab0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.319s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:24:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:02 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Searching for a device in session 40 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:24:02 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yDMrVtcn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 08:24:02 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.409s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:24:02 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] <== connect_volume: return (2605ms) {'type': 'block', 'scsi_wwn': '26636653166656534', 'path': '/dev/sdf'} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:24:02 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636653166656534', 'path': '/dev/sdf'} {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 08:24:02 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T08:20:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-177934737',display_name='tempest-TestShelveInstance-server-177934737',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-177934737',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-347903963',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:20:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='dd7182b78b65480eb2e51db102fd9c2d',ramdisk_id='',reservation_id='r-8qvr6rl5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-668674769',owner_user_name='tempest-TestShelveInstance-668674769-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:23:52Z,user_data=None,user_id='354af2d9fe0e4fa4be1d9b851773e8d9',uuid=6a551521-28cf-4b4e-94e8-5f5ecc0c37f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "93a4c2ed-b2a8-471c-8173-d221f7251e8b", "address": "fa:16:3e:9b:81:50", "network": {"id": "44a920f2-9a44-480e-bbd4-82afd3303a7f", "bridge": "br-int", "label": "tempest-TestShelveInstance-57422602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7182b78b65480eb2e51db102fd9c2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93a4c2ed-b2", "ovs_interfaceid": "93a4c2ed-b2a8-471c-8173-d221f7251e8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:24:02 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Converting VIF {"id": "93a4c2ed-b2a8-471c-8173-d221f7251e8b", "address": "fa:16:3e:9b:81:50", "network": {"id": "44a920f2-9a44-480e-bbd4-82afd3303a7f", "bridge": "br-int", "label": "tempest-TestShelveInstance-57422602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7182b78b65480eb2e51db102fd9c2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93a4c2ed-b2", "ovs_interfaceid": "93a4c2ed-b2a8-471c-8173-d221f7251e8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:24:02 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:81:50,bridge_name='br-int',has_traffic_filtering=True,id=93a4c2ed-b2a8-471c-8173-d221f7251e8b,network=Network(44a920f2-9a44-480e-bbd4-82afd3303a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93a4c2ed-b2') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:24:02 user nova-compute[95467]: DEBUG nova.objects.instance [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Lazy-loading 'pci_devices' on Instance uuid 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:24:02 user nova-compute[95467]: DEBUG nova.objects.base [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Object Instance<6a551521-28cf-4b4e-94e8-5f5ecc0c37f7> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=95467) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 08:24:02 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:24:02 user nova-compute[95467]:   <uuid>6a551521-28cf-4b4e-94e8-5f5ecc0c37f7</uuid>
Nov 15 08:24:02 user nova-compute[95467]:   <name>instance-00000021</name>
Nov 15 08:24:02 user nova-compute[95467]:   <memory>524288</memory>
Nov 15 08:24:02 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:24:02 user nova-compute[95467]:   <metadata>
Nov 15 08:24:02 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:24:02 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:24:02 user nova-compute[95467]:       <nova:name>tempest-TestShelveInstance-server-177934737</nova:name>
Nov 15 08:24:02 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:24:00</nova:creationTime>
Nov 15 08:24:02 user nova-compute[95467]:       <nova:flavor name="m1.tiny">
Nov 15 08:24:02 user nova-compute[95467]:         <nova:memory>512</nova:memory>
Nov 15 08:24:02 user nova-compute[95467]:         <nova:disk>1</nova:disk>
Nov 15 08:24:02 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:24:02 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:24:02 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:24:02 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:24:02 user nova-compute[95467]:       <nova:owner>
Nov 15 08:24:02 user nova-compute[95467]:         <nova:user uuid="354af2d9fe0e4fa4be1d9b851773e8d9">tempest-TestShelveInstance-668674769-project-member</nova:user>
Nov 15 08:24:02 user nova-compute[95467]:         <nova:project uuid="dd7182b78b65480eb2e51db102fd9c2d">tempest-TestShelveInstance-668674769</nova:project>
Nov 15 08:24:02 user nova-compute[95467]:       </nova:owner>
Nov 15 08:24:02 user nova-compute[95467]:       <nova:ports>
Nov 15 08:24:02 user nova-compute[95467]:         <nova:port uuid="93a4c2ed-b2a8-471c-8173-d221f7251e8b">
Nov 15 08:24:02 user nova-compute[95467]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 08:24:02 user nova-compute[95467]:         </nova:port>
Nov 15 08:24:02 user nova-compute[95467]:       </nova:ports>
Nov 15 08:24:02 user nova-compute[95467]:     </nova:instance>
Nov 15 08:24:02 user nova-compute[95467]:   </metadata>
Nov 15 08:24:02 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:24:02 user nova-compute[95467]:     <system>
Nov 15 08:24:02 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:24:02 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:24:02 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:24:02 user nova-compute[95467]:       <entry name="serial">6a551521-28cf-4b4e-94e8-5f5ecc0c37f7</entry>
Nov 15 08:24:02 user nova-compute[95467]:       <entry name="uuid">6a551521-28cf-4b4e-94e8-5f5ecc0c37f7</entry>
Nov 15 08:24:02 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:24:02 user nova-compute[95467]:     </system>
Nov 15 08:24:02 user nova-compute[95467]:   </sysinfo>
Nov 15 08:24:02 user nova-compute[95467]:   <os>
Nov 15 08:24:02 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:24:02 user nova-compute[95467]:     <boot dev="hd"/>
Nov 15 08:24:02 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:24:02 user nova-compute[95467]:   </os>
Nov 15 08:24:02 user nova-compute[95467]:   <features>
Nov 15 08:24:02 user nova-compute[95467]:     <acpi/>
Nov 15 08:24:02 user nova-compute[95467]:     <apic/>
Nov 15 08:24:02 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:24:02 user nova-compute[95467]:   </features>
Nov 15 08:24:02 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:24:02 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:24:02 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:24:02 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:24:02 user nova-compute[95467]:   </clock>
Nov 15 08:24:02 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:24:02 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:24:02 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:24:02 user nova-compute[95467]:   </cpu>
Nov 15 08:24:02 user nova-compute[95467]:   <devices>
Nov 15 08:24:02 user nova-compute[95467]:     <disk type="block" device="disk">
Nov 15 08:24:02 user nova-compute[95467]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:24:02 user nova-compute[95467]:       <source dev="/dev/sdf"/>
Nov 15 08:24:02 user nova-compute[95467]:       <target dev="vda" bus="virtio"/>
Nov 15 08:24:02 user nova-compute[95467]:       <serial>965f0947-8c2b-4f39-a814-22493fb16775</serial>
Nov 15 08:24:02 user nova-compute[95467]:     </disk>
Nov 15 08:24:02 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:24:02 user nova-compute[95467]:       <mac address="fa:16:3e:9b:81:50"/>
Nov 15 08:24:02 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:24:02 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:24:02 user nova-compute[95467]:       <target dev="tap93a4c2ed-b2"/>
Nov 15 08:24:02 user nova-compute[95467]:     </interface>
Nov 15 08:24:02 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:24:02 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/6a551521-28cf-4b4e-94e8-5f5ecc0c37f7/console.log" append="off"/>
Nov 15 08:24:02 user nova-compute[95467]:     </serial>
Nov 15 08:24:02 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:24:02 user nova-compute[95467]:     <video>
Nov 15 08:24:02 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:24:02 user nova-compute[95467]:     </video>
Nov 15 08:24:02 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:24:02 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:24:02 user nova-compute[95467]:     </rng>
Nov 15 08:24:02 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:24:02 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:24:02 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:24:02 user nova-compute[95467]:     </memballoon>
Nov 15 08:24:02 user nova-compute[95467]:   </devices>
Nov 15 08:24:02 user nova-compute[95467]: </domain>
Nov 15 08:24:02 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:24:02 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T08:20:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-177934737',display_name='tempest-TestShelveInstance-server-177934737',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-177934737',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-347903963',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:20:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='dd7182b78b65480eb2e51db102fd9c2d',ramdisk_id='',reservation_id='r-8qvr6rl5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-668674769',owner_user_name='tempest-TestShelveInstance-668674769-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:23:52Z,user_data=None,user_id='354af2d9fe0e4fa4be1d9b851773e8d9',uuid=6a551521-28cf-4b4e-94e8-5f5ecc0c37f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "93a4c2ed-b2a8-471c-8173-d221f7251e8b", "address": "fa:16:3e:9b:81:50", "network": {"id": "44a920f2-9a44-480e-bbd4-82afd3303a7f", "bridge": "br-int", "label": "tempest-TestShelveInstance-57422602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7182b78b65480eb2e51db102fd9c2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93a4c2ed-b2", "ovs_interfaceid": "93a4c2ed-b2a8-471c-8173-d221f7251e8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:24:02 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Converting VIF {"id": "93a4c2ed-b2a8-471c-8173-d221f7251e8b", "address": "fa:16:3e:9b:81:50", "network": {"id": "44a920f2-9a44-480e-bbd4-82afd3303a7f", "bridge": "br-int", "label": "tempest-TestShelveInstance-57422602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7182b78b65480eb2e51db102fd9c2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93a4c2ed-b2", "ovs_interfaceid": "93a4c2ed-b2a8-471c-8173-d221f7251e8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:24:02 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:81:50,bridge_name='br-int',has_traffic_filtering=True,id=93a4c2ed-b2a8-471c-8173-d221f7251e8b,network=Network(44a920f2-9a44-480e-bbd4-82afd3303a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93a4c2ed-b2') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:24:02 user nova-compute[95467]: DEBUG os_vif [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:81:50,bridge_name='br-int',has_traffic_filtering=True,id=93a4c2ed-b2a8-471c-8173-d221f7251e8b,network=Network(44a920f2-9a44-480e-bbd4-82afd3303a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93a4c2ed-b2') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:24:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:24:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:24:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9927b7ef-9c3d-5396-8dbd-f6615fe9ad5b', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:24:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:24:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap93a4c2ed-b2, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:24:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap93a4c2ed-b2, col_values=(('qos', UUID('f4939204-7846-4cde-8f8c-75e881c1b763')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:24:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap93a4c2ed-b2, col_values=(('external_ids', {'iface-id': '93a4c2ed-b2a8-471c-8173-d221f7251e8b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:81:50', 'vm-uuid': '6a551521-28cf-4b4e-94e8-5f5ecc0c37f7'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:24:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:24:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:02 user nova-compute[95467]: INFO os_vif [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:81:50,bridge_name='br-int',has_traffic_filtering=True,id=93a4c2ed-b2a8-471c-8173-d221f7251e8b,network=Network(44a920f2-9a44-480e-bbd4-82afd3303a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93a4c2ed-b2')
Nov 15 08:24:02 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:24:02 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] No VIF found with MAC fa:16:3e:9b:81:50, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:24:03 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e0209ee0-477c-426c-9db4-f2d65214f022 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Acquiring lock "a1a155e6-0ee2-4728-a526-17c149107ab0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:24:03 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e0209ee0-477c-426c-9db4-f2d65214f022 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lock "a1a155e6-0ee2-4728-a526-17c149107ab0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:24:04 user nova-compute[95467]: INFO nova.compute.manager [None req-e0209ee0-477c-426c-9db4-f2d65214f022 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Detaching volume c277482a-0dfd-44ff-aae4-fd6c8a855c41
Nov 15 08:24:04 user nova-compute[95467]: INFO nova.virt.block_device [None req-e0209ee0-477c-426c-9db4-f2d65214f022 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Attempting to driver detach volume c277482a-0dfd-44ff-aae4-fd6c8a855c41 from mountpoint /dev/vdb
Nov 15 08:24:04 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-e0209ee0-477c-426c-9db4-f2d65214f022 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Attempting to detach device vdb from instance a1a155e6-0ee2-4728-a526-17c149107ab0 from the persistent domain config. {{(pid=95467) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 08:24:04 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-e0209ee0-477c-426c-9db4-f2d65214f022 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 08:24:04 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:24:04 user nova-compute[95467]:   <source dev="/dev/sdc"/>
Nov 15 08:24:04 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:24:04 user nova-compute[95467]:   <serial>c277482a-0dfd-44ff-aae4-fd6c8a855c41</serial>
Nov 15 08:24:04 user nova-compute[95467]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 08:24:04 user nova-compute[95467]: </disk>
Nov 15 08:24:04 user nova-compute[95467]:  {{(pid=95467) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 08:24:04 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-e0209ee0-477c-426c-9db4-f2d65214f022 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Successfully detached device vdb from instance a1a155e6-0ee2-4728-a526-17c149107ab0 from the persistent domain config.
Nov 15 08:24:04 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-e0209ee0-477c-426c-9db4-f2d65214f022 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a1a155e6-0ee2-4728-a526-17c149107ab0 from the live domain config. {{(pid=95467) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 08:24:04 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-e0209ee0-477c-426c-9db4-f2d65214f022 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 08:24:04 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:24:04 user nova-compute[95467]:   <source dev="/dev/sdc"/>
Nov 15 08:24:04 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:24:04 user nova-compute[95467]:   <serial>c277482a-0dfd-44ff-aae4-fd6c8a855c41</serial>
Nov 15 08:24:04 user nova-compute[95467]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 08:24:04 user nova-compute[95467]: </disk>
Nov 15 08:24:04 user nova-compute[95467]:  {{(pid=95467) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 08:24:04 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:04 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:04 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:04 user nova-compute[95467]: DEBUG nova.compute.manager [req-e5efa034-983a-4a36-9ec5-d338b043c9eb req-ce10c6b0-5a0a-4635-9102-670ed1091974 service nova] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Received event network-vif-plugged-93a4c2ed-b2a8-471c-8173-d221f7251e8b {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:24:04 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-e5efa034-983a-4a36-9ec5-d338b043c9eb req-ce10c6b0-5a0a-4635-9102-670ed1091974 service nova] Acquiring lock "6a551521-28cf-4b4e-94e8-5f5ecc0c37f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:24:04 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-e5efa034-983a-4a36-9ec5-d338b043c9eb req-ce10c6b0-5a0a-4635-9102-670ed1091974 service nova] Lock "6a551521-28cf-4b4e-94e8-5f5ecc0c37f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:24:04 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-e5efa034-983a-4a36-9ec5-d338b043c9eb req-ce10c6b0-5a0a-4635-9102-670ed1091974 service nova] Lock "6a551521-28cf-4b4e-94e8-5f5ecc0c37f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:24:04 user nova-compute[95467]: DEBUG nova.compute.manager [req-e5efa034-983a-4a36-9ec5-d338b043c9eb req-ce10c6b0-5a0a-4635-9102-670ed1091974 service nova] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] No waiting events found dispatching network-vif-plugged-93a4c2ed-b2a8-471c-8173-d221f7251e8b {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:24:04 user nova-compute[95467]: WARNING nova.compute.manager [req-e5efa034-983a-4a36-9ec5-d338b043c9eb req-ce10c6b0-5a0a-4635-9102-670ed1091974 service nova] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Received unexpected event network-vif-plugged-93a4c2ed-b2a8-471c-8173-d221f7251e8b for instance with vm_state shelved_offloaded and task_state spawning.
Nov 15 08:24:04 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:04 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:04 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:04 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:04 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:04 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-e0209ee0-477c-426c-9db4-f2d65214f022 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a1a155e6-0ee2-4728-a526-17c149107ab0 {{(pid=95467) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 08:24:06 user nova-compute[95467]: DEBUG nova.compute.manager [req-66111131-532a-463b-bba0-ec7b9ca7ebaf req-9b715304-a920-48cb-8cd4-69518ab2d9a3 service nova] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Received event network-vif-plugged-93a4c2ed-b2a8-471c-8173-d221f7251e8b {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:24:06 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-66111131-532a-463b-bba0-ec7b9ca7ebaf req-9b715304-a920-48cb-8cd4-69518ab2d9a3 service nova] Acquiring lock "6a551521-28cf-4b4e-94e8-5f5ecc0c37f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:24:06 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-66111131-532a-463b-bba0-ec7b9ca7ebaf req-9b715304-a920-48cb-8cd4-69518ab2d9a3 service nova] Lock "6a551521-28cf-4b4e-94e8-5f5ecc0c37f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:24:06 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-66111131-532a-463b-bba0-ec7b9ca7ebaf req-9b715304-a920-48cb-8cd4-69518ab2d9a3 service nova] Lock "6a551521-28cf-4b4e-94e8-5f5ecc0c37f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:24:06 user nova-compute[95467]: DEBUG nova.compute.manager [req-66111131-532a-463b-bba0-ec7b9ca7ebaf req-9b715304-a920-48cb-8cd4-69518ab2d9a3 service nova] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] No waiting events found dispatching network-vif-plugged-93a4c2ed-b2a8-471c-8173-d221f7251e8b {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:24:06 user nova-compute[95467]: WARNING nova.compute.manager [req-66111131-532a-463b-bba0-ec7b9ca7ebaf req-9b715304-a920-48cb-8cd4-69518ab2d9a3 service nova] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Received unexpected event network-vif-plugged-93a4c2ed-b2a8-471c-8173-d221f7251e8b for instance with vm_state shelved_offloaded and task_state spawning.
Nov 15 08:24:07 user nova-compute[95467]: DEBUG nova.compute.manager [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Instance event wait completed in 0 seconds for  {{(pid=95467) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 08:24:07 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Guest created on hypervisor {{(pid=95467) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 08:24:07 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Instance spawned successfully.
Nov 15 08:24:07 user nova-compute[95467]: DEBUG nova.compute.manager [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:24:07 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e38f6ca4-2da7-4458-8b60-d3d6731a72b2 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Lock "6a551521-28cf-4b4e-94e8-5f5ecc0c37f7" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 15.163s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:24:07 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:07 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:17 user nova-compute[95467]: DEBUG nova.compute.manager [req-97360b96-d672-4c95-b7e7-029d4b002e70 req-1ce2f4b2-ad93-45a7-987f-345717bf99c1 service nova] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] Received event network-changed-0c59c093-b66f-4b70-997f-90d68d08091b {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:24:17 user nova-compute[95467]: DEBUG nova.compute.manager [req-97360b96-d672-4c95-b7e7-029d4b002e70 req-1ce2f4b2-ad93-45a7-987f-345717bf99c1 service nova] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] Refreshing instance network info cache due to event network-changed-0c59c093-b66f-4b70-997f-90d68d08091b. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:24:17 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-97360b96-d672-4c95-b7e7-029d4b002e70 req-1ce2f4b2-ad93-45a7-987f-345717bf99c1 service nova] Acquiring lock "refresh_cache-710d9598-1d36-4fdb-aa62-e7ff0b5ababe" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:24:17 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-97360b96-d672-4c95-b7e7-029d4b002e70 req-1ce2f4b2-ad93-45a7-987f-345717bf99c1 service nova] Acquired lock "refresh_cache-710d9598-1d36-4fdb-aa62-e7ff0b5ababe" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:24:17 user nova-compute[95467]: DEBUG nova.network.neutron [req-97360b96-d672-4c95-b7e7-029d4b002e70 req-1ce2f4b2-ad93-45a7-987f-345717bf99c1 service nova] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] Refreshing network info cache for port 0c59c093-b66f-4b70-997f-90d68d08091b {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:24:17 user nova-compute[95467]: DEBUG nova.network.neutron [req-97360b96-d672-4c95-b7e7-029d4b002e70 req-1ce2f4b2-ad93-45a7-987f-345717bf99c1 service nova] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] Updated VIF entry in instance network info cache for port 0c59c093-b66f-4b70-997f-90d68d08091b. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:24:17 user nova-compute[95467]: DEBUG nova.network.neutron [req-97360b96-d672-4c95-b7e7-029d4b002e70 req-1ce2f4b2-ad93-45a7-987f-345717bf99c1 service nova] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] Updating instance_info_cache with network_info: [{"id": "0c59c093-b66f-4b70-997f-90d68d08091b", "address": "fa:16:3e:b2:d1:09", "network": {"id": "96d9262b-11fb-497d-8e38-fa46076c010f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2069167691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7791bd92c7c488aa72474ecde2e1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c59c093-b6", "ovs_interfaceid": "0c59c093-b66f-4b70-997f-90d68d08091b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:24:17 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-97360b96-d672-4c95-b7e7-029d4b002e70 req-1ce2f4b2-ad93-45a7-987f-345717bf99c1 service nova] Releasing lock "refresh_cache-710d9598-1d36-4fdb-aa62-e7ff0b5ababe" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:24:17 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-77056803-ffe7-4540-853f-86488054c83d tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Acquiring lock "710d9598-1d36-4fdb-aa62-e7ff0b5ababe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:24:17 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-77056803-ffe7-4540-853f-86488054c83d tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "710d9598-1d36-4fdb-aa62-e7ff0b5ababe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:24:17 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-77056803-ffe7-4540-853f-86488054c83d tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Acquiring lock "710d9598-1d36-4fdb-aa62-e7ff0b5ababe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:24:17 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-77056803-ffe7-4540-853f-86488054c83d tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "710d9598-1d36-4fdb-aa62-e7ff0b5ababe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:24:17 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-77056803-ffe7-4540-853f-86488054c83d tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "710d9598-1d36-4fdb-aa62-e7ff0b5ababe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:24:17 user nova-compute[95467]: INFO nova.compute.manager [None req-77056803-ffe7-4540-853f-86488054c83d tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] Terminating instance
Nov 15 08:24:17 user nova-compute[95467]: DEBUG nova.compute.manager [None req-77056803-ffe7-4540-853f-86488054c83d tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] Start destroying the instance on the hypervisor. {{(pid=95467) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 08:24:17 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:17 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:17 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:17 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:17 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:18 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] Instance destroyed successfully.
Nov 15 08:24:18 user nova-compute[95467]: DEBUG nova.objects.instance [None req-77056803-ffe7-4540-853f-86488054c83d tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lazy-loading 'resources' on Instance uuid 710d9598-1d36-4fdb-aa62-e7ff0b5ababe {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:24:18 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-77056803-ffe7-4540-853f-86488054c83d tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:22:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1931377887',display_name='tempest-TestVolumeBootPattern-server-1931377887',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1931377887',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGn1slhlv/lpfM2oYeApx9piTNh8psQp9CpZOaXQ+Ydt2JJikCfOrBRqv7qZ3oUV5yn53tl6dDTEsiUIm5m/x3Q62LZpqk25/AJiUoLr4SnG2Qg5vjpEqPX27JlljHO+ew==',key_name='tempest-TestVolumeBootPattern-1986786502',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:22:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e7791bd92c7c488aa72474ecde2e1155',ramdisk_id='',reservation_id='r-tnnhyram',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-978207351',owner_user_name='tempest-TestVolumeBootPattern-978207351-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:22:35Z,user_data=None,user_id='11bbbd3ef322402cb5dc60455a54319b',uuid=710d9598-1d36-4fdb-aa62-e7ff0b5ababe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0c59c093-b66f-4b70-997f-90d68d08091b", "address": "fa:16:3e:b2:d1:09", "network": {"id": "96d9262b-11fb-497d-8e38-fa46076c010f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2069167691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7791bd92c7c488aa72474ecde2e1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c59c093-b6", "ovs_interfaceid": "0c59c093-b66f-4b70-997f-90d68d08091b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:24:18 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-77056803-ffe7-4540-853f-86488054c83d tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Converting VIF {"id": "0c59c093-b66f-4b70-997f-90d68d08091b", "address": "fa:16:3e:b2:d1:09", "network": {"id": "96d9262b-11fb-497d-8e38-fa46076c010f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2069167691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7791bd92c7c488aa72474ecde2e1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c59c093-b6", "ovs_interfaceid": "0c59c093-b66f-4b70-997f-90d68d08091b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:24:18 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-77056803-ffe7-4540-853f-86488054c83d tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:d1:09,bridge_name='br-int',has_traffic_filtering=True,id=0c59c093-b66f-4b70-997f-90d68d08091b,network=Network(96d9262b-11fb-497d-8e38-fa46076c010f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c59c093-b6') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:24:18 user nova-compute[95467]: DEBUG os_vif [None req-77056803-ffe7-4540-853f-86488054c83d tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:d1:09,bridge_name='br-int',has_traffic_filtering=True,id=0c59c093-b66f-4b70-997f-90d68d08091b,network=Network(96d9262b-11fb-497d-8e38-fa46076c010f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c59c093-b6') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:24:18 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:18 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0c59c093-b6, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:24:18 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:24:18 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:18 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=327b1bf8-e176-4c8f-95ac-dc970566f747) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:24:18 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:18 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:24:18 user nova-compute[95467]: INFO os_vif [None req-77056803-ffe7-4540-853f-86488054c83d tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:d1:09,bridge_name='br-int',has_traffic_filtering=True,id=0c59c093-b66f-4b70-997f-90d68d08091b,network=Network(96d9262b-11fb-497d-8e38-fa46076c010f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c59c093-b6')
Nov 15 08:24:18 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77056803-ffe7-4540-853f-86488054c83d tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] calling os-brick to detach iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 08:24:18 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-77056803-ffe7-4540-853f-86488054c83d tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, {'target_iqn': 'iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AmMxUCDH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:24:18 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-77056803-ffe7-4540-853f-86488054c83d tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:24:18 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-77056803-ffe7-4540-853f-86488054c83d tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:24:18 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-77056803-ffe7-4540-853f-86488054c83d tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.005s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:24:18 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:18 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:18 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7036f4-e6ea-4231-8820-97a9404cfcae]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c277482a-0dfd-44ff-aae4-fd6c8a855c41\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:24:18 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-77056803-ffe7-4540-853f-86488054c83d tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 08:24:18 user nova-compute[95467]: No targets found.
Nov 15 08:24:18 user nova-compute[95467]: iSNS:
Nov 15 08:24:18 user nova-compute[95467]: No targets found.
Nov 15 08:24:18 user nova-compute[95467]: STATIC:
Nov 15 08:24:18 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b
Nov 15 08:24:18 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:24:18 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:24:18 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e
Nov 15 08:24:18 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:24:18 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:24:18 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775
Nov 15 08:24:18 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:24:18 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:24:18 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:c277482a-0dfd-44ff-aae4-fd6c8a855c41
Nov 15 08:24:18 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:24:18 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:24:18 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400
Nov 15 08:24:18 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:24:18 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:24:18 user nova-compute[95467]: FIRMWARE:
Nov 15 08:24:18 user nova-compute[95467]: No targets found.
Nov 15 08:24:18 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:24:18 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-77056803-ffe7-4540-853f-86488054c83d tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 08:24:18 user nova-compute[95467]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 08:24:18 user nova-compute[95467]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=95467) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 08:24:18 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-77056803-ffe7-4540-853f-86488054c83d tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b', 0)] {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 08:24:18 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:18 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:18 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[26de9bbd-5f9c-4bd7-b43a-02f5f4c50189]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c277482a-0dfd-44ff-aae4-fd6c8a855c41\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:24:18 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:18 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:18 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc6b89c-8293-4ac6-a698-0e70b4c3fa56]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c277482a-0dfd-44ff-aae4-fd6c8a855c41 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:24:18 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-77056803-ffe7-4540-853f-86488054c83d tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:24:18 user nova-compute[95467]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:24:18 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:24:18 user nova-compute[95467]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c277482a-0dfd-44ff-aae4-fd6c8a855c41 (non-flash)
Nov 15 08:24:18 user nova-compute[95467]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:24:18 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:24:18 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-77056803-ffe7-4540-853f-86488054c83d tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:24:18 user nova-compute[95467]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:24:18 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:24:18 user nova-compute[95467]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c277482a-0dfd-44ff-aae4-fd6c8a855c41 (non-flash)
Nov 15 08:24:18 user nova-compute[95467]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:24:18 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:24:18 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-77056803-ffe7-4540-853f-86488054c83d tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efed82479a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b'): ({'sde'}, set())}) {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 08:24:18 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-77056803-ffe7-4540-853f-86488054c83d tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Removing single pathed devices sde {{(pid=95467) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 08:24:18 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:18 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:18 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b0c097-1a77-4a12-81a4-70fe41c5ebc5]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:24:18 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:18 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:18 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4074438-4188-4fd5-8d54-1b29a10be037]: (4, ('ok\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:24:18 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-77056803-ffe7-4540-853f-86488054c83d tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Flushing IO for device /dev/sde {{(pid=95467) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 08:24:18 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:18 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:18 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19bd072-7bc1-48f7-9e0f-34153b9132e7]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:24:18 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-77056803-ffe7-4540-853f-86488054c83d tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=95467) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 08:24:18 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:18 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.038s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:18 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b46358f-5dae-4348-8156-0c3804f3b72f]: (4, ('1', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:24:18 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-77056803-ffe7-4540-853f-86488054c83d tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 08:24:18 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-77056803-ffe7-4540-853f-86488054c83d tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] SCSI volumes sde have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 08:24:18 user nova-compute[95467]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23130393335336366', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_b5792435', '/dev/disk/by-id/scsi-1SCST_BIOb5792435-109353cf9c5bd865') {{(pid=105611) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 08:24:18 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0979f91-6c87-4869-83c7-f5e194a2f800]: (4, None) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:24:18 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-77056803-ffe7-4540-853f-86488054c83d tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b')] {{(pid=95467) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 08:24:18 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:18 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:18 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[be446056-0d90-4a8b-8f8b-daeff13c4585]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:24:18 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-77056803-ffe7-4540-853f-86488054c83d tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:24:18 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b -p 172.16.0.220:3260 --logout {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:18 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:18 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[741b1a07-1120-4771-9378-476e63263556]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:24:18 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-77056803-ffe7-4540-853f-86488054c83d tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b, portal: 172.16.0.220,3260]
Nov 15 08:24:18 user nova-compute[95467]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b, portal: 172.16.0.220,3260] successful.
Nov 15 08:24:18 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:24:18 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b -p 172.16.0.220:3260 --op delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:18 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:18 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa80521-4422-4f91-ad93-4ce0b4e861d6]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:24:18 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-77056803-ffe7-4540-853f-86488054c83d tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:24:18 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-77056803-ffe7-4540-853f-86488054c83d tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:24:18 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-77056803-ffe7-4540-853f-86488054c83d tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] <== disconnect_volume: return (362ms) None {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:24:18 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77056803-ffe7-4540-853f-86488054c83d tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] Disconnected iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 08:24:18 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-77056803-ffe7-4540-853f-86488054c83d tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] Deleting instance files /opt/stack/data/nova/instances/710d9598-1d36-4fdb-aa62-e7ff0b5ababe_del
Nov 15 08:24:18 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-77056803-ffe7-4540-853f-86488054c83d tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] Deletion of /opt/stack/data/nova/instances/710d9598-1d36-4fdb-aa62-e7ff0b5ababe_del complete
Nov 15 08:24:18 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:18 user nova-compute[95467]: INFO nova.compute.manager [None req-77056803-ffe7-4540-853f-86488054c83d tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] Took 1.25 seconds to destroy the instance on the hypervisor.
Nov 15 08:24:18 user nova-compute[95467]: DEBUG oslo.service.loopingcall [None req-77056803-ffe7-4540-853f-86488054c83d tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=95467) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 08:24:18 user nova-compute[95467]: DEBUG nova.compute.manager [-] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] Deallocating network for instance {{(pid=95467) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 08:24:18 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] deallocate_for_instance() {{(pid=95467) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 08:24:19 user nova-compute[95467]: DEBUG nova.compute.manager [req-71f54257-ed4e-4c80-aa22-405799bdbf5d req-b875fae5-9761-4b90-8827-241dd7c0a8eb service nova] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] Received event network-vif-unplugged-0c59c093-b66f-4b70-997f-90d68d08091b {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:24:19 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-71f54257-ed4e-4c80-aa22-405799bdbf5d req-b875fae5-9761-4b90-8827-241dd7c0a8eb service nova] Acquiring lock "710d9598-1d36-4fdb-aa62-e7ff0b5ababe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:24:19 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-71f54257-ed4e-4c80-aa22-405799bdbf5d req-b875fae5-9761-4b90-8827-241dd7c0a8eb service nova] Lock "710d9598-1d36-4fdb-aa62-e7ff0b5ababe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:24:19 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-71f54257-ed4e-4c80-aa22-405799bdbf5d req-b875fae5-9761-4b90-8827-241dd7c0a8eb service nova] Lock "710d9598-1d36-4fdb-aa62-e7ff0b5ababe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:24:19 user nova-compute[95467]: DEBUG nova.compute.manager [req-71f54257-ed4e-4c80-aa22-405799bdbf5d req-b875fae5-9761-4b90-8827-241dd7c0a8eb service nova] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] No waiting events found dispatching network-vif-unplugged-0c59c093-b66f-4b70-997f-90d68d08091b {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:24:19 user nova-compute[95467]: DEBUG nova.compute.manager [req-71f54257-ed4e-4c80-aa22-405799bdbf5d req-b875fae5-9761-4b90-8827-241dd7c0a8eb service nova] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] Received event network-vif-unplugged-0c59c093-b66f-4b70-997f-90d68d08091b for instance with task_state deleting. {{(pid=95467) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 08:24:19 user nova-compute[95467]: DEBUG nova.compute.manager [req-71f54257-ed4e-4c80-aa22-405799bdbf5d req-b875fae5-9761-4b90-8827-241dd7c0a8eb service nova] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] Received event network-vif-plugged-0c59c093-b66f-4b70-997f-90d68d08091b {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:24:19 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-71f54257-ed4e-4c80-aa22-405799bdbf5d req-b875fae5-9761-4b90-8827-241dd7c0a8eb service nova] Acquiring lock "710d9598-1d36-4fdb-aa62-e7ff0b5ababe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:24:19 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-71f54257-ed4e-4c80-aa22-405799bdbf5d req-b875fae5-9761-4b90-8827-241dd7c0a8eb service nova] Lock "710d9598-1d36-4fdb-aa62-e7ff0b5ababe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:24:19 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-71f54257-ed4e-4c80-aa22-405799bdbf5d req-b875fae5-9761-4b90-8827-241dd7c0a8eb service nova] Lock "710d9598-1d36-4fdb-aa62-e7ff0b5ababe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:24:19 user nova-compute[95467]: DEBUG nova.compute.manager [req-71f54257-ed4e-4c80-aa22-405799bdbf5d req-b875fae5-9761-4b90-8827-241dd7c0a8eb service nova] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] No waiting events found dispatching network-vif-plugged-0c59c093-b66f-4b70-997f-90d68d08091b {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:24:19 user nova-compute[95467]: WARNING nova.compute.manager [req-71f54257-ed4e-4c80-aa22-405799bdbf5d req-b875fae5-9761-4b90-8827-241dd7c0a8eb service nova] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] Received unexpected event network-vif-plugged-0c59c093-b66f-4b70-997f-90d68d08091b for instance with vm_state active and task_state deleting.
Nov 15 08:24:19 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:24:19 user nova-compute[95467]: DEBUG nova.compute.manager [req-4afc9454-d388-464f-93c8-61557479ba4c req-ffd014a1-b13b-418a-92ca-aa86e47ffc4d service nova] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] Received event network-vif-deleted-0c59c093-b66f-4b70-997f-90d68d08091b {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:24:19 user nova-compute[95467]: INFO nova.compute.manager [req-4afc9454-d388-464f-93c8-61557479ba4c req-ffd014a1-b13b-418a-92ca-aa86e47ffc4d service nova] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] Neutron deleted interface 0c59c093-b66f-4b70-997f-90d68d08091b; detaching it from the instance and deleting it from the info cache
Nov 15 08:24:19 user nova-compute[95467]: DEBUG nova.network.neutron [req-4afc9454-d388-464f-93c8-61557479ba4c req-ffd014a1-b13b-418a-92ca-aa86e47ffc4d service nova] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:24:19 user nova-compute[95467]: INFO nova.compute.manager [-] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] Took 0.87 seconds to deallocate network for instance.
Nov 15 08:24:19 user nova-compute[95467]: DEBUG nova.compute.manager [req-4afc9454-d388-464f-93c8-61557479ba4c req-ffd014a1-b13b-418a-92ca-aa86e47ffc4d service nova] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] Detach interface failed, port_id=0c59c093-b66f-4b70-997f-90d68d08091b, reason: Instance 710d9598-1d36-4fdb-aa62-e7ff0b5ababe could not be found. {{(pid=95467) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 08:24:20 user nova-compute[95467]: INFO nova.compute.manager [None req-77056803-ffe7-4540-853f-86488054c83d tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 710d9598-1d36-4fdb-aa62-e7ff0b5ababe] Took 0.84 seconds to detach 1 volumes for instance.
Nov 15 08:24:20 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-77056803-ffe7-4540-853f-86488054c83d tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:24:20 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-77056803-ffe7-4540-853f-86488054c83d tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:24:21 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-77056803-ffe7-4540-853f-86488054c83d tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:24:21 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-77056803-ffe7-4540-853f-86488054c83d tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:24:21 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-77056803-ffe7-4540-853f-86488054c83d tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.438s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:24:21 user nova-compute[95467]: INFO nova.scheduler.client.report [None req-77056803-ffe7-4540-853f-86488054c83d tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Deleted allocations for instance 710d9598-1d36-4fdb-aa62-e7ff0b5ababe
Nov 15 08:24:21 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-77056803-ffe7-4540-853f-86488054c83d tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "710d9598-1d36-4fdb-aa62-e7ff0b5ababe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.651s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:24:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:23 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:24 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:24 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-e0209ee0-477c-426c-9db4-f2d65214f022 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a1a155e6-0ee2-4728-a526-17c149107ab0 is timed out.
Nov 15 08:24:24 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-e0209ee0-477c-426c-9db4-f2d65214f022 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Successfully detached device vdb from instance a1a155e6-0ee2-4728-a526-17c149107ab0 from the live domain config.
Nov 15 08:24:24 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0209ee0-477c-426c-9db4-f2d65214f022 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] calling os-brick to detach iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 08:24:24 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0209ee0-477c-426c-9db4-f2d65214f022 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, {'target_iqn': 'iqn.2010-10.org.openstack:c277482a-0dfd-44ff-aae4-fd6c8a855c41', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dTWkhsfL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:24:24 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-e0209ee0-477c-426c-9db4-f2d65214f022 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:24:24 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-e0209ee0-477c-426c-9db4-f2d65214f022 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:24:24 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-e0209ee0-477c-426c-9db4-f2d65214f022 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:24:24 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:24 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:24 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0e91f0-c51b-40bf-a8b3-1e39904c8363]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c277482a-0dfd-44ff-aae4-fd6c8a855c41\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:24:24 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0209ee0-477c-426c-9db4-f2d65214f022 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 08:24:24 user nova-compute[95467]: No targets found.
Nov 15 08:24:24 user nova-compute[95467]: iSNS:
Nov 15 08:24:24 user nova-compute[95467]: No targets found.
Nov 15 08:24:24 user nova-compute[95467]: STATIC:
Nov 15 08:24:24 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e
Nov 15 08:24:24 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:24:24 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:24:24 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775
Nov 15 08:24:24 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:24:24 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:24:24 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:c277482a-0dfd-44ff-aae4-fd6c8a855c41
Nov 15 08:24:24 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:24:24 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:24:24 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400
Nov 15 08:24:24 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:24:24 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:24:24 user nova-compute[95467]: FIRMWARE:
Nov 15 08:24:24 user nova-compute[95467]: No targets found.
Nov 15 08:24:24 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:24:24 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0209ee0-477c-426c-9db4-f2d65214f022 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 08:24:24 user nova-compute[95467]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 08:24:24 user nova-compute[95467]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=95467) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 08:24:24 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0209ee0-477c-426c-9db4-f2d65214f022 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c277482a-0dfd-44ff-aae4-fd6c8a855c41', 0)] {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 08:24:24 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:24 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:24 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[78129ca0-8855-45ff-bd89-3a97aff03259]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c277482a-0dfd-44ff-aae4-fd6c8a855c41\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:24:24 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:25 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:25 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d35540-a54f-4997-9434-248c7e440888]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c277482a-0dfd-44ff-aae4-fd6c8a855c41 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:24:25 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0209ee0-477c-426c-9db4-f2d65214f022 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:24:25 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:24:25 user nova-compute[95467]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c277482a-0dfd-44ff-aae4-fd6c8a855c41 (non-flash)
Nov 15 08:24:25 user nova-compute[95467]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:24:25 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:24:25 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0209ee0-477c-426c-9db4-f2d65214f022 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:24:25 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:24:25 user nova-compute[95467]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c277482a-0dfd-44ff-aae4-fd6c8a855c41 (non-flash)
Nov 15 08:24:25 user nova-compute[95467]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:24:25 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:24:25 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0209ee0-477c-426c-9db4-f2d65214f022 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efec82dac20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c277482a-0dfd-44ff-aae4-fd6c8a855c41'): ({'sdc'}, set())}) {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 08:24:25 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-e0209ee0-477c-426c-9db4-f2d65214f022 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Removing single pathed devices sdc {{(pid=95467) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 08:24:25 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:25 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:25 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5fbdc6-42b3-446f-8030-3668e922eaf4]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:24:25 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:25 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:25 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8c7884-587b-473f-bea8-cd5a913f349c]: (4, ('ok\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:24:25 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-e0209ee0-477c-426c-9db4-f2d65214f022 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Flushing IO for device /dev/sdc {{(pid=95467) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 08:24:25 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:25 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:25 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[301703eb-62a8-46e7-b4c8-023ff7c64453]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:24:25 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-e0209ee0-477c-426c-9db4-f2d65214f022 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=95467) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 08:24:25 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:25 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.059s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:25 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec65604c-01b3-4318-95cc-230a82cd855b]: (4, ('1', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:24:25 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-e0209ee0-477c-426c-9db4-f2d65214f022 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 08:24:25 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-e0209ee0-477c-426c-9db4-f2d65214f022 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] SCSI volumes sdc have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 08:24:25 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0209ee0-477c-426c-9db4-f2d65214f022 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c277482a-0dfd-44ff-aae4-fd6c8a855c41')] {{(pid=95467) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 08:24:25 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c277482a-0dfd-44ff-aae4-fd6c8a855c41 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:25 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c277482a-0dfd-44ff-aae4-fd6c8a855c41 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:25 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8684c703-0783-4a82-bef8-7f795b260f2c]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:24:25 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0209ee0-477c-426c-9db4-f2d65214f022 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:24:25 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c277482a-0dfd-44ff-aae4-fd6c8a855c41 -p 172.16.0.220:3260 --logout {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:25 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c277482a-0dfd-44ff-aae4-fd6c8a855c41 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:25 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f79c5a-9242-4c79-ba84-65288ee7e072]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:c277482a-0dfd-44ff-aae4-fd6c8a855c41, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:c277482a-0dfd-44ff-aae4-fd6c8a855c41, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:24:25 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0209ee0-477c-426c-9db4-f2d65214f022 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:c277482a-0dfd-44ff-aae4-fd6c8a855c41, portal: 172.16.0.220,3260]
Nov 15 08:24:25 user nova-compute[95467]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:c277482a-0dfd-44ff-aae4-fd6c8a855c41, portal: 172.16.0.220,3260] successful.
Nov 15 08:24:25 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:24:25 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c277482a-0dfd-44ff-aae4-fd6c8a855c41 -p 172.16.0.220:3260 --op delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:25 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c277482a-0dfd-44ff-aae4-fd6c8a855c41 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:25 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[048bf8fc-025c-47aa-b2ec-73873bc21f7c]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:24:25 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0209ee0-477c-426c-9db4-f2d65214f022 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:24:25 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-e0209ee0-477c-426c-9db4-f2d65214f022 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:24:25 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0209ee0-477c-426c-9db4-f2d65214f022 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] <== disconnect_volume: return (350ms) None {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:24:25 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0209ee0-477c-426c-9db4-f2d65214f022 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Disconnected iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 08:24:26 user nova-compute[95467]: DEBUG nova.objects.instance [None req-e0209ee0-477c-426c-9db4-f2d65214f022 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lazy-loading 'flavor' on Instance uuid a1a155e6-0ee2-4728-a526-17c149107ab0 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:24:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e0209ee0-477c-426c-9db4-f2d65214f022 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lock "a1a155e6-0ee2-4728-a526-17c149107ab0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.198s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:24:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:28 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Acquiring lock "ba05c01d-ae74-467c-a309-4d0ba904453d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:24:28 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "ba05c01d-ae74-467c-a309-4d0ba904453d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:24:28 user nova-compute[95467]: DEBUG nova.compute.manager [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Starting instance... {{(pid=95467) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 08:24:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:24:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:24:29 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=95467) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 08:24:29 user nova-compute[95467]: INFO nova.compute.claims [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Claim successful on node user
Nov 15 08:24:29 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:24:29 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:24:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.512s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:24:29 user nova-compute[95467]: DEBUG nova.compute.manager [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Start building networks asynchronously for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 08:24:29 user nova-compute[95467]: DEBUG nova.compute.manager [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Allocating IP information in the background. {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 08:24:29 user nova-compute[95467]: DEBUG nova.network.neutron [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] allocate_for_instance() {{(pid=95467) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 08:24:29 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 08:24:29 user nova-compute[95467]: DEBUG nova.compute.manager [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Start building block device mappings for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 08:24:29 user nova-compute[95467]: INFO nova.virt.block_device [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Booting with volume-backed-image ed9c48aa-ce73-4b3b-9db1-235898be671b at /dev/vda
Nov 15 08:24:29 user nova-compute[95467]: DEBUG nova.policy [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6971581ab2604353aeb0c45c5252b4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c34d65a8000347feb2b3966b7ce0d785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95467) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 08:24:30 user nova-compute[95467]: DEBUG nova.network.neutron [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Successfully created port: 3738b806-4005-468d-87df-f879eb2ff43d {{(pid=95467) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 08:24:31 user nova-compute[95467]: DEBUG nova.network.neutron [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Successfully updated port: 3738b806-4005-468d-87df-f879eb2ff43d {{(pid=95467) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 08:24:31 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Acquiring lock "refresh_cache-ba05c01d-ae74-467c-a309-4d0ba904453d" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:24:31 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Acquired lock "refresh_cache-ba05c01d-ae74-467c-a309-4d0ba904453d" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:24:31 user nova-compute[95467]: DEBUG nova.network.neutron [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:24:31 user nova-compute[95467]: DEBUG nova.network.neutron [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Instance cache missing network info. {{(pid=95467) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 08:24:31 user nova-compute[95467]: DEBUG nova.compute.manager [req-9faeedfc-0058-4a62-8c66-35080d17e3c0 req-a76ce17d-1430-472e-8e05-23857c568296 service nova] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Received event network-changed-3738b806-4005-468d-87df-f879eb2ff43d {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:24:31 user nova-compute[95467]: DEBUG nova.compute.manager [req-9faeedfc-0058-4a62-8c66-35080d17e3c0 req-a76ce17d-1430-472e-8e05-23857c568296 service nova] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Refreshing instance network info cache due to event network-changed-3738b806-4005-468d-87df-f879eb2ff43d. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:24:31 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-9faeedfc-0058-4a62-8c66-35080d17e3c0 req-a76ce17d-1430-472e-8e05-23857c568296 service nova] Acquiring lock "refresh_cache-ba05c01d-ae74-467c-a309-4d0ba904453d" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:24:31 user nova-compute[95467]: DEBUG nova.network.neutron [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Updating instance_info_cache with network_info: [{"id": "3738b806-4005-468d-87df-f879eb2ff43d", "address": "fa:16:3e:86:6f:d3", "network": {"id": "ac9a381d-25fe-4419-b151-f03333413813", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1183680999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34d65a8000347feb2b3966b7ce0d785", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3738b806-40", "ovs_interfaceid": "3738b806-4005-468d-87df-f879eb2ff43d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:24:31 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Releasing lock "refresh_cache-ba05c01d-ae74-467c-a309-4d0ba904453d" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:24:31 user nova-compute[95467]: DEBUG nova.compute.manager [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Instance network_info: |[{"id": "3738b806-4005-468d-87df-f879eb2ff43d", "address": "fa:16:3e:86:6f:d3", "network": {"id": "ac9a381d-25fe-4419-b151-f03333413813", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1183680999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34d65a8000347feb2b3966b7ce0d785", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3738b806-40", "ovs_interfaceid": "3738b806-4005-468d-87df-f879eb2ff43d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 08:24:31 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-9faeedfc-0058-4a62-8c66-35080d17e3c0 req-a76ce17d-1430-472e-8e05-23857c568296 service nova] Acquired lock "refresh_cache-ba05c01d-ae74-467c-a309-4d0ba904453d" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:24:31 user nova-compute[95467]: DEBUG nova.network.neutron [req-9faeedfc-0058-4a62-8c66-35080d17e3c0 req-a76ce17d-1430-472e-8e05-23857c568296 service nova] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Refreshing network info cache for port 3738b806-4005-468d-87df-f879eb2ff43d {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:24:32 user nova-compute[95467]: DEBUG nova.network.neutron [req-9faeedfc-0058-4a62-8c66-35080d17e3c0 req-a76ce17d-1430-472e-8e05-23857c568296 service nova] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Updated VIF entry in instance network info cache for port 3738b806-4005-468d-87df-f879eb2ff43d. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:24:32 user nova-compute[95467]: DEBUG nova.network.neutron [req-9faeedfc-0058-4a62-8c66-35080d17e3c0 req-a76ce17d-1430-472e-8e05-23857c568296 service nova] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Updating instance_info_cache with network_info: [{"id": "3738b806-4005-468d-87df-f879eb2ff43d", "address": "fa:16:3e:86:6f:d3", "network": {"id": "ac9a381d-25fe-4419-b151-f03333413813", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1183680999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34d65a8000347feb2b3966b7ce0d785", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3738b806-40", "ovs_interfaceid": "3738b806-4005-468d-87df-f879eb2ff43d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:24:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-9faeedfc-0058-4a62-8c66-35080d17e3c0 req-a76ce17d-1430-472e-8e05-23857c568296 service nova] Releasing lock "refresh_cache-ba05c01d-ae74-467c-a309-4d0ba904453d" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:24:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:34 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:35 user nova-compute[95467]: DEBUG os_brick.utils [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:24:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:35 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[093f9f8e-af40-45b7-b0ad-e5aedd9a0b4f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:882ae90641f\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:24:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:35 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[9702c0aa-dcea-46b7-bbb8-d0435a7ee4dc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:24:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:35 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7244fd-e6de-4a42-915e-bfcdcd99f383]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:24:35 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4129adf-0bc9-4584-9089-be84abce3390]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:24:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Running cmd (subprocess): nvme version {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] 'nvme version' failed. Not Retrying. {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:24:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.nvmeof [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] nvme not present on system {{(pid=95467) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 08:24:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:24:35 user nova-compute[95467]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 08:24:35 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e731ec-3e9a-4536-b0f6-b89b761395de]: (4, '') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:24:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=95467) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 08:24:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 08:24:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] LIGHTOS: no hostnqn found. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 08:24:35 user nova-compute[95467]: DEBUG os_brick.utils [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:882ae90641f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:24:35 user nova-compute[95467]: DEBUG nova.virt.block_device [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Updating existing volume attachment record: bc46b669-2948-4082-94ac-c15bb0c8749b {{(pid=95467) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 08:24:37 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Acquiring lock "7f14502f-8c4d-400a-a68a-f3f9c3d48524" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:24:37 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Lock "7f14502f-8c4d-400a-a68a-f3f9c3d48524" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:24:37 user nova-compute[95467]: DEBUG nova.compute.manager [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] Starting instance... {{(pid=95467) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 08:24:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:37 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:24:37 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:24:37 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=95467) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 08:24:37 user nova-compute[95467]: INFO nova.compute.claims [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] Claim successful on node user
Nov 15 08:24:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:38 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:24:38 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:24:38 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:38 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.615s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:24:38 user nova-compute[95467]: DEBUG nova.compute.manager [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] Start building networks asynchronously for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 08:24:38 user nova-compute[95467]: DEBUG nova.compute.manager [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] Allocating IP information in the background. {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 08:24:38 user nova-compute[95467]: DEBUG nova.network.neutron [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] allocate_for_instance() {{(pid=95467) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 08:24:38 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 08:24:38 user nova-compute[95467]: DEBUG nova.compute.manager [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] Start building block device mappings for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 08:24:38 user nova-compute[95467]: DEBUG nova.policy [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '19ea481e3ed04dada51185d22951cb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544d63a64ba74f95b1eea2ea7f1241a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95467) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 08:24:38 user nova-compute[95467]: DEBUG nova.compute.manager [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] Start spawning the instance on the hypervisor. {{(pid=95467) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 08:24:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] Creating instance directory {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 08:24:38 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] Creating image(s)
Nov 15 08:24:38 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Acquiring lock "/opt/stack/data/nova/instances/7f14502f-8c4d-400a-a68a-f3f9c3d48524/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:24:38 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Lock "/opt/stack/data/nova/instances/7f14502f-8c4d-400a-a68a-f3f9c3d48524/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:24:38 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Lock "/opt/stack/data/nova/instances/7f14502f-8c4d-400a-a68a-f3f9c3d48524/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:24:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.184s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:38 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Acquiring lock "a3fcf60225fcefd310404971cd18ab9851c548dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:24:38 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:24:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:39 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.186s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:39 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/7f14502f-8c4d-400a-a68a-f3f9c3d48524/disk 1073741824 {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:39 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/7f14502f-8c4d-400a-a68a-f3f9c3d48524/disk 1073741824" returned: 0 in 0.051s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:24:39 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:39 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.179s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:39 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7f14502f-8c4d-400a-a68a-f3f9c3d48524/disk. size=1073741824 {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 08:24:39 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f14502f-8c4d-400a-a68a-f3f9c3d48524/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:39 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f14502f-8c4d-400a-a68a-f3f9c3d48524/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:39 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Cannot resize image /opt/stack/data/nova/instances/7f14502f-8c4d-400a-a68a-f3f9c3d48524/disk to a smaller size. {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 08:24:39 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] Created local disks {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 08:24:39 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] Ensure instance console log exists: /opt/stack/data/nova/instances/7f14502f-8c4d-400a-a68a-f3f9c3d48524/console.log {{(pid=95467) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 08:24:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:24:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:24:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:24:39 user nova-compute[95467]: DEBUG nova.network.neutron [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] Successfully created port: 28b18ef7-c90a-4036-be3b-46cb5a2793f5 {{(pid=95467) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 08:24:39 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG nova.compute.manager [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Start spawning the instance on the hypervisor. {{(pid=95467) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Creating instance directory {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 08:24:40 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Creating image(s)
Nov 15 08:24:40 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Did not create local disks {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Ensure instance console log exists: /opt/stack/data/nova/instances/ba05c01d-ae74-467c-a309-4d0ba904453d/console.log {{(pid=95467) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Start _get_guest_xml network_info=[{"id": "3738b806-4005-468d-87df-f879eb2ff43d", "address": "fa:16:3e:86:6f:d3", "network": {"id": "ac9a381d-25fe-4419-b151-f03333413813", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1183680999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34d65a8000347feb2b3966b7ce0d785", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3738b806-40", "ovs_interfaceid": "3738b806-4005-468d-87df-f879eb2ff43d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'bc46b669-2948-4082-94ac-c15bb0c8749b', 'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hAzlOrmx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ba05c01d-ae74-467c-a309-4d0ba904453d', 'attached_at': '', 'detached_at': '', 'volume_id': '24e79401-c916-4d6f-bee4-b169342acd24', 'serial': '24e79401-c916-4d6f-bee4-b169342acd24'}, 'volume_type': None} {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:24:40 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:24:40 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:24:40 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Calling os-brick to attach iSCSI Volume {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hAzlOrmx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:24:40 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:24:40 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:24:40 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:24:40 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:24:40 user nova-compute[95467]: INFO os_brick.initiator.connectors.iscsi [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 08:24:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 -p 172.16.0.220:3260 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f599edae-4a4a-4389-a2c1-9f08eb98a642]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 08:24:40 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 -p 172.16.0.220:3260 --interface default --op new {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[50822a22-e663-466a-805d-70fb484cc585]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24] added\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24] added
Nov 15 08:24:40 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[85466e1e-8c49-4630-8fb3-86de20bfcd27]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d539b031-f549-447b-b8f1-3b136655de37]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hAzlOrmx {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hAzlOrmx" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b479317-94ba-4770-861b-138fe33e341b]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hAzlOrmx'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f80827b-8821-4fbb-bb1c-fbf1be5386eb]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG nova.network.neutron [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] Successfully updated port: 28b18ef7-c90a-4036-be3b-46cb5a2793f5 {{(pid=95467) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5979baf-59b2-4c0a-9824-af2461ba50f7]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:24:40 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:24:40 user nova-compute[95467]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:24:40 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:24:40 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:24:40 user nova-compute[95467]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:24:40 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 -p 172.16.0.220:3260 --login {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Acquiring lock "refresh_cache-7f14502f-8c4d-400a-a68a-f3f9c3d48524" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Acquired lock "refresh_cache-7f14502f-8c4d-400a-a68a-f3f9c3d48524" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG nova.network.neutron [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG nova.compute.manager [req-a84d0804-058a-4a6e-bc5a-e0dbb21048ad req-00603682-b189-46cc-a594-dcd00a032de3 service nova] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] Received event network-changed-28b18ef7-c90a-4036-be3b-46cb5a2793f5 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG nova.compute.manager [req-a84d0804-058a-4a6e-bc5a-e0dbb21048ad req-00603682-b189-46cc-a594-dcd00a032de3 service nova] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] Refreshing instance network info cache due to event network-changed-28b18ef7-c90a-4036-be3b-46cb5a2793f5. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-a84d0804-058a-4a6e-bc5a-e0dbb21048ad req-00603682-b189-46cc-a594-dcd00a032de3 service nova] Acquiring lock "refresh_cache-7f14502f-8c4d-400a-a68a-f3f9c3d48524" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[46511613-a23e-4773-9cc4-90604895cff3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24, portal: 172.16.0.220,3260]
Nov 15 08:24:40 user nova-compute[95467]: Login to [iface: default, target: iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24, portal: 172.16.0.220,3260] successful.
Nov 15 08:24:40 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ebfbff9-e3fc-4141-9990-034ce16f4050]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[785571c1-6f9f-4941-a355-ccc3d9aff494]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:24:40 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:24:40 user nova-compute[95467]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:24:40 user nova-compute[95467]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)
Nov 15 08:24:40 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:24:40 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:24:40 user nova-compute[95467]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:24:40 user nova-compute[95467]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)
Nov 15 08:24:40 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Connected to 172.16.0.220:3260 {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] HCTL ('34', '-', '-', 0) found on session 41 with lun 0 {{(pid=95467) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=95467) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG nova.network.neutron [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] Instance cache missing network info. {{(pid=95467) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed505595-77bb-463a-b824-5bab40aba193]: (4, ('- - 0', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Searching for a device in session 41 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:24:40 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hAzlOrmx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG nova.network.neutron [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] Updating instance_info_cache with network_info: [{"id": "28b18ef7-c90a-4036-be3b-46cb5a2793f5", "address": "fa:16:3e:0b:69:75", "network": {"id": "304f39cf-cfb1-462f-8f2e-2ee6fd1fd47b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-226476785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "544d63a64ba74f95b1eea2ea7f1241a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28b18ef7-c9", "ovs_interfaceid": "28b18ef7-c90a-4036-be3b-46cb5a2793f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Releasing lock "refresh_cache-7f14502f-8c4d-400a-a68a-f3f9c3d48524" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG nova.compute.manager [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] Instance network_info: |[{"id": "28b18ef7-c90a-4036-be3b-46cb5a2793f5", "address": "fa:16:3e:0b:69:75", "network": {"id": "304f39cf-cfb1-462f-8f2e-2ee6fd1fd47b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-226476785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "544d63a64ba74f95b1eea2ea7f1241a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28b18ef7-c9", "ovs_interfaceid": "28b18ef7-c90a-4036-be3b-46cb5a2793f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-a84d0804-058a-4a6e-bc5a-e0dbb21048ad req-00603682-b189-46cc-a594-dcd00a032de3 service nova] Acquired lock "refresh_cache-7f14502f-8c4d-400a-a68a-f3f9c3d48524" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG nova.network.neutron [req-a84d0804-058a-4a6e-bc5a-e0dbb21048ad req-00603682-b189-46cc-a594-dcd00a032de3 service nova] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] Refreshing network info cache for port 28b18ef7-c90a-4036-be3b-46cb5a2793f5 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] Start _get_guest_xml network_info=[{"id": "28b18ef7-c90a-4036-be3b-46cb5a2793f5", "address": "fa:16:3e:0b:69:75", "network": {"id": "304f39cf-cfb1-462f-8f2e-2ee6fd1fd47b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-226476785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "544d63a64ba74f95b1eea2ea7f1241a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28b18ef7-c9", "ovs_interfaceid": "28b18ef7-c90a-4036-be3b-46cb5a2793f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'ed9c48aa-ce73-4b3b-9db1-235898be671b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:24:41 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:24:41 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:24:41 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:24:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1991254971',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1991254971',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1991254',id=42,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPuyFm/Z/l5Dl1Y+kjqAOyOdq7eUXt4Ptl0Kmd9IRqD1zfmeUUxxJ0Imi+2wOi0McSTJp1hwsW+TWB+Jbv3nU4aeo6sRGk3uWM/Kuh24A+hDqZn9thb9s0Ha0xm5oDvwpw==',key_name='tempest-keypair-1007709814',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='544d63a64ba74f95b1eea2ea7f1241a0',ramdisk_id='',reservation_id='r-s4vfc2dl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-383911196',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:24:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19ea481e3ed04dada51185d22951cb93',uuid=7f14502f-8c4d-400a-a68a-f3f9c3d48524,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28b18ef7-c90a-4036-be3b-46cb5a2793f5", "address": "fa:16:3e:0b:69:75", "network": {"id": "304f39cf-cfb1-462f-8f2e-2ee6fd1fd47b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-226476785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "544d63a64ba74f95b1eea2ea7f1241a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28b18ef7-c9", "ovs_interfaceid": "28b18ef7-c90a-4036-be3b-46cb5a2793f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Converting VIF {"id": "28b18ef7-c90a-4036-be3b-46cb5a2793f5", "address": "fa:16:3e:0b:69:75", "network": {"id": "304f39cf-cfb1-462f-8f2e-2ee6fd1fd47b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-226476785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "544d63a64ba74f95b1eea2ea7f1241a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28b18ef7-c9", "ovs_interfaceid": "28b18ef7-c90a-4036-be3b-46cb5a2793f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:69:75,bridge_name='br-int',has_traffic_filtering=True,id=28b18ef7-c90a-4036-be3b-46cb5a2793f5,network=Network(304f39cf-cfb1-462f-8f2e-2ee6fd1fd47b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28b18ef7-c9') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG nova.objects.instance [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Lazy-loading 'pci_devices' on Instance uuid 7f14502f-8c4d-400a-a68a-f3f9c3d48524 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:24:41 user nova-compute[95467]:   <uuid>7f14502f-8c4d-400a-a68a-f3f9c3d48524</uuid>
Nov 15 08:24:41 user nova-compute[95467]:   <name>instance-0000002a</name>
Nov 15 08:24:41 user nova-compute[95467]:   <memory>524288</memory>
Nov 15 08:24:41 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:24:41 user nova-compute[95467]:   <metadata>
Nov 15 08:24:41 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:24:41 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:24:41 user nova-compute[95467]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1991254971</nova:name>
Nov 15 08:24:41 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:24:41</nova:creationTime>
Nov 15 08:24:41 user nova-compute[95467]:       <nova:flavor name="m1.tiny">
Nov 15 08:24:41 user nova-compute[95467]:         <nova:memory>512</nova:memory>
Nov 15 08:24:41 user nova-compute[95467]:         <nova:disk>1</nova:disk>
Nov 15 08:24:41 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:24:41 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:24:41 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:24:41 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:24:41 user nova-compute[95467]:       <nova:owner>
Nov 15 08:24:41 user nova-compute[95467]:         <nova:user uuid="19ea481e3ed04dada51185d22951cb93">tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member</nova:user>
Nov 15 08:24:41 user nova-compute[95467]:         <nova:project uuid="544d63a64ba74f95b1eea2ea7f1241a0">tempest-TestServerVolumeAttachScenarioOldVersion-383911196</nova:project>
Nov 15 08:24:41 user nova-compute[95467]:       </nova:owner>
Nov 15 08:24:41 user nova-compute[95467]:       <nova:root type="image" uuid="ed9c48aa-ce73-4b3b-9db1-235898be671b"/>
Nov 15 08:24:41 user nova-compute[95467]:       <nova:ports>
Nov 15 08:24:41 user nova-compute[95467]:         <nova:port uuid="28b18ef7-c90a-4036-be3b-46cb5a2793f5">
Nov 15 08:24:41 user nova-compute[95467]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 08:24:41 user nova-compute[95467]:         </nova:port>
Nov 15 08:24:41 user nova-compute[95467]:       </nova:ports>
Nov 15 08:24:41 user nova-compute[95467]:     </nova:instance>
Nov 15 08:24:41 user nova-compute[95467]:   </metadata>
Nov 15 08:24:41 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:24:41 user nova-compute[95467]:     <system>
Nov 15 08:24:41 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:24:41 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:24:41 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:24:41 user nova-compute[95467]:       <entry name="serial">7f14502f-8c4d-400a-a68a-f3f9c3d48524</entry>
Nov 15 08:24:41 user nova-compute[95467]:       <entry name="uuid">7f14502f-8c4d-400a-a68a-f3f9c3d48524</entry>
Nov 15 08:24:41 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:24:41 user nova-compute[95467]:     </system>
Nov 15 08:24:41 user nova-compute[95467]:   </sysinfo>
Nov 15 08:24:41 user nova-compute[95467]:   <os>
Nov 15 08:24:41 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:24:41 user nova-compute[95467]:     <boot dev="hd"/>
Nov 15 08:24:41 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:24:41 user nova-compute[95467]:   </os>
Nov 15 08:24:41 user nova-compute[95467]:   <features>
Nov 15 08:24:41 user nova-compute[95467]:     <acpi/>
Nov 15 08:24:41 user nova-compute[95467]:     <apic/>
Nov 15 08:24:41 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:24:41 user nova-compute[95467]:   </features>
Nov 15 08:24:41 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:24:41 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:24:41 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:24:41 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:24:41 user nova-compute[95467]:   </clock>
Nov 15 08:24:41 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:24:41 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:24:41 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:24:41 user nova-compute[95467]:   </cpu>
Nov 15 08:24:41 user nova-compute[95467]:   <devices>
Nov 15 08:24:41 user nova-compute[95467]:     <disk type="file" device="disk">
Nov 15 08:24:41 user nova-compute[95467]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 08:24:41 user nova-compute[95467]:       <source file="/opt/stack/data/nova/instances/7f14502f-8c4d-400a-a68a-f3f9c3d48524/disk"/>
Nov 15 08:24:41 user nova-compute[95467]:       <target dev="vda" bus="virtio"/>
Nov 15 08:24:41 user nova-compute[95467]:     </disk>
Nov 15 08:24:41 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:24:41 user nova-compute[95467]:       <mac address="fa:16:3e:0b:69:75"/>
Nov 15 08:24:41 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:24:41 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:24:41 user nova-compute[95467]:       <target dev="tap28b18ef7-c9"/>
Nov 15 08:24:41 user nova-compute[95467]:     </interface>
Nov 15 08:24:41 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:24:41 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/7f14502f-8c4d-400a-a68a-f3f9c3d48524/console.log" append="off"/>
Nov 15 08:24:41 user nova-compute[95467]:     </serial>
Nov 15 08:24:41 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:24:41 user nova-compute[95467]:     <video>
Nov 15 08:24:41 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:24:41 user nova-compute[95467]:     </video>
Nov 15 08:24:41 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:24:41 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:24:41 user nova-compute[95467]:     </rng>
Nov 15 08:24:41 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:24:41 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:24:41 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:24:41 user nova-compute[95467]:     </memballoon>
Nov 15 08:24:41 user nova-compute[95467]:   </devices>
Nov 15 08:24:41 user nova-compute[95467]: </domain>
Nov 15 08:24:41 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:24:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1991254971',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1991254971',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1991254',id=42,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPuyFm/Z/l5Dl1Y+kjqAOyOdq7eUXt4Ptl0Kmd9IRqD1zfmeUUxxJ0Imi+2wOi0McSTJp1hwsW+TWB+Jbv3nU4aeo6sRGk3uWM/Kuh24A+hDqZn9thb9s0Ha0xm5oDvwpw==',key_name='tempest-keypair-1007709814',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='544d63a64ba74f95b1eea2ea7f1241a0',ramdisk_id='',reservation_id='r-s4vfc2dl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-383911196',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:24:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19ea481e3ed04dada51185d22951cb93',uuid=7f14502f-8c4d-400a-a68a-f3f9c3d48524,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28b18ef7-c90a-4036-be3b-46cb5a2793f5", "address": "fa:16:3e:0b:69:75", "network": {"id": "304f39cf-cfb1-462f-8f2e-2ee6fd1fd47b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-226476785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "544d63a64ba74f95b1eea2ea7f1241a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28b18ef7-c9", "ovs_interfaceid": "28b18ef7-c90a-4036-be3b-46cb5a2793f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Converting VIF {"id": "28b18ef7-c90a-4036-be3b-46cb5a2793f5", "address": "fa:16:3e:0b:69:75", "network": {"id": "304f39cf-cfb1-462f-8f2e-2ee6fd1fd47b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-226476785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "544d63a64ba74f95b1eea2ea7f1241a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28b18ef7-c9", "ovs_interfaceid": "28b18ef7-c90a-4036-be3b-46cb5a2793f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:69:75,bridge_name='br-int',has_traffic_filtering=True,id=28b18ef7-c90a-4036-be3b-46cb5a2793f5,network=Network(304f39cf-cfb1-462f-8f2e-2ee6fd1fd47b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28b18ef7-c9') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG os_vif [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:69:75,bridge_name='br-int',has_traffic_filtering=True,id=28b18ef7-c90a-4036-be3b-46cb5a2793f5,network=Network(304f39cf-cfb1-462f-8f2e-2ee6fd1fd47b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28b18ef7-c9') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '941f3650-6eca-55fb-9bbf-c4ab72e55c02', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap28b18ef7-c9, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap28b18ef7-c9, col_values=(('qos', UUID('a9c6ac81-b6c6-44fc-a889-066d4d4da1ea')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap28b18ef7-c9, col_values=(('external_ids', {'iface-id': '28b18ef7-c90a-4036-be3b-46cb5a2793f5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:69:75', 'vm-uuid': '7f14502f-8c4d-400a-a68a-f3f9c3d48524'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:41 user nova-compute[95467]: INFO os_vif [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:69:75,bridge_name='br-int',has_traffic_filtering=True,id=28b18ef7-c90a-4036-be3b-46cb5a2793f5,network=Network(304f39cf-cfb1-462f-8f2e-2ee6fd1fd47b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28b18ef7-c9')
Nov 15 08:24:41 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] No VIF found with MAC fa:16:3e:0b:69:75, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG nova.network.neutron [req-a84d0804-058a-4a6e-bc5a-e0dbb21048ad req-00603682-b189-46cc-a594-dcd00a032de3 service nova] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] Updated VIF entry in instance network info cache for port 28b18ef7-c90a-4036-be3b-46cb5a2793f5. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG nova.network.neutron [req-a84d0804-058a-4a6e-bc5a-e0dbb21048ad req-00603682-b189-46cc-a594-dcd00a032de3 service nova] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] Updating instance_info_cache with network_info: [{"id": "28b18ef7-c90a-4036-be3b-46cb5a2793f5", "address": "fa:16:3e:0b:69:75", "network": {"id": "304f39cf-cfb1-462f-8f2e-2ee6fd1fd47b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-226476785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "544d63a64ba74f95b1eea2ea7f1241a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28b18ef7-c9", "ovs_interfaceid": "28b18ef7-c90a-4036-be3b-46cb5a2793f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-a84d0804-058a-4a6e-bc5a-e0dbb21048ad req-00603682-b189-46cc-a594-dcd00a032de3 service nova] Releasing lock "refresh_cache-7f14502f-8c4d-400a-a68a-f3f9c3d48524" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '23036643765326264', 'path': '/dev/sdc'} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036643765326264', 'path': '/dev/sdc'} {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:24:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-970128298',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-970128298',id=41,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c34d65a8000347feb2b3966b7ce0d785',ramdisk_id='',reservation_id='r-0wg1av9z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1903830225',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:24:30Z,user_data=None,user_id='6971581ab2604353aeb0c45c5252b4fb',uuid=ba05c01d-ae74-467c-a309-4d0ba904453d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3738b806-4005-468d-87df-f879eb2ff43d", "address": "fa:16:3e:86:6f:d3", "network": {"id": "ac9a381d-25fe-4419-b151-f03333413813", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1183680999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34d65a8000347feb2b3966b7ce0d785", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3738b806-40", "ovs_interfaceid": "3738b806-4005-468d-87df-f879eb2ff43d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Converting VIF {"id": "3738b806-4005-468d-87df-f879eb2ff43d", "address": "fa:16:3e:86:6f:d3", "network": {"id": "ac9a381d-25fe-4419-b151-f03333413813", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1183680999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34d65a8000347feb2b3966b7ce0d785", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3738b806-40", "ovs_interfaceid": "3738b806-4005-468d-87df-f879eb2ff43d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:6f:d3,bridge_name='br-int',has_traffic_filtering=True,id=3738b806-4005-468d-87df-f879eb2ff43d,network=Network(ac9a381d-25fe-4419-b151-f03333413813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3738b806-40') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG nova.objects.instance [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lazy-loading 'pci_devices' on Instance uuid ba05c01d-ae74-467c-a309-4d0ba904453d {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:24:41 user nova-compute[95467]:   <uuid>ba05c01d-ae74-467c-a309-4d0ba904453d</uuid>
Nov 15 08:24:41 user nova-compute[95467]:   <name>instance-00000029</name>
Nov 15 08:24:41 user nova-compute[95467]:   <memory>524288</memory>
Nov 15 08:24:41 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:24:41 user nova-compute[95467]:   <metadata>
Nov 15 08:24:41 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:24:41 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:24:41 user nova-compute[95467]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-970128298</nova:name>
Nov 15 08:24:41 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:24:40</nova:creationTime>
Nov 15 08:24:41 user nova-compute[95467]:       <nova:flavor name="m1.tiny">
Nov 15 08:24:41 user nova-compute[95467]:         <nova:memory>512</nova:memory>
Nov 15 08:24:41 user nova-compute[95467]:         <nova:disk>1</nova:disk>
Nov 15 08:24:41 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:24:41 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:24:41 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:24:41 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:24:41 user nova-compute[95467]:       <nova:owner>
Nov 15 08:24:41 user nova-compute[95467]:         <nova:user uuid="6971581ab2604353aeb0c45c5252b4fb">tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member</nova:user>
Nov 15 08:24:41 user nova-compute[95467]:         <nova:project uuid="c34d65a8000347feb2b3966b7ce0d785">tempest-ServerBootFromVolumeStableRescueTest-1903830225</nova:project>
Nov 15 08:24:41 user nova-compute[95467]:       </nova:owner>
Nov 15 08:24:41 user nova-compute[95467]:       <nova:root type="image" uuid="ed9c48aa-ce73-4b3b-9db1-235898be671b"/>
Nov 15 08:24:41 user nova-compute[95467]:       <nova:ports>
Nov 15 08:24:41 user nova-compute[95467]:         <nova:port uuid="3738b806-4005-468d-87df-f879eb2ff43d">
Nov 15 08:24:41 user nova-compute[95467]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 08:24:41 user nova-compute[95467]:         </nova:port>
Nov 15 08:24:41 user nova-compute[95467]:       </nova:ports>
Nov 15 08:24:41 user nova-compute[95467]:     </nova:instance>
Nov 15 08:24:41 user nova-compute[95467]:   </metadata>
Nov 15 08:24:41 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:24:41 user nova-compute[95467]:     <system>
Nov 15 08:24:41 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:24:41 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:24:41 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:24:41 user nova-compute[95467]:       <entry name="serial">ba05c01d-ae74-467c-a309-4d0ba904453d</entry>
Nov 15 08:24:41 user nova-compute[95467]:       <entry name="uuid">ba05c01d-ae74-467c-a309-4d0ba904453d</entry>
Nov 15 08:24:41 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:24:41 user nova-compute[95467]:     </system>
Nov 15 08:24:41 user nova-compute[95467]:   </sysinfo>
Nov 15 08:24:41 user nova-compute[95467]:   <os>
Nov 15 08:24:41 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:24:41 user nova-compute[95467]:     <boot dev="hd"/>
Nov 15 08:24:41 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:24:41 user nova-compute[95467]:   </os>
Nov 15 08:24:41 user nova-compute[95467]:   <features>
Nov 15 08:24:41 user nova-compute[95467]:     <acpi/>
Nov 15 08:24:41 user nova-compute[95467]:     <apic/>
Nov 15 08:24:41 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:24:41 user nova-compute[95467]:   </features>
Nov 15 08:24:41 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:24:41 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:24:41 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:24:41 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:24:41 user nova-compute[95467]:   </clock>
Nov 15 08:24:41 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:24:41 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:24:41 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:24:41 user nova-compute[95467]:   </cpu>
Nov 15 08:24:41 user nova-compute[95467]:   <devices>
Nov 15 08:24:41 user nova-compute[95467]:     <disk type="block" device="disk">
Nov 15 08:24:41 user nova-compute[95467]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:24:41 user nova-compute[95467]:       <source dev="/dev/sdc"/>
Nov 15 08:24:41 user nova-compute[95467]:       <target dev="vda" bus="virtio"/>
Nov 15 08:24:41 user nova-compute[95467]:       <serial>24e79401-c916-4d6f-bee4-b169342acd24</serial>
Nov 15 08:24:41 user nova-compute[95467]:     </disk>
Nov 15 08:24:41 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:24:41 user nova-compute[95467]:       <mac address="fa:16:3e:86:6f:d3"/>
Nov 15 08:24:41 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:24:41 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:24:41 user nova-compute[95467]:       <target dev="tap3738b806-40"/>
Nov 15 08:24:41 user nova-compute[95467]:     </interface>
Nov 15 08:24:41 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:24:41 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/ba05c01d-ae74-467c-a309-4d0ba904453d/console.log" append="off"/>
Nov 15 08:24:41 user nova-compute[95467]:     </serial>
Nov 15 08:24:41 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:24:41 user nova-compute[95467]:     <video>
Nov 15 08:24:41 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:24:41 user nova-compute[95467]:     </video>
Nov 15 08:24:41 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:24:41 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:24:41 user nova-compute[95467]:     </rng>
Nov 15 08:24:41 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:24:41 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:24:41 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:24:41 user nova-compute[95467]:     </memballoon>
Nov 15 08:24:41 user nova-compute[95467]:   </devices>
Nov 15 08:24:41 user nova-compute[95467]: </domain>
Nov 15 08:24:41 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:24:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-970128298',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-970128298',id=41,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c34d65a8000347feb2b3966b7ce0d785',ramdisk_id='',reservation_id='r-0wg1av9z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1903830225',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:24:30Z,user_data=None,user_id='6971581ab2604353aeb0c45c5252b4fb',uuid=ba05c01d-ae74-467c-a309-4d0ba904453d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3738b806-4005-468d-87df-f879eb2ff43d", "address": "fa:16:3e:86:6f:d3", "network": {"id": "ac9a381d-25fe-4419-b151-f03333413813", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1183680999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34d65a8000347feb2b3966b7ce0d785", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3738b806-40", "ovs_interfaceid": "3738b806-4005-468d-87df-f879eb2ff43d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Converting VIF {"id": "3738b806-4005-468d-87df-f879eb2ff43d", "address": "fa:16:3e:86:6f:d3", "network": {"id": "ac9a381d-25fe-4419-b151-f03333413813", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1183680999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34d65a8000347feb2b3966b7ce0d785", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3738b806-40", "ovs_interfaceid": "3738b806-4005-468d-87df-f879eb2ff43d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:6f:d3,bridge_name='br-int',has_traffic_filtering=True,id=3738b806-4005-468d-87df-f879eb2ff43d,network=Network(ac9a381d-25fe-4419-b151-f03333413813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3738b806-40') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG os_vif [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:6f:d3,bridge_name='br-int',has_traffic_filtering=True,id=3738b806-4005-468d-87df-f879eb2ff43d,network=Network(ac9a381d-25fe-4419-b151-f03333413813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3738b806-40') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '98696ece-86fc-5d6a-a1ef-fc8e3746d8c4', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3738b806-40, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3738b806-40, col_values=(('qos', UUID('2d17db79-0516-42ec-9f80-00cb1a582c09')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3738b806-40, col_values=(('external_ids', {'iface-id': '3738b806-4005-468d-87df-f879eb2ff43d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:6f:d3', 'vm-uuid': 'ba05c01d-ae74-467c-a309-4d0ba904453d'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:41 user nova-compute[95467]: INFO os_vif [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:6f:d3,bridge_name='br-int',has_traffic_filtering=True,id=3738b806-4005-468d-87df-f879eb2ff43d,network=Network(ac9a381d-25fe-4419-b151-f03333413813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3738b806-40')
Nov 15 08:24:41 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:24:41 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] No VIF found with MAC fa:16:3e:86:6f:d3, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:24:42 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Acquiring lock "218f0d21-181c-4634-b6f7-20137fe30520" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:24:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Lock "218f0d21-181c-4634-b6f7-20137fe30520" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:24:43 user nova-compute[95467]: DEBUG nova.compute.manager [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 218f0d21-181c-4634-b6f7-20137fe30520] Starting instance... {{(pid=95467) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 08:24:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:24:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:24:43 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=95467) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 08:24:43 user nova-compute[95467]: INFO nova.compute.claims [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 218f0d21-181c-4634-b6f7-20137fe30520] Claim successful on node user
Nov 15 08:24:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:43 user nova-compute[95467]: DEBUG nova.compute.manager [req-275a4623-72ed-4393-8c16-9e247d9e2591 req-48f82edc-4e59-4b3c-9b0f-64fc6cad7396 service nova] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] Received event network-vif-plugged-28b18ef7-c90a-4036-be3b-46cb5a2793f5 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:24:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-275a4623-72ed-4393-8c16-9e247d9e2591 req-48f82edc-4e59-4b3c-9b0f-64fc6cad7396 service nova] Acquiring lock "7f14502f-8c4d-400a-a68a-f3f9c3d48524-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:24:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-275a4623-72ed-4393-8c16-9e247d9e2591 req-48f82edc-4e59-4b3c-9b0f-64fc6cad7396 service nova] Lock "7f14502f-8c4d-400a-a68a-f3f9c3d48524-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:24:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-275a4623-72ed-4393-8c16-9e247d9e2591 req-48f82edc-4e59-4b3c-9b0f-64fc6cad7396 service nova] Lock "7f14502f-8c4d-400a-a68a-f3f9c3d48524-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:24:43 user nova-compute[95467]: DEBUG nova.compute.manager [req-275a4623-72ed-4393-8c16-9e247d9e2591 req-48f82edc-4e59-4b3c-9b0f-64fc6cad7396 service nova] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] No waiting events found dispatching network-vif-plugged-28b18ef7-c90a-4036-be3b-46cb5a2793f5 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:24:43 user nova-compute[95467]: WARNING nova.compute.manager [req-275a4623-72ed-4393-8c16-9e247d9e2591 req-48f82edc-4e59-4b3c-9b0f-64fc6cad7396 service nova] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] Received unexpected event network-vif-plugged-28b18ef7-c90a-4036-be3b-46cb5a2793f5 for instance with vm_state building and task_state spawning.
Nov 15 08:24:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:44 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:24:44 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:24:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.631s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:24:44 user nova-compute[95467]: DEBUG nova.compute.manager [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 218f0d21-181c-4634-b6f7-20137fe30520] Start building networks asynchronously for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 08:24:44 user nova-compute[95467]: DEBUG nova.compute.manager [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 218f0d21-181c-4634-b6f7-20137fe30520] Allocating IP information in the background. {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 08:24:44 user nova-compute[95467]: DEBUG nova.network.neutron [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 218f0d21-181c-4634-b6f7-20137fe30520] allocate_for_instance() {{(pid=95467) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 08:24:44 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 218f0d21-181c-4634-b6f7-20137fe30520] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 08:24:44 user nova-compute[95467]: DEBUG nova.compute.manager [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 218f0d21-181c-4634-b6f7-20137fe30520] Start building block device mappings for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 08:24:44 user nova-compute[95467]: DEBUG nova.policy [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '21abcb55c48d44af8a215cdc4013a065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e179db7f977c4d98abb497c6a3b4f5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95467) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 08:24:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:44 user nova-compute[95467]: DEBUG nova.compute.manager [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 218f0d21-181c-4634-b6f7-20137fe30520] Start spawning the instance on the hypervisor. {{(pid=95467) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 08:24:44 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 218f0d21-181c-4634-b6f7-20137fe30520] Creating instance directory {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 08:24:44 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 218f0d21-181c-4634-b6f7-20137fe30520] Creating image(s)
Nov 15 08:24:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Acquiring lock "/opt/stack/data/nova/instances/218f0d21-181c-4634-b6f7-20137fe30520/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:24:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Lock "/opt/stack/data/nova/instances/218f0d21-181c-4634-b6f7-20137fe30520/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:24:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Lock "/opt/stack/data/nova/instances/218f0d21-181c-4634-b6f7-20137fe30520/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:24:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.172s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Acquiring lock "a3fcf60225fcefd310404971cd18ab9851c548dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:24:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:24:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.171s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/218f0d21-181c-4634-b6f7-20137fe30520/disk 1073741824 {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/218f0d21-181c-4634-b6f7-20137fe30520/disk 1073741824" returned: 0 in 0.073s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:24:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:45 user nova-compute[95467]: DEBUG nova.network.neutron [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 218f0d21-181c-4634-b6f7-20137fe30520] Successfully created port: 33bb6ea0-983d-4a4a-960e-ca26aade5062 {{(pid=95467) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 08:24:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.187s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:45 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Checking if we can resize image /opt/stack/data/nova/instances/218f0d21-181c-4634-b6f7-20137fe30520/disk. size=1073741824 {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 08:24:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/218f0d21-181c-4634-b6f7-20137fe30520/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/218f0d21-181c-4634-b6f7-20137fe30520/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:45 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Cannot resize image /opt/stack/data/nova/instances/218f0d21-181c-4634-b6f7-20137fe30520/disk to a smaller size. {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 08:24:45 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 218f0d21-181c-4634-b6f7-20137fe30520] Created local disks {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 08:24:45 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 218f0d21-181c-4634-b6f7-20137fe30520] Ensure instance console log exists: /opt/stack/data/nova/instances/218f0d21-181c-4634-b6f7-20137fe30520/console.log {{(pid=95467) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 08:24:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:24:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:24:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:24:45 user nova-compute[95467]: DEBUG nova.compute.manager [req-47fad702-07cc-4195-a930-97d2d1a30ccd req-6ae4dc2a-f6a3-4c42-a516-26066b391334 service nova] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] Received event network-vif-plugged-28b18ef7-c90a-4036-be3b-46cb5a2793f5 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:24:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-47fad702-07cc-4195-a930-97d2d1a30ccd req-6ae4dc2a-f6a3-4c42-a516-26066b391334 service nova] Acquiring lock "7f14502f-8c4d-400a-a68a-f3f9c3d48524-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:24:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-47fad702-07cc-4195-a930-97d2d1a30ccd req-6ae4dc2a-f6a3-4c42-a516-26066b391334 service nova] Lock "7f14502f-8c4d-400a-a68a-f3f9c3d48524-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:24:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-47fad702-07cc-4195-a930-97d2d1a30ccd req-6ae4dc2a-f6a3-4c42-a516-26066b391334 service nova] Lock "7f14502f-8c4d-400a-a68a-f3f9c3d48524-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:24:45 user nova-compute[95467]: DEBUG nova.compute.manager [req-47fad702-07cc-4195-a930-97d2d1a30ccd req-6ae4dc2a-f6a3-4c42-a516-26066b391334 service nova] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] No waiting events found dispatching network-vif-plugged-28b18ef7-c90a-4036-be3b-46cb5a2793f5 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:24:45 user nova-compute[95467]: WARNING nova.compute.manager [req-47fad702-07cc-4195-a930-97d2d1a30ccd req-6ae4dc2a-f6a3-4c42-a516-26066b391334 service nova] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] Received unexpected event network-vif-plugged-28b18ef7-c90a-4036-be3b-46cb5a2793f5 for instance with vm_state building and task_state spawning.
Nov 15 08:24:45 user nova-compute[95467]: DEBUG nova.compute.manager [req-47fad702-07cc-4195-a930-97d2d1a30ccd req-6ae4dc2a-f6a3-4c42-a516-26066b391334 service nova] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Received event network-vif-plugged-3738b806-4005-468d-87df-f879eb2ff43d {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:24:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-47fad702-07cc-4195-a930-97d2d1a30ccd req-6ae4dc2a-f6a3-4c42-a516-26066b391334 service nova] Acquiring lock "ba05c01d-ae74-467c-a309-4d0ba904453d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:24:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-47fad702-07cc-4195-a930-97d2d1a30ccd req-6ae4dc2a-f6a3-4c42-a516-26066b391334 service nova] Lock "ba05c01d-ae74-467c-a309-4d0ba904453d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:24:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-47fad702-07cc-4195-a930-97d2d1a30ccd req-6ae4dc2a-f6a3-4c42-a516-26066b391334 service nova] Lock "ba05c01d-ae74-467c-a309-4d0ba904453d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:24:45 user nova-compute[95467]: DEBUG nova.compute.manager [req-47fad702-07cc-4195-a930-97d2d1a30ccd req-6ae4dc2a-f6a3-4c42-a516-26066b391334 service nova] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] No waiting events found dispatching network-vif-plugged-3738b806-4005-468d-87df-f879eb2ff43d {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:24:45 user nova-compute[95467]: WARNING nova.compute.manager [req-47fad702-07cc-4195-a930-97d2d1a30ccd req-6ae4dc2a-f6a3-4c42-a516-26066b391334 service nova] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Received unexpected event network-vif-plugged-3738b806-4005-468d-87df-f879eb2ff43d for instance with vm_state building and task_state spawning.
Nov 15 08:24:45 user nova-compute[95467]: DEBUG nova.compute.manager [req-47fad702-07cc-4195-a930-97d2d1a30ccd req-6ae4dc2a-f6a3-4c42-a516-26066b391334 service nova] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Received event network-vif-plugged-3738b806-4005-468d-87df-f879eb2ff43d {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:24:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-47fad702-07cc-4195-a930-97d2d1a30ccd req-6ae4dc2a-f6a3-4c42-a516-26066b391334 service nova] Acquiring lock "ba05c01d-ae74-467c-a309-4d0ba904453d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:24:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-47fad702-07cc-4195-a930-97d2d1a30ccd req-6ae4dc2a-f6a3-4c42-a516-26066b391334 service nova] Lock "ba05c01d-ae74-467c-a309-4d0ba904453d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:24:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-47fad702-07cc-4195-a930-97d2d1a30ccd req-6ae4dc2a-f6a3-4c42-a516-26066b391334 service nova] Lock "ba05c01d-ae74-467c-a309-4d0ba904453d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:24:45 user nova-compute[95467]: DEBUG nova.compute.manager [req-47fad702-07cc-4195-a930-97d2d1a30ccd req-6ae4dc2a-f6a3-4c42-a516-26066b391334 service nova] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] No waiting events found dispatching network-vif-plugged-3738b806-4005-468d-87df-f879eb2ff43d {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:24:45 user nova-compute[95467]: WARNING nova.compute.manager [req-47fad702-07cc-4195-a930-97d2d1a30ccd req-6ae4dc2a-f6a3-4c42-a516-26066b391334 service nova] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Received unexpected event network-vif-plugged-3738b806-4005-468d-87df-f879eb2ff43d for instance with vm_state building and task_state spawning.
Nov 15 08:24:46 user nova-compute[95467]: DEBUG nova.network.neutron [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 218f0d21-181c-4634-b6f7-20137fe30520] Successfully updated port: 33bb6ea0-983d-4a4a-960e-ca26aade5062 {{(pid=95467) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Acquiring lock "refresh_cache-218f0d21-181c-4634-b6f7-20137fe30520" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Acquired lock "refresh_cache-218f0d21-181c-4634-b6f7-20137fe30520" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG nova.network.neutron [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 218f0d21-181c-4634-b6f7-20137fe30520] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG nova.compute.manager [req-f8078a90-7113-47fb-99a4-99fe57779cd4 req-9867fc2d-2627-485e-9cf5-f917b5bd3d4c service nova] [instance: 218f0d21-181c-4634-b6f7-20137fe30520] Received event network-changed-33bb6ea0-983d-4a4a-960e-ca26aade5062 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG nova.compute.manager [req-f8078a90-7113-47fb-99a4-99fe57779cd4 req-9867fc2d-2627-485e-9cf5-f917b5bd3d4c service nova] [instance: 218f0d21-181c-4634-b6f7-20137fe30520] Refreshing instance network info cache due to event network-changed-33bb6ea0-983d-4a4a-960e-ca26aade5062. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-f8078a90-7113-47fb-99a4-99fe57779cd4 req-9867fc2d-2627-485e-9cf5-f917b5bd3d4c service nova] Acquiring lock "refresh_cache-218f0d21-181c-4634-b6f7-20137fe30520" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG nova.network.neutron [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 218f0d21-181c-4634-b6f7-20137fe30520] Instance cache missing network info. {{(pid=95467) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG nova.compute.manager [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] Instance event wait completed in 0 seconds for  {{(pid=95467) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] Guest created on hypervisor {{(pid=95467) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 08:24:46 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] Instance spawned successfully.
Nov 15 08:24:46 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] Found default for hw_cdrom_bus of ide {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] Found default for hw_disk_bus of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] Found default for hw_input_bus of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] Found default for hw_pointer_model of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] Found default for hw_video_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] Found default for hw_vif_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG nova.compute.manager [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Instance event wait completed in 0 seconds for  {{(pid=95467) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Guest created on hypervisor {{(pid=95467) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 08:24:46 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Instance spawned successfully.
Nov 15 08:24:46 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG nova.network.neutron [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 218f0d21-181c-4634-b6f7-20137fe30520] Updating instance_info_cache with network_info: [{"id": "33bb6ea0-983d-4a4a-960e-ca26aade5062", "address": "fa:16:3e:c9:9f:d2", "network": {"id": "3bb97374-8e3e-4364-a350-dbe265332087", "bridge": "br-int", "label": "tempest-VolumesActionsTest-966132722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e179db7f977c4d98abb497c6a3b4f5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33bb6ea0-98", "ovs_interfaceid": "33bb6ea0-983d-4a4a-960e-ca26aade5062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Found default for hw_cdrom_bus of ide {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Found default for hw_disk_bus of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Found default for hw_input_bus of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Found default for hw_pointer_model of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Found default for hw_video_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Found default for hw_vif_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:24:46 user nova-compute[95467]: INFO nova.compute.manager [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] Took 7.73 seconds to spawn the instance on the hypervisor.
Nov 15 08:24:46 user nova-compute[95467]: DEBUG nova.compute.manager [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Releasing lock "refresh_cache-218f0d21-181c-4634-b6f7-20137fe30520" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG nova.compute.manager [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 218f0d21-181c-4634-b6f7-20137fe30520] Instance network_info: |[{"id": "33bb6ea0-983d-4a4a-960e-ca26aade5062", "address": "fa:16:3e:c9:9f:d2", "network": {"id": "3bb97374-8e3e-4364-a350-dbe265332087", "bridge": "br-int", "label": "tempest-VolumesActionsTest-966132722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e179db7f977c4d98abb497c6a3b4f5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33bb6ea0-98", "ovs_interfaceid": "33bb6ea0-983d-4a4a-960e-ca26aade5062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-f8078a90-7113-47fb-99a4-99fe57779cd4 req-9867fc2d-2627-485e-9cf5-f917b5bd3d4c service nova] Acquired lock "refresh_cache-218f0d21-181c-4634-b6f7-20137fe30520" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG nova.network.neutron [req-f8078a90-7113-47fb-99a4-99fe57779cd4 req-9867fc2d-2627-485e-9cf5-f917b5bd3d4c service nova] [instance: 218f0d21-181c-4634-b6f7-20137fe30520] Refreshing network info cache for port 33bb6ea0-983d-4a4a-960e-ca26aade5062 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 218f0d21-181c-4634-b6f7-20137fe30520] Start _get_guest_xml network_info=[{"id": "33bb6ea0-983d-4a4a-960e-ca26aade5062", "address": "fa:16:3e:c9:9f:d2", "network": {"id": "3bb97374-8e3e-4364-a350-dbe265332087", "bridge": "br-int", "label": "tempest-VolumesActionsTest-966132722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e179db7f977c4d98abb497c6a3b4f5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33bb6ea0-98", "ovs_interfaceid": "33bb6ea0-983d-4a4a-960e-ca26aade5062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'ed9c48aa-ce73-4b3b-9db1-235898be671b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:24:46 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:24:46 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:24:46 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:24:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1086256702',display_name='tempest-VolumesActionsTest-instance-1086256702',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1086256702',id=43,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e179db7f977c4d98abb497c6a3b4f5e9',ramdisk_id='',reservation_id='r-r0gk7g66',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1524883282',owner_user_name='tempest-VolumesActionsTest-1524883282-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:24:45Z,user_data=None,user_id='21abcb55c48d44af8a215cdc4013a065',uuid=218f0d21-181c-4634-b6f7-20137fe30520,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33bb6ea0-983d-4a4a-960e-ca26aade5062", "address": "fa:16:3e:c9:9f:d2", "network": {"id": "3bb97374-8e3e-4364-a350-dbe265332087", "bridge": "br-int", "label": "tempest-VolumesActionsTest-966132722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e179db7f977c4d98abb497c6a3b4f5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33bb6ea0-98", "ovs_interfaceid": "33bb6ea0-983d-4a4a-960e-ca26aade5062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Converting VIF {"id": "33bb6ea0-983d-4a4a-960e-ca26aade5062", "address": "fa:16:3e:c9:9f:d2", "network": {"id": "3bb97374-8e3e-4364-a350-dbe265332087", "bridge": "br-int", "label": "tempest-VolumesActionsTest-966132722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e179db7f977c4d98abb497c6a3b4f5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33bb6ea0-98", "ovs_interfaceid": "33bb6ea0-983d-4a4a-960e-ca26aade5062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:9f:d2,bridge_name='br-int',has_traffic_filtering=True,id=33bb6ea0-983d-4a4a-960e-ca26aade5062,network=Network(3bb97374-8e3e-4364-a350-dbe265332087),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33bb6ea0-98') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG nova.objects.instance [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Lazy-loading 'pci_devices' on Instance uuid 218f0d21-181c-4634-b6f7-20137fe30520 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:24:46 user nova-compute[95467]: INFO nova.compute.manager [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Took 6.10 seconds to spawn the instance on the hypervisor.
Nov 15 08:24:46 user nova-compute[95467]: DEBUG nova.compute.manager [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 218f0d21-181c-4634-b6f7-20137fe30520] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:24:46 user nova-compute[95467]:   <uuid>218f0d21-181c-4634-b6f7-20137fe30520</uuid>
Nov 15 08:24:46 user nova-compute[95467]:   <name>instance-0000002b</name>
Nov 15 08:24:46 user nova-compute[95467]:   <memory>524288</memory>
Nov 15 08:24:46 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:24:46 user nova-compute[95467]:   <metadata>
Nov 15 08:24:46 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:24:46 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:24:46 user nova-compute[95467]:       <nova:name>tempest-VolumesActionsTest-instance-1086256702</nova:name>
Nov 15 08:24:46 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:24:46</nova:creationTime>
Nov 15 08:24:46 user nova-compute[95467]:       <nova:flavor name="m1.tiny">
Nov 15 08:24:46 user nova-compute[95467]:         <nova:memory>512</nova:memory>
Nov 15 08:24:46 user nova-compute[95467]:         <nova:disk>1</nova:disk>
Nov 15 08:24:46 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:24:46 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:24:46 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:24:46 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:24:46 user nova-compute[95467]:       <nova:owner>
Nov 15 08:24:46 user nova-compute[95467]:         <nova:user uuid="21abcb55c48d44af8a215cdc4013a065">tempest-VolumesActionsTest-1524883282-project-member</nova:user>
Nov 15 08:24:46 user nova-compute[95467]:         <nova:project uuid="e179db7f977c4d98abb497c6a3b4f5e9">tempest-VolumesActionsTest-1524883282</nova:project>
Nov 15 08:24:46 user nova-compute[95467]:       </nova:owner>
Nov 15 08:24:46 user nova-compute[95467]:       <nova:root type="image" uuid="ed9c48aa-ce73-4b3b-9db1-235898be671b"/>
Nov 15 08:24:46 user nova-compute[95467]:       <nova:ports>
Nov 15 08:24:46 user nova-compute[95467]:         <nova:port uuid="33bb6ea0-983d-4a4a-960e-ca26aade5062">
Nov 15 08:24:46 user nova-compute[95467]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 08:24:46 user nova-compute[95467]:         </nova:port>
Nov 15 08:24:46 user nova-compute[95467]:       </nova:ports>
Nov 15 08:24:46 user nova-compute[95467]:     </nova:instance>
Nov 15 08:24:46 user nova-compute[95467]:   </metadata>
Nov 15 08:24:46 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:24:46 user nova-compute[95467]:     <system>
Nov 15 08:24:46 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:24:46 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:24:46 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:24:46 user nova-compute[95467]:       <entry name="serial">218f0d21-181c-4634-b6f7-20137fe30520</entry>
Nov 15 08:24:46 user nova-compute[95467]:       <entry name="uuid">218f0d21-181c-4634-b6f7-20137fe30520</entry>
Nov 15 08:24:46 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:24:46 user nova-compute[95467]:     </system>
Nov 15 08:24:46 user nova-compute[95467]:   </sysinfo>
Nov 15 08:24:46 user nova-compute[95467]:   <os>
Nov 15 08:24:46 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:24:46 user nova-compute[95467]:     <boot dev="hd"/>
Nov 15 08:24:46 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:24:46 user nova-compute[95467]:   </os>
Nov 15 08:24:46 user nova-compute[95467]:   <features>
Nov 15 08:24:46 user nova-compute[95467]:     <acpi/>
Nov 15 08:24:46 user nova-compute[95467]:     <apic/>
Nov 15 08:24:46 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:24:46 user nova-compute[95467]:   </features>
Nov 15 08:24:46 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:24:46 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:24:46 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:24:46 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:24:46 user nova-compute[95467]:   </clock>
Nov 15 08:24:46 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:24:46 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:24:46 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:24:46 user nova-compute[95467]:   </cpu>
Nov 15 08:24:46 user nova-compute[95467]:   <devices>
Nov 15 08:24:46 user nova-compute[95467]:     <disk type="file" device="disk">
Nov 15 08:24:46 user nova-compute[95467]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 08:24:46 user nova-compute[95467]:       <source file="/opt/stack/data/nova/instances/218f0d21-181c-4634-b6f7-20137fe30520/disk"/>
Nov 15 08:24:46 user nova-compute[95467]:       <target dev="vda" bus="virtio"/>
Nov 15 08:24:46 user nova-compute[95467]:     </disk>
Nov 15 08:24:46 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:24:46 user nova-compute[95467]:       <mac address="fa:16:3e:c9:9f:d2"/>
Nov 15 08:24:46 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:24:46 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:24:46 user nova-compute[95467]:       <target dev="tap33bb6ea0-98"/>
Nov 15 08:24:46 user nova-compute[95467]:     </interface>
Nov 15 08:24:46 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:24:46 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/218f0d21-181c-4634-b6f7-20137fe30520/console.log" append="off"/>
Nov 15 08:24:46 user nova-compute[95467]:     </serial>
Nov 15 08:24:46 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:24:46 user nova-compute[95467]:     <video>
Nov 15 08:24:46 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:24:46 user nova-compute[95467]:     </video>
Nov 15 08:24:46 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:24:46 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:24:46 user nova-compute[95467]:     </rng>
Nov 15 08:24:46 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:24:46 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:24:46 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:24:46 user nova-compute[95467]:     </memballoon>
Nov 15 08:24:46 user nova-compute[95467]:   </devices>
Nov 15 08:24:46 user nova-compute[95467]: </domain>
Nov 15 08:24:46 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:24:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1086256702',display_name='tempest-VolumesActionsTest-instance-1086256702',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1086256702',id=43,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e179db7f977c4d98abb497c6a3b4f5e9',ramdisk_id='',reservation_id='r-r0gk7g66',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1524883282',owner_user_name='tempest-VolumesActionsTest-1524883282-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:24:45Z,user_data=None,user_id='21abcb55c48d44af8a215cdc4013a065',uuid=218f0d21-181c-4634-b6f7-20137fe30520,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33bb6ea0-983d-4a4a-960e-ca26aade5062", "address": "fa:16:3e:c9:9f:d2", "network": {"id": "3bb97374-8e3e-4364-a350-dbe265332087", "bridge": "br-int", "label": "tempest-VolumesActionsTest-966132722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e179db7f977c4d98abb497c6a3b4f5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33bb6ea0-98", "ovs_interfaceid": "33bb6ea0-983d-4a4a-960e-ca26aade5062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Converting VIF {"id": "33bb6ea0-983d-4a4a-960e-ca26aade5062", "address": "fa:16:3e:c9:9f:d2", "network": {"id": "3bb97374-8e3e-4364-a350-dbe265332087", "bridge": "br-int", "label": "tempest-VolumesActionsTest-966132722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e179db7f977c4d98abb497c6a3b4f5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33bb6ea0-98", "ovs_interfaceid": "33bb6ea0-983d-4a4a-960e-ca26aade5062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:9f:d2,bridge_name='br-int',has_traffic_filtering=True,id=33bb6ea0-983d-4a4a-960e-ca26aade5062,network=Network(3bb97374-8e3e-4364-a350-dbe265332087),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33bb6ea0-98') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG os_vif [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:9f:d2,bridge_name='br-int',has_traffic_filtering=True,id=33bb6ea0-983d-4a4a-960e-ca26aade5062,network=Network(3bb97374-8e3e-4364-a350-dbe265332087),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33bb6ea0-98') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:24:46 user nova-compute[95467]: INFO nova.compute.manager [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] Took 8.73 seconds to build instance.
Nov 15 08:24:46 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '670662a7-babf-56fc-9a3f-028c3ba312a8', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap33bb6ea0-98, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap33bb6ea0-98, col_values=(('qos', UUID('9e4ade4f-067c-49eb-b8d3-932f78606fbd')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap33bb6ea0-98, col_values=(('external_ids', {'iface-id': '33bb6ea0-983d-4a4a-960e-ca26aade5062', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:9f:d2', 'vm-uuid': '218f0d21-181c-4634-b6f7-20137fe30520'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a72431c8-ed45-487d-be08-e8fcf1a13529 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Lock "7f14502f-8c4d-400a-a68a-f3f9c3d48524" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.849s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:46 user nova-compute[95467]: INFO os_vif [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:9f:d2,bridge_name='br-int',has_traffic_filtering=True,id=33bb6ea0-983d-4a4a-960e-ca26aade5062,network=Network(3bb97374-8e3e-4364-a350-dbe265332087),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33bb6ea0-98')
Nov 15 08:24:46 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] No VIF found with MAC fa:16:3e:c9:9f:d2, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager.update_available_resource {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:24:46 user nova-compute[95467]: INFO nova.compute.manager [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Took 17.58 seconds to build instance.
Nov 15 08:24:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-462e2e9e-9739-421b-a7ad-c21d91fb0b8b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "ba05c01d-ae74-467c-a309-4d0ba904453d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.670s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Auditing locally available compute resources for user (node: user) {{(pid=95467) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG nova.network.neutron [req-f8078a90-7113-47fb-99a4-99fe57779cd4 req-9867fc2d-2627-485e-9cf5-f917b5bd3d4c service nova] [instance: 218f0d21-181c-4634-b6f7-20137fe30520] Updated VIF entry in instance network info cache for port 33bb6ea0-983d-4a4a-960e-ca26aade5062. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG nova.network.neutron [req-f8078a90-7113-47fb-99a4-99fe57779cd4 req-9867fc2d-2627-485e-9cf5-f917b5bd3d4c service nova] [instance: 218f0d21-181c-4634-b6f7-20137fe30520] Updating instance_info_cache with network_info: [{"id": "33bb6ea0-983d-4a4a-960e-ca26aade5062", "address": "fa:16:3e:c9:9f:d2", "network": {"id": "3bb97374-8e3e-4364-a350-dbe265332087", "bridge": "br-int", "label": "tempest-VolumesActionsTest-966132722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e179db7f977c4d98abb497c6a3b4f5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33bb6ea0-98", "ovs_interfaceid": "33bb6ea0-983d-4a4a-960e-ca26aade5062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:24:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-f8078a90-7113-47fb-99a4-99fe57779cd4 req-9867fc2d-2627-485e-9cf5-f917b5bd3d4c service nova] Releasing lock "refresh_cache-218f0d21-181c-4634-b6f7-20137fe30520" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:24:47 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:47 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:48 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:48 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:48 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:48 user nova-compute[95467]: DEBUG nova.compute.manager [req-86387de1-2e39-4f3f-a885-c35f4bce7470 req-cd69c102-20e8-47df-8322-58f2fa82bc2d service nova] [instance: 218f0d21-181c-4634-b6f7-20137fe30520] Received event network-vif-plugged-33bb6ea0-983d-4a4a-960e-ca26aade5062 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:24:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-86387de1-2e39-4f3f-a885-c35f4bce7470 req-cd69c102-20e8-47df-8322-58f2fa82bc2d service nova] Acquiring lock "218f0d21-181c-4634-b6f7-20137fe30520-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:24:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-86387de1-2e39-4f3f-a885-c35f4bce7470 req-cd69c102-20e8-47df-8322-58f2fa82bc2d service nova] Lock "218f0d21-181c-4634-b6f7-20137fe30520-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:24:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-86387de1-2e39-4f3f-a885-c35f4bce7470 req-cd69c102-20e8-47df-8322-58f2fa82bc2d service nova] Lock "218f0d21-181c-4634-b6f7-20137fe30520-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:24:48 user nova-compute[95467]: DEBUG nova.compute.manager [req-86387de1-2e39-4f3f-a885-c35f4bce7470 req-cd69c102-20e8-47df-8322-58f2fa82bc2d service nova] [instance: 218f0d21-181c-4634-b6f7-20137fe30520] No waiting events found dispatching network-vif-plugged-33bb6ea0-983d-4a4a-960e-ca26aade5062 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:24:48 user nova-compute[95467]: WARNING nova.compute.manager [req-86387de1-2e39-4f3f-a885-c35f4bce7470 req-cd69c102-20e8-47df-8322-58f2fa82bc2d service nova] [instance: 218f0d21-181c-4634-b6f7-20137fe30520] Received unexpected event network-vif-plugged-33bb6ea0-983d-4a4a-960e-ca26aade5062 for instance with vm_state building and task_state spawning.
Nov 15 08:24:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:48 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:48 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:48 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:49 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:24:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a155e6-0ee2-4728-a526-17c149107ab0/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a155e6-0ee2-4728-a526-17c149107ab0/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a155e6-0ee2-4728-a526-17c149107ab0/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a155e6-0ee2-4728-a526-17c149107ab0/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/218f0d21-181c-4634-b6f7-20137fe30520/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/218f0d21-181c-4634-b6f7-20137fe30520/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/218f0d21-181c-4634-b6f7-20137fe30520/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:50 user nova-compute[95467]: DEBUG nova.compute.manager [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 218f0d21-181c-4634-b6f7-20137fe30520] Instance event wait completed in 0 seconds for  {{(pid=95467) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 08:24:50 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 218f0d21-181c-4634-b6f7-20137fe30520] Guest created on hypervisor {{(pid=95467) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 08:24:50 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 218f0d21-181c-4634-b6f7-20137fe30520] Instance spawned successfully.
Nov 15 08:24:50 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 218f0d21-181c-4634-b6f7-20137fe30520] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 08:24:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/218f0d21-181c-4634-b6f7-20137fe30520/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/739645e6-9952-40db-a876-f23d02d4e411/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:50 user nova-compute[95467]: DEBUG nova.compute.manager [req-9ab6c26a-3cde-4b4f-b301-e19115fda590 req-d368a171-ef39-41b5-a3ad-de49b394e63b service nova] [instance: 218f0d21-181c-4634-b6f7-20137fe30520] Received event network-vif-plugged-33bb6ea0-983d-4a4a-960e-ca26aade5062 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:24:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-9ab6c26a-3cde-4b4f-b301-e19115fda590 req-d368a171-ef39-41b5-a3ad-de49b394e63b service nova] Acquiring lock "218f0d21-181c-4634-b6f7-20137fe30520-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:24:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-9ab6c26a-3cde-4b4f-b301-e19115fda590 req-d368a171-ef39-41b5-a3ad-de49b394e63b service nova] Lock "218f0d21-181c-4634-b6f7-20137fe30520-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:24:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-9ab6c26a-3cde-4b4f-b301-e19115fda590 req-d368a171-ef39-41b5-a3ad-de49b394e63b service nova] Lock "218f0d21-181c-4634-b6f7-20137fe30520-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:24:50 user nova-compute[95467]: DEBUG nova.compute.manager [req-9ab6c26a-3cde-4b4f-b301-e19115fda590 req-d368a171-ef39-41b5-a3ad-de49b394e63b service nova] [instance: 218f0d21-181c-4634-b6f7-20137fe30520] No waiting events found dispatching network-vif-plugged-33bb6ea0-983d-4a4a-960e-ca26aade5062 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:24:50 user nova-compute[95467]: WARNING nova.compute.manager [req-9ab6c26a-3cde-4b4f-b301-e19115fda590 req-d368a171-ef39-41b5-a3ad-de49b394e63b service nova] [instance: 218f0d21-181c-4634-b6f7-20137fe30520] Received unexpected event network-vif-plugged-33bb6ea0-983d-4a4a-960e-ca26aade5062 for instance with vm_state building and task_state spawning.
Nov 15 08:24:50 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 218f0d21-181c-4634-b6f7-20137fe30520] Found default for hw_cdrom_bus of ide {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:24:50 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 218f0d21-181c-4634-b6f7-20137fe30520] Found default for hw_disk_bus of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:24:50 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 218f0d21-181c-4634-b6f7-20137fe30520] Found default for hw_input_bus of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:24:50 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 218f0d21-181c-4634-b6f7-20137fe30520] Found default for hw_pointer_model of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:24:50 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 218f0d21-181c-4634-b6f7-20137fe30520] Found default for hw_video_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:24:50 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 218f0d21-181c-4634-b6f7-20137fe30520] Found default for hw_vif_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:24:50 user nova-compute[95467]: INFO nova.compute.manager [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 218f0d21-181c-4634-b6f7-20137fe30520] Took 5.92 seconds to spawn the instance on the hypervisor.
Nov 15 08:24:50 user nova-compute[95467]: DEBUG nova.compute.manager [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 218f0d21-181c-4634-b6f7-20137fe30520] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:24:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/739645e6-9952-40db-a876-f23d02d4e411/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/739645e6-9952-40db-a876-f23d02d4e411/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:50 user nova-compute[95467]: INFO nova.compute.manager [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 218f0d21-181c-4634-b6f7-20137fe30520] Took 7.00 seconds to build instance.
Nov 15 08:24:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-533d16de-1ade-4a82-a62a-3bed86a6443c tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Lock "218f0d21-181c-4634-b6f7-20137fe30520" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.120s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:24:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/739645e6-9952-40db-a876-f23d02d4e411/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091612cf-b737-480b-984e-a05b522676b6/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091612cf-b737-480b-984e-a05b522676b6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091612cf-b737-480b-984e-a05b522676b6/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091612cf-b737-480b-984e-a05b522676b6/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:51 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f14502f-8c4d-400a-a68a-f3f9c3d48524/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f14502f-8c4d-400a-a68a-f3f9c3d48524/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f14502f-8c4d-400a-a68a-f3f9c3d48524/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f14502f-8c4d-400a-a68a-f3f9c3d48524/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:52 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:24:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/843b778c-f823-4bee-aa76-ab44345be9a7/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/843b778c-f823-4bee-aa76-ab44345be9a7/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/843b778c-f823-4bee-aa76-ab44345be9a7/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/843b778c-f823-4bee-aa76-ab44345be9a7/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk.rescue --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:52 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk.rescue --force-share --output=json" returned: 0 in 0.227s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk.rescue --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk.rescue --force-share --output=json" returned: 0 in 0.241s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d22eb02b-7e8d-4755-9f1e-3eee56ddec0c/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d22eb02b-7e8d-4755-9f1e-3eee56ddec0c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d22eb02b-7e8d-4755-9f1e-3eee56ddec0c/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d22eb02b-7e8d-4755-9f1e-3eee56ddec0c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:53 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:24:53 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:24:54 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:24:54 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:24:54 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Hypervisor/Node resource view: name=user free_ram=7091MB free_disk=24.98006820678711GB free_vcpus=-3 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=95467) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 08:24:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:24:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:24:54 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Applying migration context for instance a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80 as it has an incoming, in-progress migration 8fe2f3a2-0317-41fd-bdca-8be49a9a3d90. Migration status is finished {{(pid=95467) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 15 08:24:54 user nova-compute[95467]: INFO nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Updating resource usage from migration 8fe2f3a2-0317-41fd-bdca-8be49a9a3d90
Nov 15 08:24:54 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 73fe8852-c47a-47ab-a56f-6864c8ed5479 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:24:54 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 21cf2ada-b15c-490d-ac37-96e9c87e9056 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:24:54 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:24:54 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 10d73b73-ca65-4192-8954-288dc1df9f24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:24:54 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 3825a691-ac5c-4c06-b4a4-2a0b40c638c4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:24:54 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance a1a155e6-0ee2-4728-a526-17c149107ab0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:24:54 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 091612cf-b737-480b-984e-a05b522676b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:24:54 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance d22eb02b-7e8d-4755-9f1e-3eee56ddec0c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:24:54 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Migration 8fe2f3a2-0317-41fd-bdca-8be49a9a3d90 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 15 08:24:54 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:24:54 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 843b778c-f823-4bee-aa76-ab44345be9a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:24:54 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 739645e6-9952-40db-a876-f23d02d4e411 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:24:54 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:24:54 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance ba05c01d-ae74-467c-a309-4d0ba904453d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:24:54 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 7f14502f-8c4d-400a-a68a-f3f9c3d48524 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:24:54 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 218f0d21-181c-4634-b6f7-20137fe30520 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:24:54 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Total usable vcpus: 12, total allocated vcpus: 16 {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 08:24:54 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Final resource view: name=user phys_ram=16011MB used_ram=10240MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=16 pci_stats=[] {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 08:24:54 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:24:55 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:24:55 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Compute_service record updated for user:user {{(pid=95467) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 08:24:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.664s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:24:56 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:24:56 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:24:56 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Starting heal instance info cache {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 08:24:56 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Didn't find any instances for network info cache update. {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 08:24:56 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:24:56 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:24:56 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:24:56 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:24:56 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:24:56 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:24:56 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=95467) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 08:24:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f33a1ea2-3162-48f7-a021-1a5af40cd2a6 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Acquiring lock "a1a155e6-0ee2-4728-a526-17c149107ab0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:24:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f33a1ea2-3162-48f7-a021-1a5af40cd2a6 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lock "a1a155e6-0ee2-4728-a526-17c149107ab0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:24:56 user nova-compute[95467]: DEBUG nova.objects.instance [None req-f33a1ea2-3162-48f7-a021-1a5af40cd2a6 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lazy-loading 'flavor' on Instance uuid a1a155e6-0ee2-4728-a526-17c149107ab0 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:24:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f33a1ea2-3162-48f7-a021-1a5af40cd2a6 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lock "a1a155e6-0ee2-4728-a526-17c149107ab0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:24:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f33a1ea2-3162-48f7-a021-1a5af40cd2a6 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Acquiring lock "a1a155e6-0ee2-4728-a526-17c149107ab0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:24:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f33a1ea2-3162-48f7-a021-1a5af40cd2a6 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lock "a1a155e6-0ee2-4728-a526-17c149107ab0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:24:56 user nova-compute[95467]: INFO nova.compute.manager [None req-f33a1ea2-3162-48f7-a021-1a5af40cd2a6 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Attaching volume b47b2007-2b9e-4a27-a6b0-696d5145e34d to /dev/vdb
Nov 15 08:24:56 user nova-compute[95467]: DEBUG os_brick.utils [None req-f33a1ea2-3162-48f7-a021-1a5af40cd2a6 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:24:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:24:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:56 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[830d8657-d05e-454a-b073-91fc40449e68]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:882ae90641f\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:24:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:56 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e08ca56-1609-48b6-bfff-a7e917f0518f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:24:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:24:56 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b97c5bb-c977-401f-a29c-13da439264bd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:24:56 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d5b800-2533-4bdf-8ff9-8afc3e98dfe3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:24:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-f33a1ea2-3162-48f7-a021-1a5af40cd2a6 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Running cmd (subprocess): nvme version {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-f33a1ea2-3162-48f7-a021-1a5af40cd2a6 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] 'nvme version' failed. Not Retrying. {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:24:56 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f33a1ea2-3162-48f7-a021-1a5af40cd2a6 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] nvme not present on system {{(pid=95467) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 08:24:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:24:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:24:56 user nova-compute[95467]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 08:24:56 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b13a1e-7c41-4e95-bb6f-4a8a11ebb3da]: (4, '') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:24:56 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-f33a1ea2-3162-48f7-a021-1a5af40cd2a6 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=95467) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 08:24:56 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-f33a1ea2-3162-48f7-a021-1a5af40cd2a6 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 08:24:56 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-f33a1ea2-3162-48f7-a021-1a5af40cd2a6 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] LIGHTOS: no hostnqn found. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 08:24:56 user nova-compute[95467]: DEBUG os_brick.utils [None req-f33a1ea2-3162-48f7-a021-1a5af40cd2a6 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:882ae90641f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:24:56 user nova-compute[95467]: DEBUG nova.virt.block_device [None req-f33a1ea2-3162-48f7-a021-1a5af40cd2a6 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Updating existing volume attachment record: 55adaa38-1095-4a66-b3bc-dc26969758d9 {{(pid=95467) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 08:24:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-84efdca2-1c05-41d3-bf69-c63a21548e67 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Acquiring lock "a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:25:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-84efdca2-1c05-41d3-bf69-c63a21548e67 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:25:01 user nova-compute[95467]: DEBUG nova.compute.manager [None req-84efdca2-1c05-41d3-bf69-c63a21548e67 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Going to confirm migration 1 {{(pid=95467) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 15 08:25:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-84efdca2-1c05-41d3-bf69-c63a21548e67 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Acquiring lock "refresh_cache-a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:25:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-84efdca2-1c05-41d3-bf69-c63a21548e67 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Acquired lock "refresh_cache-a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:25:01 user nova-compute[95467]: DEBUG nova.network.neutron [None req-84efdca2-1c05-41d3-bf69-c63a21548e67 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:25:01 user nova-compute[95467]: DEBUG nova.objects.instance [None req-84efdca2-1c05-41d3-bf69-c63a21548e67 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lazy-loading 'info_cache' on Instance uuid a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:25:01 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:01 user nova-compute[95467]: DEBUG nova.network.neutron [None req-84efdca2-1c05-41d3-bf69-c63a21548e67 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Updating instance_info_cache with network_info: [{"id": "cb099600-0c5c-4e0d-adfe-91a6ba3e0f08", "address": "fa:16:3e:1d:28:85", "network": {"id": "d8a362dc-0dc8-49dd-b2da-0e0749d5edca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-256373617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a1aa4f562c64545a94157d4aaf8d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb099600-0c", "ovs_interfaceid": "cb099600-0c5c-4e0d-adfe-91a6ba3e0f08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:25:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-84efdca2-1c05-41d3-bf69-c63a21548e67 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Releasing lock "refresh_cache-a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:25:01 user nova-compute[95467]: DEBUG nova.objects.instance [None req-84efdca2-1c05-41d3-bf69-c63a21548e67 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lazy-loading 'migration_context' on Instance uuid a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:25:01 user nova-compute[95467]: DEBUG nova.objects.base [None req-84efdca2-1c05-41d3-bf69-c63a21548e67 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Object Instance<a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80> lazy-loaded attributes: info_cache,migration_context {{(pid=95467) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 08:25:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-84efdca2-1c05-41d3-bf69-c63a21548e67 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:25:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-84efdca2-1c05-41d3-bf69-c63a21548e67 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:25:02 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-84efdca2-1c05-41d3-bf69-c63a21548e67 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:25:02 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-84efdca2-1c05-41d3-bf69-c63a21548e67 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:25:03 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-84efdca2-1c05-41d3-bf69-c63a21548e67 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 1.102s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:25:03 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f33a1ea2-3162-48f7-a021-1a5af40cd2a6 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Calling os-brick to attach iSCSI Volume {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 08:25:03 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33a1ea2-3162-48f7-a021-1a5af40cd2a6 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b47b2007-2b9e-4a27-a6b0-696d5145e34d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TxSDHvWb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:25:03 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-f33a1ea2-3162-48f7-a021-1a5af40cd2a6 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:25:03 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-f33a1ea2-3162-48f7-a021-1a5af40cd2a6 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:25:03 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-f33a1ea2-3162-48f7-a021-1a5af40cd2a6 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:25:03 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-f33a1ea2-3162-48f7-a021-1a5af40cd2a6 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:25:03 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-f33a1ea2-3162-48f7-a021-1a5af40cd2a6 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b47b2007-2b9e-4a27-a6b0-696d5145e34d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:25:03 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-f33a1ea2-3162-48f7-a021-1a5af40cd2a6 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b47b2007-2b9e-4a27-a6b0-696d5145e34d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:25:03 user nova-compute[95467]: INFO os_brick.initiator.connectors.iscsi [None req-f33a1ea2-3162-48f7-a021-1a5af40cd2a6 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 08:25:03 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b47b2007-2b9e-4a27-a6b0-696d5145e34d -p 172.16.0.220:3260 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:03 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b47b2007-2b9e-4a27-a6b0-696d5145e34d -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:03 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb57569-535c-494c-b167-58133c5ccddb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:03 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33a1ea2-3162-48f7-a021-1a5af40cd2a6 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 08:25:03 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:25:03 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b47b2007-2b9e-4a27-a6b0-696d5145e34d -p 172.16.0.220:3260 --interface default --op new {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:03 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b47b2007-2b9e-4a27-a6b0-696d5145e34d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:03 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[6474d26d-703a-41d5-b57b-6572e8a86da3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b47b2007-2b9e-4a27-a6b0-696d5145e34d] added\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:03 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33a1ea2-3162-48f7-a021-1a5af40cd2a6 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b47b2007-2b9e-4a27-a6b0-696d5145e34d] added
Nov 15 08:25:03 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:25:03 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b47b2007-2b9e-4a27-a6b0-696d5145e34d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:03 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b47b2007-2b9e-4a27-a6b0-696d5145e34d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:03 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[16fea3af-a23a-4ea2-95fd-7021d95f3bf3]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:03 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33a1ea2-3162-48f7-a021-1a5af40cd2a6 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:25:03 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b47b2007-2b9e-4a27-a6b0-696d5145e34d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:03 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b47b2007-2b9e-4a27-a6b0-696d5145e34d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:03 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0566ae2-bcec-4d37-ae18-f625f370dca1]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:03 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33a1ea2-3162-48f7-a021-1a5af40cd2a6 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:25:03 user nova-compute[95467]: INFO nova.scheduler.client.report [None req-84efdca2-1c05-41d3-bf69-c63a21548e67 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Deleted allocation for migration 8fe2f3a2-0317-41fd-bdca-8be49a9a3d90
Nov 15 08:25:03 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b47b2007-2b9e-4a27-a6b0-696d5145e34d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TxSDHvWb {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:03 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b47b2007-2b9e-4a27-a6b0-696d5145e34d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TxSDHvWb" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:03 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc7dc25-50cf-4b38-a94f-d0462cb8df7c]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:03 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33a1ea2-3162-48f7-a021-1a5af40cd2a6 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TxSDHvWb'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:25:03 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b47b2007-2b9e-4a27-a6b0-696d5145e34d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:03 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b47b2007-2b9e-4a27-a6b0-696d5145e34d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:03 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd81bf6-82aa-4daa-86b0-58ecbcfbbbc4]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:03 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33a1ea2-3162-48f7-a021-1a5af40cd2a6 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:25:03 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:03 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-84efdca2-1c05-41d3-bf69-c63a21548e67 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 2.514s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:25:03 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:03 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee09947-d9cf-4f46-8a5f-afecb1c4efd9]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:03 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33a1ea2-3162-48f7-a021-1a5af40cd2a6 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:25:03 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:25:03 user nova-compute[95467]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:25:03 user nova-compute[95467]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)
Nov 15 08:25:03 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:25:03 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33a1ea2-3162-48f7-a021-1a5af40cd2a6 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:25:03 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:25:03 user nova-compute[95467]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:25:03 user nova-compute[95467]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)
Nov 15 08:25:03 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:25:03 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b47b2007-2b9e-4a27-a6b0-696d5145e34d -p 172.16.0.220:3260 --login {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:03 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b47b2007-2b9e-4a27-a6b0-696d5145e34d -p 172.16.0.220:3260 --login" returned: 0 in 0.243s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:03 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e63ad83-f667-4243-868b-c3c1d1e4cadc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b47b2007-2b9e-4a27-a6b0-696d5145e34d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b47b2007-2b9e-4a27-a6b0-696d5145e34d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:03 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33a1ea2-3162-48f7-a021-1a5af40cd2a6 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b47b2007-2b9e-4a27-a6b0-696d5145e34d, portal: 172.16.0.220,3260]
Nov 15 08:25:03 user nova-compute[95467]: Login to [iface: default, target: iqn.2010-10.org.openstack:b47b2007-2b9e-4a27-a6b0-696d5145e34d, portal: 172.16.0.220,3260] successful.
Nov 15 08:25:03 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:25:03 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b47b2007-2b9e-4a27-a6b0-696d5145e34d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b47b2007-2b9e-4a27-a6b0-696d5145e34d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:04 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f2ab5a-5f1a-4718-b26e-d3d7209bf525]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:04 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33a1ea2-3162-48f7-a021-1a5af40cd2a6 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:25:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:04 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[935e92d2-a429-464d-9ef2-9d7837be97e6]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b47b2007-2b9e-4a27-a6b0-696d5145e34d (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:04 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33a1ea2-3162-48f7-a021-1a5af40cd2a6 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:25:04 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:25:04 user nova-compute[95467]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:25:04 user nova-compute[95467]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)
Nov 15 08:25:04 user nova-compute[95467]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b47b2007-2b9e-4a27-a6b0-696d5145e34d (non-flash)
Nov 15 08:25:04 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:25:04 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33a1ea2-3162-48f7-a021-1a5af40cd2a6 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:25:04 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:25:04 user nova-compute[95467]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:25:04 user nova-compute[95467]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)
Nov 15 08:25:04 user nova-compute[95467]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b47b2007-2b9e-4a27-a6b0-696d5145e34d (non-flash)
Nov 15 08:25:04 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:25:04 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-f33a1ea2-3162-48f7-a021-1a5af40cd2a6 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b47b2007-2b9e-4a27-a6b0-696d5145e34d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.500s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:25:04 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33a1ea2-3162-48f7-a021-1a5af40cd2a6 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Connected to 172.16.0.220:3260 {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 08:25:04 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-f33a1ea2-3162-48f7-a021-1a5af40cd2a6 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] HCTL ('36', '-', '-', 0) found on session 42 with lun 0 {{(pid=95467) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 08:25:04 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-f33a1ea2-3162-48f7-a021-1a5af40cd2a6 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=95467) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 08:25:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:04 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0cd088-cde0-47b3-bfa9-3c17e360d2c6]: (4, ('- - 0', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:04 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-f33a1ea2-3162-48f7-a021-1a5af40cd2a6 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Searching for a device in session 42 and hctl ['36', '*', '*', 0] yield: sde {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:25:04 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33a1ea2-3162-48f7-a021-1a5af40cd2a6 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:b47b2007-2b9e-4a27-a6b0-696d5145e34d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TxSDHvWb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 08:25:05 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-f33a1ea2-3162-48f7-a021-1a5af40cd2a6 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.532s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:25:05 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33a1ea2-3162-48f7-a021-1a5af40cd2a6 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] <== connect_volume: return (1534ms) {'type': 'block', 'scsi_wwn': '23831366534373132', 'path': '/dev/sde'} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:25:05 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f33a1ea2-3162-48f7-a021-1a5af40cd2a6 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831366534373132', 'path': '/dev/sde'} {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 08:25:05 user nova-compute[95467]: DEBUG nova.objects.instance [None req-f33a1ea2-3162-48f7-a021-1a5af40cd2a6 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lazy-loading 'flavor' on Instance uuid a1a155e6-0ee2-4728-a526-17c149107ab0 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:25:05 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-f33a1ea2-3162-48f7-a021-1a5af40cd2a6 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 08:25:05 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:25:05 user nova-compute[95467]:   <source dev="/dev/sde"/>
Nov 15 08:25:05 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:25:05 user nova-compute[95467]:   <serial>b47b2007-2b9e-4a27-a6b0-696d5145e34d</serial>
Nov 15 08:25:05 user nova-compute[95467]: </disk>
Nov 15 08:25:05 user nova-compute[95467]:  {{(pid=95467) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 08:25:05 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-f33a1ea2-3162-48f7-a021-1a5af40cd2a6 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:25:05 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-f33a1ea2-3162-48f7-a021-1a5af40cd2a6 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] No BDM found with device name vdb, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:25:05 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-f33a1ea2-3162-48f7-a021-1a5af40cd2a6 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] No VIF found with MAC fa:16:3e:83:dc:7a, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:25:05 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f33a1ea2-3162-48f7-a021-1a5af40cd2a6 tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lock "a1a155e6-0ee2-4728-a526-17c149107ab0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.279s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:25:06 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:07 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:08 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-88290b21-dc31-415c-92e9-a154e53a459f tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Acquiring lock "a1a155e6-0ee2-4728-a526-17c149107ab0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:25:08 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-88290b21-dc31-415c-92e9-a154e53a459f tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lock "a1a155e6-0ee2-4728-a526-17c149107ab0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:25:08 user nova-compute[95467]: INFO nova.compute.manager [None req-88290b21-dc31-415c-92e9-a154e53a459f tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Detaching volume b47b2007-2b9e-4a27-a6b0-696d5145e34d
Nov 15 08:25:08 user nova-compute[95467]: INFO nova.virt.block_device [None req-88290b21-dc31-415c-92e9-a154e53a459f tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Attempting to driver detach volume b47b2007-2b9e-4a27-a6b0-696d5145e34d from mountpoint /dev/vdb
Nov 15 08:25:08 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-88290b21-dc31-415c-92e9-a154e53a459f tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Attempting to detach device vdb from instance a1a155e6-0ee2-4728-a526-17c149107ab0 from the persistent domain config. {{(pid=95467) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 08:25:08 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-88290b21-dc31-415c-92e9-a154e53a459f tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 08:25:08 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:25:08 user nova-compute[95467]:   <source dev="/dev/sde"/>
Nov 15 08:25:08 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:25:08 user nova-compute[95467]:   <serial>b47b2007-2b9e-4a27-a6b0-696d5145e34d</serial>
Nov 15 08:25:08 user nova-compute[95467]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 08:25:08 user nova-compute[95467]: </disk>
Nov 15 08:25:08 user nova-compute[95467]:  {{(pid=95467) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 08:25:08 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-88290b21-dc31-415c-92e9-a154e53a459f tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Successfully detached device vdb from instance a1a155e6-0ee2-4728-a526-17c149107ab0 from the persistent domain config.
Nov 15 08:25:08 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-88290b21-dc31-415c-92e9-a154e53a459f tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a1a155e6-0ee2-4728-a526-17c149107ab0 from the live domain config. {{(pid=95467) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 08:25:08 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-88290b21-dc31-415c-92e9-a154e53a459f tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 08:25:08 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:25:08 user nova-compute[95467]:   <source dev="/dev/sde"/>
Nov 15 08:25:08 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:25:08 user nova-compute[95467]:   <serial>b47b2007-2b9e-4a27-a6b0-696d5145e34d</serial>
Nov 15 08:25:08 user nova-compute[95467]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 08:25:08 user nova-compute[95467]: </disk>
Nov 15 08:25:08 user nova-compute[95467]:  {{(pid=95467) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 08:25:08 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-88290b21-dc31-415c-92e9-a154e53a459f tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a1a155e6-0ee2-4728-a526-17c149107ab0 {{(pid=95467) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 08:25:09 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Acquiring lock "7eb1f0ce-72bd-4015-993c-a32404f15481" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:25:09 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "7eb1f0ce-72bd-4015-993c-a32404f15481" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:25:09 user nova-compute[95467]: DEBUG nova.compute.manager [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Starting instance... {{(pid=95467) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 08:25:09 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:25:09 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:25:09 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=95467) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 08:25:09 user nova-compute[95467]: INFO nova.compute.claims [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Claim successful on node user
Nov 15 08:25:09 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:25:09 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:25:10 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.488s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:25:10 user nova-compute[95467]: DEBUG nova.compute.manager [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Start building networks asynchronously for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 08:25:10 user nova-compute[95467]: DEBUG nova.compute.manager [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Allocating IP information in the background. {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 08:25:10 user nova-compute[95467]: DEBUG nova.network.neutron [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] allocate_for_instance() {{(pid=95467) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 08:25:10 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 08:25:10 user nova-compute[95467]: DEBUG nova.compute.manager [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Start building block device mappings for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 08:25:10 user nova-compute[95467]: DEBUG nova.policy [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '11bbbd3ef322402cb5dc60455a54319b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7791bd92c7c488aa72474ecde2e1155', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95467) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 08:25:10 user nova-compute[95467]: INFO nova.virt.block_device [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Booting with volume 56e4d788-8159-47c4-bbea-a4b90cb6170b at /dev/vda
Nov 15 08:25:10 user nova-compute[95467]: DEBUG os_brick.utils [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:25:10 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:10 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:10 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[356e6cd0-7f69-4a8a-807c-a8d645e03465]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:882ae90641f\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:10 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:10 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:10 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f144bd-c1d7-46c4-a61b-237d81267752]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:10 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:10 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:10 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0635fb2-0728-40c8-b070-88b9213b2e64]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:10 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[5266f575-e923-4d43-8241-7694bea73dda]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:10 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Running cmd (subprocess): nvme version {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:10 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] 'nvme version' failed. Not Retrying. {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:25:10 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] nvme not present on system {{(pid=95467) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 08:25:10 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:10 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:25:10 user nova-compute[95467]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 08:25:10 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[32255ae5-2b08-46de-9f78-4f9c65f80b1f]: (4, '') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:10 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=95467) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 08:25:10 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 08:25:10 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] LIGHTOS: no hostnqn found. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 08:25:10 user nova-compute[95467]: DEBUG os_brick.utils [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:882ae90641f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:25:10 user nova-compute[95467]: DEBUG nova.virt.block_device [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Updating existing volume attachment record: 7c4b8e33-021c-43f2-8730-4acc44580f54 {{(pid=95467) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 08:25:10 user nova-compute[95467]: DEBUG nova.network.neutron [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Successfully created port: f4caa0ae-9571-4c82-9717-07935e6991a2 {{(pid=95467) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 08:25:11 user nova-compute[95467]: DEBUG nova.network.neutron [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Successfully updated port: f4caa0ae-9571-4c82-9717-07935e6991a2 {{(pid=95467) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 08:25:11 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Acquiring lock "refresh_cache-7eb1f0ce-72bd-4015-993c-a32404f15481" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:25:11 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Acquired lock "refresh_cache-7eb1f0ce-72bd-4015-993c-a32404f15481" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:25:11 user nova-compute[95467]: DEBUG nova.network.neutron [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:25:11 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:11 user nova-compute[95467]: DEBUG nova.network.neutron [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Instance cache missing network info. {{(pid=95467) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 08:25:11 user nova-compute[95467]: DEBUG nova.compute.manager [req-e93789b7-56ee-49ac-a801-053757d9a280 req-db1e7460-a850-4449-a2cf-8f4483043743 service nova] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Received event network-changed-f4caa0ae-9571-4c82-9717-07935e6991a2 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:25:11 user nova-compute[95467]: DEBUG nova.compute.manager [req-e93789b7-56ee-49ac-a801-053757d9a280 req-db1e7460-a850-4449-a2cf-8f4483043743 service nova] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Refreshing instance network info cache due to event network-changed-f4caa0ae-9571-4c82-9717-07935e6991a2. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:25:11 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-e93789b7-56ee-49ac-a801-053757d9a280 req-db1e7460-a850-4449-a2cf-8f4483043743 service nova] Acquiring lock "refresh_cache-7eb1f0ce-72bd-4015-993c-a32404f15481" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:25:11 user nova-compute[95467]: DEBUG nova.network.neutron [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Updating instance_info_cache with network_info: [{"id": "f4caa0ae-9571-4c82-9717-07935e6991a2", "address": "fa:16:3e:22:a5:e5", "network": {"id": "96d9262b-11fb-497d-8e38-fa46076c010f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2069167691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7791bd92c7c488aa72474ecde2e1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4caa0ae-95", "ovs_interfaceid": "f4caa0ae-9571-4c82-9717-07935e6991a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:25:11 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Releasing lock "refresh_cache-7eb1f0ce-72bd-4015-993c-a32404f15481" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:25:11 user nova-compute[95467]: DEBUG nova.compute.manager [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Instance network_info: |[{"id": "f4caa0ae-9571-4c82-9717-07935e6991a2", "address": "fa:16:3e:22:a5:e5", "network": {"id": "96d9262b-11fb-497d-8e38-fa46076c010f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2069167691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7791bd92c7c488aa72474ecde2e1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4caa0ae-95", "ovs_interfaceid": "f4caa0ae-9571-4c82-9717-07935e6991a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 08:25:11 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-e93789b7-56ee-49ac-a801-053757d9a280 req-db1e7460-a850-4449-a2cf-8f4483043743 service nova] Acquired lock "refresh_cache-7eb1f0ce-72bd-4015-993c-a32404f15481" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:25:11 user nova-compute[95467]: DEBUG nova.network.neutron [req-e93789b7-56ee-49ac-a801-053757d9a280 req-db1e7460-a850-4449-a2cf-8f4483043743 service nova] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Refreshing network info cache for port f4caa0ae-9571-4c82-9717-07935e6991a2 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:25:12 user nova-compute[95467]: DEBUG nova.network.neutron [req-e93789b7-56ee-49ac-a801-053757d9a280 req-db1e7460-a850-4449-a2cf-8f4483043743 service nova] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Updated VIF entry in instance network info cache for port f4caa0ae-9571-4c82-9717-07935e6991a2. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:25:12 user nova-compute[95467]: DEBUG nova.network.neutron [req-e93789b7-56ee-49ac-a801-053757d9a280 req-db1e7460-a850-4449-a2cf-8f4483043743 service nova] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Updating instance_info_cache with network_info: [{"id": "f4caa0ae-9571-4c82-9717-07935e6991a2", "address": "fa:16:3e:22:a5:e5", "network": {"id": "96d9262b-11fb-497d-8e38-fa46076c010f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2069167691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7791bd92c7c488aa72474ecde2e1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4caa0ae-95", "ovs_interfaceid": "f4caa0ae-9571-4c82-9717-07935e6991a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:25:12 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-e93789b7-56ee-49ac-a801-053757d9a280 req-db1e7460-a850-4449-a2cf-8f4483043743 service nova] Releasing lock "refresh_cache-7eb1f0ce-72bd-4015-993c-a32404f15481" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:25:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG nova.compute.manager [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Start spawning the instance on the hypervisor. {{(pid=95467) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Creating instance directory {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 08:25:15 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Creating image(s)
Nov 15 08:25:15 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Did not create local disks {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Ensure instance console log exists: /opt/stack/data/nova/instances/7eb1f0ce-72bd-4015-993c-a32404f15481/console.log {{(pid=95467) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Start _get_guest_xml network_info=[{"id": "f4caa0ae-9571-4c82-9717-07935e6991a2", "address": "fa:16:3e:22:a5:e5", "network": {"id": "96d9262b-11fb-497d-8e38-fa46076c010f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2069167691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7791bd92c7c488aa72474ecde2e1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4caa0ae-95", "ovs_interfaceid": "f4caa0ae-9571-4c82-9717-07935e6991a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '7c4b8e33-021c-43f2-8730-4acc44580f54', 'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AmMxUCDH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7eb1f0ce-72bd-4015-993c-a32404f15481', 'attached_at': '', 'detached_at': '', 'volume_id': '56e4d788-8159-47c4-bbea-a4b90cb6170b', 'serial': '56e4d788-8159-47c4-bbea-a4b90cb6170b'}, 'volume_type': None} {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:25:15 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:25:15 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:25:15 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Calling os-brick to attach iSCSI Volume {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AmMxUCDH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:25:15 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:25:15 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:25:15 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:25:15 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:25:15 user nova-compute[95467]: INFO os_brick.initiator.connectors.iscsi [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 08:25:15 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b -p 172.16.0.220:3260 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4fd6fc0-b620-4a3d-b088-8e63a4cba0db]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 08:25:15 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b -p 172.16.0.220:3260 --interface default --op new {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a471150b-a02a-45e2-9dff-6d702fe1acf4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b] added\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b] added
Nov 15 08:25:15 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[5548eb17-61ee-4c96-9e05-f48416894d94]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3040a41-c2e1-49d2-93ab-7c330a6fa235]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AmMxUCDH {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AmMxUCDH" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[99eb672e-9188-4346-bce7-dd9a321b2134]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AmMxUCDH'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb815fd5-98ca-4263-981c-cb7c927bd299]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b6df88-bb5b-49b1-87f3-e6cc6ebdff65]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b47b2007-2b9e-4a27-a6b0-696d5145e34d (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:25:15 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:25:15 user nova-compute[95467]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:25:15 user nova-compute[95467]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)
Nov 15 08:25:15 user nova-compute[95467]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b47b2007-2b9e-4a27-a6b0-696d5145e34d (non-flash)
Nov 15 08:25:15 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:25:15 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:25:15 user nova-compute[95467]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:25:15 user nova-compute[95467]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)
Nov 15 08:25:15 user nova-compute[95467]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b47b2007-2b9e-4a27-a6b0-696d5145e34d (non-flash)
Nov 15 08:25:15 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b -p 172.16.0.220:3260 --login {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[1233ecb2-9ff2-4338-a7fd-67c68157e676]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b, portal: 172.16.0.220,3260]
Nov 15 08:25:15 user nova-compute[95467]: Login to [iface: default, target: iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b, portal: 172.16.0.220,3260] successful.
Nov 15 08:25:15 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.083s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c75b1f-f51c-40a6-8d0a-8f83db6ce233]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[54404639-4613-4713-a314-fd81ef382dde]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b47b2007-2b9e-4a27-a6b0-696d5145e34d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:25:15 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:25:15 user nova-compute[95467]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:25:15 user nova-compute[95467]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)
Nov 15 08:25:15 user nova-compute[95467]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b47b2007-2b9e-4a27-a6b0-696d5145e34d (non-flash)
Nov 15 08:25:15 user nova-compute[95467]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:25:15 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:25:15 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:25:15 user nova-compute[95467]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:25:15 user nova-compute[95467]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)
Nov 15 08:25:15 user nova-compute[95467]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b47b2007-2b9e-4a27-a6b0-696d5145e34d (non-flash)
Nov 15 08:25:15 user nova-compute[95467]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:25:15 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.433s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Connected to 172.16.0.220:3260 {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] HCTL ('38', '-', '-', 0) found on session 43 with lun 0 {{(pid=95467) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=95467) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[110d49f5-0c72-4400-9f06-cf480f175c54]: (4, ('- - 0', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Searching for a device in session 43 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:25:15 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AmMxUCDH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 08:25:16 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:16 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.467s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:25:16 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] <== connect_volume: return (1469ms) {'type': 'block', 'scsi_wwn': '23130393335336366', 'path': '/dev/sdg'} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:25:16 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130393335336366', 'path': '/dev/sdg'} {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 08:25:16 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:25:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-288305650',display_name='tempest-TestVolumeBootPattern-server-288305650',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-288305650',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGn1slhlv/lpfM2oYeApx9piTNh8psQp9CpZOaXQ+Ydt2JJikCfOrBRqv7qZ3oUV5yn53tl6dDTEsiUIm5m/x3Q62LZpqk25/AJiUoLr4SnG2Qg5vjpEqPX27JlljHO+ew==',key_name='tempest-TestVolumeBootPattern-1986786502',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7791bd92c7c488aa72474ecde2e1155',ramdisk_id='',reservation_id='r-ipv6tx80',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-978207351',owner_user_name='tempest-TestVolumeBootPattern-978207351-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:25:10Z,user_data=None,user_id='11bbbd3ef322402cb5dc60455a54319b',uuid=7eb1f0ce-72bd-4015-993c-a32404f15481,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4caa0ae-9571-4c82-9717-07935e6991a2", "address": "fa:16:3e:22:a5:e5", "network": {"id": "96d9262b-11fb-497d-8e38-fa46076c010f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2069167691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7791bd92c7c488aa72474ecde2e1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4caa0ae-95", "ovs_interfaceid": "f4caa0ae-9571-4c82-9717-07935e6991a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:25:16 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Converting VIF {"id": "f4caa0ae-9571-4c82-9717-07935e6991a2", "address": "fa:16:3e:22:a5:e5", "network": {"id": "96d9262b-11fb-497d-8e38-fa46076c010f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2069167691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7791bd92c7c488aa72474ecde2e1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4caa0ae-95", "ovs_interfaceid": "f4caa0ae-9571-4c82-9717-07935e6991a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:25:16 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:a5:e5,bridge_name='br-int',has_traffic_filtering=True,id=f4caa0ae-9571-4c82-9717-07935e6991a2,network=Network(96d9262b-11fb-497d-8e38-fa46076c010f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4caa0ae-95') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:25:16 user nova-compute[95467]: DEBUG nova.objects.instance [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lazy-loading 'pci_devices' on Instance uuid 7eb1f0ce-72bd-4015-993c-a32404f15481 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:25:16 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:25:16 user nova-compute[95467]:   <uuid>7eb1f0ce-72bd-4015-993c-a32404f15481</uuid>
Nov 15 08:25:16 user nova-compute[95467]:   <name>instance-0000002c</name>
Nov 15 08:25:16 user nova-compute[95467]:   <memory>524288</memory>
Nov 15 08:25:16 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:25:16 user nova-compute[95467]:   <metadata>
Nov 15 08:25:16 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:25:16 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:25:16 user nova-compute[95467]:       <nova:name>tempest-TestVolumeBootPattern-server-288305650</nova:name>
Nov 15 08:25:16 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:25:15</nova:creationTime>
Nov 15 08:25:16 user nova-compute[95467]:       <nova:flavor name="m1.tiny">
Nov 15 08:25:16 user nova-compute[95467]:         <nova:memory>512</nova:memory>
Nov 15 08:25:16 user nova-compute[95467]:         <nova:disk>1</nova:disk>
Nov 15 08:25:16 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:25:16 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:25:16 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:25:16 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:25:16 user nova-compute[95467]:       <nova:owner>
Nov 15 08:25:16 user nova-compute[95467]:         <nova:user uuid="11bbbd3ef322402cb5dc60455a54319b">tempest-TestVolumeBootPattern-978207351-project-member</nova:user>
Nov 15 08:25:16 user nova-compute[95467]:         <nova:project uuid="e7791bd92c7c488aa72474ecde2e1155">tempest-TestVolumeBootPattern-978207351</nova:project>
Nov 15 08:25:16 user nova-compute[95467]:       </nova:owner>
Nov 15 08:25:16 user nova-compute[95467]:       <nova:ports>
Nov 15 08:25:16 user nova-compute[95467]:         <nova:port uuid="f4caa0ae-9571-4c82-9717-07935e6991a2">
Nov 15 08:25:16 user nova-compute[95467]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 08:25:16 user nova-compute[95467]:         </nova:port>
Nov 15 08:25:16 user nova-compute[95467]:       </nova:ports>
Nov 15 08:25:16 user nova-compute[95467]:     </nova:instance>
Nov 15 08:25:16 user nova-compute[95467]:   </metadata>
Nov 15 08:25:16 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:25:16 user nova-compute[95467]:     <system>
Nov 15 08:25:16 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:25:16 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:25:16 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:25:16 user nova-compute[95467]:       <entry name="serial">7eb1f0ce-72bd-4015-993c-a32404f15481</entry>
Nov 15 08:25:16 user nova-compute[95467]:       <entry name="uuid">7eb1f0ce-72bd-4015-993c-a32404f15481</entry>
Nov 15 08:25:16 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:25:16 user nova-compute[95467]:     </system>
Nov 15 08:25:16 user nova-compute[95467]:   </sysinfo>
Nov 15 08:25:16 user nova-compute[95467]:   <os>
Nov 15 08:25:16 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:25:16 user nova-compute[95467]:     <boot dev="hd"/>
Nov 15 08:25:16 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:25:16 user nova-compute[95467]:   </os>
Nov 15 08:25:16 user nova-compute[95467]:   <features>
Nov 15 08:25:16 user nova-compute[95467]:     <acpi/>
Nov 15 08:25:16 user nova-compute[95467]:     <apic/>
Nov 15 08:25:16 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:25:16 user nova-compute[95467]:   </features>
Nov 15 08:25:16 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:25:16 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:25:16 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:25:16 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:25:16 user nova-compute[95467]:   </clock>
Nov 15 08:25:16 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:25:16 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:25:16 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:25:16 user nova-compute[95467]:   </cpu>
Nov 15 08:25:16 user nova-compute[95467]:   <devices>
Nov 15 08:25:16 user nova-compute[95467]:     <disk type="block" device="disk">
Nov 15 08:25:16 user nova-compute[95467]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:25:16 user nova-compute[95467]:       <source dev="/dev/sdg"/>
Nov 15 08:25:16 user nova-compute[95467]:       <target dev="vda" bus="virtio"/>
Nov 15 08:25:16 user nova-compute[95467]:       <serial>56e4d788-8159-47c4-bbea-a4b90cb6170b</serial>
Nov 15 08:25:16 user nova-compute[95467]:     </disk>
Nov 15 08:25:16 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:25:16 user nova-compute[95467]:       <mac address="fa:16:3e:22:a5:e5"/>
Nov 15 08:25:16 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:25:16 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:25:16 user nova-compute[95467]:       <target dev="tapf4caa0ae-95"/>
Nov 15 08:25:16 user nova-compute[95467]:     </interface>
Nov 15 08:25:16 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:25:16 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/7eb1f0ce-72bd-4015-993c-a32404f15481/console.log" append="off"/>
Nov 15 08:25:16 user nova-compute[95467]:     </serial>
Nov 15 08:25:16 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:25:16 user nova-compute[95467]:     <video>
Nov 15 08:25:16 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:25:16 user nova-compute[95467]:     </video>
Nov 15 08:25:16 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:25:16 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:25:16 user nova-compute[95467]:     </rng>
Nov 15 08:25:16 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:25:16 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:25:16 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:25:16 user nova-compute[95467]:     </memballoon>
Nov 15 08:25:16 user nova-compute[95467]:   </devices>
Nov 15 08:25:16 user nova-compute[95467]: </domain>
Nov 15 08:25:16 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:25:16 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:25:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-288305650',display_name='tempest-TestVolumeBootPattern-server-288305650',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-288305650',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGn1slhlv/lpfM2oYeApx9piTNh8psQp9CpZOaXQ+Ydt2JJikCfOrBRqv7qZ3oUV5yn53tl6dDTEsiUIm5m/x3Q62LZpqk25/AJiUoLr4SnG2Qg5vjpEqPX27JlljHO+ew==',key_name='tempest-TestVolumeBootPattern-1986786502',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7791bd92c7c488aa72474ecde2e1155',ramdisk_id='',reservation_id='r-ipv6tx80',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-978207351',owner_user_name='tempest-TestVolumeBootPattern-978207351-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:25:10Z,user_data=None,user_id='11bbbd3ef322402cb5dc60455a54319b',uuid=7eb1f0ce-72bd-4015-993c-a32404f15481,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4caa0ae-9571-4c82-9717-07935e6991a2", "address": "fa:16:3e:22:a5:e5", "network": {"id": "96d9262b-11fb-497d-8e38-fa46076c010f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2069167691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7791bd92c7c488aa72474ecde2e1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4caa0ae-95", "ovs_interfaceid": "f4caa0ae-9571-4c82-9717-07935e6991a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:25:16 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Converting VIF {"id": "f4caa0ae-9571-4c82-9717-07935e6991a2", "address": "fa:16:3e:22:a5:e5", "network": {"id": "96d9262b-11fb-497d-8e38-fa46076c010f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2069167691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7791bd92c7c488aa72474ecde2e1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4caa0ae-95", "ovs_interfaceid": "f4caa0ae-9571-4c82-9717-07935e6991a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:25:16 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:a5:e5,bridge_name='br-int',has_traffic_filtering=True,id=f4caa0ae-9571-4c82-9717-07935e6991a2,network=Network(96d9262b-11fb-497d-8e38-fa46076c010f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4caa0ae-95') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:25:16 user nova-compute[95467]: DEBUG os_vif [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:a5:e5,bridge_name='br-int',has_traffic_filtering=True,id=f4caa0ae-9571-4c82-9717-07935e6991a2,network=Network(96d9262b-11fb-497d-8e38-fa46076c010f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4caa0ae-95') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:25:16 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:16 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:25:16 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:25:16 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:16 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '38312ca5-95c1-5c59-8e00-877bf053ae4c', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:25:16 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:16 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:16 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:16 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf4caa0ae-95, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:25:16 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf4caa0ae-95, col_values=(('qos', UUID('430c86a0-0638-4168-af81-2bc48dbc097c')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:25:16 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf4caa0ae-95, col_values=(('external_ids', {'iface-id': 'f4caa0ae-9571-4c82-9717-07935e6991a2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:a5:e5', 'vm-uuid': '7eb1f0ce-72bd-4015-993c-a32404f15481'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:25:16 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:16 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:25:16 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:16 user nova-compute[95467]: INFO os_vif [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:a5:e5,bridge_name='br-int',has_traffic_filtering=True,id=f4caa0ae-9571-4c82-9717-07935e6991a2,network=Network(96d9262b-11fb-497d-8e38-fa46076c010f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4caa0ae-95')
Nov 15 08:25:16 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:25:16 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] No VIF found with MAC fa:16:3e:22:a5:e5, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:25:17 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:18 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:18 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:18 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:18 user nova-compute[95467]: DEBUG nova.compute.manager [req-d4d9fcf2-bed1-40c8-87aa-397d649bc934 req-053530f8-c89e-4e59-8f40-adcedcf6b1e1 service nova] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Received event network-vif-plugged-f4caa0ae-9571-4c82-9717-07935e6991a2 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:25:18 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-d4d9fcf2-bed1-40c8-87aa-397d649bc934 req-053530f8-c89e-4e59-8f40-adcedcf6b1e1 service nova] Acquiring lock "7eb1f0ce-72bd-4015-993c-a32404f15481-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:25:18 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-d4d9fcf2-bed1-40c8-87aa-397d649bc934 req-053530f8-c89e-4e59-8f40-adcedcf6b1e1 service nova] Lock "7eb1f0ce-72bd-4015-993c-a32404f15481-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:25:18 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-d4d9fcf2-bed1-40c8-87aa-397d649bc934 req-053530f8-c89e-4e59-8f40-adcedcf6b1e1 service nova] Lock "7eb1f0ce-72bd-4015-993c-a32404f15481-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:25:18 user nova-compute[95467]: DEBUG nova.compute.manager [req-d4d9fcf2-bed1-40c8-87aa-397d649bc934 req-053530f8-c89e-4e59-8f40-adcedcf6b1e1 service nova] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] No waiting events found dispatching network-vif-plugged-f4caa0ae-9571-4c82-9717-07935e6991a2 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:25:18 user nova-compute[95467]: WARNING nova.compute.manager [req-d4d9fcf2-bed1-40c8-87aa-397d649bc934 req-053530f8-c89e-4e59-8f40-adcedcf6b1e1 service nova] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Received unexpected event network-vif-plugged-f4caa0ae-9571-4c82-9717-07935e6991a2 for instance with vm_state building and task_state spawning.
Nov 15 08:25:18 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:18 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:18 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:20 user nova-compute[95467]: DEBUG nova.compute.manager [req-384632fe-aaed-4850-9eae-8be20436860e req-690a3e98-a58d-49a5-b14c-e1998c843109 service nova] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Received event network-vif-plugged-f4caa0ae-9571-4c82-9717-07935e6991a2 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:25:20 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-384632fe-aaed-4850-9eae-8be20436860e req-690a3e98-a58d-49a5-b14c-e1998c843109 service nova] Acquiring lock "7eb1f0ce-72bd-4015-993c-a32404f15481-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:25:20 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-384632fe-aaed-4850-9eae-8be20436860e req-690a3e98-a58d-49a5-b14c-e1998c843109 service nova] Lock "7eb1f0ce-72bd-4015-993c-a32404f15481-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:25:20 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-384632fe-aaed-4850-9eae-8be20436860e req-690a3e98-a58d-49a5-b14c-e1998c843109 service nova] Lock "7eb1f0ce-72bd-4015-993c-a32404f15481-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:25:20 user nova-compute[95467]: DEBUG nova.compute.manager [req-384632fe-aaed-4850-9eae-8be20436860e req-690a3e98-a58d-49a5-b14c-e1998c843109 service nova] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] No waiting events found dispatching network-vif-plugged-f4caa0ae-9571-4c82-9717-07935e6991a2 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:25:20 user nova-compute[95467]: WARNING nova.compute.manager [req-384632fe-aaed-4850-9eae-8be20436860e req-690a3e98-a58d-49a5-b14c-e1998c843109 service nova] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Received unexpected event network-vif-plugged-f4caa0ae-9571-4c82-9717-07935e6991a2 for instance with vm_state building and task_state spawning.
Nov 15 08:25:20 user nova-compute[95467]: DEBUG nova.compute.manager [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Instance event wait completed in 0 seconds for  {{(pid=95467) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 08:25:20 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Guest created on hypervisor {{(pid=95467) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 08:25:20 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Instance spawned successfully.
Nov 15 08:25:20 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 08:25:20 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Found default for hw_cdrom_bus of ide {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:25:20 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Found default for hw_disk_bus of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:25:20 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Found default for hw_input_bus of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:25:20 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Found default for hw_pointer_model of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:25:20 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Found default for hw_video_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:25:20 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Found default for hw_vif_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:25:20 user nova-compute[95467]: INFO nova.compute.manager [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Took 5.29 seconds to spawn the instance on the hypervisor.
Nov 15 08:25:20 user nova-compute[95467]: DEBUG nova.compute.manager [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:25:20 user nova-compute[95467]: INFO nova.compute.manager [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Took 11.15 seconds to build instance.
Nov 15 08:25:20 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d416ac54-c410-4cf1-ae62-ded3c7c48424 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "7eb1f0ce-72bd-4015-993c-a32404f15481" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.252s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:25:21 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:24 user nova-compute[95467]: DEBUG nova.compute.manager [req-b4067f68-d7a5-4629-974e-fbcef6f3c5c7 req-0aa52601-4f75-426f-ba1c-5d139ba9fa00 service nova] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Received event network-changed-4572a8d9-9e56-47da-b59d-013b88b32e8b {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:25:24 user nova-compute[95467]: DEBUG nova.compute.manager [req-b4067f68-d7a5-4629-974e-fbcef6f3c5c7 req-0aa52601-4f75-426f-ba1c-5d139ba9fa00 service nova] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Refreshing instance network info cache due to event network-changed-4572a8d9-9e56-47da-b59d-013b88b32e8b. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:25:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b4067f68-d7a5-4629-974e-fbcef6f3c5c7 req-0aa52601-4f75-426f-ba1c-5d139ba9fa00 service nova] Acquiring lock "refresh_cache-843b778c-f823-4bee-aa76-ab44345be9a7" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:25:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b4067f68-d7a5-4629-974e-fbcef6f3c5c7 req-0aa52601-4f75-426f-ba1c-5d139ba9fa00 service nova] Acquired lock "refresh_cache-843b778c-f823-4bee-aa76-ab44345be9a7" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:25:24 user nova-compute[95467]: DEBUG nova.network.neutron [req-b4067f68-d7a5-4629-974e-fbcef6f3c5c7 req-0aa52601-4f75-426f-ba1c-5d139ba9fa00 service nova] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Refreshing network info cache for port 4572a8d9-9e56-47da-b59d-013b88b32e8b {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:25:25 user nova-compute[95467]: DEBUG nova.compute.manager [req-94d55f3c-0222-4a8b-9b83-ed22273c1a09 req-2498f9dc-8e22-4b7d-86cb-eeae5380ab2a service nova] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Received event network-changed-a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:25:25 user nova-compute[95467]: DEBUG nova.compute.manager [req-94d55f3c-0222-4a8b-9b83-ed22273c1a09 req-2498f9dc-8e22-4b7d-86cb-eeae5380ab2a service nova] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Refreshing instance network info cache due to event network-changed-a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:25:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-94d55f3c-0222-4a8b-9b83-ed22273c1a09 req-2498f9dc-8e22-4b7d-86cb-eeae5380ab2a service nova] Acquiring lock "refresh_cache-739645e6-9952-40db-a876-f23d02d4e411" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:25:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-94d55f3c-0222-4a8b-9b83-ed22273c1a09 req-2498f9dc-8e22-4b7d-86cb-eeae5380ab2a service nova] Acquired lock "refresh_cache-739645e6-9952-40db-a876-f23d02d4e411" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:25:25 user nova-compute[95467]: DEBUG nova.network.neutron [req-94d55f3c-0222-4a8b-9b83-ed22273c1a09 req-2498f9dc-8e22-4b7d-86cb-eeae5380ab2a service nova] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Refreshing network info cache for port a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:25:25 user nova-compute[95467]: DEBUG nova.network.neutron [req-b4067f68-d7a5-4629-974e-fbcef6f3c5c7 req-0aa52601-4f75-426f-ba1c-5d139ba9fa00 service nova] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Updated VIF entry in instance network info cache for port 4572a8d9-9e56-47da-b59d-013b88b32e8b. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:25:25 user nova-compute[95467]: DEBUG nova.network.neutron [req-b4067f68-d7a5-4629-974e-fbcef6f3c5c7 req-0aa52601-4f75-426f-ba1c-5d139ba9fa00 service nova] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Updating instance_info_cache with network_info: [{"id": "4572a8d9-9e56-47da-b59d-013b88b32e8b", "address": "fa:16:3e:08:74:0a", "network": {"id": "bdae4fa0-34fd-4b85-8c8b-7d68b7e80282", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-680251229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6fb970c784b4c3c8e64abd04523885a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4572a8d9-9e", "ovs_interfaceid": "4572a8d9-9e56-47da-b59d-013b88b32e8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:25:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b4067f68-d7a5-4629-974e-fbcef6f3c5c7 req-0aa52601-4f75-426f-ba1c-5d139ba9fa00 service nova] Releasing lock "refresh_cache-843b778c-f823-4bee-aa76-ab44345be9a7" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:25:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d591aafa-f8c6-4b1b-b4f0-714eba57902a tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Acquiring lock "739645e6-9952-40db-a876-f23d02d4e411" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:25:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d591aafa-f8c6-4b1b-b4f0-714eba57902a tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "739645e6-9952-40db-a876-f23d02d4e411" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:25:25 user nova-compute[95467]: DEBUG nova.objects.instance [None req-d591aafa-f8c6-4b1b-b4f0-714eba57902a tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lazy-loading 'flavor' on Instance uuid 739645e6-9952-40db-a876-f23d02d4e411 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:25:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d591aafa-f8c6-4b1b-b4f0-714eba57902a tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "739645e6-9952-40db-a876-f23d02d4e411" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:25:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d591aafa-f8c6-4b1b-b4f0-714eba57902a tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Acquiring lock "739645e6-9952-40db-a876-f23d02d4e411" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:25:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d591aafa-f8c6-4b1b-b4f0-714eba57902a tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "739645e6-9952-40db-a876-f23d02d4e411" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:25:25 user nova-compute[95467]: INFO nova.compute.manager [None req-d591aafa-f8c6-4b1b-b4f0-714eba57902a tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Attaching volume 3ecac43f-808f-4c62-a879-3ed80e24c373 to /dev/vdb
Nov 15 08:25:25 user nova-compute[95467]: DEBUG os_brick.utils [None req-d591aafa-f8c6-4b1b-b4f0-714eba57902a tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:25:25 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:25 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:25 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0db452-d926-4808-9ce4-957559fba9de]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:882ae90641f\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:25 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:25 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.032s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:25 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c478da52-a187-4dbb-9f8d-d90cec96c996]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:25 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:25 user nova-compute[95467]: DEBUG nova.network.neutron [req-94d55f3c-0222-4a8b-9b83-ed22273c1a09 req-2498f9dc-8e22-4b7d-86cb-eeae5380ab2a service nova] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Updated VIF entry in instance network info cache for port a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:25:25 user nova-compute[95467]: DEBUG nova.network.neutron [req-94d55f3c-0222-4a8b-9b83-ed22273c1a09 req-2498f9dc-8e22-4b7d-86cb-eeae5380ab2a service nova] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Updating instance_info_cache with network_info: [{"id": "a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae", "address": "fa:16:3e:13:89:c0", "network": {"id": "369d2a6f-60b7-4c92-8b2d-1f3828f6698b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1491709218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd281be4e94a4d31a47a13267d51d9b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6f2f30d-af", "ovs_interfaceid": "a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:25:25 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:25 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d107ed-7271-4732-9d55-ee836db4687e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:25 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9be1f97-8f29-4728-b970-742530fd7bb2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:25 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-d591aafa-f8c6-4b1b-b4f0-714eba57902a tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Running cmd (subprocess): nvme version {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:25 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-d591aafa-f8c6-4b1b-b4f0-714eba57902a tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] 'nvme version' failed. Not Retrying. {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:25:25 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d591aafa-f8c6-4b1b-b4f0-714eba57902a tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] nvme not present on system {{(pid=95467) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 08:25:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-94d55f3c-0222-4a8b-9b83-ed22273c1a09 req-2498f9dc-8e22-4b7d-86cb-eeae5380ab2a service nova] Releasing lock "refresh_cache-739645e6-9952-40db-a876-f23d02d4e411" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:25:25 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a339a9ee-f2c5-4f72-8e26-3d0e9645b8ee tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Acquiring lock "843b778c-f823-4bee-aa76-ab44345be9a7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:25:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a339a9ee-f2c5-4f72-8e26-3d0e9645b8ee tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Lock "843b778c-f823-4bee-aa76-ab44345be9a7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:25:25 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:25:25 user nova-compute[95467]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 08:25:25 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d632cd83-d344-45fd-ab3f-d19019cdcd64]: (4, '') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:25 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-d591aafa-f8c6-4b1b-b4f0-714eba57902a tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=95467) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 08:25:25 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-d591aafa-f8c6-4b1b-b4f0-714eba57902a tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 08:25:25 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-d591aafa-f8c6-4b1b-b4f0-714eba57902a tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] LIGHTOS: no hostnqn found. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 08:25:25 user nova-compute[95467]: DEBUG os_brick.utils [None req-d591aafa-f8c6-4b1b-b4f0-714eba57902a tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:882ae90641f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:25:25 user nova-compute[95467]: DEBUG nova.virt.block_device [None req-d591aafa-f8c6-4b1b-b4f0-714eba57902a tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Updating existing volume attachment record: 0db1fab1-3e97-4bb3-8eed-b92fefe88ece {{(pid=95467) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 08:25:25 user nova-compute[95467]: DEBUG nova.objects.instance [None req-a339a9ee-f2c5-4f72-8e26-3d0e9645b8ee tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Lazy-loading 'flavor' on Instance uuid 843b778c-f823-4bee-aa76-ab44345be9a7 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:25:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a339a9ee-f2c5-4f72-8e26-3d0e9645b8ee tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Lock "843b778c-f823-4bee-aa76-ab44345be9a7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:25:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a339a9ee-f2c5-4f72-8e26-3d0e9645b8ee tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Acquiring lock "843b778c-f823-4bee-aa76-ab44345be9a7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:25:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a339a9ee-f2c5-4f72-8e26-3d0e9645b8ee tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Lock "843b778c-f823-4bee-aa76-ab44345be9a7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:25:26 user nova-compute[95467]: INFO nova.compute.manager [None req-a339a9ee-f2c5-4f72-8e26-3d0e9645b8ee tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Attaching volume c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 to /dev/vdb
Nov 15 08:25:26 user nova-compute[95467]: DEBUG os_brick.utils [None req-a339a9ee-f2c5-4f72-8e26-3d0e9645b8ee tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:25:26 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:26 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:26 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1a37de-da56-47ab-8398-095ee1c97ef8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:882ae90641f\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:26 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:26 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:26 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bab69b5-319d-4cce-b0f5-09e7ae141705]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:26 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:26 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:26 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b41b5075-baa2-49ca-b254-680a0184712c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:26 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d717515-3fe1-40a9-93ff-c9f2d1f54026]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:26 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a339a9ee-f2c5-4f72-8e26-3d0e9645b8ee tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Running cmd (subprocess): nvme version {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:26 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a339a9ee-f2c5-4f72-8e26-3d0e9645b8ee tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] 'nvme version' failed. Not Retrying. {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:25:26 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a339a9ee-f2c5-4f72-8e26-3d0e9645b8ee tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] nvme not present on system {{(pid=95467) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 08:25:26 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:26 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:25:26 user nova-compute[95467]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 08:25:26 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac755d4-a11c-479b-bd14-5d7c63442361]: (4, '') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:26 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-a339a9ee-f2c5-4f72-8e26-3d0e9645b8ee tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=95467) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 08:25:26 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-a339a9ee-f2c5-4f72-8e26-3d0e9645b8ee tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 08:25:26 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-a339a9ee-f2c5-4f72-8e26-3d0e9645b8ee tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] LIGHTOS: no hostnqn found. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 08:25:26 user nova-compute[95467]: DEBUG os_brick.utils [None req-a339a9ee-f2c5-4f72-8e26-3d0e9645b8ee tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:882ae90641f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:25:26 user nova-compute[95467]: DEBUG nova.virt.block_device [None req-a339a9ee-f2c5-4f72-8e26-3d0e9645b8ee tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Updating existing volume attachment record: 6b332321-a564-49de-a70c-17566b1546aa {{(pid=95467) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 08:25:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:28 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-88290b21-dc31-415c-92e9-a154e53a459f tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a1a155e6-0ee2-4728-a526-17c149107ab0 is timed out.
Nov 15 08:25:28 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-88290b21-dc31-415c-92e9-a154e53a459f tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Successfully detached device vdb from instance a1a155e6-0ee2-4728-a526-17c149107ab0 from the live domain config.
Nov 15 08:25:28 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88290b21-dc31-415c-92e9-a154e53a459f tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] calling os-brick to detach iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 08:25:28 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-88290b21-dc31-415c-92e9-a154e53a459f tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, {'target_iqn': 'iqn.2010-10.org.openstack:b47b2007-2b9e-4a27-a6b0-696d5145e34d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TxSDHvWb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:25:28 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-88290b21-dc31-415c-92e9-a154e53a459f tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:25:28 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-88290b21-dc31-415c-92e9-a154e53a459f tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:25:28 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-88290b21-dc31-415c-92e9-a154e53a459f tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:25:28 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:28 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:28 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d78e27b-be34-4dd0-b085-a77f92857f34]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b47b2007-2b9e-4a27-a6b0-696d5145e34d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:28 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-88290b21-dc31-415c-92e9-a154e53a459f tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 08:25:28 user nova-compute[95467]: No targets found.
Nov 15 08:25:28 user nova-compute[95467]: iSNS:
Nov 15 08:25:28 user nova-compute[95467]: No targets found.
Nov 15 08:25:28 user nova-compute[95467]: STATIC:
Nov 15 08:25:28 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24
Nov 15 08:25:28 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:25:28 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:25:28 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b
Nov 15 08:25:28 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:25:28 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:25:28 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e
Nov 15 08:25:28 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:25:28 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:25:28 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775
Nov 15 08:25:28 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:25:28 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:25:28 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:b47b2007-2b9e-4a27-a6b0-696d5145e34d
Nov 15 08:25:28 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:25:28 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:25:28 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400
Nov 15 08:25:28 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:25:28 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:25:28 user nova-compute[95467]: FIRMWARE:
Nov 15 08:25:28 user nova-compute[95467]: No targets found.
Nov 15 08:25:28 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:25:28 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-88290b21-dc31-415c-92e9-a154e53a459f tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 08:25:28 user nova-compute[95467]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 08:25:28 user nova-compute[95467]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=95467) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 08:25:28 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-88290b21-dc31-415c-92e9-a154e53a459f tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b47b2007-2b9e-4a27-a6b0-696d5145e34d', 0)] {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 08:25:28 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:28 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:28 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b3224e-be9a-4668-87e4-fe29f1b509b2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b47b2007-2b9e-4a27-a6b0-696d5145e34d\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:28 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:28 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:28 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceaba8ad-361a-4d11-876b-45f9e9069c4f]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b47b2007-2b9e-4a27-a6b0-696d5145e34d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:28 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-88290b21-dc31-415c-92e9-a154e53a459f tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:25:28 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:25:28 user nova-compute[95467]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:25:28 user nova-compute[95467]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)
Nov 15 08:25:28 user nova-compute[95467]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b47b2007-2b9e-4a27-a6b0-696d5145e34d (non-flash)
Nov 15 08:25:28 user nova-compute[95467]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:25:28 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:25:28 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-88290b21-dc31-415c-92e9-a154e53a459f tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:25:28 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:25:28 user nova-compute[95467]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:25:28 user nova-compute[95467]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)
Nov 15 08:25:28 user nova-compute[95467]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b47b2007-2b9e-4a27-a6b0-696d5145e34d (non-flash)
Nov 15 08:25:28 user nova-compute[95467]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:25:28 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:25:28 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-88290b21-dc31-415c-92e9-a154e53a459f tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efed82b83a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b47b2007-2b9e-4a27-a6b0-696d5145e34d'): ({'sde'}, set())}) {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 08:25:28 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-88290b21-dc31-415c-92e9-a154e53a459f tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Removing single pathed devices sde {{(pid=95467) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 08:25:28 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:28 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:28 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[76800349-8e27-4171-8335-a69ab82d3251]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:28 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:28 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:28 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a749eb-618d-41b3-a2be-112f1efc77f4]: (4, ('ok\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:28 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-88290b21-dc31-415c-92e9-a154e53a459f tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Flushing IO for device /dev/sde {{(pid=95467) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 08:25:28 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:28 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:28 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4bf5a5e-6c71-4d6a-9ada-94d446eb04d8]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:28 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-88290b21-dc31-415c-92e9-a154e53a459f tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=95467) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 08:25:28 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:28 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.033s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:28 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7db0d3-75e1-4727-8c70-6547c2210d24]: (4, ('1', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:28 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-88290b21-dc31-415c-92e9-a154e53a459f tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 08:25:28 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-88290b21-dc31-415c-92e9-a154e53a459f tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] SCSI volumes sde have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 08:25:28 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-88290b21-dc31-415c-92e9-a154e53a459f tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b47b2007-2b9e-4a27-a6b0-696d5145e34d')] {{(pid=95467) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 08:25:28 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b47b2007-2b9e-4a27-a6b0-696d5145e34d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:28 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b47b2007-2b9e-4a27-a6b0-696d5145e34d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:28 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[164df717-87b8-480d-bc15-adb4d4e12b0a]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:28 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-88290b21-dc31-415c-92e9-a154e53a459f tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:25:28 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b47b2007-2b9e-4a27-a6b0-696d5145e34d -p 172.16.0.220:3260 --logout {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:28 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b47b2007-2b9e-4a27-a6b0-696d5145e34d -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:28 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e45597c-7b91-4507-95e0-3ba306396fc0]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:b47b2007-2b9e-4a27-a6b0-696d5145e34d, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:b47b2007-2b9e-4a27-a6b0-696d5145e34d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:28 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-88290b21-dc31-415c-92e9-a154e53a459f tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:b47b2007-2b9e-4a27-a6b0-696d5145e34d, portal: 172.16.0.220,3260]
Nov 15 08:25:28 user nova-compute[95467]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:b47b2007-2b9e-4a27-a6b0-696d5145e34d, portal: 172.16.0.220,3260] successful.
Nov 15 08:25:28 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:25:28 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b47b2007-2b9e-4a27-a6b0-696d5145e34d -p 172.16.0.220:3260 --op delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:28 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b47b2007-2b9e-4a27-a6b0-696d5145e34d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:28 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[674d1c92-8f1e-41e6-b493-904268e19699]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:28 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-88290b21-dc31-415c-92e9-a154e53a459f tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:25:28 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-88290b21-dc31-415c-92e9-a154e53a459f tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:25:28 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-88290b21-dc31-415c-92e9-a154e53a459f tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] <== disconnect_volume: return (344ms) None {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:25:28 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88290b21-dc31-415c-92e9-a154e53a459f tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Disconnected iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 08:25:31 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a339a9ee-f2c5-4f72-8e26-3d0e9645b8ee tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Calling os-brick to attach iSCSI Volume {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 08:25:31 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a339a9ee-f2c5-4f72-8e26-3d0e9645b8ee tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ewCbqZTQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:25:31 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-a339a9ee-f2c5-4f72-8e26-3d0e9645b8ee tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:25:31 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-a339a9ee-f2c5-4f72-8e26-3d0e9645b8ee tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:25:31 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-a339a9ee-f2c5-4f72-8e26-3d0e9645b8ee tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:25:31 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-a339a9ee-f2c5-4f72-8e26-3d0e9645b8ee tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:25:31 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-a339a9ee-f2c5-4f72-8e26-3d0e9645b8ee tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:25:31 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-a339a9ee-f2c5-4f72-8e26-3d0e9645b8ee tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:25:31 user nova-compute[95467]: INFO os_brick.initiator.connectors.iscsi [None req-a339a9ee-f2c5-4f72-8e26-3d0e9645b8ee tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 08:25:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 -p 172.16.0.220:3260 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:31 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c168c39-366d-4798-a359-398cc473c789]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:31 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a339a9ee-f2c5-4f72-8e26-3d0e9645b8ee tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 08:25:31 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:25:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 -p 172.16.0.220:3260 --interface default --op new {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:31 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[698e46a8-cfcf-48c2-bd85-b4bbb86f8add]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8] added\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:31 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a339a9ee-f2c5-4f72-8e26-3d0e9645b8ee tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8] added
Nov 15 08:25:31 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:25:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:31 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9cdf257-ff1d-4d9f-baaa-9f633facd83f]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:31 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a339a9ee-f2c5-4f72-8e26-3d0e9645b8ee tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:25:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:31 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b67596-2ee5-486a-bd96-0e67e29abe37]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:31 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a339a9ee-f2c5-4f72-8e26-3d0e9645b8ee tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:25:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ewCbqZTQ {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:31 user nova-compute[95467]: DEBUG nova.objects.instance [None req-88290b21-dc31-415c-92e9-a154e53a459f tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lazy-loading 'flavor' on Instance uuid a1a155e6-0ee2-4728-a526-17c149107ab0 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:25:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ewCbqZTQ" returned: 0 in 0.024s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:31 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[89157f65-87cf-45a1-9791-da91f71ce69c]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:31 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a339a9ee-f2c5-4f72-8e26-3d0e9645b8ee tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ewCbqZTQ'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:25:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:31 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca37d76e-2e62-4d75-9663-ef6c3c99d5b3]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:31 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a339a9ee-f2c5-4f72-8e26-3d0e9645b8ee tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:25:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:31 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-88290b21-dc31-415c-92e9-a154e53a459f tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lock "a1a155e6-0ee2-4728-a526-17c149107ab0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.473s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:25:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:31 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ee3cec-0c4b-4412-b845-bb7d881268df]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:31 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a339a9ee-f2c5-4f72-8e26-3d0e9645b8ee tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:25:31 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:25:31 user nova-compute[95467]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:25:31 user nova-compute[95467]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)
Nov 15 08:25:31 user nova-compute[95467]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:25:31 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:25:31 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a339a9ee-f2c5-4f72-8e26-3d0e9645b8ee tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:25:31 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:25:31 user nova-compute[95467]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:25:31 user nova-compute[95467]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)
Nov 15 08:25:31 user nova-compute[95467]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:25:31 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:25:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 -p 172.16.0.220:3260 --login {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:31 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d591aafa-f8c6-4b1b-b4f0-714eba57902a tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Calling os-brick to attach iSCSI Volume {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 08:25:31 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-d591aafa-f8c6-4b1b-b4f0-714eba57902a tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gbxKIWwP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:25:31 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-d591aafa-f8c6-4b1b-b4f0-714eba57902a tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:25:31 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-d591aafa-f8c6-4b1b-b4f0-714eba57902a tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:25:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:31 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[23630a58-3b64-4f69-bd63-a9570d2b8ed2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:31 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a339a9ee-f2c5-4f72-8e26-3d0e9645b8ee tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8, portal: 172.16.0.220,3260]
Nov 15 08:25:31 user nova-compute[95467]: Login to [iface: default, target: iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8, portal: 172.16.0.220,3260] successful.
Nov 15 08:25:31 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:25:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:31 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0e9e72-49e6-4b12-81fb-2a5ea03860bd]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:31 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a339a9ee-f2c5-4f72-8e26-3d0e9645b8ee tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:25:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:31 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccbe5590-5eb6-4619-b598-e5b63e2cef6e]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:31 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a339a9ee-f2c5-4f72-8e26-3d0e9645b8ee tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:25:31 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:25:31 user nova-compute[95467]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:25:31 user nova-compute[95467]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)
Nov 15 08:25:31 user nova-compute[95467]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:25:31 user nova-compute[95467]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 (non-flash)
Nov 15 08:25:31 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:25:31 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a339a9ee-f2c5-4f72-8e26-3d0e9645b8ee tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:25:31 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:25:31 user nova-compute[95467]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:25:31 user nova-compute[95467]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)
Nov 15 08:25:31 user nova-compute[95467]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:25:31 user nova-compute[95467]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 (non-flash)
Nov 15 08:25:31 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:25:31 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-a339a9ee-f2c5-4f72-8e26-3d0e9645b8ee tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:25:31 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a339a9ee-f2c5-4f72-8e26-3d0e9645b8ee tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Connected to 172.16.0.220:3260 {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 08:25:31 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-a339a9ee-f2c5-4f72-8e26-3d0e9645b8ee tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] HCTL ('36', '-', '-', 0) found on session 44 with lun 0 {{(pid=95467) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 08:25:31 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-a339a9ee-f2c5-4f72-8e26-3d0e9645b8ee tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=95467) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 08:25:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:31 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa3bead-e169-48b4-a3bb-55d433c3ff18]: (4, ('- - 0', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:31 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-a339a9ee-f2c5-4f72-8e26-3d0e9645b8ee tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Searching for a device in session 44 and hctl ['36', '*', '*', 0] yield: sde {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:25:31 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a339a9ee-f2c5-4f72-8e26-3d0e9645b8ee tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ewCbqZTQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 08:25:31 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:32 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-a339a9ee-f2c5-4f72-8e26-3d0e9645b8ee tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:25:32 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a339a9ee-f2c5-4f72-8e26-3d0e9645b8ee tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '23762323434363738', 'path': '/dev/sde'} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:25:32 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a339a9ee-f2c5-4f72-8e26-3d0e9645b8ee tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762323434363738', 'path': '/dev/sde'} {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 08:25:32 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-d591aafa-f8c6-4b1b-b4f0-714eba57902a tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.169s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:25:32 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-d591aafa-f8c6-4b1b-b4f0-714eba57902a tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:25:32 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-d591aafa-f8c6-4b1b-b4f0-714eba57902a tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:25:32 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-d591aafa-f8c6-4b1b-b4f0-714eba57902a tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:25:32 user nova-compute[95467]: INFO os_brick.initiator.connectors.iscsi [None req-d591aafa-f8c6-4b1b-b4f0-714eba57902a tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 08:25:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 -p 172.16.0.220:3260 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:32 user nova-compute[95467]: DEBUG nova.objects.instance [None req-a339a9ee-f2c5-4f72-8e26-3d0e9645b8ee tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Lazy-loading 'flavor' on Instance uuid 843b778c-f823-4bee-aa76-ab44345be9a7 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:25:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:32 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca17ec33-062a-4cf8-bed1-6fd2b6a4fac7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:32 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-d591aafa-f8c6-4b1b-b4f0-714eba57902a tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 08:25:32 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:25:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 -p 172.16.0.220:3260 --interface default --op new {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:32 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-a339a9ee-f2c5-4f72-8e26-3d0e9645b8ee tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 08:25:32 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:25:32 user nova-compute[95467]:   <source dev="/dev/sde"/>
Nov 15 08:25:32 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:25:32 user nova-compute[95467]:   <serial>c72f2f38-cf4d-48aa-98b2-cceddbc99cd8</serial>
Nov 15 08:25:32 user nova-compute[95467]: </disk>
Nov 15 08:25:32 user nova-compute[95467]:  {{(pid=95467) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 08:25:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:32 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eee6651-d687-450f-beed-5c1fa291e49d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373] added\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:32 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-d591aafa-f8c6-4b1b-b4f0-714eba57902a tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373] added
Nov 15 08:25:32 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:25:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:32 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d7b16c4-8da8-453f-97b5-f1090f7ee0f7]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:32 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-d591aafa-f8c6-4b1b-b4f0-714eba57902a tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:25:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:32 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[3700185b-0c02-4be8-bf96-7588c8405898]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:32 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-d591aafa-f8c6-4b1b-b4f0-714eba57902a tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:25:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gbxKIWwP {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gbxKIWwP" returned: 0 in 0.029s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:32 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ee556b-6465-48af-b6ab-a0826721299b]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:32 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-d591aafa-f8c6-4b1b-b4f0-714eba57902a tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gbxKIWwP'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:25:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:32 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[9928750e-1b80-485c-bd36-9e3b8f659ed5]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:32 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-d591aafa-f8c6-4b1b-b4f0-714eba57902a tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:25:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:32 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[4713d333-59c2-4e37-88f7-be6ff56e5488]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:32 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-d591aafa-f8c6-4b1b-b4f0-714eba57902a tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:25:32 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:25:32 user nova-compute[95467]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:25:32 user nova-compute[95467]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)
Nov 15 08:25:32 user nova-compute[95467]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:25:32 user nova-compute[95467]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 (non-flash)
Nov 15 08:25:32 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:25:32 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-d591aafa-f8c6-4b1b-b4f0-714eba57902a tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:25:32 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:25:32 user nova-compute[95467]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:25:32 user nova-compute[95467]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)
Nov 15 08:25:32 user nova-compute[95467]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:25:32 user nova-compute[95467]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 (non-flash)
Nov 15 08:25:32 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:25:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 -p 172.16.0.220:3260 --login {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:32 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[08af13e8-446a-464e-9bbf-d4f7a331fbe9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:32 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-d591aafa-f8c6-4b1b-b4f0-714eba57902a tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373, portal: 172.16.0.220,3260]
Nov 15 08:25:32 user nova-compute[95467]: Login to [iface: default, target: iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373, portal: 172.16.0.220,3260] successful.
Nov 15 08:25:32 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:25:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:33 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:33 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4f689c-dba6-46b0-a0e7-f2d6c57ccea4]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:33 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-d591aafa-f8c6-4b1b-b4f0-714eba57902a tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:25:33 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:33 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:33 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8493f74-b1b5-4841-a5ac-738d7b5a773a]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:33 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-d591aafa-f8c6-4b1b-b4f0-714eba57902a tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:25:33 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:25:33 user nova-compute[95467]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:25:33 user nova-compute[95467]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)
Nov 15 08:25:33 user nova-compute[95467]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:25:33 user nova-compute[95467]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 (non-flash)
Nov 15 08:25:33 user nova-compute[95467]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 (non-flash)
Nov 15 08:25:33 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:25:33 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-d591aafa-f8c6-4b1b-b4f0-714eba57902a tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:25:33 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:25:33 user nova-compute[95467]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:25:33 user nova-compute[95467]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)
Nov 15 08:25:33 user nova-compute[95467]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:25:33 user nova-compute[95467]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 (non-flash)
Nov 15 08:25:33 user nova-compute[95467]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 (non-flash)
Nov 15 08:25:33 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:25:33 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-d591aafa-f8c6-4b1b-b4f0-714eba57902a tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.349s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:25:33 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-d591aafa-f8c6-4b1b-b4f0-714eba57902a tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Connected to 172.16.0.220:3260 {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 08:25:33 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-d591aafa-f8c6-4b1b-b4f0-714eba57902a tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] HCTL ('39', '-', '-', 0) found on session 45 with lun 0 {{(pid=95467) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 08:25:33 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-d591aafa-f8c6-4b1b-b4f0-714eba57902a tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=95467) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 08:25:33 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:33 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:33 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea882fa-0080-4d64-9f68-b5ef8d4c2ebe]: (4, ('- - 0', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:33 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-d591aafa-f8c6-4b1b-b4f0-714eba57902a tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Searching for a device in session 45 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:25:33 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-d591aafa-f8c6-4b1b-b4f0-714eba57902a tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gbxKIWwP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 08:25:33 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1662bd70-fc9b-4b74-a14e-c53de4b5a4e8 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Acquiring lock "d22eb02b-7e8d-4755-9f1e-3eee56ddec0c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:25:33 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1662bd70-fc9b-4b74-a14e-c53de4b5a4e8 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Lock "d22eb02b-7e8d-4755-9f1e-3eee56ddec0c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:25:33 user nova-compute[95467]: DEBUG nova.objects.instance [None req-1662bd70-fc9b-4b74-a14e-c53de4b5a4e8 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Lazy-loading 'flavor' on Instance uuid d22eb02b-7e8d-4755-9f1e-3eee56ddec0c {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:25:33 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a339a9ee-f2c5-4f72-8e26-3d0e9645b8ee tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:25:33 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a339a9ee-f2c5-4f72-8e26-3d0e9645b8ee tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] No BDM found with device name vdb, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:25:33 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a339a9ee-f2c5-4f72-8e26-3d0e9645b8ee tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] No VIF found with MAC fa:16:3e:08:74:0a, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:25:33 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1662bd70-fc9b-4b74-a14e-c53de4b5a4e8 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Lock "d22eb02b-7e8d-4755-9f1e-3eee56ddec0c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:25:33 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a339a9ee-f2c5-4f72-8e26-3d0e9645b8ee tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Lock "843b778c-f823-4bee-aa76-ab44345be9a7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.205s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:25:33 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1662bd70-fc9b-4b74-a14e-c53de4b5a4e8 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Acquiring lock "d22eb02b-7e8d-4755-9f1e-3eee56ddec0c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:25:33 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1662bd70-fc9b-4b74-a14e-c53de4b5a4e8 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Lock "d22eb02b-7e8d-4755-9f1e-3eee56ddec0c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:25:33 user nova-compute[95467]: INFO nova.compute.manager [None req-1662bd70-fc9b-4b74-a14e-c53de4b5a4e8 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Attaching volume c086dbf2-482f-40d5-815e-a7fff977a3a0 to /dev/vdb
Nov 15 08:25:33 user nova-compute[95467]: DEBUG os_brick.utils [None req-1662bd70-fc9b-4b74-a14e-c53de4b5a4e8 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:25:33 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:33 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:33 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f73a6ea-4212-48b6-b455-75957b10014b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:882ae90641f\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:33 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:33 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:33 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[4acba8d0-0244-4a29-b32b-389a7f8b16ab]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:33 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:33 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:33 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f7504f-5f22-48b2-8074-af9016ac734c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:33 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e73eb2e-4d82-48d6-b186-de2aabb43333]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:33 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-1662bd70-fc9b-4b74-a14e-c53de4b5a4e8 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Running cmd (subprocess): nvme version {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:33 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-1662bd70-fc9b-4b74-a14e-c53de4b5a4e8 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] 'nvme version' failed. Not Retrying. {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:25:33 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1662bd70-fc9b-4b74-a14e-c53de4b5a4e8 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] nvme not present on system {{(pid=95467) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 08:25:33 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:33 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:25:33 user nova-compute[95467]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 08:25:33 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[971a9292-2628-4542-83c1-30645f6865bd]: (4, '') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:33 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-1662bd70-fc9b-4b74-a14e-c53de4b5a4e8 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=95467) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 08:25:33 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-1662bd70-fc9b-4b74-a14e-c53de4b5a4e8 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 08:25:33 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-1662bd70-fc9b-4b74-a14e-c53de4b5a4e8 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] LIGHTOS: no hostnqn found. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 08:25:33 user nova-compute[95467]: DEBUG os_brick.utils [None req-1662bd70-fc9b-4b74-a14e-c53de4b5a4e8 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:882ae90641f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:25:33 user nova-compute[95467]: DEBUG nova.virt.block_device [None req-1662bd70-fc9b-4b74-a14e-c53de4b5a4e8 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Updating existing volume attachment record: 0c59167d-50be-46a7-b11b-2b43c3c9e901 {{(pid=95467) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 08:25:34 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-d591aafa-f8c6-4b1b-b4f0-714eba57902a tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.393s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:25:34 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-d591aafa-f8c6-4b1b-b4f0-714eba57902a tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] <== connect_volume: return (2563ms) {'type': 'block', 'scsi_wwn': '23762316161313039', 'path': '/dev/sdh'} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:25:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d591aafa-f8c6-4b1b-b4f0-714eba57902a tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762316161313039', 'path': '/dev/sdh'} {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 08:25:34 user nova-compute[95467]: DEBUG nova.objects.instance [None req-d591aafa-f8c6-4b1b-b4f0-714eba57902a tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lazy-loading 'flavor' on Instance uuid 739645e6-9952-40db-a876-f23d02d4e411 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:25:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-d591aafa-f8c6-4b1b-b4f0-714eba57902a tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 08:25:34 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:25:34 user nova-compute[95467]:   <source dev="/dev/sdh"/>
Nov 15 08:25:34 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:25:34 user nova-compute[95467]:   <serial>3ecac43f-808f-4c62-a879-3ed80e24c373</serial>
Nov 15 08:25:34 user nova-compute[95467]: </disk>
Nov 15 08:25:34 user nova-compute[95467]:  {{(pid=95467) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 08:25:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-d591aafa-f8c6-4b1b-b4f0-714eba57902a tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:25:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-d591aafa-f8c6-4b1b-b4f0-714eba57902a tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] No BDM found with device name vdb, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:25:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-d591aafa-f8c6-4b1b-b4f0-714eba57902a tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] No VIF found with MAC fa:16:3e:13:89:c0, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:25:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d591aafa-f8c6-4b1b-b4f0-714eba57902a tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "739645e6-9952-40db-a876-f23d02d4e411" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.004s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:25:35 user nova-compute[95467]: INFO nova.compute.manager [None req-d57c9579-6ffa-449b-acb6-95223025eedc tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Rescuing
Nov 15 08:25:35 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d57c9579-6ffa-449b-acb6-95223025eedc tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Acquiring lock "refresh_cache-739645e6-9952-40db-a876-f23d02d4e411" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:25:35 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d57c9579-6ffa-449b-acb6-95223025eedc tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Acquired lock "refresh_cache-739645e6-9952-40db-a876-f23d02d4e411" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:25:35 user nova-compute[95467]: DEBUG nova.network.neutron [None req-d57c9579-6ffa-449b-acb6-95223025eedc tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:25:36 user nova-compute[95467]: DEBUG nova.network.neutron [None req-d57c9579-6ffa-449b-acb6-95223025eedc tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Updating instance_info_cache with network_info: [{"id": "a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae", "address": "fa:16:3e:13:89:c0", "network": {"id": "369d2a6f-60b7-4c92-8b2d-1f3828f6698b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1491709218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd281be4e94a4d31a47a13267d51d9b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6f2f30d-af", "ovs_interfaceid": "a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:25:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d57c9579-6ffa-449b-acb6-95223025eedc tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Releasing lock "refresh_cache-739645e6-9952-40db-a876-f23d02d4e411" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:25:36 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e11ea9c8-d500-4cdc-81d8-ff230a746fd9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Acquiring lock "843b778c-f823-4bee-aa76-ab44345be9a7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:25:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e11ea9c8-d500-4cdc-81d8-ff230a746fd9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Lock "843b778c-f823-4bee-aa76-ab44345be9a7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:25:36 user nova-compute[95467]: DEBUG nova.objects.instance [None req-e11ea9c8-d500-4cdc-81d8-ff230a746fd9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Lazy-loading 'flavor' on Instance uuid 843b778c-f823-4bee-aa76-ab44345be9a7 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:25:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e11ea9c8-d500-4cdc-81d8-ff230a746fd9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Lock "843b778c-f823-4bee-aa76-ab44345be9a7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:25:36 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:36 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:37 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e11ea9c8-d500-4cdc-81d8-ff230a746fd9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Acquiring lock "843b778c-f823-4bee-aa76-ab44345be9a7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:25:37 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e11ea9c8-d500-4cdc-81d8-ff230a746fd9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Lock "843b778c-f823-4bee-aa76-ab44345be9a7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:25:37 user nova-compute[95467]: INFO nova.compute.manager [None req-e11ea9c8-d500-4cdc-81d8-ff230a746fd9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Attaching volume 6593af50-4de5-4559-8aa6-ddc60c31bc3a to /dev/vdc
Nov 15 08:25:37 user nova-compute[95467]: DEBUG os_brick.utils [None req-e11ea9c8-d500-4cdc-81d8-ff230a746fd9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:25:37 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:37 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:37 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9962f8c-0988-406a-86dc-b7531a996ae7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:882ae90641f\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:37 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:37 user nova-compute[95467]: DEBUG nova.compute.manager [req-0bd9a348-87c3-4198-ae20-26f32f80c200 req-f0f209c1-4f35-4c8c-9ef7-998a4e61c2dc service nova] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Received event network-vif-unplugged-a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:25:37 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-0bd9a348-87c3-4198-ae20-26f32f80c200 req-f0f209c1-4f35-4c8c-9ef7-998a4e61c2dc service nova] Acquiring lock "739645e6-9952-40db-a876-f23d02d4e411-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:25:37 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-0bd9a348-87c3-4198-ae20-26f32f80c200 req-f0f209c1-4f35-4c8c-9ef7-998a4e61c2dc service nova] Lock "739645e6-9952-40db-a876-f23d02d4e411-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:25:37 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-0bd9a348-87c3-4198-ae20-26f32f80c200 req-f0f209c1-4f35-4c8c-9ef7-998a4e61c2dc service nova] Lock "739645e6-9952-40db-a876-f23d02d4e411-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:25:37 user nova-compute[95467]: DEBUG nova.compute.manager [req-0bd9a348-87c3-4198-ae20-26f32f80c200 req-f0f209c1-4f35-4c8c-9ef7-998a4e61c2dc service nova] [instance: 739645e6-9952-40db-a876-f23d02d4e411] No waiting events found dispatching network-vif-unplugged-a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:25:37 user nova-compute[95467]: WARNING nova.compute.manager [req-0bd9a348-87c3-4198-ae20-26f32f80c200 req-f0f209c1-4f35-4c8c-9ef7-998a4e61c2dc service nova] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Received unexpected event network-vif-unplugged-a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae for instance with vm_state active and task_state rescuing.
Nov 15 08:25:37 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.057s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:37 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9140d7c-5fb5-408b-ab9b-95fe9998383c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:37 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:37 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:37 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[3667a79f-62e3-4cb1-aeea-1c4c87c175ec]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:37 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a41dd2-a684-419c-b8c2-cbb1ef96b38c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:37 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-e11ea9c8-d500-4cdc-81d8-ff230a746fd9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Running cmd (subprocess): nvme version {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:37 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-e11ea9c8-d500-4cdc-81d8-ff230a746fd9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] 'nvme version' failed. Not Retrying. {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:25:37 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e11ea9c8-d500-4cdc-81d8-ff230a746fd9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] nvme not present on system {{(pid=95467) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 08:25:37 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:37 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:25:37 user nova-compute[95467]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 08:25:37 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe72a3d-3323-477f-9b25-f5f1d2478129]: (4, '') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:37 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-e11ea9c8-d500-4cdc-81d8-ff230a746fd9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=95467) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 08:25:37 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-e11ea9c8-d500-4cdc-81d8-ff230a746fd9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 08:25:37 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-e11ea9c8-d500-4cdc-81d8-ff230a746fd9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] LIGHTOS: no hostnqn found. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 08:25:37 user nova-compute[95467]: DEBUG os_brick.utils [None req-e11ea9c8-d500-4cdc-81d8-ff230a746fd9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] <== get_connector_properties: return (179ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:882ae90641f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:25:37 user nova-compute[95467]: DEBUG nova.virt.block_device [None req-e11ea9c8-d500-4cdc-81d8-ff230a746fd9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Updating existing volume attachment record: 1bd5a822-ec84-4ee2-8687-01116dba16fe {{(pid=95467) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 08:25:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:37 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Instance destroyed successfully.
Nov 15 08:25:37 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-d57c9579-6ffa-449b-acb6-95223025eedc tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Attempting rescue
Nov 15 08:25:37 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-d57c9579-6ffa-449b-acb6-95223025eedc tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=95467) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 08:25:37 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-d57c9579-6ffa-449b-acb6-95223025eedc tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Instance directory exists: not creating {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 08:25:37 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-d57c9579-6ffa-449b-acb6-95223025eedc tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Creating image(s)
Nov 15 08:25:37 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d57c9579-6ffa-449b-acb6-95223025eedc tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Acquiring lock "/opt/stack/data/nova/instances/739645e6-9952-40db-a876-f23d02d4e411/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:25:37 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d57c9579-6ffa-449b-acb6-95223025eedc tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "/opt/stack/data/nova/instances/739645e6-9952-40db-a876-f23d02d4e411/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:25:37 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d57c9579-6ffa-449b-acb6-95223025eedc tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "/opt/stack/data/nova/instances/739645e6-9952-40db-a876-f23d02d4e411/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.060s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:25:37 user nova-compute[95467]: DEBUG nova.objects.instance [None req-d57c9579-6ffa-449b-acb6-95223025eedc tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lazy-loading 'trusted_certs' on Instance uuid 739645e6-9952-40db-a876-f23d02d4e411 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:25:37 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d57c9579-6ffa-449b-acb6-95223025eedc tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Acquiring lock "a3fcf60225fcefd310404971cd18ab9851c548dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:25:37 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d57c9579-6ffa-449b-acb6-95223025eedc tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:25:37 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-d57c9579-6ffa-449b-acb6-95223025eedc tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:37 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-d57c9579-6ffa-449b-acb6-95223025eedc tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.185s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:37 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-d57c9579-6ffa-449b-acb6-95223025eedc tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/739645e6-9952-40db-a876-f23d02d4e411/disk.rescue {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:37 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-d57c9579-6ffa-449b-acb6-95223025eedc tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/739645e6-9952-40db-a876-f23d02d4e411/disk.rescue" returned: 0 in 0.050s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:37 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d57c9579-6ffa-449b-acb6-95223025eedc tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:25:37 user nova-compute[95467]: DEBUG nova.objects.instance [None req-d57c9579-6ffa-449b-acb6-95223025eedc tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lazy-loading 'migration_context' on Instance uuid 739645e6-9952-40db-a876-f23d02d4e411 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:25:37 user nova-compute[95467]: DEBUG nova.objects.base [None req-d57c9579-6ffa-449b-acb6-95223025eedc tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Object Instance<739645e6-9952-40db-a876-f23d02d4e411> lazy-loaded attributes: trusted_certs,migration_context {{(pid=95467) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 08:25:37 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-d57c9579-6ffa-449b-acb6-95223025eedc tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Created local disks {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 08:25:37 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-d57c9579-6ffa-449b-acb6-95223025eedc tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Start _get_guest_xml network_info=[{"id": "a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae", "address": "fa:16:3e:13:89:c0", "network": {"id": "369d2a6f-60b7-4c92-8b2d-1f3828f6698b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1491709218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1491709218-network", "vif_mac": "fa:16:3e:13:89:c0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd281be4e94a4d31a47a13267d51d9b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6f2f30d-af", "ovs_interfaceid": "a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ed9c48aa-ce73-4b3b-9db1-235898be671b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:25:37 user nova-compute[95467]: DEBUG nova.objects.instance [None req-d57c9579-6ffa-449b-acb6-95223025eedc tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lazy-loading 'resources' on Instance uuid 739645e6-9952-40db-a876-f23d02d4e411 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG nova.objects.base [None req-d57c9579-6ffa-449b-acb6-95223025eedc tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Object Instance<739645e6-9952-40db-a876-f23d02d4e411> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=95467) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG nova.objects.instance [None req-d57c9579-6ffa-449b-acb6-95223025eedc tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lazy-loading 'numa_topology' on Instance uuid 739645e6-9952-40db-a876-f23d02d4e411 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG nova.objects.base [None req-d57c9579-6ffa-449b-acb6-95223025eedc tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Object Instance<739645e6-9952-40db-a876-f23d02d4e411> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=95467) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 08:25:38 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-d57c9579-6ffa-449b-acb6-95223025eedc tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:25:38 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-d57c9579-6ffa-449b-acb6-95223025eedc tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:25:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-d57c9579-6ffa-449b-acb6-95223025eedc tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-d57c9579-6ffa-449b-acb6-95223025eedc tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-d57c9579-6ffa-449b-acb6-95223025eedc tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-d57c9579-6ffa-449b-acb6-95223025eedc tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-d57c9579-6ffa-449b-acb6-95223025eedc tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-d57c9579-6ffa-449b-acb6-95223025eedc tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-d57c9579-6ffa-449b-acb6-95223025eedc tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-d57c9579-6ffa-449b-acb6-95223025eedc tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-d57c9579-6ffa-449b-acb6-95223025eedc tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-d57c9579-6ffa-449b-acb6-95223025eedc tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-d57c9579-6ffa-449b-acb6-95223025eedc tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-d57c9579-6ffa-449b-acb6-95223025eedc tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-d57c9579-6ffa-449b-acb6-95223025eedc tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-d57c9579-6ffa-449b-acb6-95223025eedc tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-d57c9579-6ffa-449b-acb6-95223025eedc tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-d57c9579-6ffa-449b-acb6-95223025eedc tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG nova.objects.instance [None req-d57c9579-6ffa-449b-acb6-95223025eedc tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lazy-loading 'vcpu_model' on Instance uuid 739645e6-9952-40db-a876-f23d02d4e411 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG nova.objects.base [None req-d57c9579-6ffa-449b-acb6-95223025eedc tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Object Instance<739645e6-9952-40db-a876-f23d02d4e411> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=95467) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-d57c9579-6ffa-449b-acb6-95223025eedc tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:23:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1308444358',display_name='tempest-ServerRescueNegativeTestJSON-server-1308444358',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1308444358',id=40,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKzoLkdMobeNcNbHKHSz6pf9KB3mnqKkGNlpbsfMF936yySn1GMTRgtnj4EoSqGo09dnRTYgYgXqxoNmiTwq5Zdq5EmI5cdClHP/6DwnQRnc+u/69gFrqzMpVc0XcKHOQ==',key_name='tempest-keypair-573508882',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:23:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bd281be4e94a4d31a47a13267d51d9b6',ramdisk_id='',reservation_id='r-qs39ggxa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1148442534',owner_user_name='tempest-ServerRescueNegativeTestJSON-1148442534-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:23:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c07f8dbc38004ecd973f61bba63606d4',uuid=739645e6-9952-40db-a876-f23d02d4e411,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae", "address": "fa:16:3e:13:89:c0", "network": {"id": "369d2a6f-60b7-4c92-8b2d-1f3828f6698b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1491709218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1491709218-network", "vif_mac": "fa:16:3e:13:89:c0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd281be4e94a4d31a47a13267d51d9b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6f2f30d-af", "ovs_interfaceid": "a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-d57c9579-6ffa-449b-acb6-95223025eedc tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Converting VIF {"id": "a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae", "address": "fa:16:3e:13:89:c0", "network": {"id": "369d2a6f-60b7-4c92-8b2d-1f3828f6698b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1491709218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1491709218-network", "vif_mac": "fa:16:3e:13:89:c0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd281be4e94a4d31a47a13267d51d9b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6f2f30d-af", "ovs_interfaceid": "a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-d57c9579-6ffa-449b-acb6-95223025eedc tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:13:89:c0,bridge_name='br-int',has_traffic_filtering=True,id=a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae,network=Network(369d2a6f-60b7-4c92-8b2d-1f3828f6698b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6f2f30d-af') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG nova.objects.instance [None req-d57c9579-6ffa-449b-acb6-95223025eedc tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lazy-loading 'pci_devices' on Instance uuid 739645e6-9952-40db-a876-f23d02d4e411 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG nova.objects.base [None req-d57c9579-6ffa-449b-acb6-95223025eedc tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Object Instance<739645e6-9952-40db-a876-f23d02d4e411> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=95467) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-d57c9579-6ffa-449b-acb6-95223025eedc tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 739645e6-9952-40db-a876-f23d02d4e411] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:25:38 user nova-compute[95467]:   <uuid>739645e6-9952-40db-a876-f23d02d4e411</uuid>
Nov 15 08:25:38 user nova-compute[95467]:   <name>instance-00000028</name>
Nov 15 08:25:38 user nova-compute[95467]:   <memory>524288</memory>
Nov 15 08:25:38 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:25:38 user nova-compute[95467]:   <metadata>
Nov 15 08:25:38 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:25:38 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:25:38 user nova-compute[95467]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1308444358</nova:name>
Nov 15 08:25:38 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:25:38</nova:creationTime>
Nov 15 08:25:38 user nova-compute[95467]:       <nova:flavor name="m1.tiny">
Nov 15 08:25:38 user nova-compute[95467]:         <nova:memory>512</nova:memory>
Nov 15 08:25:38 user nova-compute[95467]:         <nova:disk>1</nova:disk>
Nov 15 08:25:38 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:25:38 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:25:38 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:25:38 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:25:38 user nova-compute[95467]:       <nova:owner>
Nov 15 08:25:38 user nova-compute[95467]:         <nova:user uuid="c07f8dbc38004ecd973f61bba63606d4">tempest-ServerRescueNegativeTestJSON-1148442534-project-member</nova:user>
Nov 15 08:25:38 user nova-compute[95467]:         <nova:project uuid="bd281be4e94a4d31a47a13267d51d9b6">tempest-ServerRescueNegativeTestJSON-1148442534</nova:project>
Nov 15 08:25:38 user nova-compute[95467]:       </nova:owner>
Nov 15 08:25:38 user nova-compute[95467]:       <nova:root type="image" uuid="ed9c48aa-ce73-4b3b-9db1-235898be671b"/>
Nov 15 08:25:38 user nova-compute[95467]:       <nova:ports>
Nov 15 08:25:38 user nova-compute[95467]:         <nova:port uuid="a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae">
Nov 15 08:25:38 user nova-compute[95467]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 08:25:38 user nova-compute[95467]:         </nova:port>
Nov 15 08:25:38 user nova-compute[95467]:       </nova:ports>
Nov 15 08:25:38 user nova-compute[95467]:     </nova:instance>
Nov 15 08:25:38 user nova-compute[95467]:   </metadata>
Nov 15 08:25:38 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:25:38 user nova-compute[95467]:     <system>
Nov 15 08:25:38 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:25:38 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:25:38 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:25:38 user nova-compute[95467]:       <entry name="serial">739645e6-9952-40db-a876-f23d02d4e411</entry>
Nov 15 08:25:38 user nova-compute[95467]:       <entry name="uuid">739645e6-9952-40db-a876-f23d02d4e411</entry>
Nov 15 08:25:38 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:25:38 user nova-compute[95467]:     </system>
Nov 15 08:25:38 user nova-compute[95467]:   </sysinfo>
Nov 15 08:25:38 user nova-compute[95467]:   <os>
Nov 15 08:25:38 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:25:38 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:25:38 user nova-compute[95467]:   </os>
Nov 15 08:25:38 user nova-compute[95467]:   <features>
Nov 15 08:25:38 user nova-compute[95467]:     <acpi/>
Nov 15 08:25:38 user nova-compute[95467]:     <apic/>
Nov 15 08:25:38 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:25:38 user nova-compute[95467]:   </features>
Nov 15 08:25:38 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:25:38 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:25:38 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:25:38 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:25:38 user nova-compute[95467]:   </clock>
Nov 15 08:25:38 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:25:38 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:25:38 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:25:38 user nova-compute[95467]:   </cpu>
Nov 15 08:25:38 user nova-compute[95467]:   <devices>
Nov 15 08:25:38 user nova-compute[95467]:     <disk type="file" device="disk">
Nov 15 08:25:38 user nova-compute[95467]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 08:25:38 user nova-compute[95467]:       <source file="/opt/stack/data/nova/instances/739645e6-9952-40db-a876-f23d02d4e411/disk.rescue"/>
Nov 15 08:25:38 user nova-compute[95467]:       <target dev="vda" bus="virtio"/>
Nov 15 08:25:38 user nova-compute[95467]:     </disk>
Nov 15 08:25:38 user nova-compute[95467]:     <disk type="file" device="disk">
Nov 15 08:25:38 user nova-compute[95467]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 08:25:38 user nova-compute[95467]:       <source file="/opt/stack/data/nova/instances/739645e6-9952-40db-a876-f23d02d4e411/disk"/>
Nov 15 08:25:38 user nova-compute[95467]:       <target dev="vdb" bus="virtio"/>
Nov 15 08:25:38 user nova-compute[95467]:     </disk>
Nov 15 08:25:38 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:25:38 user nova-compute[95467]:       <mac address="fa:16:3e:13:89:c0"/>
Nov 15 08:25:38 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:25:38 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:25:38 user nova-compute[95467]:       <target dev="tapa6f2f30d-af"/>
Nov 15 08:25:38 user nova-compute[95467]:     </interface>
Nov 15 08:25:38 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:25:38 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/739645e6-9952-40db-a876-f23d02d4e411/console.log" append="off"/>
Nov 15 08:25:38 user nova-compute[95467]:     </serial>
Nov 15 08:25:38 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:25:38 user nova-compute[95467]:     <video>
Nov 15 08:25:38 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:25:38 user nova-compute[95467]:     </video>
Nov 15 08:25:38 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:25:38 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:25:38 user nova-compute[95467]:     </rng>
Nov 15 08:25:38 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:25:38 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:25:38 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:25:38 user nova-compute[95467]:     </memballoon>
Nov 15 08:25:38 user nova-compute[95467]:   </devices>
Nov 15 08:25:38 user nova-compute[95467]: </domain>
Nov 15 08:25:38 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:25:38 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Instance destroyed successfully.
Nov 15 08:25:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-d57c9579-6ffa-449b-acb6-95223025eedc tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-d57c9579-6ffa-449b-acb6-95223025eedc tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] No BDM found with device name vdb, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-d57c9579-6ffa-449b-acb6-95223025eedc tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] No VIF found with MAC fa:16:3e:13:89:c0, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1662bd70-fc9b-4b74-a14e-c53de4b5a4e8 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Calling os-brick to attach iSCSI Volume {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1662bd70-fc9b-4b74-a14e-c53de4b5a4e8 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kVIbNLMg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:25:38 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-1662bd70-fc9b-4b74-a14e-c53de4b5a4e8 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:25:38 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-1662bd70-fc9b-4b74-a14e-c53de4b5a4e8 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-1662bd70-fc9b-4b74-a14e-c53de4b5a4e8 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:25:38 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-1662bd70-fc9b-4b74-a14e-c53de4b5a4e8 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:25:38 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-1662bd70-fc9b-4b74-a14e-c53de4b5a4e8 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-1662bd70-fc9b-4b74-a14e-c53de4b5a4e8 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:25:38 user nova-compute[95467]: INFO os_brick.initiator.connectors.iscsi [None req-1662bd70-fc9b-4b74-a14e-c53de4b5a4e8 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 08:25:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 -p 172.16.0.220:3260 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[363bc502-a917-4823-8f88-b200e58e25ec]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1662bd70-fc9b-4b74-a14e-c53de4b5a4e8 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 08:25:38 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 -p 172.16.0.220:3260 --interface default --op new {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee9f1bc-cec5-4d46-b232-7503eb2b81c8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0] added\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1662bd70-fc9b-4b74-a14e-c53de4b5a4e8 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0] added
Nov 15 08:25:38 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[35345e96-6cd8-406b-968a-2ab6eb28a7f9]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1662bd70-fc9b-4b74-a14e-c53de4b5a4e8 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e0b356-9cbe-4fa7-89ef-d3be79efa4b7]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1662bd70-fc9b-4b74-a14e-c53de4b5a4e8 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kVIbNLMg {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kVIbNLMg" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c70557f-5f65-40ce-b006-b5442c5a69ae]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1662bd70-fc9b-4b74-a14e-c53de4b5a4e8 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kVIbNLMg'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aeb2f5d-cdbd-42df-94c4-57896ba04384]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1662bd70-fc9b-4b74-a14e-c53de4b5a4e8 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f092d11-855d-4d1e-8541-c1a93550db55]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1662bd70-fc9b-4b74-a14e-c53de4b5a4e8 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:25:38 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:25:38 user nova-compute[95467]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:25:38 user nova-compute[95467]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)
Nov 15 08:25:38 user nova-compute[95467]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:25:38 user nova-compute[95467]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 (non-flash)
Nov 15 08:25:38 user nova-compute[95467]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 (non-flash)
Nov 15 08:25:38 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1662bd70-fc9b-4b74-a14e-c53de4b5a4e8 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:25:38 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:25:38 user nova-compute[95467]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:25:38 user nova-compute[95467]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)
Nov 15 08:25:38 user nova-compute[95467]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:25:38 user nova-compute[95467]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 (non-flash)
Nov 15 08:25:38 user nova-compute[95467]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 (non-flash)
Nov 15 08:25:38 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 -p 172.16.0.220:3260 --login {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[2894792f-ba82-41c7-ada5-e05e739b19e7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1662bd70-fc9b-4b74-a14e-c53de4b5a4e8 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0, portal: 172.16.0.220,3260]
Nov 15 08:25:38 user nova-compute[95467]: Login to [iface: default, target: iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0, portal: 172.16.0.220,3260] successful.
Nov 15 08:25:38 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15ab098-43f9-4cc3-85ba-2e841f003d43]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1662bd70-fc9b-4b74-a14e-c53de4b5a4e8 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc8d812-c452-4729-941c-1fd134a7736f]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1662bd70-fc9b-4b74-a14e-c53de4b5a4e8 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:25:38 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:25:38 user nova-compute[95467]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:25:38 user nova-compute[95467]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)
Nov 15 08:25:38 user nova-compute[95467]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:25:38 user nova-compute[95467]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 (non-flash)
Nov 15 08:25:38 user nova-compute[95467]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 (non-flash)
Nov 15 08:25:38 user nova-compute[95467]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 (non-flash)
Nov 15 08:25:38 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1662bd70-fc9b-4b74-a14e-c53de4b5a4e8 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:25:38 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:25:38 user nova-compute[95467]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:25:38 user nova-compute[95467]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)
Nov 15 08:25:38 user nova-compute[95467]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:25:38 user nova-compute[95467]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 (non-flash)
Nov 15 08:25:38 user nova-compute[95467]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 (non-flash)
Nov 15 08:25:38 user nova-compute[95467]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 (non-flash)
Nov 15 08:25:38 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-1662bd70-fc9b-4b74-a14e-c53de4b5a4e8 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1662bd70-fc9b-4b74-a14e-c53de4b5a4e8 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Connected to 172.16.0.220:3260 {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-1662bd70-fc9b-4b74-a14e-c53de4b5a4e8 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] HCTL ('40', '-', '-', 0) found on session 46 with lun 0 {{(pid=95467) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-1662bd70-fc9b-4b74-a14e-c53de4b5a4e8 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=95467) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 08:25:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:39 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.015s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:39 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9547ce6-7dcd-48db-8b2c-edfb1701c451]: (4, ('- - 0', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:39 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-1662bd70-fc9b-4b74-a14e-c53de4b5a4e8 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Searching for a device in session 46 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:25:39 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1662bd70-fc9b-4b74-a14e-c53de4b5a4e8 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kVIbNLMg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 08:25:39 user nova-compute[95467]: DEBUG nova.compute.manager [req-02a1e42e-901d-452c-9935-424b8cdb1cd0 req-ad17a3b4-b707-42df-8c87-a0bd28bfe53c service nova] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Received event network-vif-plugged-a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:25:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-02a1e42e-901d-452c-9935-424b8cdb1cd0 req-ad17a3b4-b707-42df-8c87-a0bd28bfe53c service nova] Acquiring lock "739645e6-9952-40db-a876-f23d02d4e411-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:25:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-02a1e42e-901d-452c-9935-424b8cdb1cd0 req-ad17a3b4-b707-42df-8c87-a0bd28bfe53c service nova] Lock "739645e6-9952-40db-a876-f23d02d4e411-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:25:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-02a1e42e-901d-452c-9935-424b8cdb1cd0 req-ad17a3b4-b707-42df-8c87-a0bd28bfe53c service nova] Lock "739645e6-9952-40db-a876-f23d02d4e411-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:25:39 user nova-compute[95467]: DEBUG nova.compute.manager [req-02a1e42e-901d-452c-9935-424b8cdb1cd0 req-ad17a3b4-b707-42df-8c87-a0bd28bfe53c service nova] [instance: 739645e6-9952-40db-a876-f23d02d4e411] No waiting events found dispatching network-vif-plugged-a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:25:39 user nova-compute[95467]: WARNING nova.compute.manager [req-02a1e42e-901d-452c-9935-424b8cdb1cd0 req-ad17a3b4-b707-42df-8c87-a0bd28bfe53c service nova] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Received unexpected event network-vif-plugged-a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae for instance with vm_state active and task_state rescuing.
Nov 15 08:25:39 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:39 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:39 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:39 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:39 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:39 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:39 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:40 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-1662bd70-fc9b-4b74-a14e-c53de4b5a4e8 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:25:40 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1662bd70-fc9b-4b74-a14e-c53de4b5a4e8 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '23137343362303231', 'path': '/dev/sdi'} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:25:40 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1662bd70-fc9b-4b74-a14e-c53de4b5a4e8 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23137343362303231', 'path': '/dev/sdi'} {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 08:25:40 user nova-compute[95467]: DEBUG nova.objects.instance [None req-1662bd70-fc9b-4b74-a14e-c53de4b5a4e8 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Lazy-loading 'flavor' on Instance uuid d22eb02b-7e8d-4755-9f1e-3eee56ddec0c {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:25:40 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-1662bd70-fc9b-4b74-a14e-c53de4b5a4e8 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 08:25:40 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:25:40 user nova-compute[95467]:   <source dev="/dev/sdi"/>
Nov 15 08:25:40 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:25:40 user nova-compute[95467]:   <serial>c086dbf2-482f-40d5-815e-a7fff977a3a0</serial>
Nov 15 08:25:40 user nova-compute[95467]: </disk>
Nov 15 08:25:40 user nova-compute[95467]:  {{(pid=95467) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 08:25:40 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-1662bd70-fc9b-4b74-a14e-c53de4b5a4e8 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:25:40 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-1662bd70-fc9b-4b74-a14e-c53de4b5a4e8 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] No BDM found with device name vdb, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:25:40 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-1662bd70-fc9b-4b74-a14e-c53de4b5a4e8 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] No VIF found with MAC fa:16:3e:e4:27:f3, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:25:40 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1662bd70-fc9b-4b74-a14e-c53de4b5a4e8 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Lock "d22eb02b-7e8d-4755-9f1e-3eee56ddec0c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.087s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:25:41 user nova-compute[95467]: DEBUG nova.compute.manager [req-93b94896-13df-4fe0-b20d-c356fde1a1f7 req-fb052079-87e5-48cd-9b28-ba3455cc30c3 service nova] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Received event network-vif-plugged-a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:25:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-93b94896-13df-4fe0-b20d-c356fde1a1f7 req-fb052079-87e5-48cd-9b28-ba3455cc30c3 service nova] Acquiring lock "739645e6-9952-40db-a876-f23d02d4e411-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:25:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-93b94896-13df-4fe0-b20d-c356fde1a1f7 req-fb052079-87e5-48cd-9b28-ba3455cc30c3 service nova] Lock "739645e6-9952-40db-a876-f23d02d4e411-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:25:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-93b94896-13df-4fe0-b20d-c356fde1a1f7 req-fb052079-87e5-48cd-9b28-ba3455cc30c3 service nova] Lock "739645e6-9952-40db-a876-f23d02d4e411-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:25:41 user nova-compute[95467]: DEBUG nova.compute.manager [req-93b94896-13df-4fe0-b20d-c356fde1a1f7 req-fb052079-87e5-48cd-9b28-ba3455cc30c3 service nova] [instance: 739645e6-9952-40db-a876-f23d02d4e411] No waiting events found dispatching network-vif-plugged-a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:25:41 user nova-compute[95467]: WARNING nova.compute.manager [req-93b94896-13df-4fe0-b20d-c356fde1a1f7 req-fb052079-87e5-48cd-9b28-ba3455cc30c3 service nova] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Received unexpected event network-vif-plugged-a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae for instance with vm_state active and task_state rescuing.
Nov 15 08:25:41 user nova-compute[95467]: DEBUG nova.compute.manager [req-93b94896-13df-4fe0-b20d-c356fde1a1f7 req-fb052079-87e5-48cd-9b28-ba3455cc30c3 service nova] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Received event network-vif-plugged-a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:25:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-93b94896-13df-4fe0-b20d-c356fde1a1f7 req-fb052079-87e5-48cd-9b28-ba3455cc30c3 service nova] Acquiring lock "739645e6-9952-40db-a876-f23d02d4e411-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:25:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-93b94896-13df-4fe0-b20d-c356fde1a1f7 req-fb052079-87e5-48cd-9b28-ba3455cc30c3 service nova] Lock "739645e6-9952-40db-a876-f23d02d4e411-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:25:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-93b94896-13df-4fe0-b20d-c356fde1a1f7 req-fb052079-87e5-48cd-9b28-ba3455cc30c3 service nova] Lock "739645e6-9952-40db-a876-f23d02d4e411-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:25:41 user nova-compute[95467]: DEBUG nova.compute.manager [req-93b94896-13df-4fe0-b20d-c356fde1a1f7 req-fb052079-87e5-48cd-9b28-ba3455cc30c3 service nova] [instance: 739645e6-9952-40db-a876-f23d02d4e411] No waiting events found dispatching network-vif-plugged-a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:25:41 user nova-compute[95467]: WARNING nova.compute.manager [req-93b94896-13df-4fe0-b20d-c356fde1a1f7 req-fb052079-87e5-48cd-9b28-ba3455cc30c3 service nova] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Received unexpected event network-vif-plugged-a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae for instance with vm_state active and task_state rescuing.
Nov 15 08:25:41 user nova-compute[95467]: DEBUG nova.compute.manager [None req-d57c9579-6ffa-449b-acb6-95223025eedc tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:25:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:42 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e11ea9c8-d500-4cdc-81d8-ff230a746fd9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Calling os-brick to attach iSCSI Volume {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 08:25:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e11ea9c8-d500-4cdc-81d8-ff230a746fd9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6593af50-4de5-4559-8aa6-ddc60c31bc3a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WQVtPEXY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:25:42 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-e11ea9c8-d500-4cdc-81d8-ff230a746fd9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:25:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-e11ea9c8-d500-4cdc-81d8-ff230a746fd9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:25:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-e11ea9c8-d500-4cdc-81d8-ff230a746fd9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:25:42 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-e11ea9c8-d500-4cdc-81d8-ff230a746fd9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:25:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-e11ea9c8-d500-4cdc-81d8-ff230a746fd9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6593af50-4de5-4559-8aa6-ddc60c31bc3a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:25:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-e11ea9c8-d500-4cdc-81d8-ff230a746fd9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6593af50-4de5-4559-8aa6-ddc60c31bc3a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:25:42 user nova-compute[95467]: INFO os_brick.initiator.connectors.iscsi [None req-e11ea9c8-d500-4cdc-81d8-ff230a746fd9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 08:25:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6593af50-4de5-4559-8aa6-ddc60c31bc3a -p 172.16.0.220:3260 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6593af50-4de5-4559-8aa6-ddc60c31bc3a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:42 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[1967c97f-934e-4cfd-8efd-2cbc87fc2c35]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e11ea9c8-d500-4cdc-81d8-ff230a746fd9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 08:25:42 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:25:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6593af50-4de5-4559-8aa6-ddc60c31bc3a -p 172.16.0.220:3260 --interface default --op new {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6593af50-4de5-4559-8aa6-ddc60c31bc3a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:42 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e2901f-177b-4f38-a1f0-c5e4c6038b0e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6593af50-4de5-4559-8aa6-ddc60c31bc3a] added\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e11ea9c8-d500-4cdc-81d8-ff230a746fd9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6593af50-4de5-4559-8aa6-ddc60c31bc3a] added
Nov 15 08:25:42 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:25:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6593af50-4de5-4559-8aa6-ddc60c31bc3a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6593af50-4de5-4559-8aa6-ddc60c31bc3a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:42 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c94e72-debb-4db0-896b-85e4de91b392]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e11ea9c8-d500-4cdc-81d8-ff230a746fd9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:25:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6593af50-4de5-4559-8aa6-ddc60c31bc3a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:42 user nova-compute[95467]: DEBUG nova.compute.manager [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Stashing vm_state: active {{(pid=95467) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 15 08:25:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6593af50-4de5-4559-8aa6-ddc60c31bc3a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:42 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e3966a-eeef-424d-b2af-ce581d1f3ebe]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e11ea9c8-d500-4cdc-81d8-ff230a746fd9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:25:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6593af50-4de5-4559-8aa6-ddc60c31bc3a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WQVtPEXY {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6593af50-4de5-4559-8aa6-ddc60c31bc3a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WQVtPEXY" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:42 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c214df72-0b3d-4e38-9290-6d33ad60f138]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e11ea9c8-d500-4cdc-81d8-ff230a746fd9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WQVtPEXY'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:25:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6593af50-4de5-4559-8aa6-ddc60c31bc3a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6593af50-4de5-4559-8aa6-ddc60c31bc3a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:42 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[517163b3-2901-4e58-9f4f-3a06f02f43c8]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e11ea9c8-d500-4cdc-81d8-ff230a746fd9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:25:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:42 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:25:42 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:25:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:42 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[7390a614-a0ca-4150-833b-7362ac17bc93]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e11ea9c8-d500-4cdc-81d8-ff230a746fd9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:25:42 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:25:42 user nova-compute[95467]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:25:42 user nova-compute[95467]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)
Nov 15 08:25:42 user nova-compute[95467]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:25:42 user nova-compute[95467]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 (non-flash)
Nov 15 08:25:42 user nova-compute[95467]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 (non-flash)
Nov 15 08:25:42 user nova-compute[95467]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 (non-flash)
Nov 15 08:25:42 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:25:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e11ea9c8-d500-4cdc-81d8-ff230a746fd9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:25:42 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:25:42 user nova-compute[95467]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:25:42 user nova-compute[95467]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)
Nov 15 08:25:42 user nova-compute[95467]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:25:42 user nova-compute[95467]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 (non-flash)
Nov 15 08:25:42 user nova-compute[95467]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 (non-flash)
Nov 15 08:25:42 user nova-compute[95467]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 (non-flash)
Nov 15 08:25:42 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:25:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6593af50-4de5-4559-8aa6-ddc60c31bc3a -p 172.16.0.220:3260 --login {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:42 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=95467) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 08:25:42 user nova-compute[95467]: INFO nova.compute.claims [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Claim successful on node user
Nov 15 08:25:42 user nova-compute[95467]: INFO nova.compute.resource_tracker [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Updating resource usage from migration 69284ce8-8fa6-4f81-b112-d885cdea390d
Nov 15 08:25:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6593af50-4de5-4559-8aa6-ddc60c31bc3a -p 172.16.0.220:3260 --login" returned: 0 in 0.098s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:42 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2903367-ebaf-4735-90f8-42370422260f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6593af50-4de5-4559-8aa6-ddc60c31bc3a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6593af50-4de5-4559-8aa6-ddc60c31bc3a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e11ea9c8-d500-4cdc-81d8-ff230a746fd9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6593af50-4de5-4559-8aa6-ddc60c31bc3a, portal: 172.16.0.220,3260]
Nov 15 08:25:42 user nova-compute[95467]: Login to [iface: default, target: iqn.2010-10.org.openstack:6593af50-4de5-4559-8aa6-ddc60c31bc3a, portal: 172.16.0.220,3260] successful.
Nov 15 08:25:42 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:25:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6593af50-4de5-4559-8aa6-ddc60c31bc3a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6593af50-4de5-4559-8aa6-ddc60c31bc3a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:42 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36c0a72-0bd2-4f0b-a6da-84486c7ad7e6]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e11ea9c8-d500-4cdc-81d8-ff230a746fd9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:25:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:42 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f53039-3ecd-403e-8862-59c255af0443]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6593af50-4de5-4559-8aa6-ddc60c31bc3a (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e11ea9c8-d500-4cdc-81d8-ff230a746fd9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:25:42 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:25:42 user nova-compute[95467]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:25:42 user nova-compute[95467]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)
Nov 15 08:25:42 user nova-compute[95467]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:25:42 user nova-compute[95467]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 (non-flash)
Nov 15 08:25:42 user nova-compute[95467]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 (non-flash)
Nov 15 08:25:42 user nova-compute[95467]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 (non-flash)
Nov 15 08:25:42 user nova-compute[95467]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6593af50-4de5-4559-8aa6-ddc60c31bc3a (non-flash)
Nov 15 08:25:42 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:25:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e11ea9c8-d500-4cdc-81d8-ff230a746fd9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:25:42 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:25:42 user nova-compute[95467]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:25:42 user nova-compute[95467]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)
Nov 15 08:25:42 user nova-compute[95467]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:25:42 user nova-compute[95467]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 (non-flash)
Nov 15 08:25:42 user nova-compute[95467]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 (non-flash)
Nov 15 08:25:42 user nova-compute[95467]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 (non-flash)
Nov 15 08:25:42 user nova-compute[95467]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6593af50-4de5-4559-8aa6-ddc60c31bc3a (non-flash)
Nov 15 08:25:42 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:25:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-e11ea9c8-d500-4cdc-81d8-ff230a746fd9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6593af50-4de5-4559-8aa6-ddc60c31bc3a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.382s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:25:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e11ea9c8-d500-4cdc-81d8-ff230a746fd9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Connected to 172.16.0.220:3260 {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 08:25:42 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-e11ea9c8-d500-4cdc-81d8-ff230a746fd9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] HCTL ('41', '-', '-', 0) found on session 47 with lun 0 {{(pid=95467) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 08:25:42 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-e11ea9c8-d500-4cdc-81d8-ff230a746fd9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=95467) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 08:25:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:42 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3e63a0-2178-43ae-b400-bb5e30107711]: (4, ('- - 0', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:42 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-e11ea9c8-d500-4cdc-81d8-ff230a746fd9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Searching for a device in session 47 and hctl ['41', '*', '*', 0] yield: None {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:25:42 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:43 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:25:43 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:25:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.584s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:25:43 user nova-compute[95467]: INFO nova.compute.manager [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Migrating
Nov 15 08:25:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Acquiring lock "refresh_cache-d22eb02b-7e8d-4755-9f1e-3eee56ddec0c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:25:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Acquired lock "refresh_cache-d22eb02b-7e8d-4755-9f1e-3eee56ddec0c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:25:43 user nova-compute[95467]: DEBUG nova.network.neutron [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:25:43 user nova-compute[95467]: DEBUG nova.compute.manager [req-0b7a0bb7-90c1-49f0-9d48-430475929c3c req-80819554-7335-470d-b452-839afd8239b3 service nova] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Received event network-changed-93a4c2ed-b2a8-471c-8173-d221f7251e8b {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:25:43 user nova-compute[95467]: DEBUG nova.compute.manager [req-0b7a0bb7-90c1-49f0-9d48-430475929c3c req-80819554-7335-470d-b452-839afd8239b3 service nova] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Refreshing instance network info cache due to event network-changed-93a4c2ed-b2a8-471c-8173-d221f7251e8b. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:25:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-0b7a0bb7-90c1-49f0-9d48-430475929c3c req-80819554-7335-470d-b452-839afd8239b3 service nova] Acquiring lock "refresh_cache-6a551521-28cf-4b4e-94e8-5f5ecc0c37f7" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:25:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-0b7a0bb7-90c1-49f0-9d48-430475929c3c req-80819554-7335-470d-b452-839afd8239b3 service nova] Acquired lock "refresh_cache-6a551521-28cf-4b4e-94e8-5f5ecc0c37f7" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:25:43 user nova-compute[95467]: DEBUG nova.network.neutron [req-0b7a0bb7-90c1-49f0-9d48-430475929c3c req-80819554-7335-470d-b452-839afd8239b3 service nova] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Refreshing network info cache for port 93a4c2ed-b2a8-471c-8173-d221f7251e8b {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:25:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0ec0333e-1785-489a-8bf2-3bd90fd0a178 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Acquiring lock "6a551521-28cf-4b4e-94e8-5f5ecc0c37f7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:25:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0ec0333e-1785-489a-8bf2-3bd90fd0a178 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Lock "6a551521-28cf-4b4e-94e8-5f5ecc0c37f7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:25:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0ec0333e-1785-489a-8bf2-3bd90fd0a178 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Acquiring lock "6a551521-28cf-4b4e-94e8-5f5ecc0c37f7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:25:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0ec0333e-1785-489a-8bf2-3bd90fd0a178 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Lock "6a551521-28cf-4b4e-94e8-5f5ecc0c37f7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:25:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0ec0333e-1785-489a-8bf2-3bd90fd0a178 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Lock "6a551521-28cf-4b4e-94e8-5f5ecc0c37f7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:25:43 user nova-compute[95467]: INFO nova.compute.manager [None req-0ec0333e-1785-489a-8bf2-3bd90fd0a178 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Terminating instance
Nov 15 08:25:43 user nova-compute[95467]: DEBUG nova.compute.manager [None req-0ec0333e-1785-489a-8bf2-3bd90fd0a178 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Start destroying the instance on the hypervisor. {{(pid=95467) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 08:25:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:43 user nova-compute[95467]: DEBUG nova.network.neutron [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Updating instance_info_cache with network_info: [{"id": "62cba8e1-074b-41db-bb58-3363138fb060", "address": "fa:16:3e:e4:27:f3", "network": {"id": "439fd8f9-3cf0-449d-b7e1-eba4d33109f9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-399225774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7f46c4dc5bf438cad677a366bdd5b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62cba8e1-07", "ovs_interfaceid": "62cba8e1-074b-41db-bb58-3363138fb060", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:25:43 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-e11ea9c8-d500-4cdc-81d8-ff230a746fd9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Searching for a device in session 47 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:25:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e11ea9c8-d500-4cdc-81d8-ff230a746fd9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:6593af50-4de5-4559-8aa6-ddc60c31bc3a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WQVtPEXY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 08:25:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-e11ea9c8-d500-4cdc-81d8-ff230a746fd9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.416s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:25:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e11ea9c8-d500-4cdc-81d8-ff230a746fd9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] <== connect_volume: return (1418ms) {'type': 'block', 'scsi_wwn': '26536306237663035', 'path': '/dev/sdj'} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:25:43 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e11ea9c8-d500-4cdc-81d8-ff230a746fd9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26536306237663035', 'path': '/dev/sdj'} {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 08:25:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Releasing lock "refresh_cache-d22eb02b-7e8d-4755-9f1e-3eee56ddec0c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:25:43 user nova-compute[95467]: DEBUG nova.objects.instance [None req-e11ea9c8-d500-4cdc-81d8-ff230a746fd9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Lazy-loading 'flavor' on Instance uuid 843b778c-f823-4bee-aa76-ab44345be9a7 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:25:43 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-e11ea9c8-d500-4cdc-81d8-ff230a746fd9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 08:25:43 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:25:43 user nova-compute[95467]:   <source dev="/dev/sdj"/>
Nov 15 08:25:43 user nova-compute[95467]:   <target dev="vdc" bus="virtio"/>
Nov 15 08:25:43 user nova-compute[95467]:   <serial>6593af50-4de5-4559-8aa6-ddc60c31bc3a</serial>
Nov 15 08:25:43 user nova-compute[95467]: </disk>
Nov 15 08:25:43 user nova-compute[95467]:  {{(pid=95467) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 08:25:43 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Starting migrate_disk_and_power_off {{(pid=95467) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 15 08:25:44 user nova-compute[95467]: DEBUG nova.network.neutron [req-0b7a0bb7-90c1-49f0-9d48-430475929c3c req-80819554-7335-470d-b452-839afd8239b3 service nova] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Updated VIF entry in instance network info cache for port 93a4c2ed-b2a8-471c-8173-d221f7251e8b. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:25:44 user nova-compute[95467]: DEBUG nova.network.neutron [req-0b7a0bb7-90c1-49f0-9d48-430475929c3c req-80819554-7335-470d-b452-839afd8239b3 service nova] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Updating instance_info_cache with network_info: [{"id": "93a4c2ed-b2a8-471c-8173-d221f7251e8b", "address": "fa:16:3e:9b:81:50", "network": {"id": "44a920f2-9a44-480e-bbd4-82afd3303a7f", "bridge": "br-int", "label": "tempest-TestShelveInstance-57422602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7182b78b65480eb2e51db102fd9c2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93a4c2ed-b2", "ovs_interfaceid": "93a4c2ed-b2a8-471c-8173-d221f7251e8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:25:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-0b7a0bb7-90c1-49f0-9d48-430475929c3c req-80819554-7335-470d-b452-839afd8239b3 service nova] Releasing lock "refresh_cache-6a551521-28cf-4b4e-94e8-5f5ecc0c37f7" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:25:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:44 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-e11ea9c8-d500-4cdc-81d8-ff230a746fd9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:25:44 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-e11ea9c8-d500-4cdc-81d8-ff230a746fd9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] No BDM found with device name vdb, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:25:44 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-e11ea9c8-d500-4cdc-81d8-ff230a746fd9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] No BDM found with device name vdc, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:25:44 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-e11ea9c8-d500-4cdc-81d8-ff230a746fd9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] No VIF found with MAC fa:16:3e:08:74:0a, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:25:44 user nova-compute[95467]: DEBUG nova.compute.manager [req-a805acd9-d420-4fb5-8c13-130c0daaea5f req-e23cc2ca-978b-4ef5-b495-c5b24ad8503f service nova] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Received event network-vif-unplugged-62cba8e1-074b-41db-bb58-3363138fb060 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:25:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-a805acd9-d420-4fb5-8c13-130c0daaea5f req-e23cc2ca-978b-4ef5-b495-c5b24ad8503f service nova] Acquiring lock "d22eb02b-7e8d-4755-9f1e-3eee56ddec0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:25:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-a805acd9-d420-4fb5-8c13-130c0daaea5f req-e23cc2ca-978b-4ef5-b495-c5b24ad8503f service nova] Lock "d22eb02b-7e8d-4755-9f1e-3eee56ddec0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:25:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-a805acd9-d420-4fb5-8c13-130c0daaea5f req-e23cc2ca-978b-4ef5-b495-c5b24ad8503f service nova] Lock "d22eb02b-7e8d-4755-9f1e-3eee56ddec0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:25:44 user nova-compute[95467]: DEBUG nova.compute.manager [req-a805acd9-d420-4fb5-8c13-130c0daaea5f req-e23cc2ca-978b-4ef5-b495-c5b24ad8503f service nova] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] No waiting events found dispatching network-vif-unplugged-62cba8e1-074b-41db-bb58-3363138fb060 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:25:44 user nova-compute[95467]: WARNING nova.compute.manager [req-a805acd9-d420-4fb5-8c13-130c0daaea5f req-e23cc2ca-978b-4ef5-b495-c5b24ad8503f service nova] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Received unexpected event network-vif-unplugged-62cba8e1-074b-41db-bb58-3363138fb060 for instance with vm_state active and task_state resize_migrating.
Nov 15 08:25:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e11ea9c8-d500-4cdc-81d8-ff230a746fd9 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Lock "843b778c-f823-4bee-aa76-ab44345be9a7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.405s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:25:44 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:25:44 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Cleaning up deleted instances with incomplete migration  {{(pid=95467) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 08:25:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:44 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Instance destroyed successfully.
Nov 15 08:25:44 user nova-compute[95467]: DEBUG nova.objects.instance [None req-0ec0333e-1785-489a-8bf2-3bd90fd0a178 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Lazy-loading 'resources' on Instance uuid 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:25:44 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-0ec0333e-1785-489a-8bf2-3bd90fd0a178 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T08:20:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-177934737',display_name='tempest-TestShelveInstance-server-177934737',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-177934737',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJC4LZpX54Ka4CeYP7mgSTaMm2Q0taurdpd9b7can1Ul1AsTpY2sRQ536DDEYxtxG0i1vSLR8KRvCVHbBH9pBlB10+jQxss4INx8+NUQcLORFtrp/d3ty3KPezfHsZOFw==',key_name='tempest-TestShelveInstance-347903963',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:24:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dd7182b78b65480eb2e51db102fd9c2d',ramdisk_id='',reservation_id='r-8qvr6rl5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-668674769',owner_user_name='tempest-TestShelveInstance-668674769-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:24:07Z,user_data=None,user_id='354af2d9fe0e4fa4be1d9b851773e8d9',uuid=6a551521-28cf-4b4e-94e8-5f5ecc0c37f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "93a4c2ed-b2a8-471c-8173-d221f7251e8b", "address": "fa:16:3e:9b:81:50", "network": {"id": "44a920f2-9a44-480e-bbd4-82afd3303a7f", "bridge": "br-int", "label": "tempest-TestShelveInstance-57422602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7182b78b65480eb2e51db102fd9c2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93a4c2ed-b2", "ovs_interfaceid": "93a4c2ed-b2a8-471c-8173-d221f7251e8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:25:44 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-0ec0333e-1785-489a-8bf2-3bd90fd0a178 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Converting VIF {"id": "93a4c2ed-b2a8-471c-8173-d221f7251e8b", "address": "fa:16:3e:9b:81:50", "network": {"id": "44a920f2-9a44-480e-bbd4-82afd3303a7f", "bridge": "br-int", "label": "tempest-TestShelveInstance-57422602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7182b78b65480eb2e51db102fd9c2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93a4c2ed-b2", "ovs_interfaceid": "93a4c2ed-b2a8-471c-8173-d221f7251e8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:25:44 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-0ec0333e-1785-489a-8bf2-3bd90fd0a178 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:81:50,bridge_name='br-int',has_traffic_filtering=True,id=93a4c2ed-b2a8-471c-8173-d221f7251e8b,network=Network(44a920f2-9a44-480e-bbd4-82afd3303a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93a4c2ed-b2') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:25:44 user nova-compute[95467]: DEBUG os_vif [None req-0ec0333e-1785-489a-8bf2-3bd90fd0a178 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:81:50,bridge_name='br-int',has_traffic_filtering=True,id=93a4c2ed-b2a8-471c-8173-d221f7251e8b,network=Network(44a920f2-9a44-480e-bbd4-82afd3303a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93a4c2ed-b2') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:25:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap93a4c2ed-b2, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:25:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:25:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f4939204-7846-4cde-8f8c-75e881c1b763) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:25:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:25:44 user nova-compute[95467]: INFO os_vif [None req-0ec0333e-1785-489a-8bf2-3bd90fd0a178 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:81:50,bridge_name='br-int',has_traffic_filtering=True,id=93a4c2ed-b2a8-471c-8173-d221f7251e8b,network=Network(44a920f2-9a44-480e-bbd4-82afd3303a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93a4c2ed-b2')
Nov 15 08:25:44 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ec0333e-1785-489a-8bf2-3bd90fd0a178 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] calling os-brick to detach iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 08:25:44 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ec0333e-1785-489a-8bf2-3bd90fd0a178 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, {'target_iqn': 'iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yDMrVtcn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:25:44 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-0ec0333e-1785-489a-8bf2-3bd90fd0a178 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:25:44 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-0ec0333e-1785-489a-8bf2-3bd90fd0a178 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:25:44 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-0ec0333e-1785-489a-8bf2-3bd90fd0a178 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:25:44 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Instance destroyed successfully.
Nov 15 08:25:44 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:21:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-748321325',display_name='tempest-ServerActionsTestOtherB-server-748321325',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-748321325',id=37,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4fkN7k+peQ5MHRVAmSWsJ4XWACmBTaERqxpnxcsdjwMrROQbOXtjSL/x5jDo9fewvV0xuNQFNzIDf7IiXE/hxIrMO+qPlCpDl2ne6370CaB1c+V4MsUeGSWpmCOrmyfA==',key_name='tempest-keypair-1354708686',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:21:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b7f46c4dc5bf438cad677a366bdd5b5f',ramdisk_id='',reservation_id='r-1rd2gc25',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-220421987',owner_user_name='tempest-ServerActionsTestOtherB-220421987-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:25:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53a0c2be5d1f4831961aa1cc29c4d46f',uuid=d22eb02b-7e8d-4755-9f1e-3eee56ddec0c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "62cba8e1-074b-41db-bb58-3363138fb060", "address": "fa:16:3e:e4:27:f3", "network": {"id": "439fd8f9-3cf0-449d-b7e1-eba4d33109f9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-399225774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-399225774-network", "vif_mac": "fa:16:3e:e4:27:f3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7f46c4dc5bf438cad677a366bdd5b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62cba8e1-07", "ovs_interfaceid": "62cba8e1-074b-41db-bb58-3363138fb060", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:25:44 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Converting VIF {"id": "62cba8e1-074b-41db-bb58-3363138fb060", "address": "fa:16:3e:e4:27:f3", "network": {"id": "439fd8f9-3cf0-449d-b7e1-eba4d33109f9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-399225774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-399225774-network", "vif_mac": "fa:16:3e:e4:27:f3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7f46c4dc5bf438cad677a366bdd5b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62cba8e1-07", "ovs_interfaceid": "62cba8e1-074b-41db-bb58-3363138fb060", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:25:44 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:27:f3,bridge_name='br-int',has_traffic_filtering=True,id=62cba8e1-074b-41db-bb58-3363138fb060,network=Network(439fd8f9-3cf0-449d-b7e1-eba4d33109f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62cba8e1-07') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:25:44 user nova-compute[95467]: DEBUG os_vif [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:27:f3,bridge_name='br-int',has_traffic_filtering=True,id=62cba8e1-074b-41db-bb58-3363138fb060,network=Network(439fd8f9-3cf0-449d-b7e1-eba4d33109f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62cba8e1-07') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:25:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap62cba8e1-07, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:25:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:25:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:44 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ac9192-8927-4e15-a494-e2b9b20c0980]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6593af50-4de5-4559-8aa6-ddc60c31bc3a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:44 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ec0333e-1785-489a-8bf2-3bd90fd0a178 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 08:25:44 user nova-compute[95467]: No targets found.
Nov 15 08:25:44 user nova-compute[95467]: iSNS:
Nov 15 08:25:44 user nova-compute[95467]: No targets found.
Nov 15 08:25:44 user nova-compute[95467]: STATIC:
Nov 15 08:25:44 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:6593af50-4de5-4559-8aa6-ddc60c31bc3a
Nov 15 08:25:44 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:25:44 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:25:44 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24
Nov 15 08:25:44 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:25:44 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:25:44 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b
Nov 15 08:25:44 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:25:44 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:25:44 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0
Nov 15 08:25:44 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:25:44 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:25:44 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e
Nov 15 08:25:44 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:25:44 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:25:44 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373
Nov 15 08:25:44 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:25:44 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:25:44 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775
Nov 15 08:25:44 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:25:44 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:25:44 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400
Nov 15 08:25:44 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:25:44 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:25:44 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8
Nov 15 08:25:44 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:25:44 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:25:44 user nova-compute[95467]: FIRMWARE:
Nov 15 08:25:44 user nova-compute[95467]: No targets found.
Nov 15 08:25:44 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:25:44 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ec0333e-1785-489a-8bf2-3bd90fd0a178 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 08:25:44 user nova-compute[95467]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 08:25:44 user nova-compute[95467]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=95467) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 08:25:44 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ec0333e-1785-489a-8bf2-3bd90fd0a178 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775', 0)] {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 08:25:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d88d175b-3ff7-43b0-a796-76d7ae4c1435) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:25:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e1d1b5ee-db01-4587-b613-da34166ef422 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Acquiring lock "843b778c-f823-4bee-aa76-ab44345be9a7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:25:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e1d1b5ee-db01-4587-b613-da34166ef422 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Lock "843b778c-f823-4bee-aa76-ab44345be9a7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:25:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:25:45 user nova-compute[95467]: INFO os_vif [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:27:f3,bridge_name='br-int',has_traffic_filtering=True,id=62cba8e1-074b-41db-bb58-3363138fb060,network=Network(439fd8f9-3cf0-449d-b7e1-eba4d33109f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62cba8e1-07')
Nov 15 08:25:45 user nova-compute[95467]: INFO nova.compute.manager [None req-e1d1b5ee-db01-4587-b613-da34166ef422 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Detaching volume 6593af50-4de5-4559-8aa6-ddc60c31bc3a
Nov 15 08:25:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[837db001-8df7-4103-bda8-5a7929dc6969]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6593af50-4de5-4559-8aa6-ddc60c31bc3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] calling os-brick to detach iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, {'target_iqn': 'iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kVIbNLMg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:25:45 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:25:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe00d06d-ba54-4d54-8ef7-09fcaac239c2]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6593af50-4de5-4559-8aa6-ddc60c31bc3a (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ec0333e-1785-489a-8bf2-3bd90fd0a178 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:25:45 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:25:45 user nova-compute[95467]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:25:45 user nova-compute[95467]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)
Nov 15 08:25:45 user nova-compute[95467]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:25:45 user nova-compute[95467]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 (non-flash)
Nov 15 08:25:45 user nova-compute[95467]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 (non-flash)
Nov 15 08:25:45 user nova-compute[95467]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 (non-flash)
Nov 15 08:25:45 user nova-compute[95467]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6593af50-4de5-4559-8aa6-ddc60c31bc3a (non-flash)
Nov 15 08:25:45 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ec0333e-1785-489a-8bf2-3bd90fd0a178 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:25:45 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:25:45 user nova-compute[95467]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 (non-flash)
Nov 15 08:25:45 user nova-compute[95467]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)
Nov 15 08:25:45 user nova-compute[95467]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:25:45 user nova-compute[95467]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 (non-flash)
Nov 15 08:25:45 user nova-compute[95467]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 (non-flash)
Nov 15 08:25:45 user nova-compute[95467]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 (non-flash)
Nov 15 08:25:45 user nova-compute[95467]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6593af50-4de5-4559-8aa6-ddc60c31bc3a (non-flash)
Nov 15 08:25:45 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ec0333e-1785-489a-8bf2-3bd90fd0a178 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efed9fa16c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775'): ({'sdf'}, set())}) {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-0ec0333e-1785-489a-8bf2-3bd90fd0a178 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Removing single pathed devices sdf {{(pid=95467) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[12239652-d9b7-4076-bbaa-d850517caa89]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:45 user nova-compute[95467]: INFO nova.virt.block_device [None req-e1d1b5ee-db01-4587-b613-da34166ef422 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Attempting to driver detach volume 6593af50-4de5-4559-8aa6-ddc60c31bc3a from mountpoint /dev/vdc
Nov 15 08:25:45 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-e1d1b5ee-db01-4587-b613-da34166ef422 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Attempting to detach device vdc from instance 843b778c-f823-4bee-aa76-ab44345be9a7 from the persistent domain config. {{(pid=95467) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-e1d1b5ee-db01-4587-b613-da34166ef422 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 08:25:45 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:25:45 user nova-compute[95467]:   <source dev="/dev/sdj"/>
Nov 15 08:25:45 user nova-compute[95467]:   <target dev="vdc" bus="virtio"/>
Nov 15 08:25:45 user nova-compute[95467]:   <serial>6593af50-4de5-4559-8aa6-ddc60c31bc3a</serial>
Nov 15 08:25:45 user nova-compute[95467]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 08:25:45 user nova-compute[95467]: </disk>
Nov 15 08:25:45 user nova-compute[95467]:  {{(pid=95467) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.027s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3cff67-1779-4ba5-b157-0e9c8ecd311a]: (4, ('ok\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-0ec0333e-1785-489a-8bf2-3bd90fd0a178 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Flushing IO for device /dev/sdf {{(pid=95467) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:45 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-e1d1b5ee-db01-4587-b613-da34166ef422 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Successfully detached device vdc from instance 843b778c-f823-4bee-aa76-ab44345be9a7 from the persistent domain config.
Nov 15 08:25:45 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-e1d1b5ee-db01-4587-b613-da34166ef422 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 843b778c-f823-4bee-aa76-ab44345be9a7 from the live domain config. {{(pid=95467) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-e1d1b5ee-db01-4587-b613-da34166ef422 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 08:25:45 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:25:45 user nova-compute[95467]:   <source dev="/dev/sdj"/>
Nov 15 08:25:45 user nova-compute[95467]:   <target dev="vdc" bus="virtio"/>
Nov 15 08:25:45 user nova-compute[95467]:   <serial>6593af50-4de5-4559-8aa6-ddc60c31bc3a</serial>
Nov 15 08:25:45 user nova-compute[95467]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 08:25:45 user nova-compute[95467]: </disk>
Nov 15 08:25:45 user nova-compute[95467]:  {{(pid=95467) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.028s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[0399a03b-6fa5-45e2-af34-c9d36a882c61]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-0ec0333e-1785-489a-8bf2-3bd90fd0a178 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=95467) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.044s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78d591c-e5ba-4f03-a10b-4e33c73f6499]: (4, ('1', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-0ec0333e-1785-489a-8bf2-3bd90fd0a178 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-0ec0333e-1785-489a-8bf2-3bd90fd0a178 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] SCSI volumes sdf have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ec0333e-1785-489a-8bf2-3bd90fd0a178 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775')] {{(pid=95467) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa8bf39-6a26-4193-924c-bd0018b44ab7]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ec0333e-1785-489a-8bf2-3bd90fd0a178 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 -p 172.16.0.220:3260 --logout {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f772546-19e2-492b-a674-799f79cd0066]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ec0333e-1785-489a-8bf2-3bd90fd0a178 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775, portal: 172.16.0.220,3260]
Nov 15 08:25:45 user nova-compute[95467]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775, portal: 172.16.0.220,3260] successful.
Nov 15 08:25:45 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 -p 172.16.0.220:3260 --op delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:965f0947-8c2b-4f39-a814-22493fb16775 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33bc691-b051-4b05-859b-959d25c66e3e]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ec0333e-1785-489a-8bf2-3bd90fd0a178 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-0ec0333e-1785-489a-8bf2-3bd90fd0a178 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.408s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ec0333e-1785-489a-8bf2-3bd90fd0a178 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] <== disconnect_volume: return (409ms) None {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ec0333e-1785-489a-8bf2-3bd90fd0a178 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Disconnected iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 08:25:45 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-0ec0333e-1785-489a-8bf2-3bd90fd0a178 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Deleting instance files /opt/stack/data/nova/instances/6a551521-28cf-4b4e-94e8-5f5ecc0c37f7_del
Nov 15 08:25:45 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-0ec0333e-1785-489a-8bf2-3bd90fd0a178 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Deletion of /opt/stack/data/nova/instances/6a551521-28cf-4b4e-94e8-5f5ecc0c37f7_del complete
Nov 15 08:25:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.347s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e82e1c3-7d3c-41c9-95e5-f3239e52d76d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6593af50-4de5-4559-8aa6-ddc60c31bc3a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 08:25:45 user nova-compute[95467]: No targets found.
Nov 15 08:25:45 user nova-compute[95467]: iSNS:
Nov 15 08:25:45 user nova-compute[95467]: No targets found.
Nov 15 08:25:45 user nova-compute[95467]: STATIC:
Nov 15 08:25:45 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:6593af50-4de5-4559-8aa6-ddc60c31bc3a
Nov 15 08:25:45 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:25:45 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:25:45 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24
Nov 15 08:25:45 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:25:45 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:25:45 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b
Nov 15 08:25:45 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:25:45 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:25:45 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0
Nov 15 08:25:45 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:25:45 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:25:45 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e
Nov 15 08:25:45 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:25:45 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:25:45 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373
Nov 15 08:25:45 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:25:45 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:25:45 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400
Nov 15 08:25:45 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:25:45 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:25:45 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8
Nov 15 08:25:45 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:25:45 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:25:45 user nova-compute[95467]: FIRMWARE:
Nov 15 08:25:45 user nova-compute[95467]: No targets found.
Nov 15 08:25:45 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 08:25:45 user nova-compute[95467]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 08:25:45 user nova-compute[95467]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=95467) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0', 0)] {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.059s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f11f8939-2071-4000-aca3-b8372d433792]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6593af50-4de5-4559-8aa6-ddc60c31bc3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84298b9-6658-4666-993a-67f5340ba527]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6593af50-4de5-4559-8aa6-ddc60c31bc3a (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:25:45 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:25:45 user nova-compute[95467]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)
Nov 15 08:25:45 user nova-compute[95467]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:25:45 user nova-compute[95467]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 (non-flash)
Nov 15 08:25:45 user nova-compute[95467]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 (non-flash)
Nov 15 08:25:45 user nova-compute[95467]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 (non-flash)
Nov 15 08:25:45 user nova-compute[95467]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6593af50-4de5-4559-8aa6-ddc60c31bc3a (non-flash)
Nov 15 08:25:45 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:25:45 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:25:45 user nova-compute[95467]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)
Nov 15 08:25:45 user nova-compute[95467]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:25:45 user nova-compute[95467]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 (non-flash)
Nov 15 08:25:45 user nova-compute[95467]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 (non-flash)
Nov 15 08:25:45 user nova-compute[95467]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 (non-flash)
Nov 15 08:25:45 user nova-compute[95467]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6593af50-4de5-4559-8aa6-ddc60c31bc3a (non-flash)
Nov 15 08:25:45 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efed844a710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0'): ({'sdi'}, set())}) {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Removing single pathed devices sdi {{(pid=95467) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG nova.compute.manager [req-b1fb79a0-3ac5-4266-bfb0-53711e15e77f req-84c3f737-27d0-4e84-84ba-e31c6c4d6bcc service nova] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Received event network-vif-unplugged-93a4c2ed-b2a8-471c-8173-d221f7251e8b {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b1fb79a0-3ac5-4266-bfb0-53711e15e77f req-84c3f737-27d0-4e84-84ba-e31c6c4d6bcc service nova] Acquiring lock "6a551521-28cf-4b4e-94e8-5f5ecc0c37f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b1fb79a0-3ac5-4266-bfb0-53711e15e77f req-84c3f737-27d0-4e84-84ba-e31c6c4d6bcc service nova] Lock "6a551521-28cf-4b4e-94e8-5f5ecc0c37f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b1fb79a0-3ac5-4266-bfb0-53711e15e77f req-84c3f737-27d0-4e84-84ba-e31c6c4d6bcc service nova] Lock "6a551521-28cf-4b4e-94e8-5f5ecc0c37f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG nova.compute.manager [req-b1fb79a0-3ac5-4266-bfb0-53711e15e77f req-84c3f737-27d0-4e84-84ba-e31c6c4d6bcc service nova] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] No waiting events found dispatching network-vif-unplugged-93a4c2ed-b2a8-471c-8173-d221f7251e8b {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG nova.compute.manager [req-b1fb79a0-3ac5-4266-bfb0-53711e15e77f req-84c3f737-27d0-4e84-84ba-e31c6c4d6bcc service nova] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Received event network-vif-unplugged-93a4c2ed-b2a8-471c-8173-d221f7251e8b for instance with task_state deleting. {{(pid=95467) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG nova.compute.manager [req-b1fb79a0-3ac5-4266-bfb0-53711e15e77f req-84c3f737-27d0-4e84-84ba-e31c6c4d6bcc service nova] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Received event network-vif-plugged-93a4c2ed-b2a8-471c-8173-d221f7251e8b {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b1fb79a0-3ac5-4266-bfb0-53711e15e77f req-84c3f737-27d0-4e84-84ba-e31c6c4d6bcc service nova] Acquiring lock "6a551521-28cf-4b4e-94e8-5f5ecc0c37f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b1fb79a0-3ac5-4266-bfb0-53711e15e77f req-84c3f737-27d0-4e84-84ba-e31c6c4d6bcc service nova] Lock "6a551521-28cf-4b4e-94e8-5f5ecc0c37f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b1fb79a0-3ac5-4266-bfb0-53711e15e77f req-84c3f737-27d0-4e84-84ba-e31c6c4d6bcc service nova] Lock "6a551521-28cf-4b4e-94e8-5f5ecc0c37f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG nova.compute.manager [req-b1fb79a0-3ac5-4266-bfb0-53711e15e77f req-84c3f737-27d0-4e84-84ba-e31c6c4d6bcc service nova] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] No waiting events found dispatching network-vif-plugged-93a4c2ed-b2a8-471c-8173-d221f7251e8b {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:25:45 user nova-compute[95467]: WARNING nova.compute.manager [req-b1fb79a0-3ac5-4266-bfb0-53711e15e77f req-84c3f737-27d0-4e84-84ba-e31c6c4d6bcc service nova] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Received unexpected event network-vif-plugged-93a4c2ed-b2a8-471c-8173-d221f7251e8b for instance with vm_state active and task_state deleting.
Nov 15 08:25:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:45 user nova-compute[95467]: INFO nova.compute.manager [None req-0ec0333e-1785-489a-8bf2-3bd90fd0a178 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Took 1.98 seconds to destroy the instance on the hypervisor.
Nov 15 08:25:45 user nova-compute[95467]: DEBUG oslo.service.loopingcall [None req-0ec0333e-1785-489a-8bf2-3bd90fd0a178 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=95467) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG nova.compute.manager [-] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Deallocating network for instance {{(pid=95467) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] deallocate_for_instance() {{(pid=95467) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e04d017-10dd-4573-be51-f2a3af669add]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.026s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[762b5afa-dc36-4d52-bb68-a47f5a701ff6]: (4, ('ok\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Flushing IO for device /dev/sdi {{(pid=95467) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b3fc7d-b8b1-45ac-9900-673f7cef3570]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=95467) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.044s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1ce5f2-91b0-4ebf-84b8-5be56bce72d5]: (4, ('1', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] SCSI volumes sdi have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0')] {{(pid=95467) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-e1d1b5ee-db01-4587-b613-da34166ef422 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 843b778c-f823-4bee-aa76-ab44345be9a7 {{(pid=95467) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[798c26f4-5e45-487e-8032-cdf1373d27db]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 -p 172.16.0.220:3260 --logout {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[642ee6ae-3a65-4092-a59e-693a75abbb5d]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0, portal: 172.16.0.220,3260]
Nov 15 08:25:45 user nova-compute[95467]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0, portal: 172.16.0.220,3260] successful.
Nov 15 08:25:45 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 -p 172.16.0.220:3260 --op delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a24fb927-48e3-49f6-a02e-f0afbbf8097c]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.412s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] <== disconnect_volume: return (759ms) None {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Disconnected iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d22eb02b-7e8d-4755-9f1e-3eee56ddec0c/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d22eb02b-7e8d-4755-9f1e-3eee56ddec0c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d22eb02b-7e8d-4755-9f1e-3eee56ddec0c/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d22eb02b-7e8d-4755-9f1e-3eee56ddec0c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:46 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:25:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/d22eb02b-7e8d-4755-9f1e-3eee56ddec0c_resize/disk /opt/stack/data/nova/instances/d22eb02b-7e8d-4755-9f1e-3eee56ddec0c/disk {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:46 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:25:46 user nova-compute[95467]: INFO nova.compute.manager [-] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Took 0.80 seconds to deallocate network for instance.
Nov 15 08:25:46 user nova-compute[95467]: DEBUG nova.compute.manager [req-36ef7f4c-72dc-4b6b-bcbb-c46163420f0f req-76b33cd7-2ed5-4edf-8b68-054a66d652d0 service nova] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Received event network-vif-plugged-62cba8e1-074b-41db-bb58-3363138fb060 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:25:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-36ef7f4c-72dc-4b6b-bcbb-c46163420f0f req-76b33cd7-2ed5-4edf-8b68-054a66d652d0 service nova] Acquiring lock "d22eb02b-7e8d-4755-9f1e-3eee56ddec0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:25:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-36ef7f4c-72dc-4b6b-bcbb-c46163420f0f req-76b33cd7-2ed5-4edf-8b68-054a66d652d0 service nova] Lock "d22eb02b-7e8d-4755-9f1e-3eee56ddec0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:25:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-36ef7f4c-72dc-4b6b-bcbb-c46163420f0f req-76b33cd7-2ed5-4edf-8b68-054a66d652d0 service nova] Lock "d22eb02b-7e8d-4755-9f1e-3eee56ddec0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:25:46 user nova-compute[95467]: DEBUG nova.compute.manager [req-36ef7f4c-72dc-4b6b-bcbb-c46163420f0f req-76b33cd7-2ed5-4edf-8b68-054a66d652d0 service nova] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] No waiting events found dispatching network-vif-plugged-62cba8e1-074b-41db-bb58-3363138fb060 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:25:46 user nova-compute[95467]: WARNING nova.compute.manager [req-36ef7f4c-72dc-4b6b-bcbb-c46163420f0f req-76b33cd7-2ed5-4edf-8b68-054a66d652d0 service nova] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Received unexpected event network-vif-plugged-62cba8e1-074b-41db-bb58-3363138fb060 for instance with vm_state active and task_state resize_migrating.
Nov 15 08:25:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] CMD "cp -r /opt/stack/data/nova/instances/d22eb02b-7e8d-4755-9f1e-3eee56ddec0c_resize/disk /opt/stack/data/nova/instances/d22eb02b-7e8d-4755-9f1e-3eee56ddec0c/disk" returned: 0 in 0.361s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/d22eb02b-7e8d-4755-9f1e-3eee56ddec0c_resize/disk.info /opt/stack/data/nova/instances/d22eb02b-7e8d-4755-9f1e-3eee56ddec0c/disk.info {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:46 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] CMD "cp -r /opt/stack/data/nova/instances/d22eb02b-7e8d-4755-9f1e-3eee56ddec0c_resize/disk.info /opt/stack/data/nova/instances/d22eb02b-7e8d-4755-9f1e-3eee56ddec0c/disk.info" returned: 0 in 0.036s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:47 user nova-compute[95467]: INFO nova.compute.manager [None req-0ec0333e-1785-489a-8bf2-3bd90fd0a178 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Took 0.79 seconds to detach 1 volumes for instance.
Nov 15 08:25:47 user nova-compute[95467]: DEBUG nova.compute.manager [None req-0ec0333e-1785-489a-8bf2-3bd90fd0a178 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Deleting volume: 965f0947-8c2b-4f39-a814-22493fb16775 {{(pid=95467) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 08:25:47 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0ec0333e-1785-489a-8bf2-3bd90fd0a178 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:25:47 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0ec0333e-1785-489a-8bf2-3bd90fd0a178 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:25:47 user nova-compute[95467]: DEBUG nova.compute.manager [req-9c4531b9-4276-47e6-8f88-5838fcb2ba36 req-456e0787-93fd-467a-895e-de5e58d706b0 service nova] [instance: 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7] Received event network-vif-deleted-93a4c2ed-b2a8-471c-8173-d221f7251e8b {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:25:47 user nova-compute[95467]: DEBUG nova.network.neutron [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Port 62cba8e1-074b-41db-bb58-3363138fb060 binding to destination host user is already ACTIVE {{(pid=95467) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 15 08:25:47 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:25:47 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=95467) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 08:25:47 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Acquiring lock "d22eb02b-7e8d-4755-9f1e-3eee56ddec0c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:25:47 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Lock "d22eb02b-7e8d-4755-9f1e-3eee56ddec0c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:25:47 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Lock "d22eb02b-7e8d-4755-9f1e-3eee56ddec0c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:25:47 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:47 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Acquiring lock "refresh_cache-d22eb02b-7e8d-4755-9f1e-3eee56ddec0c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:25:47 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Acquired lock "refresh_cache-d22eb02b-7e8d-4755-9f1e-3eee56ddec0c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:25:47 user nova-compute[95467]: DEBUG nova.network.neutron [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:25:47 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-0ec0333e-1785-489a-8bf2-3bd90fd0a178 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:25:47 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-0ec0333e-1785-489a-8bf2-3bd90fd0a178 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:25:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0ec0333e-1785-489a-8bf2-3bd90fd0a178 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.800s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:25:48 user nova-compute[95467]: INFO nova.scheduler.client.report [None req-0ec0333e-1785-489a-8bf2-3bd90fd0a178 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Deleted allocations for instance 6a551521-28cf-4b4e-94e8-5f5ecc0c37f7
Nov 15 08:25:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0ec0333e-1785-489a-8bf2-3bd90fd0a178 tempest-TestShelveInstance-668674769 tempest-TestShelveInstance-668674769-project-member] Lock "6a551521-28cf-4b4e-94e8-5f5ecc0c37f7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.636s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:25:48 user nova-compute[95467]: DEBUG nova.network.neutron [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Updating instance_info_cache with network_info: [{"id": "62cba8e1-074b-41db-bb58-3363138fb060", "address": "fa:16:3e:e4:27:f3", "network": {"id": "439fd8f9-3cf0-449d-b7e1-eba4d33109f9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-399225774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7f46c4dc5bf438cad677a366bdd5b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62cba8e1-07", "ovs_interfaceid": "62cba8e1-074b-41db-bb58-3363138fb060", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:25:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Releasing lock "refresh_cache-d22eb02b-7e8d-4755-9f1e-3eee56ddec0c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:25:48 user nova-compute[95467]: DEBUG os_brick.utils [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:25:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:48 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d6c35d-c615-4873-9452-53aab7a31a2c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:882ae90641f\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:48 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5eb8d5-739b-489b-a54c-bbcad3c854cf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:48 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d6e221-a101-4838-9126-cc3be7566c91]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:48 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[1167cc37-7a66-4a49-97ef-c82c5a5c7b45]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Running cmd (subprocess): nvme version {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] 'nvme version' failed. Not Retrying. {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:25:48 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] nvme not present on system {{(pid=95467) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 08:25:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:25:48 user nova-compute[95467]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 08:25:48 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a09291-a436-42dd-a870-99e3250581ed]: (4, '') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:48 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=95467) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 08:25:48 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 08:25:48 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] LIGHTOS: no hostnqn found. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 08:25:48 user nova-compute[95467]: DEBUG os_brick.utils [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:882ae90641f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:25:48 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:25:48 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:25:48 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager.update_available_resource {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:25:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:25:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:25:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:25:48 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Auditing locally available compute resources for user (node: user) {{(pid=95467) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 08:25:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d22eb02b-7e8d-4755-9f1e-3eee56ddec0c/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d22eb02b-7e8d-4755-9f1e-3eee56ddec0c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d22eb02b-7e8d-4755-9f1e-3eee56ddec0c/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d22eb02b-7e8d-4755-9f1e-3eee56ddec0c/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:49 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:25:49 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:25:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:49 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:25:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/843b778c-f823-4bee-aa76-ab44345be9a7/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/843b778c-f823-4bee-aa76-ab44345be9a7/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/843b778c-f823-4bee-aa76-ab44345be9a7/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/843b778c-f823-4bee-aa76-ab44345be9a7/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:49 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:25:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk.rescue --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk.rescue --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/218f0d21-181c-4634-b6f7-20137fe30520/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/218f0d21-181c-4634-b6f7-20137fe30520/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/218f0d21-181c-4634-b6f7-20137fe30520/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/218f0d21-181c-4634-b6f7-20137fe30520/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a155e6-0ee2-4728-a526-17c149107ab0/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a155e6-0ee2-4728-a526-17c149107ab0/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a155e6-0ee2-4728-a526-17c149107ab0/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a155e6-0ee2-4728-a526-17c149107ab0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:51 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:25:51 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:25:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f14502f-8c4d-400a-a68a-f3f9c3d48524/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f14502f-8c4d-400a-a68a-f3f9c3d48524/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f14502f-8c4d-400a-a68a-f3f9c3d48524/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f14502f-8c4d-400a-a68a-f3f9c3d48524/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091612cf-b737-480b-984e-a05b522676b6/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091612cf-b737-480b-984e-a05b522676b6/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091612cf-b737-480b-984e-a05b522676b6/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:52 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091612cf-b737-480b-984e-a05b522676b6/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/739645e6-9952-40db-a876-f23d02d4e411/disk.rescue --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/739645e6-9952-40db-a876-f23d02d4e411/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/739645e6-9952-40db-a876-f23d02d4e411/disk.rescue --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/739645e6-9952-40db-a876-f23d02d4e411/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:53 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /opt/stack/data/nova/instances/739645e6-9952-40db-a876-f23d02d4e411/disk (vdb) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:25:53 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:25:53 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:25:53 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Hypervisor/Node resource view: name=user free_ram=6890MB free_disk=24.882732391357422GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=95467) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 08:25:53 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:25:53 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:25:53 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Starting finish_migration {{(pid=95467) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 15 08:25:53 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Instance directory exists: not creating {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 08:25:53 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Creating image(s)
Nov 15 08:25:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Applying migration context for instance d22eb02b-7e8d-4755-9f1e-3eee56ddec0c as it has an incoming, in-progress migration 69284ce8-8fa6-4f81-b112-d885cdea390d. Migration status is post-migrating {{(pid=95467) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 15 08:25:54 user nova-compute[95467]: INFO nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Updating resource usage from migration 69284ce8-8fa6-4f81-b112-d885cdea390d
Nov 15 08:25:54 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 73fe8852-c47a-47ab-a56f-6864c8ed5479 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 21cf2ada-b15c-490d-ac37-96e9c87e9056 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 10d73b73-ca65-4192-8954-288dc1df9f24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 3825a691-ac5c-4c06-b4a4-2a0b40c638c4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance a1a155e6-0ee2-4728-a526-17c149107ab0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 091612cf-b737-480b-984e-a05b522676b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 843b778c-f823-4bee-aa76-ab44345be9a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 739645e6-9952-40db-a876-f23d02d4e411 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance ba05c01d-ae74-467c-a309-4d0ba904453d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 7f14502f-8c4d-400a-a68a-f3f9c3d48524 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 218f0d21-181c-4634-b6f7-20137fe30520 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 7eb1f0ce-72bd-4015-993c-a32404f15481 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Migration 69284ce8-8fa6-4f81-b112-d885cdea390d is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance d22eb02b-7e8d-4755-9f1e-3eee56ddec0c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Total usable vcpus: 12, total allocated vcpus: 16 {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Final resource view: name=user phys_ram=16011MB used_ram=11776MB phys_disk=40GB used_disk=31GB total_vcpus=12 used_vcpus=16 pci_stats=[] {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Refreshing inventories for resource provider f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.178s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d22eb02b-7e8d-4755-9f1e-3eee56ddec0c/disk. size=21474836480 {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d22eb02b-7e8d-4755-9f1e-3eee56ddec0c/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Updating ProviderTree inventory for provider f56c3524-ed11-494e-82e4-b1a23920d1ae from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Updating inventory in ProviderTree for provider f56c3524-ed11-494e-82e4-b1a23920d1ae with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Refreshing aggregate associations for resource provider f56c3524-ed11-494e-82e4-b1a23920d1ae, aggregates: None {{(pid=95467) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Refreshing trait associations for resource provider f56c3524-ed11-494e-82e4-b1a23920d1ae, traits: COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSSE3,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI {{(pid=95467) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d22eb02b-7e8d-4755-9f1e-3eee56ddec0c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/d22eb02b-7e8d-4755-9f1e-3eee56ddec0c/disk 21474836480 {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/d22eb02b-7e8d-4755-9f1e-3eee56ddec0c/disk 21474836480" returned: 0 in 0.046s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Did not create local disks {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Ensure instance console log exists: /opt/stack/data/nova/instances/d22eb02b-7e8d-4755-9f1e-3eee56ddec0c/console.log {{(pid=95467) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Start _get_guest_xml network_info=[{"id": "62cba8e1-074b-41db-bb58-3363138fb060", "address": "fa:16:3e:e4:27:f3", "network": {"id": "439fd8f9-3cf0-449d-b7e1-eba4d33109f9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-399225774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-399225774-network", "vif_mac": "fa:16:3e:e4:27:f3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7f46c4dc5bf438cad677a366bdd5b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62cba8e1-07", "ovs_interfaceid": "62cba8e1-074b-41db-bb58-3363138fb060", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'ed9c48aa-ce73-4b3b-9db1-235898be671b'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '433c79f6-b936-40a8-8dab-e923de6784c0', 'delete_on_termination': False, 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kVIbNLMg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'd22eb02b-7e8d-4755-9f1e-3eee56ddec0c', 'attached_at': '2023-11-15T08:25:53.000000', 'detached_at': '', 'volume_id': 'c086dbf2-482f-40d5-815e-a7fff977a3a0', 'serial': 'c086dbf2-482f-40d5-815e-a7fff977a3a0'}, 'volume_type': None} {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:25:54 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:25:54 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:25:54 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Calling os-brick to attach iSCSI Volume {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kVIbNLMg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:25:54 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:25:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:25:54 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:25:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:25:54 user nova-compute[95467]: INFO os_brick.initiator.connectors.iscsi [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 08:25:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 -p 172.16.0.220:3260 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[79bd19a1-5c19-404d-bb4f-3cb4c2621743]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 08:25:54 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 -p 172.16.0.220:3260 --interface default --op new {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[621d465a-1d48-4b39-8506-04a7a13552b0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0] added\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0] added
Nov 15 08:25:54 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[02cb584b-7d00-473d-8ffd-b6d5f7dd0a26]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26cb8df-8063-4521-b826-56c357d03f9b]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kVIbNLMg {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kVIbNLMg" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b58ea4-98c1-4995-9e2b-551db34493ad]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kVIbNLMg'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[3615f963-45df-44cf-a07f-f5cc704825d2]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b12bd45-32f6-4f9b-b35f-b37c943ecd89]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6593af50-4de5-4559-8aa6-ddc60c31bc3a (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:25:54 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:25:54 user nova-compute[95467]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)
Nov 15 08:25:54 user nova-compute[95467]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:25:54 user nova-compute[95467]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 (non-flash)
Nov 15 08:25:54 user nova-compute[95467]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 (non-flash)
Nov 15 08:25:54 user nova-compute[95467]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6593af50-4de5-4559-8aa6-ddc60c31bc3a (non-flash)
Nov 15 08:25:54 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:25:54 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:25:54 user nova-compute[95467]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)
Nov 15 08:25:54 user nova-compute[95467]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:25:54 user nova-compute[95467]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 (non-flash)
Nov 15 08:25:54 user nova-compute[95467]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 (non-flash)
Nov 15 08:25:54 user nova-compute[95467]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6593af50-4de5-4559-8aa6-ddc60c31bc3a (non-flash)
Nov 15 08:25:54 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 -p 172.16.0.220:3260 --login {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[523f1ce6-88a2-4484-8cfc-63b3ad794f1a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0, portal: 172.16.0.220,3260]
Nov 15 08:25:54 user nova-compute[95467]: Login to [iface: default, target: iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0, portal: 172.16.0.220,3260] successful.
Nov 15 08:25:54 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5039f6e-13b8-4188-b1b4-b89a32eaf014]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Compute_service record updated for user:user {{(pid=95467) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.922s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Cleaning up deleted instances {{(pid=95467) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f265a7-97e3-45de-9de1-864d4e62026c]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6593af50-4de5-4559-8aa6-ddc60c31bc3a (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:25:54 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:25:54 user nova-compute[95467]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)
Nov 15 08:25:54 user nova-compute[95467]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:25:54 user nova-compute[95467]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 (non-flash)
Nov 15 08:25:54 user nova-compute[95467]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 (non-flash)
Nov 15 08:25:54 user nova-compute[95467]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6593af50-4de5-4559-8aa6-ddc60c31bc3a (non-flash)
Nov 15 08:25:54 user nova-compute[95467]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 (non-flash)
Nov 15 08:25:54 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:25:54 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:25:54 user nova-compute[95467]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)
Nov 15 08:25:54 user nova-compute[95467]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:25:54 user nova-compute[95467]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 (non-flash)
Nov 15 08:25:54 user nova-compute[95467]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 (non-flash)
Nov 15 08:25:54 user nova-compute[95467]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6593af50-4de5-4559-8aa6-ddc60c31bc3a (non-flash)
Nov 15 08:25:54 user nova-compute[95467]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 (non-flash)
Nov 15 08:25:54 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Connected to 172.16.0.220:3260 {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] HCTL ('37', '-', '-', 0) found on session 48 with lun 0 {{(pid=95467) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=95467) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] There are 0 instances to clean {{(pid=95467) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e245a4f-df3c-4191-8c92-798933338cf4]: (4, ('- - 0', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Searching for a device in session 48 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kVIbNLMg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 08:25:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:25:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '23137343362303231', 'path': '/dev/sdf'} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:25:55 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23137343362303231', 'path': '/dev/sdf'} {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 08:25:55 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:21:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-748321325',display_name='tempest-ServerActionsTestOtherB-server-748321325',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-748321325',id=37,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4fkN7k+peQ5MHRVAmSWsJ4XWACmBTaERqxpnxcsdjwMrROQbOXtjSL/x5jDo9fewvV0xuNQFNzIDf7IiXE/hxIrMO+qPlCpDl2ne6370CaB1c+V4MsUeGSWpmCOrmyfA==',key_name='tempest-keypair-1354708686',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:21:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b7f46c4dc5bf438cad677a366bdd5b5f',ramdisk_id='',reservation_id='r-1rd2gc25',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-220421987',owner_user_name='tempest-ServerActionsTestOtherB-220421987-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:25:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53a0c2be5d1f4831961aa1cc29c4d46f',uuid=d22eb02b-7e8d-4755-9f1e-3eee56ddec0c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "62cba8e1-074b-41db-bb58-3363138fb060", "address": "fa:16:3e:e4:27:f3", "network": {"id": "439fd8f9-3cf0-449d-b7e1-eba4d33109f9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-399225774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-399225774-network", "vif_mac": "fa:16:3e:e4:27:f3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7f46c4dc5bf438cad677a366bdd5b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62cba8e1-07", "ovs_interfaceid": "62cba8e1-074b-41db-bb58-3363138fb060", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:25:55 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Converting VIF {"id": "62cba8e1-074b-41db-bb58-3363138fb060", "address": "fa:16:3e:e4:27:f3", "network": {"id": "439fd8f9-3cf0-449d-b7e1-eba4d33109f9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-399225774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-399225774-network", "vif_mac": "fa:16:3e:e4:27:f3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7f46c4dc5bf438cad677a366bdd5b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62cba8e1-07", "ovs_interfaceid": "62cba8e1-074b-41db-bb58-3363138fb060", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:25:55 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:27:f3,bridge_name='br-int',has_traffic_filtering=True,id=62cba8e1-074b-41db-bb58-3363138fb060,network=Network(439fd8f9-3cf0-449d-b7e1-eba4d33109f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62cba8e1-07') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:25:55 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:25:55 user nova-compute[95467]:   <uuid>d22eb02b-7e8d-4755-9f1e-3eee56ddec0c</uuid>
Nov 15 08:25:55 user nova-compute[95467]:   <name>instance-00000025</name>
Nov 15 08:25:55 user nova-compute[95467]:   <memory>2097152</memory>
Nov 15 08:25:55 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:25:55 user nova-compute[95467]:   <metadata>
Nov 15 08:25:55 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:25:55 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:25:55 user nova-compute[95467]:       <nova:name>tempest-ServerActionsTestOtherB-server-748321325</nova:name>
Nov 15 08:25:55 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:25:54</nova:creationTime>
Nov 15 08:25:55 user nova-compute[95467]:       <nova:flavor name="m1.small">
Nov 15 08:25:55 user nova-compute[95467]:         <nova:memory>2048</nova:memory>
Nov 15 08:25:55 user nova-compute[95467]:         <nova:disk>20</nova:disk>
Nov 15 08:25:55 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:25:55 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:25:55 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:25:55 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:25:55 user nova-compute[95467]:       <nova:owner>
Nov 15 08:25:55 user nova-compute[95467]:         <nova:user uuid="53a0c2be5d1f4831961aa1cc29c4d46f">tempest-ServerActionsTestOtherB-220421987-project-member</nova:user>
Nov 15 08:25:55 user nova-compute[95467]:         <nova:project uuid="b7f46c4dc5bf438cad677a366bdd5b5f">tempest-ServerActionsTestOtherB-220421987</nova:project>
Nov 15 08:25:55 user nova-compute[95467]:       </nova:owner>
Nov 15 08:25:55 user nova-compute[95467]:       <nova:root type="image" uuid="ed9c48aa-ce73-4b3b-9db1-235898be671b"/>
Nov 15 08:25:55 user nova-compute[95467]:       <nova:ports>
Nov 15 08:25:55 user nova-compute[95467]:         <nova:port uuid="62cba8e1-074b-41db-bb58-3363138fb060">
Nov 15 08:25:55 user nova-compute[95467]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 15 08:25:55 user nova-compute[95467]:         </nova:port>
Nov 15 08:25:55 user nova-compute[95467]:       </nova:ports>
Nov 15 08:25:55 user nova-compute[95467]:     </nova:instance>
Nov 15 08:25:55 user nova-compute[95467]:   </metadata>
Nov 15 08:25:55 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:25:55 user nova-compute[95467]:     <system>
Nov 15 08:25:55 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:25:55 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:25:55 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:25:55 user nova-compute[95467]:       <entry name="serial">d22eb02b-7e8d-4755-9f1e-3eee56ddec0c</entry>
Nov 15 08:25:55 user nova-compute[95467]:       <entry name="uuid">d22eb02b-7e8d-4755-9f1e-3eee56ddec0c</entry>
Nov 15 08:25:55 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:25:55 user nova-compute[95467]:     </system>
Nov 15 08:25:55 user nova-compute[95467]:   </sysinfo>
Nov 15 08:25:55 user nova-compute[95467]:   <os>
Nov 15 08:25:55 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:25:55 user nova-compute[95467]:     <boot dev="hd"/>
Nov 15 08:25:55 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:25:55 user nova-compute[95467]:   </os>
Nov 15 08:25:55 user nova-compute[95467]:   <features>
Nov 15 08:25:55 user nova-compute[95467]:     <acpi/>
Nov 15 08:25:55 user nova-compute[95467]:     <apic/>
Nov 15 08:25:55 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:25:55 user nova-compute[95467]:   </features>
Nov 15 08:25:55 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:25:55 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:25:55 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:25:55 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:25:55 user nova-compute[95467]:   </clock>
Nov 15 08:25:55 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:25:55 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:25:55 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:25:55 user nova-compute[95467]:   </cpu>
Nov 15 08:25:55 user nova-compute[95467]:   <devices>
Nov 15 08:25:55 user nova-compute[95467]:     <disk type="file" device="disk">
Nov 15 08:25:55 user nova-compute[95467]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 08:25:55 user nova-compute[95467]:       <source file="/opt/stack/data/nova/instances/d22eb02b-7e8d-4755-9f1e-3eee56ddec0c/disk"/>
Nov 15 08:25:55 user nova-compute[95467]:       <target dev="vda" bus="virtio"/>
Nov 15 08:25:55 user nova-compute[95467]:     </disk>
Nov 15 08:25:55 user nova-compute[95467]:     <disk type="block" device="disk">
Nov 15 08:25:55 user nova-compute[95467]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:25:55 user nova-compute[95467]:       <source dev="/dev/sdf"/>
Nov 15 08:25:55 user nova-compute[95467]:       <target dev="vdb" bus="virtio"/>
Nov 15 08:25:55 user nova-compute[95467]:       <serial>c086dbf2-482f-40d5-815e-a7fff977a3a0</serial>
Nov 15 08:25:55 user nova-compute[95467]:     </disk>
Nov 15 08:25:55 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:25:55 user nova-compute[95467]:       <mac address="fa:16:3e:e4:27:f3"/>
Nov 15 08:25:55 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:25:55 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:25:55 user nova-compute[95467]:       <target dev="tap62cba8e1-07"/>
Nov 15 08:25:55 user nova-compute[95467]:     </interface>
Nov 15 08:25:55 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:25:55 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/d22eb02b-7e8d-4755-9f1e-3eee56ddec0c/console.log" append="off"/>
Nov 15 08:25:55 user nova-compute[95467]:     </serial>
Nov 15 08:25:55 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:25:55 user nova-compute[95467]:     <video>
Nov 15 08:25:55 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:25:55 user nova-compute[95467]:     </video>
Nov 15 08:25:55 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:25:55 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:25:55 user nova-compute[95467]:     </rng>
Nov 15 08:25:55 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:25:55 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:25:55 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:25:55 user nova-compute[95467]:     </memballoon>
Nov 15 08:25:55 user nova-compute[95467]:   </devices>
Nov 15 08:25:55 user nova-compute[95467]: </domain>
Nov 15 08:25:55 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:25:55 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:21:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-748321325',display_name='tempest-ServerActionsTestOtherB-server-748321325',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-748321325',id=37,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4fkN7k+peQ5MHRVAmSWsJ4XWACmBTaERqxpnxcsdjwMrROQbOXtjSL/x5jDo9fewvV0xuNQFNzIDf7IiXE/hxIrMO+qPlCpDl2ne6370CaB1c+V4MsUeGSWpmCOrmyfA==',key_name='tempest-keypair-1354708686',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:21:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b7f46c4dc5bf438cad677a366bdd5b5f',ramdisk_id='',reservation_id='r-1rd2gc25',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-220421987',owner_user_name='tempest-ServerActionsTestOtherB-220421987-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:25:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53a0c2be5d1f4831961aa1cc29c4d46f',uuid=d22eb02b-7e8d-4755-9f1e-3eee56ddec0c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "62cba8e1-074b-41db-bb58-3363138fb060", "address": "fa:16:3e:e4:27:f3", "network": {"id": "439fd8f9-3cf0-449d-b7e1-eba4d33109f9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-399225774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-399225774-network", "vif_mac": "fa:16:3e:e4:27:f3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7f46c4dc5bf438cad677a366bdd5b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62cba8e1-07", "ovs_interfaceid": "62cba8e1-074b-41db-bb58-3363138fb060", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:25:55 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Converting VIF {"id": "62cba8e1-074b-41db-bb58-3363138fb060", "address": "fa:16:3e:e4:27:f3", "network": {"id": "439fd8f9-3cf0-449d-b7e1-eba4d33109f9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-399225774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-399225774-network", "vif_mac": "fa:16:3e:e4:27:f3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7f46c4dc5bf438cad677a366bdd5b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62cba8e1-07", "ovs_interfaceid": "62cba8e1-074b-41db-bb58-3363138fb060", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:25:55 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:27:f3,bridge_name='br-int',has_traffic_filtering=True,id=62cba8e1-074b-41db-bb58-3363138fb060,network=Network(439fd8f9-3cf0-449d-b7e1-eba4d33109f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62cba8e1-07') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:25:55 user nova-compute[95467]: DEBUG os_vif [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:27:f3,bridge_name='br-int',has_traffic_filtering=True,id=62cba8e1-074b-41db-bb58-3363138fb060,network=Network(439fd8f9-3cf0-449d-b7e1-eba4d33109f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62cba8e1-07') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:25:55 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:55 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:25:55 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:25:55 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:55 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f5d761f3-0679-5756-b53a-16721bb0b0f8', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:25:55 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:25:55 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:55 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap62cba8e1-07, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:25:55 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap62cba8e1-07, col_values=(('qos', UUID('af4949b8-58b8-43ee-8fcb-11313cd095dc')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:25:55 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap62cba8e1-07, col_values=(('external_ids', {'iface-id': '62cba8e1-074b-41db-bb58-3363138fb060', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:27:f3', 'vm-uuid': 'd22eb02b-7e8d-4755-9f1e-3eee56ddec0c'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:25:55 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:25:55 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:55 user nova-compute[95467]: INFO os_vif [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:27:f3,bridge_name='br-int',has_traffic_filtering=True,id=62cba8e1-074b-41db-bb58-3363138fb060,network=Network(439fd8f9-3cf0-449d-b7e1-eba4d33109f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62cba8e1-07')
Nov 15 08:25:55 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:25:55 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] No BDM found with device name vdb, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:25:55 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] No VIF found with MAC fa:16:3e:e4:27:f3, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:25:56 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:25:56 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:25:56 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:25:56 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Starting heal instance info cache {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 08:25:56 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Rebuilding the list of instances to heal {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 08:25:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "refresh_cache-73fe8852-c47a-47ab-a56f-6864c8ed5479" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:25:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquired lock "refresh_cache-73fe8852-c47a-47ab-a56f-6864c8ed5479" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:25:56 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] Forcefully refreshing network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 08:25:56 user nova-compute[95467]: DEBUG nova.objects.instance [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lazy-loading 'info_cache' on Instance uuid 73fe8852-c47a-47ab-a56f-6864c8ed5479 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:25:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:57 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] Updating instance_info_cache with network_info: [{"id": "d7e5ca44-eee3-4452-9649-5fcbfe5ed5ad", "address": "fa:16:3e:e5:16:8b", "network": {"id": "d8a362dc-0dc8-49dd-b2da-0e0749d5edca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-256373617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a1aa4f562c64545a94157d4aaf8d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7e5ca44-ee", "ovs_interfaceid": "d7e5ca44-eee3-4452-9649-5fcbfe5ed5ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:25:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Releasing lock "refresh_cache-73fe8852-c47a-47ab-a56f-6864c8ed5479" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:25:57 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] Updated the network info_cache for instance {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 08:25:57 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:25:57 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:25:57 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:25:57 user nova-compute[95467]: DEBUG nova.compute.manager [req-2a27922c-1b18-4bc1-a011-cf2ee78ff044 req-384a1a32-6b5b-488e-88a9-597f6c27a803 service nova] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Received event network-vif-plugged-62cba8e1-074b-41db-bb58-3363138fb060 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:25:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-2a27922c-1b18-4bc1-a011-cf2ee78ff044 req-384a1a32-6b5b-488e-88a9-597f6c27a803 service nova] Acquiring lock "d22eb02b-7e8d-4755-9f1e-3eee56ddec0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:25:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-2a27922c-1b18-4bc1-a011-cf2ee78ff044 req-384a1a32-6b5b-488e-88a9-597f6c27a803 service nova] Lock "d22eb02b-7e8d-4755-9f1e-3eee56ddec0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:25:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-2a27922c-1b18-4bc1-a011-cf2ee78ff044 req-384a1a32-6b5b-488e-88a9-597f6c27a803 service nova] Lock "d22eb02b-7e8d-4755-9f1e-3eee56ddec0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:25:57 user nova-compute[95467]: DEBUG nova.compute.manager [req-2a27922c-1b18-4bc1-a011-cf2ee78ff044 req-384a1a32-6b5b-488e-88a9-597f6c27a803 service nova] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] No waiting events found dispatching network-vif-plugged-62cba8e1-074b-41db-bb58-3363138fb060 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:25:57 user nova-compute[95467]: WARNING nova.compute.manager [req-2a27922c-1b18-4bc1-a011-cf2ee78ff044 req-384a1a32-6b5b-488e-88a9-597f6c27a803 service nova] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Received unexpected event network-vif-plugged-62cba8e1-074b-41db-bb58-3363138fb060 for instance with vm_state active and task_state resize_finish.
Nov 15 08:25:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:25:59 user nova-compute[95467]: DEBUG nova.compute.manager [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Instance event wait completed in 0 seconds for  {{(pid=95467) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 08:25:59 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Instance running successfully.
Nov 15 08:25:59 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Failed to set time: agent not configured {{(pid=95467) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 15 08:25:59 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-a44817a8-855a-43d3-9644-bec7a5cece45 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] finish_migration finished successfully. {{(pid=95467) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 15 08:25:59 user nova-compute[95467]: DEBUG nova.compute.manager [req-7743b1ff-29af-497a-b536-c87f5922eb83 req-87a7ac02-f615-4e35-855d-75504da012fe service nova] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Received event network-vif-plugged-62cba8e1-074b-41db-bb58-3363138fb060 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:25:59 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-7743b1ff-29af-497a-b536-c87f5922eb83 req-87a7ac02-f615-4e35-855d-75504da012fe service nova] Acquiring lock "d22eb02b-7e8d-4755-9f1e-3eee56ddec0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:25:59 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-7743b1ff-29af-497a-b536-c87f5922eb83 req-87a7ac02-f615-4e35-855d-75504da012fe service nova] Lock "d22eb02b-7e8d-4755-9f1e-3eee56ddec0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:25:59 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-7743b1ff-29af-497a-b536-c87f5922eb83 req-87a7ac02-f615-4e35-855d-75504da012fe service nova] Lock "d22eb02b-7e8d-4755-9f1e-3eee56ddec0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:25:59 user nova-compute[95467]: DEBUG nova.compute.manager [req-7743b1ff-29af-497a-b536-c87f5922eb83 req-87a7ac02-f615-4e35-855d-75504da012fe service nova] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] No waiting events found dispatching network-vif-plugged-62cba8e1-074b-41db-bb58-3363138fb060 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:25:59 user nova-compute[95467]: WARNING nova.compute.manager [req-7743b1ff-29af-497a-b536-c87f5922eb83 req-87a7ac02-f615-4e35-855d-75504da012fe service nova] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Received unexpected event network-vif-plugged-62cba8e1-074b-41db-bb58-3363138fb060 for instance with vm_state active and task_state resize_finish.
Nov 15 08:26:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:26:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:26:05 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-e1d1b5ee-db01-4587-b613-da34166ef422 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 843b778c-f823-4bee-aa76-ab44345be9a7 is timed out.
Nov 15 08:26:05 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-e1d1b5ee-db01-4587-b613-da34166ef422 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Successfully detached device vdc from instance 843b778c-f823-4bee-aa76-ab44345be9a7 from the live domain config.
Nov 15 08:26:05 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1d1b5ee-db01-4587-b613-da34166ef422 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] calling os-brick to detach iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 08:26:05 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d1b5ee-db01-4587-b613-da34166ef422 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, {'target_iqn': 'iqn.2010-10.org.openstack:6593af50-4de5-4559-8aa6-ddc60c31bc3a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WQVtPEXY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:26:05 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-e1d1b5ee-db01-4587-b613-da34166ef422 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:26:05 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-e1d1b5ee-db01-4587-b613-da34166ef422 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:26:05 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-e1d1b5ee-db01-4587-b613-da34166ef422 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:26:05 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:05 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:26:05 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba32a550-90e6-4c88-bbc9-0667d762fa03]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6593af50-4de5-4559-8aa6-ddc60c31bc3a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:26:05 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d1b5ee-db01-4587-b613-da34166ef422 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 08:26:05 user nova-compute[95467]: No targets found.
Nov 15 08:26:05 user nova-compute[95467]: iSNS:
Nov 15 08:26:05 user nova-compute[95467]: No targets found.
Nov 15 08:26:05 user nova-compute[95467]: STATIC:
Nov 15 08:26:05 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:6593af50-4de5-4559-8aa6-ddc60c31bc3a
Nov 15 08:26:05 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:26:05 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:26:05 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24
Nov 15 08:26:05 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:26:05 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:26:05 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b
Nov 15 08:26:05 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:26:05 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:26:05 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0
Nov 15 08:26:05 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:26:05 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:26:05 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e
Nov 15 08:26:05 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:26:05 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:26:05 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373
Nov 15 08:26:05 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:26:05 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:26:05 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400
Nov 15 08:26:05 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:26:05 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:26:05 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8
Nov 15 08:26:05 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:26:05 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:26:05 user nova-compute[95467]: FIRMWARE:
Nov 15 08:26:05 user nova-compute[95467]: No targets found.
Nov 15 08:26:05 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:26:05 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d1b5ee-db01-4587-b613-da34166ef422 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 08:26:05 user nova-compute[95467]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 08:26:05 user nova-compute[95467]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=95467) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 08:26:05 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d1b5ee-db01-4587-b613-da34166ef422 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6593af50-4de5-4559-8aa6-ddc60c31bc3a', 0)] {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 08:26:05 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:05 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:26:05 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[49071364-dab6-4fb2-b007-12c74c1ef1a4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6593af50-4de5-4559-8aa6-ddc60c31bc3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:26:05 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:05 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:26:05 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0860dfb-d0db-4759-a56e-bfcaad1b6750]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6593af50-4de5-4559-8aa6-ddc60c31bc3a (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:26:05 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d1b5ee-db01-4587-b613-da34166ef422 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:26:05 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:26:05 user nova-compute[95467]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)
Nov 15 08:26:05 user nova-compute[95467]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:26:05 user nova-compute[95467]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 (non-flash)
Nov 15 08:26:05 user nova-compute[95467]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 (non-flash)
Nov 15 08:26:05 user nova-compute[95467]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6593af50-4de5-4559-8aa6-ddc60c31bc3a (non-flash)
Nov 15 08:26:05 user nova-compute[95467]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 (non-flash)
Nov 15 08:26:05 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:26:05 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d1b5ee-db01-4587-b613-da34166ef422 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:26:05 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:26:05 user nova-compute[95467]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)
Nov 15 08:26:05 user nova-compute[95467]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:26:05 user nova-compute[95467]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 (non-flash)
Nov 15 08:26:05 user nova-compute[95467]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 (non-flash)
Nov 15 08:26:05 user nova-compute[95467]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6593af50-4de5-4559-8aa6-ddc60c31bc3a (non-flash)
Nov 15 08:26:05 user nova-compute[95467]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 (non-flash)
Nov 15 08:26:05 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:26:05 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d1b5ee-db01-4587-b613-da34166ef422 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efec82db5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6593af50-4de5-4559-8aa6-ddc60c31bc3a'): ({'sdj'}, set())}) {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 08:26:05 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-e1d1b5ee-db01-4587-b613-da34166ef422 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Removing single pathed devices sdj {{(pid=95467) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 08:26:05 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:05 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:26:05 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4a3acb-37cc-4aa8-b3bc-c0d6f4765081]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:26:05 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:05 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:26:05 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27e9fb1-cb62-40c0-958d-8e6c82021592]: (4, ('ok\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:26:05 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-e1d1b5ee-db01-4587-b613-da34166ef422 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Flushing IO for device /dev/sdj {{(pid=95467) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 08:26:05 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:05 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.013s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:26:05 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d9a24d-6dcc-483b-98c9-442b97003e60]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:26:05 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-e1d1b5ee-db01-4587-b613-da34166ef422 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=95467) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 08:26:05 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:05 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.059s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:26:05 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[665aa67c-6052-401b-9f6c-11819143475d]: (4, ('1', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:26:05 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-e1d1b5ee-db01-4587-b613-da34166ef422 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 08:26:05 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-e1d1b5ee-db01-4587-b613-da34166ef422 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] SCSI volumes sdj have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 08:26:05 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d1b5ee-db01-4587-b613-da34166ef422 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6593af50-4de5-4559-8aa6-ddc60c31bc3a')] {{(pid=95467) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 08:26:05 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:26:05 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6593af50-4de5-4559-8aa6-ddc60c31bc3a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:05 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6593af50-4de5-4559-8aa6-ddc60c31bc3a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:26:05 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[5910bdae-023d-4f96-bb3f-e330bb3ed6fc]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:26:05 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d1b5ee-db01-4587-b613-da34166ef422 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:26:05 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6593af50-4de5-4559-8aa6-ddc60c31bc3a -p 172.16.0.220:3260 --logout {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:05 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6593af50-4de5-4559-8aa6-ddc60c31bc3a -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:26:05 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8abdfbe7-cb0e-4fbf-89b9-050d1b64085f]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:6593af50-4de5-4559-8aa6-ddc60c31bc3a, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:6593af50-4de5-4559-8aa6-ddc60c31bc3a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:26:05 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d1b5ee-db01-4587-b613-da34166ef422 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:6593af50-4de5-4559-8aa6-ddc60c31bc3a, portal: 172.16.0.220,3260]
Nov 15 08:26:05 user nova-compute[95467]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:6593af50-4de5-4559-8aa6-ddc60c31bc3a, portal: 172.16.0.220,3260] successful.
Nov 15 08:26:05 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:26:05 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6593af50-4de5-4559-8aa6-ddc60c31bc3a -p 172.16.0.220:3260 --op delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:05 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6593af50-4de5-4559-8aa6-ddc60c31bc3a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:26:05 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[396b0ebb-6095-4a88-85e7-c19e54a49ecb]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:26:05 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d1b5ee-db01-4587-b613-da34166ef422 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:26:06 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-e1d1b5ee-db01-4587-b613-da34166ef422 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:26:06 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d1b5ee-db01-4587-b613-da34166ef422 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] <== disconnect_volume: return (356ms) None {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:26:06 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1d1b5ee-db01-4587-b613-da34166ef422 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Disconnected iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 08:26:06 user nova-compute[95467]: DEBUG nova.objects.instance [None req-e1d1b5ee-db01-4587-b613-da34166ef422 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Lazy-loading 'flavor' on Instance uuid 843b778c-f823-4bee-aa76-ab44345be9a7 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:26:06 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e1d1b5ee-db01-4587-b613-da34166ef422 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Lock "843b778c-f823-4bee-aa76-ab44345be9a7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.763s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:26:07 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:26:10 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:26:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:26:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d2ebb102-4ef0-4a93-bc03-c47f9dc342cc tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Acquiring lock "a1a155e6-0ee2-4728-a526-17c149107ab0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:26:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d2ebb102-4ef0-4a93-bc03-c47f9dc342cc tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lock "a1a155e6-0ee2-4728-a526-17c149107ab0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:26:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d2ebb102-4ef0-4a93-bc03-c47f9dc342cc tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Acquiring lock "a1a155e6-0ee2-4728-a526-17c149107ab0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:26:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d2ebb102-4ef0-4a93-bc03-c47f9dc342cc tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lock "a1a155e6-0ee2-4728-a526-17c149107ab0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:26:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d2ebb102-4ef0-4a93-bc03-c47f9dc342cc tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lock "a1a155e6-0ee2-4728-a526-17c149107ab0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:26:13 user nova-compute[95467]: INFO nova.compute.manager [None req-d2ebb102-4ef0-4a93-bc03-c47f9dc342cc tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Terminating instance
Nov 15 08:26:13 user nova-compute[95467]: DEBUG nova.compute.manager [None req-d2ebb102-4ef0-4a93-bc03-c47f9dc342cc tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Start destroying the instance on the hypervisor. {{(pid=95467) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 08:26:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:26:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:26:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:26:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:26:13 user nova-compute[95467]: DEBUG nova.compute.manager [req-72afacce-aec4-4d5a-a130-546e7e634454 req-82b469b0-37e4-4b8e-937f-a03182570d99 service nova] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Received event network-vif-unplugged-d9b8cd88-c40b-4437-afd9-403eb882e80c {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:26:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-72afacce-aec4-4d5a-a130-546e7e634454 req-82b469b0-37e4-4b8e-937f-a03182570d99 service nova] Acquiring lock "a1a155e6-0ee2-4728-a526-17c149107ab0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:26:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-72afacce-aec4-4d5a-a130-546e7e634454 req-82b469b0-37e4-4b8e-937f-a03182570d99 service nova] Lock "a1a155e6-0ee2-4728-a526-17c149107ab0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:26:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-72afacce-aec4-4d5a-a130-546e7e634454 req-82b469b0-37e4-4b8e-937f-a03182570d99 service nova] Lock "a1a155e6-0ee2-4728-a526-17c149107ab0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:26:13 user nova-compute[95467]: DEBUG nova.compute.manager [req-72afacce-aec4-4d5a-a130-546e7e634454 req-82b469b0-37e4-4b8e-937f-a03182570d99 service nova] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] No waiting events found dispatching network-vif-unplugged-d9b8cd88-c40b-4437-afd9-403eb882e80c {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:26:13 user nova-compute[95467]: DEBUG nova.compute.manager [req-72afacce-aec4-4d5a-a130-546e7e634454 req-82b469b0-37e4-4b8e-937f-a03182570d99 service nova] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Received event network-vif-unplugged-d9b8cd88-c40b-4437-afd9-403eb882e80c for instance with task_state deleting. {{(pid=95467) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 08:26:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:26:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:26:13 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Instance destroyed successfully.
Nov 15 08:26:13 user nova-compute[95467]: DEBUG nova.objects.instance [None req-d2ebb102-4ef0-4a93-bc03-c47f9dc342cc tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lazy-loading 'resources' on Instance uuid a1a155e6-0ee2-4728-a526-17c149107ab0 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:26:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:26:13 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-d2ebb102-4ef0-4a93-bc03-c47f9dc342cc tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:19:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1324921877',display_name='tempest-SnapshotDataIntegrityTests-server-1324921877',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1324921877',id=32,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHE/7FAOObH6E30WeSRJDqbkxPN84jkeAolmf0oK7rvzxbEs94wBSTkJ9Sc83CURZQDHrGXL2vLymO6z7ODNaiq166wkVa+DSyeprPIhYESjVXzpFnlfBtAfHQ6jscdsMQ==',key_name='tempest-keypair-840734884',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:19:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='84f9b647fefc431099e9f77370b00e9a',ramdisk_id='',reservation_id='r-5mrupc9n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-234501990',owner_user_name='tempest-SnapshotDataIntegrityTests-234501990-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:19:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ac0c1f0393c47de8452fba44e6c28d5',uuid=a1a155e6-0ee2-4728-a526-17c149107ab0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d9b8cd88-c40b-4437-afd9-403eb882e80c", "address": "fa:16:3e:83:dc:7a", "network": {"id": "34c396ed-35f3-4c64-ae71-fec43375e75b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-631332774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f9b647fefc431099e9f77370b00e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9b8cd88-c4", "ovs_interfaceid": "d9b8cd88-c40b-4437-afd9-403eb882e80c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:26:13 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-d2ebb102-4ef0-4a93-bc03-c47f9dc342cc tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Converting VIF {"id": "d9b8cd88-c40b-4437-afd9-403eb882e80c", "address": "fa:16:3e:83:dc:7a", "network": {"id": "34c396ed-35f3-4c64-ae71-fec43375e75b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-631332774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f9b647fefc431099e9f77370b00e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9b8cd88-c4", "ovs_interfaceid": "d9b8cd88-c40b-4437-afd9-403eb882e80c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:26:13 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-d2ebb102-4ef0-4a93-bc03-c47f9dc342cc tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:dc:7a,bridge_name='br-int',has_traffic_filtering=True,id=d9b8cd88-c40b-4437-afd9-403eb882e80c,network=Network(34c396ed-35f3-4c64-ae71-fec43375e75b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9b8cd88-c4') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:26:13 user nova-compute[95467]: DEBUG os_vif [None req-d2ebb102-4ef0-4a93-bc03-c47f9dc342cc tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:dc:7a,bridge_name='br-int',has_traffic_filtering=True,id=d9b8cd88-c40b-4437-afd9-403eb882e80c,network=Network(34c396ed-35f3-4c64-ae71-fec43375e75b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9b8cd88-c4') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:26:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:26:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd9b8cd88-c4, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:26:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:26:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:26:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:26:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=60068bc0-d4d0-413f-9672-e2b5729104e5) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:26:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:26:13 user nova-compute[95467]: INFO os_vif [None req-d2ebb102-4ef0-4a93-bc03-c47f9dc342cc tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:dc:7a,bridge_name='br-int',has_traffic_filtering=True,id=d9b8cd88-c40b-4437-afd9-403eb882e80c,network=Network(34c396ed-35f3-4c64-ae71-fec43375e75b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9b8cd88-c4')
Nov 15 08:26:13 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-d2ebb102-4ef0-4a93-bc03-c47f9dc342cc tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Deleting instance files /opt/stack/data/nova/instances/a1a155e6-0ee2-4728-a526-17c149107ab0_del
Nov 15 08:26:13 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-d2ebb102-4ef0-4a93-bc03-c47f9dc342cc tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Deletion of /opt/stack/data/nova/instances/a1a155e6-0ee2-4728-a526-17c149107ab0_del complete
Nov 15 08:26:13 user nova-compute[95467]: INFO nova.compute.manager [None req-d2ebb102-4ef0-4a93-bc03-c47f9dc342cc tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 15 08:26:13 user nova-compute[95467]: DEBUG oslo.service.loopingcall [None req-d2ebb102-4ef0-4a93-bc03-c47f9dc342cc tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=95467) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 08:26:13 user nova-compute[95467]: DEBUG nova.compute.manager [-] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Deallocating network for instance {{(pid=95467) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 08:26:13 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] deallocate_for_instance() {{(pid=95467) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 08:26:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:26:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:26:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:26:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:26:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:26:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:26:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:26:14 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:26:14 user nova-compute[95467]: INFO nova.compute.manager [-] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Took 0.80 seconds to deallocate network for instance.
Nov 15 08:26:14 user nova-compute[95467]: DEBUG nova.compute.manager [req-c0739c38-fa64-4685-b6ad-72e8bb14285d req-3b5b8e51-b9f9-4ee5-9359-d3deb42b68eb service nova] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Received event network-vif-deleted-d9b8cd88-c40b-4437-afd9-403eb882e80c {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:26:14 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d2ebb102-4ef0-4a93-bc03-c47f9dc342cc tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:26:14 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d2ebb102-4ef0-4a93-bc03-c47f9dc342cc tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:26:15 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-d2ebb102-4ef0-4a93-bc03-c47f9dc342cc tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:26:15 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-d2ebb102-4ef0-4a93-bc03-c47f9dc342cc tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:26:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d2ebb102-4ef0-4a93-bc03-c47f9dc342cc tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.489s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:26:15 user nova-compute[95467]: INFO nova.scheduler.client.report [None req-d2ebb102-4ef0-4a93-bc03-c47f9dc342cc tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Deleted allocations for instance a1a155e6-0ee2-4728-a526-17c149107ab0
Nov 15 08:26:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d2ebb102-4ef0-4a93-bc03-c47f9dc342cc tempest-SnapshotDataIntegrityTests-234501990 tempest-SnapshotDataIntegrityTests-234501990-project-member] Lock "a1a155e6-0ee2-4728-a526-17c149107ab0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.373s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:26:15 user nova-compute[95467]: DEBUG nova.compute.manager [req-8bc4bb1a-1b32-4022-8886-2ece382f7584 req-2452eb2e-71f1-4234-9fb5-a7dc90815dab service nova] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Received event network-vif-plugged-d9b8cd88-c40b-4437-afd9-403eb882e80c {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:26:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-8bc4bb1a-1b32-4022-8886-2ece382f7584 req-2452eb2e-71f1-4234-9fb5-a7dc90815dab service nova] Acquiring lock "a1a155e6-0ee2-4728-a526-17c149107ab0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:26:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-8bc4bb1a-1b32-4022-8886-2ece382f7584 req-2452eb2e-71f1-4234-9fb5-a7dc90815dab service nova] Lock "a1a155e6-0ee2-4728-a526-17c149107ab0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:26:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-8bc4bb1a-1b32-4022-8886-2ece382f7584 req-2452eb2e-71f1-4234-9fb5-a7dc90815dab service nova] Lock "a1a155e6-0ee2-4728-a526-17c149107ab0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:26:15 user nova-compute[95467]: DEBUG nova.compute.manager [req-8bc4bb1a-1b32-4022-8886-2ece382f7584 req-2452eb2e-71f1-4234-9fb5-a7dc90815dab service nova] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] No waiting events found dispatching network-vif-plugged-d9b8cd88-c40b-4437-afd9-403eb882e80c {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:26:15 user nova-compute[95467]: WARNING nova.compute.manager [req-8bc4bb1a-1b32-4022-8886-2ece382f7584 req-2452eb2e-71f1-4234-9fb5-a7dc90815dab service nova] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Received unexpected event network-vif-plugged-d9b8cd88-c40b-4437-afd9-403eb882e80c for instance with vm_state deleted and task_state None.
Nov 15 08:26:15 user nova-compute[95467]: DEBUG nova.compute.manager [req-8bc4bb1a-1b32-4022-8886-2ece382f7584 req-2452eb2e-71f1-4234-9fb5-a7dc90815dab service nova] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Received event network-vif-plugged-d9b8cd88-c40b-4437-afd9-403eb882e80c {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:26:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-8bc4bb1a-1b32-4022-8886-2ece382f7584 req-2452eb2e-71f1-4234-9fb5-a7dc90815dab service nova] Acquiring lock "a1a155e6-0ee2-4728-a526-17c149107ab0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:26:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-8bc4bb1a-1b32-4022-8886-2ece382f7584 req-2452eb2e-71f1-4234-9fb5-a7dc90815dab service nova] Lock "a1a155e6-0ee2-4728-a526-17c149107ab0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:26:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-8bc4bb1a-1b32-4022-8886-2ece382f7584 req-2452eb2e-71f1-4234-9fb5-a7dc90815dab service nova] Lock "a1a155e6-0ee2-4728-a526-17c149107ab0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:26:15 user nova-compute[95467]: DEBUG nova.compute.manager [req-8bc4bb1a-1b32-4022-8886-2ece382f7584 req-2452eb2e-71f1-4234-9fb5-a7dc90815dab service nova] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] No waiting events found dispatching network-vif-plugged-d9b8cd88-c40b-4437-afd9-403eb882e80c {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:26:15 user nova-compute[95467]: WARNING nova.compute.manager [req-8bc4bb1a-1b32-4022-8886-2ece382f7584 req-2452eb2e-71f1-4234-9fb5-a7dc90815dab service nova] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Received unexpected event network-vif-plugged-d9b8cd88-c40b-4437-afd9-403eb882e80c for instance with vm_state deleted and task_state None.
Nov 15 08:26:15 user nova-compute[95467]: DEBUG nova.compute.manager [req-8bc4bb1a-1b32-4022-8886-2ece382f7584 req-2452eb2e-71f1-4234-9fb5-a7dc90815dab service nova] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Received event network-vif-plugged-d9b8cd88-c40b-4437-afd9-403eb882e80c {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:26:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-8bc4bb1a-1b32-4022-8886-2ece382f7584 req-2452eb2e-71f1-4234-9fb5-a7dc90815dab service nova] Acquiring lock "a1a155e6-0ee2-4728-a526-17c149107ab0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:26:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-8bc4bb1a-1b32-4022-8886-2ece382f7584 req-2452eb2e-71f1-4234-9fb5-a7dc90815dab service nova] Lock "a1a155e6-0ee2-4728-a526-17c149107ab0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:26:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-8bc4bb1a-1b32-4022-8886-2ece382f7584 req-2452eb2e-71f1-4234-9fb5-a7dc90815dab service nova] Lock "a1a155e6-0ee2-4728-a526-17c149107ab0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:26:15 user nova-compute[95467]: DEBUG nova.compute.manager [req-8bc4bb1a-1b32-4022-8886-2ece382f7584 req-2452eb2e-71f1-4234-9fb5-a7dc90815dab service nova] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] No waiting events found dispatching network-vif-plugged-d9b8cd88-c40b-4437-afd9-403eb882e80c {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:26:15 user nova-compute[95467]: WARNING nova.compute.manager [req-8bc4bb1a-1b32-4022-8886-2ece382f7584 req-2452eb2e-71f1-4234-9fb5-a7dc90815dab service nova] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Received unexpected event network-vif-plugged-d9b8cd88-c40b-4437-afd9-403eb882e80c for instance with vm_state deleted and task_state None.
Nov 15 08:26:15 user nova-compute[95467]: DEBUG nova.compute.manager [req-8bc4bb1a-1b32-4022-8886-2ece382f7584 req-2452eb2e-71f1-4234-9fb5-a7dc90815dab service nova] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Received event network-vif-unplugged-d9b8cd88-c40b-4437-afd9-403eb882e80c {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:26:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-8bc4bb1a-1b32-4022-8886-2ece382f7584 req-2452eb2e-71f1-4234-9fb5-a7dc90815dab service nova] Acquiring lock "a1a155e6-0ee2-4728-a526-17c149107ab0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:26:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-8bc4bb1a-1b32-4022-8886-2ece382f7584 req-2452eb2e-71f1-4234-9fb5-a7dc90815dab service nova] Lock "a1a155e6-0ee2-4728-a526-17c149107ab0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:26:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-8bc4bb1a-1b32-4022-8886-2ece382f7584 req-2452eb2e-71f1-4234-9fb5-a7dc90815dab service nova] Lock "a1a155e6-0ee2-4728-a526-17c149107ab0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:26:15 user nova-compute[95467]: DEBUG nova.compute.manager [req-8bc4bb1a-1b32-4022-8886-2ece382f7584 req-2452eb2e-71f1-4234-9fb5-a7dc90815dab service nova] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] No waiting events found dispatching network-vif-unplugged-d9b8cd88-c40b-4437-afd9-403eb882e80c {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:26:15 user nova-compute[95467]: WARNING nova.compute.manager [req-8bc4bb1a-1b32-4022-8886-2ece382f7584 req-2452eb2e-71f1-4234-9fb5-a7dc90815dab service nova] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Received unexpected event network-vif-unplugged-d9b8cd88-c40b-4437-afd9-403eb882e80c for instance with vm_state deleted and task_state None.
Nov 15 08:26:15 user nova-compute[95467]: DEBUG nova.compute.manager [req-8bc4bb1a-1b32-4022-8886-2ece382f7584 req-2452eb2e-71f1-4234-9fb5-a7dc90815dab service nova] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Received event network-vif-plugged-d9b8cd88-c40b-4437-afd9-403eb882e80c {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:26:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-8bc4bb1a-1b32-4022-8886-2ece382f7584 req-2452eb2e-71f1-4234-9fb5-a7dc90815dab service nova] Acquiring lock "a1a155e6-0ee2-4728-a526-17c149107ab0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:26:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-8bc4bb1a-1b32-4022-8886-2ece382f7584 req-2452eb2e-71f1-4234-9fb5-a7dc90815dab service nova] Lock "a1a155e6-0ee2-4728-a526-17c149107ab0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:26:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-8bc4bb1a-1b32-4022-8886-2ece382f7584 req-2452eb2e-71f1-4234-9fb5-a7dc90815dab service nova] Lock "a1a155e6-0ee2-4728-a526-17c149107ab0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:26:15 user nova-compute[95467]: DEBUG nova.compute.manager [req-8bc4bb1a-1b32-4022-8886-2ece382f7584 req-2452eb2e-71f1-4234-9fb5-a7dc90815dab service nova] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] No waiting events found dispatching network-vif-plugged-d9b8cd88-c40b-4437-afd9-403eb882e80c {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:26:15 user nova-compute[95467]: WARNING nova.compute.manager [req-8bc4bb1a-1b32-4022-8886-2ece382f7584 req-2452eb2e-71f1-4234-9fb5-a7dc90815dab service nova] [instance: a1a155e6-0ee2-4728-a526-17c149107ab0] Received unexpected event network-vif-plugged-d9b8cd88-c40b-4437-afd9-403eb882e80c for instance with vm_state deleted and task_state None.
Nov 15 08:26:17 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:26:18 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:26:19 user nova-compute[95467]: INFO nova.compute.manager [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Rescuing
Nov 15 08:26:19 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Acquiring lock "refresh_cache-ba05c01d-ae74-467c-a309-4d0ba904453d" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:26:19 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Acquired lock "refresh_cache-ba05c01d-ae74-467c-a309-4d0ba904453d" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:26:19 user nova-compute[95467]: DEBUG nova.network.neutron [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:26:20 user nova-compute[95467]: DEBUG nova.network.neutron [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Updating instance_info_cache with network_info: [{"id": "3738b806-4005-468d-87df-f879eb2ff43d", "address": "fa:16:3e:86:6f:d3", "network": {"id": "ac9a381d-25fe-4419-b151-f03333413813", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1183680999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34d65a8000347feb2b3966b7ce0d785", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3738b806-40", "ovs_interfaceid": "3738b806-4005-468d-87df-f879eb2ff43d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:26:20 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Releasing lock "refresh_cache-ba05c01d-ae74-467c-a309-4d0ba904453d" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:26:20 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:26:20 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:26:20 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:26:20 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:26:20 user nova-compute[95467]: DEBUG nova.compute.manager [req-4ed45ba2-3c03-4b85-8ef5-c5e8b61da5a3 req-1493c5cb-96bc-4b6b-8ff8-599baf93e14e service nova] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Received event network-vif-unplugged-3738b806-4005-468d-87df-f879eb2ff43d {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:26:20 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-4ed45ba2-3c03-4b85-8ef5-c5e8b61da5a3 req-1493c5cb-96bc-4b6b-8ff8-599baf93e14e service nova] Acquiring lock "ba05c01d-ae74-467c-a309-4d0ba904453d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:26:20 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-4ed45ba2-3c03-4b85-8ef5-c5e8b61da5a3 req-1493c5cb-96bc-4b6b-8ff8-599baf93e14e service nova] Lock "ba05c01d-ae74-467c-a309-4d0ba904453d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:26:20 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-4ed45ba2-3c03-4b85-8ef5-c5e8b61da5a3 req-1493c5cb-96bc-4b6b-8ff8-599baf93e14e service nova] Lock "ba05c01d-ae74-467c-a309-4d0ba904453d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:26:20 user nova-compute[95467]: DEBUG nova.compute.manager [req-4ed45ba2-3c03-4b85-8ef5-c5e8b61da5a3 req-1493c5cb-96bc-4b6b-8ff8-599baf93e14e service nova] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] No waiting events found dispatching network-vif-unplugged-3738b806-4005-468d-87df-f879eb2ff43d {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:26:20 user nova-compute[95467]: WARNING nova.compute.manager [req-4ed45ba2-3c03-4b85-8ef5-c5e8b61da5a3 req-1493c5cb-96bc-4b6b-8ff8-599baf93e14e service nova] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Received unexpected event network-vif-unplugged-3738b806-4005-468d-87df-f879eb2ff43d for instance with vm_state active and task_state rescuing.
Nov 15 08:26:20 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Instance destroyed successfully.
Nov 15 08:26:20 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Attempting a stable device rescue
Nov 15 08:26:21 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=95467) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 08:26:21 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Instance directory exists: not creating {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 08:26:21 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Creating image(s)
Nov 15 08:26:21 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Acquiring lock "/opt/stack/data/nova/instances/ba05c01d-ae74-467c-a309-4d0ba904453d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:26:21 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "/opt/stack/data/nova/instances/ba05c01d-ae74-467c-a309-4d0ba904453d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:26:21 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "/opt/stack/data/nova/instances/ba05c01d-ae74-467c-a309-4d0ba904453d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:26:21 user nova-compute[95467]: DEBUG nova.objects.instance [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lazy-loading 'trusted_certs' on Instance uuid ba05c01d-ae74-467c-a309-4d0ba904453d {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:26:21 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Acquiring lock "96b4c3c0fafcd805212dd36066d64c340ca18c05" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:26:21 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "96b4c3c0fafcd805212dd36066d64c340ca18c05" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:26:21 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96b4c3c0fafcd805212dd36066d64c340ca18c05.part --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:22 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96b4c3c0fafcd805212dd36066d64c340ca18c05.part --force-share --output=json" returned: 0 in 0.213s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:26:22 user nova-compute[95467]: DEBUG nova.virt.images [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] 0f8c25fa-14d5-4ed1-9611-71ca6ad6f71c was qcow2, converting to raw {{(pid=95467) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 08:26:22 user nova-compute[95467]: DEBUG nova.privsep.utils [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=95467) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 08:26:22 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/96b4c3c0fafcd805212dd36066d64c340ca18c05.part /opt/stack/data/nova/instances/_base/96b4c3c0fafcd805212dd36066d64c340ca18c05.converted {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:22 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/96b4c3c0fafcd805212dd36066d64c340ca18c05.part /opt/stack/data/nova/instances/_base/96b4c3c0fafcd805212dd36066d64c340ca18c05.converted" returned: 0 in 0.255s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:26:22 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96b4c3c0fafcd805212dd36066d64c340ca18c05.converted --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:22 user nova-compute[95467]: DEBUG nova.compute.manager [req-c32e5bd6-3b2d-4e7a-aa6a-99ee30e64bdd req-7b884ab1-6dbe-4425-bee9-d67082dbab49 service nova] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Received event network-vif-plugged-3738b806-4005-468d-87df-f879eb2ff43d {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:26:22 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-c32e5bd6-3b2d-4e7a-aa6a-99ee30e64bdd req-7b884ab1-6dbe-4425-bee9-d67082dbab49 service nova] Acquiring lock "ba05c01d-ae74-467c-a309-4d0ba904453d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:26:22 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-c32e5bd6-3b2d-4e7a-aa6a-99ee30e64bdd req-7b884ab1-6dbe-4425-bee9-d67082dbab49 service nova] Lock "ba05c01d-ae74-467c-a309-4d0ba904453d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:26:22 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-c32e5bd6-3b2d-4e7a-aa6a-99ee30e64bdd req-7b884ab1-6dbe-4425-bee9-d67082dbab49 service nova] Lock "ba05c01d-ae74-467c-a309-4d0ba904453d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:26:22 user nova-compute[95467]: DEBUG nova.compute.manager [req-c32e5bd6-3b2d-4e7a-aa6a-99ee30e64bdd req-7b884ab1-6dbe-4425-bee9-d67082dbab49 service nova] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] No waiting events found dispatching network-vif-plugged-3738b806-4005-468d-87df-f879eb2ff43d {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:26:22 user nova-compute[95467]: WARNING nova.compute.manager [req-c32e5bd6-3b2d-4e7a-aa6a-99ee30e64bdd req-7b884ab1-6dbe-4425-bee9-d67082dbab49 service nova] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Received unexpected event network-vif-plugged-3738b806-4005-468d-87df-f879eb2ff43d for instance with vm_state active and task_state rescuing.
Nov 15 08:26:22 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96b4c3c0fafcd805212dd36066d64c340ca18c05.converted --force-share --output=json" returned: 0 in 0.171s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:26:22 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "96b4c3c0fafcd805212dd36066d64c340ca18c05" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.614s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:26:22 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Acquiring lock "96b4c3c0fafcd805212dd36066d64c340ca18c05" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:26:22 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "96b4c3c0fafcd805212dd36066d64c340ca18c05" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:26:22 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96b4c3c0fafcd805212dd36066d64c340ca18c05 --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:22 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96b4c3c0fafcd805212dd36066d64c340ca18c05 --force-share --output=json" returned: 0 in 0.166s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:26:22 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96b4c3c0fafcd805212dd36066d64c340ca18c05,backing_fmt=raw /opt/stack/data/nova/instances/ba05c01d-ae74-467c-a309-4d0ba904453d/disk.rescue {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:26:22 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96b4c3c0fafcd805212dd36066d64c340ca18c05,backing_fmt=raw /opt/stack/data/nova/instances/ba05c01d-ae74-467c-a309-4d0ba904453d/disk.rescue" returned: 0 in 0.050s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:26:22 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "96b4c3c0fafcd805212dd36066d64c340ca18c05" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.221s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:26:22 user nova-compute[95467]: DEBUG nova.objects.instance [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lazy-loading 'migration_context' on Instance uuid ba05c01d-ae74-467c-a309-4d0ba904453d {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:26:22 user nova-compute[95467]: DEBUG nova.objects.base [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Object Instance<ba05c01d-ae74-467c-a309-4d0ba904453d> lazy-loaded attributes: trusted_certs,migration_context {{(pid=95467) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 08:26:22 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Created local disks {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 08:26:22 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Start _get_guest_xml network_info=[{"id": "3738b806-4005-468d-87df-f879eb2ff43d", "address": "fa:16:3e:86:6f:d3", "network": {"id": "ac9a381d-25fe-4419-b151-f03333413813", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1183680999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1183680999-network", "vif_mac": "fa:16:3e:86:6f:d3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34d65a8000347feb2b3966b7ce0d785", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3738b806-40", "ovs_interfaceid": "3738b806-4005-468d-87df-f879eb2ff43d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '0f8c25fa-14d5-4ed1-9611-71ca6ad6f71c', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'bc46b669-2948-4082-94ac-c15bb0c8749b', 'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hAzlOrmx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'ba05c01d-ae74-467c-a309-4d0ba904453d', 'attached_at': '', 'detached_at': '', 'volume_id': '24e79401-c916-4d6f-bee4-b169342acd24', 'serial': '24e79401-c916-4d6f-bee4-b169342acd24'}, 'volume_type': None} {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:26:22 user nova-compute[95467]: DEBUG nova.objects.instance [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lazy-loading 'resources' on Instance uuid ba05c01d-ae74-467c-a309-4d0ba904453d {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:26:22 user nova-compute[95467]: DEBUG nova.objects.base [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Object Instance<ba05c01d-ae74-467c-a309-4d0ba904453d> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=95467) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 08:26:22 user nova-compute[95467]: DEBUG nova.objects.instance [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lazy-loading 'numa_topology' on Instance uuid ba05c01d-ae74-467c-a309-4d0ba904453d {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:26:22 user nova-compute[95467]: DEBUG nova.objects.base [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Object Instance<ba05c01d-ae74-467c-a309-4d0ba904453d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=95467) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 08:26:22 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:26:22 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:26:22 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:26:22 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:26:22 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:26:22 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:26:22 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:26:22 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:26:22 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:26:22 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:26:22 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:26:22 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:26:22 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:26:22 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:26:22 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:26:22 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:26:22 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:26:22 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:26:22 user nova-compute[95467]: DEBUG nova.objects.instance [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lazy-loading 'vcpu_model' on Instance uuid ba05c01d-ae74-467c-a309-4d0ba904453d {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:26:22 user nova-compute[95467]: DEBUG nova.objects.base [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Object Instance<ba05c01d-ae74-467c-a309-4d0ba904453d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=95467) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 08:26:22 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Calling os-brick to attach iSCSI Volume {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 08:26:22 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hAzlOrmx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:26:22 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:26:22 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:26:22 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:26:22 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:26:22 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:26:22 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:26:22 user nova-compute[95467]: INFO os_brick.initiator.connectors.iscsi [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 08:26:22 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 -p 172.16.0.220:3260 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:23 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 -p 172.16.0.220:3260" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:26:23 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c45540-859e-4a55-8f59-ca4ef641502e]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = hAzlOrmx\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:26:23 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 15 08:26:23 user nova-compute[95467]: node.name = iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24
Nov 15 08:26:23 user nova-compute[95467]: node.tpgt = -1
Nov 15 08:26:23 user nova-compute[95467]: node.startup = automatic
Nov 15 08:26:23 user nova-compute[95467]: node.leading_login = No
Nov 15 08:26:23 user nova-compute[95467]: iface.iscsi_ifacename = default
Nov 15 08:26:23 user nova-compute[95467]: iface.net_ifacename = <empty>
Nov 15 08:26:23 user nova-compute[95467]: iface.ipaddress = <empty>
Nov 15 08:26:23 user nova-compute[95467]: iface.prefix_len = 0
Nov 15 08:26:23 user nova-compute[95467]: iface.hwaddress = <empty>
Nov 15 08:26:23 user nova-compute[95467]: iface.transport_name = tcp
Nov 15 08:26:23 user nova-compute[95467]: iface.initiatorname = <empty>
Nov 15 08:26:23 user nova-compute[95467]: iface.state = <empty>
Nov 15 08:26:23 user nova-compute[95467]: iface.vlan_id = 0
Nov 15 08:26:23 user nova-compute[95467]: iface.vlan_priority = 0
Nov 15 08:26:23 user nova-compute[95467]: iface.vlan_state = <empty>
Nov 15 08:26:23 user nova-compute[95467]: iface.iface_num = 0
Nov 15 08:26:23 user nova-compute[95467]: iface.mtu = 0
Nov 15 08:26:23 user nova-compute[95467]: iface.port = 0
Nov 15 08:26:23 user nova-compute[95467]: iface.bootproto = <empty>
Nov 15 08:26:23 user nova-compute[95467]: iface.subnet_mask = <empty>
Nov 15 08:26:23 user nova-compute[95467]: iface.gateway = <empty>
Nov 15 08:26:23 user nova-compute[95467]: iface.dhcp_alt_client_id_state = <empty>
Nov 15 08:26:23 user nova-compute[95467]: iface.dhcp_alt_client_id = <empty>
Nov 15 08:26:23 user nova-compute[95467]: iface.dhcp_dns = <empty>
Nov 15 08:26:23 user nova-compute[95467]: iface.dhcp_learn_iqn = <empty>
Nov 15 08:26:23 user nova-compute[95467]: iface.dhcp_req_vendor_id_state = <empty>
Nov 15 08:26:23 user nova-compute[95467]: iface.dhcp_vendor_id_state = <empty>
Nov 15 08:26:23 user nova-compute[95467]: iface.dhcp_vendor_id = <empty>
Nov 15 08:26:23 user nova-compute[95467]: iface.dhcp_slp_da = <empty>
Nov 15 08:26:23 user nova-compute[95467]: iface.fragmentation = <empty>
Nov 15 08:26:23 user nova-compute[95467]: iface.gratuitous_arp = <empty>
Nov 15 08:26:23 user nova-compute[95467]: iface.incoming_forwarding = <empty>
Nov 15 08:26:23 user nova-compute[95467]: iface.tos_state = <empty>
Nov 15 08:26:23 user nova-compute[95467]: iface.tos = 0
Nov 15 08:26:23 user nova-compute[95467]: iface.ttl = 0
Nov 15 08:26:23 user nova-compute[95467]: iface.delayed_ack = <empty>
Nov 15 08:26:23 user nova-compute[95467]: iface.tcp_nagle = <empty>
Nov 15 08:26:23 user nova-compute[95467]: iface.tcp_wsf_state = <empty>
Nov 15 08:26:23 user nova-compute[95467]: iface.tcp_wsf = 0
Nov 15 08:26:23 user nova-compute[95467]: iface.tcp_timer_scale = 0
Nov 15 08:26:23 user nova-compute[95467]: iface.tcp_timestamp = <empty>
Nov 15 08:26:23 user nova-compute[95467]: iface.redirect = <empty>
Nov 15 08:26:23 user nova-compute[95467]: iface.def_task_mgmt_timeout = 0
Nov 15 08:26:23 user nova-compute[95467]: iface.header_digest = <empty>
Nov 15 08:26:23 user nova-compute[95467]: iface.data_digest = <empty>
Nov 15 08:26:23 user nova-compute[95467]: iface.immediate_data = <empty>
Nov 15 08:26:23 user nova-compute[95467]: iface.initial_r2t = <empty>
Nov 15 08:26:23 user nova-compute[95467]: iface.data_seq_inorder = <empty>
Nov 15 08:26:23 user nova-compute[95467]: iface.data_pdu_inorder = <empty>
Nov 15 08:26:23 user nova-compute[95467]: iface.erl = 0
Nov 15 08:26:23 user nova-compute[95467]: iface.max_receive_data_len = 0
Nov 15 08:26:23 user nova-compute[95467]: iface.first_burst_len = 0
Nov 15 08:26:23 user nova-compute[95467]: iface.max_outstanding_r2t = 0
Nov 15 08:26:23 user nova-compute[95467]: iface.max_burst_len = 0
Nov 15 08:26:23 user nova-compute[95467]: iface.chap_auth = <empty>
Nov 15 08:26:23 user nova-compute[95467]: iface.bidi_chap = <empty>
Nov 15 08:26:23 user nova-compute[95467]: iface.strict_login_compliance = <empty>
Nov 15 08:26:23 user nova-compute[95467]: iface.discovery_auth = <empty>
Nov 15 08:26:23 user nova-compute[95467]: iface.discovery_logout = <empty>
Nov 15 08:26:23 user nova-compute[95467]: node.discovery_address = <empty>
Nov 15 08:26:23 user nova-compute[95467]: node.discovery_port = 0
Nov 15 08:26:23 user nova-compute[95467]: node.discovery_type = static
Nov 15 08:26:23 user nova-compute[95467]: node.session.initial_cmdsn = 0
Nov 15 08:26:23 user nova-compute[95467]: node.session.initial_login_retry_max = 8
Nov 15 08:26:23 user nova-compute[95467]: node.session.xmit_thread_priority = -20
Nov 15 08:26:23 user nova-compute[95467]: node.session.cmds_max = 128
Nov 15 08:26:23 user nova-compute[95467]: node.session.queue_depth = 32
Nov 15 08:26:23 user nova-compute[95467]: node.session.nr_sessions = 1
Nov 15 08:26:23 user nova-compute[95467]: node.session.auth.authmethod = CHAP
Nov 15 08:26:23 user nova-compute[95467]: node.session.auth.username = hAzlOrmx
Nov 15 08:26:23 user nova-compute[95467]: node.session.auth.password = ***
Nov 15 08:26:23 user nova-compute[95467]: node.session.auth.username_in = <empty>
Nov 15 08:26:23 user nova-compute[95467]: node.session.auth.password_in = <empty>
Nov 15 08:26:23 user nova-compute[95467]: node.session.auth.chap_algs = MD5
Nov 15 08:26:23 user nova-compute[95467]: node.session.timeo.replacement_timeout = 120
Nov 15 08:26:23 user nova-compute[95467]: node.session.err_timeo.abort_timeout = 15
Nov 15 08:26:23 user nova-compute[95467]: node.session.err_timeo.lu_reset_timeout = 30
Nov 15 08:26:23 user nova-compute[95467]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 15 08:26:23 user nova-compute[95467]: node.session.err_timeo.host_reset_timeout = 60
Nov 15 08:26:23 user nova-compute[95467]: node.session.iscsi.FastAbort = Yes
Nov 15 08:26:23 user nova-compute[95467]: node.session.iscsi.InitialR2T = No
Nov 15 08:26:23 user nova-compute[95467]: node.session.iscsi.ImmediateData = Yes
Nov 15 08:26:23 user nova-compute[95467]: node.session.iscsi.FirstBurstLength = 262144
Nov 15 08:26:23 user nova-compute[95467]: node.session.iscsi.MaxBurstLength = 16776192
Nov 15 08:26:23 user nova-compute[95467]: node.session.iscsi.DefaultTime2Retain = 0
Nov 15 08:26:23 user nova-compute[95467]: node.session.iscsi.DefaultTime2Wait = 2
Nov 15 08:26:23 user nova-compute[95467]: node.session.iscsi.MaxConnections = 1
Nov 15 08:26:23 user nova-compute[95467]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 15 08:26:23 user nova-compute[95467]: node.session.iscsi.ERL = 0
Nov 15 08:26:23 user nova-compute[95467]: node.session.scan = manual
Nov 15 08:26:23 user nova-compute[95467]: node.session.reopen_max = 0
Nov 15 08:26:23 user nova-compute[95467]: node.conn[0].address = 172.16.0.220
Nov 15 08:26:23 user nova-compute[95467]: node.conn[0].port = 3260
Nov 15 08:26:23 user nova-compute[95467]: node.conn[0].startup = manual
Nov 15 08:26:23 user nova-compute[95467]: node.conn[0].tcp.window_size = 524288
Nov 15 08:26:23 user nova-compute[95467]: node.conn[0].tcp.type_of_service = 0
Nov 15 08:26:23 user nova-compute[95467]: node.conn[0].timeo.logout_timeout = 15
Nov 15 08:26:23 user nova-compute[95467]: node.conn[0].timeo.login_timeout = 15
Nov 15 08:26:23 user nova-compute[95467]: node.conn[0].timeo.auth_timeout = 45
Nov 15 08:26:23 user nova-compute[95467]: node.conn[0].timeo.noop_out_interval = 5
Nov 15 08:26:23 user nova-compute[95467]: node.conn[0].timeo.noop_out_timeout = 5
Nov 15 08:26:23 user nova-compute[95467]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 15 08:26:23 user nova-compute[95467]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 15 08:26:23 user nova-compute[95467]: node.conn[0].iscsi.HeaderDigest = None
Nov 15 08:26:23 user nova-compute[95467]: node.conn[0].iscsi.DataDigest = None
Nov 15 08:26:23 user nova-compute[95467]: node.conn[0].iscsi.IFMarker = No
Nov 15 08:26:23 user nova-compute[95467]: node.conn[0].iscsi.OFMarker = No
Nov 15 08:26:23 user nova-compute[95467]: # END RECORD
Nov 15 08:26:23 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:26:23 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:23 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.075s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:26:23 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e702ecd-6b36-4b98-9c72-1184e07c7e14]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:26:23 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:26:23 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:23 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:26:23 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee2f65c-1e5c-44cc-b558-d75af85fa8a6]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:26:23 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:26:23 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hAzlOrmx {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:23 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hAzlOrmx" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:26:23 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[277f394d-386d-45af-9759-a07463e560d4]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:26:23 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hAzlOrmx'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:26:23 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:23 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:26:23 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[286ec864-59d5-49ad-a484-8bf6cb46aabb]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:26:23 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:26:23 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:23 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:26:23 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35dfa40-112b-49b1-84fe-34fee2ad33e8]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:26:23 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:26:23 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:26:23 user nova-compute[95467]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)
Nov 15 08:26:23 user nova-compute[95467]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:26:23 user nova-compute[95467]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 (non-flash)
Nov 15 08:26:23 user nova-compute[95467]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 (non-flash)
Nov 15 08:26:23 user nova-compute[95467]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 (non-flash)
Nov 15 08:26:23 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:26:23 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:26:23 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:26:23 user nova-compute[95467]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)
Nov 15 08:26:23 user nova-compute[95467]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:26:23 user nova-compute[95467]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 (non-flash)
Nov 15 08:26:23 user nova-compute[95467]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 (non-flash)
Nov 15 08:26:23 user nova-compute[95467]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 (non-flash)
Nov 15 08:26:23 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:26:23 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.193s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:26:23 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Connected to 172.16.0.220:3260 {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 08:26:23 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] HCTL ('34', '0', '0', 0) found on session 41 with lun 0 {{(pid=95467) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 08:26:23 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=95467) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 08:26:23 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:23 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.012s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:26:23 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1edfdd-b76a-406c-9710-7b9ca17c3091]: (4, ('0 0 0', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:26:23 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Searching for a device in session 41 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:26:23 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hAzlOrmx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 08:26:23 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.216s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:26:23 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] <== connect_volume: return (217ms) {'type': 'block', 'scsi_wwn': '23036643765326264', 'path': '/dev/sdc'} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:26:23 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036643765326264', 'path': '/dev/sdc'} {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 08:26:23 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:24:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-970128298',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-970128298',id=41,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:24:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c34d65a8000347feb2b3966b7ce0d785',ramdisk_id='',reservation_id='r-0wg1av9z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1903830225',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:24:47Z,user_data=None,user_id='6971581ab2604353aeb0c45c5252b4fb',uuid=ba05c01d-ae74-467c-a309-4d0ba904453d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3738b806-4005-468d-87df-f879eb2ff43d", "address": "fa:16:3e:86:6f:d3", "network": {"id": "ac9a381d-25fe-4419-b151-f03333413813", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1183680999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1183680999-network", "vif_mac": "fa:16:3e:86:6f:d3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34d65a8000347feb2b3966b7ce0d785", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3738b806-40", "ovs_interfaceid": "3738b806-4005-468d-87df-f879eb2ff43d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:26:23 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Converting VIF {"id": "3738b806-4005-468d-87df-f879eb2ff43d", "address": "fa:16:3e:86:6f:d3", "network": {"id": "ac9a381d-25fe-4419-b151-f03333413813", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1183680999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1183680999-network", "vif_mac": "fa:16:3e:86:6f:d3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34d65a8000347feb2b3966b7ce0d785", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3738b806-40", "ovs_interfaceid": "3738b806-4005-468d-87df-f879eb2ff43d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:26:23 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:6f:d3,bridge_name='br-int',has_traffic_filtering=True,id=3738b806-4005-468d-87df-f879eb2ff43d,network=Network(ac9a381d-25fe-4419-b151-f03333413813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3738b806-40') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:26:23 user nova-compute[95467]: DEBUG nova.objects.instance [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lazy-loading 'pci_devices' on Instance uuid ba05c01d-ae74-467c-a309-4d0ba904453d {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:26:23 user nova-compute[95467]: DEBUG nova.objects.base [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Object Instance<ba05c01d-ae74-467c-a309-4d0ba904453d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=95467) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 08:26:23 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:26:23 user nova-compute[95467]:   <uuid>ba05c01d-ae74-467c-a309-4d0ba904453d</uuid>
Nov 15 08:26:23 user nova-compute[95467]:   <name>instance-00000029</name>
Nov 15 08:26:23 user nova-compute[95467]:   <memory>524288</memory>
Nov 15 08:26:23 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:26:23 user nova-compute[95467]:   <metadata>
Nov 15 08:26:23 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:26:23 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:26:23 user nova-compute[95467]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-970128298</nova:name>
Nov 15 08:26:23 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:26:22</nova:creationTime>
Nov 15 08:26:23 user nova-compute[95467]:       <nova:flavor name="m1.tiny">
Nov 15 08:26:23 user nova-compute[95467]:         <nova:memory>512</nova:memory>
Nov 15 08:26:23 user nova-compute[95467]:         <nova:disk>1</nova:disk>
Nov 15 08:26:23 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:26:23 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:26:23 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:26:23 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:26:23 user nova-compute[95467]:       <nova:owner>
Nov 15 08:26:23 user nova-compute[95467]:         <nova:user uuid="6971581ab2604353aeb0c45c5252b4fb">tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member</nova:user>
Nov 15 08:26:23 user nova-compute[95467]:         <nova:project uuid="c34d65a8000347feb2b3966b7ce0d785">tempest-ServerBootFromVolumeStableRescueTest-1903830225</nova:project>
Nov 15 08:26:23 user nova-compute[95467]:       </nova:owner>
Nov 15 08:26:23 user nova-compute[95467]:       <nova:root type="image" uuid="ed9c48aa-ce73-4b3b-9db1-235898be671b"/>
Nov 15 08:26:23 user nova-compute[95467]:       <nova:ports>
Nov 15 08:26:23 user nova-compute[95467]:         <nova:port uuid="3738b806-4005-468d-87df-f879eb2ff43d">
Nov 15 08:26:23 user nova-compute[95467]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 08:26:23 user nova-compute[95467]:         </nova:port>
Nov 15 08:26:23 user nova-compute[95467]:       </nova:ports>
Nov 15 08:26:23 user nova-compute[95467]:     </nova:instance>
Nov 15 08:26:23 user nova-compute[95467]:   </metadata>
Nov 15 08:26:23 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:26:23 user nova-compute[95467]:     <system>
Nov 15 08:26:23 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:26:23 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:26:23 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:26:23 user nova-compute[95467]:       <entry name="serial">ba05c01d-ae74-467c-a309-4d0ba904453d</entry>
Nov 15 08:26:23 user nova-compute[95467]:       <entry name="uuid">ba05c01d-ae74-467c-a309-4d0ba904453d</entry>
Nov 15 08:26:23 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:26:23 user nova-compute[95467]:     </system>
Nov 15 08:26:23 user nova-compute[95467]:   </sysinfo>
Nov 15 08:26:23 user nova-compute[95467]:   <os>
Nov 15 08:26:23 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:26:23 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:26:23 user nova-compute[95467]:   </os>
Nov 15 08:26:23 user nova-compute[95467]:   <features>
Nov 15 08:26:23 user nova-compute[95467]:     <acpi/>
Nov 15 08:26:23 user nova-compute[95467]:     <apic/>
Nov 15 08:26:23 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:26:23 user nova-compute[95467]:   </features>
Nov 15 08:26:23 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:26:23 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:26:23 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:26:23 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:26:23 user nova-compute[95467]:   </clock>
Nov 15 08:26:23 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:26:23 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:26:23 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:26:23 user nova-compute[95467]:   </cpu>
Nov 15 08:26:23 user nova-compute[95467]:   <devices>
Nov 15 08:26:23 user nova-compute[95467]:     <disk type="block" device="disk">
Nov 15 08:26:23 user nova-compute[95467]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:26:23 user nova-compute[95467]:       <source dev="/dev/sdc"/>
Nov 15 08:26:23 user nova-compute[95467]:       <target dev="vda" bus="virtio"/>
Nov 15 08:26:23 user nova-compute[95467]:       <serial>24e79401-c916-4d6f-bee4-b169342acd24</serial>
Nov 15 08:26:23 user nova-compute[95467]:     </disk>
Nov 15 08:26:23 user nova-compute[95467]:     <disk type="file" device="disk">
Nov 15 08:26:23 user nova-compute[95467]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 08:26:23 user nova-compute[95467]:       <source file="/opt/stack/data/nova/instances/ba05c01d-ae74-467c-a309-4d0ba904453d/disk.rescue"/>
Nov 15 08:26:23 user nova-compute[95467]:       <target dev="vdb" bus="virtio"/>
Nov 15 08:26:23 user nova-compute[95467]:       <boot order="1"/>
Nov 15 08:26:23 user nova-compute[95467]:     </disk>
Nov 15 08:26:23 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:26:23 user nova-compute[95467]:       <mac address="fa:16:3e:86:6f:d3"/>
Nov 15 08:26:23 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:26:23 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:26:23 user nova-compute[95467]:       <target dev="tap3738b806-40"/>
Nov 15 08:26:23 user nova-compute[95467]:     </interface>
Nov 15 08:26:23 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:26:23 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/ba05c01d-ae74-467c-a309-4d0ba904453d/console.log" append="off"/>
Nov 15 08:26:23 user nova-compute[95467]:     </serial>
Nov 15 08:26:23 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:26:23 user nova-compute[95467]:     <video>
Nov 15 08:26:23 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:26:23 user nova-compute[95467]:     </video>
Nov 15 08:26:23 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:26:23 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:26:23 user nova-compute[95467]:     </rng>
Nov 15 08:26:23 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:26:23 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:26:23 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:26:23 user nova-compute[95467]:     </memballoon>
Nov 15 08:26:23 user nova-compute[95467]:   </devices>
Nov 15 08:26:23 user nova-compute[95467]: </domain>
Nov 15 08:26:23 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:26:23 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Instance destroyed successfully.
Nov 15 08:26:23 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:26:23 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] No BDM found with device name vdb, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:26:23 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] No VIF found with MAC fa:16:3e:86:6f:d3, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:26:23 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:26:24 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:26:24 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:26:24 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:26:24 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:26:24 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:26:24 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:26:24 user nova-compute[95467]: DEBUG nova.compute.manager [req-b0965d5a-42c1-439f-b0f4-a439ee52bb47 req-d4cd3caf-bb65-4c2e-a570-e1fa015ffa2b service nova] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Received event network-vif-plugged-3738b806-4005-468d-87df-f879eb2ff43d {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:26:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b0965d5a-42c1-439f-b0f4-a439ee52bb47 req-d4cd3caf-bb65-4c2e-a570-e1fa015ffa2b service nova] Acquiring lock "ba05c01d-ae74-467c-a309-4d0ba904453d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:26:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b0965d5a-42c1-439f-b0f4-a439ee52bb47 req-d4cd3caf-bb65-4c2e-a570-e1fa015ffa2b service nova] Lock "ba05c01d-ae74-467c-a309-4d0ba904453d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:26:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b0965d5a-42c1-439f-b0f4-a439ee52bb47 req-d4cd3caf-bb65-4c2e-a570-e1fa015ffa2b service nova] Lock "ba05c01d-ae74-467c-a309-4d0ba904453d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:26:24 user nova-compute[95467]: DEBUG nova.compute.manager [req-b0965d5a-42c1-439f-b0f4-a439ee52bb47 req-d4cd3caf-bb65-4c2e-a570-e1fa015ffa2b service nova] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] No waiting events found dispatching network-vif-plugged-3738b806-4005-468d-87df-f879eb2ff43d {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:26:24 user nova-compute[95467]: WARNING nova.compute.manager [req-b0965d5a-42c1-439f-b0f4-a439ee52bb47 req-d4cd3caf-bb65-4c2e-a570-e1fa015ffa2b service nova] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Received unexpected event network-vif-plugged-3738b806-4005-468d-87df-f879eb2ff43d for instance with vm_state active and task_state rescuing.
Nov 15 08:26:26 user nova-compute[95467]: DEBUG nova.compute.manager [None req-1373268f-899c-4fc5-9565-8e7b7b9da31d tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:26:27 user nova-compute[95467]: DEBUG nova.compute.manager [req-5995d835-4407-4f48-9456-8b79f4d6cfbd req-22731f73-76f7-48cb-8ec0-5fae91e2e3ee service nova] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Received event network-vif-plugged-3738b806-4005-468d-87df-f879eb2ff43d {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:26:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-5995d835-4407-4f48-9456-8b79f4d6cfbd req-22731f73-76f7-48cb-8ec0-5fae91e2e3ee service nova] Acquiring lock "ba05c01d-ae74-467c-a309-4d0ba904453d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:26:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-5995d835-4407-4f48-9456-8b79f4d6cfbd req-22731f73-76f7-48cb-8ec0-5fae91e2e3ee service nova] Lock "ba05c01d-ae74-467c-a309-4d0ba904453d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:26:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-5995d835-4407-4f48-9456-8b79f4d6cfbd req-22731f73-76f7-48cb-8ec0-5fae91e2e3ee service nova] Lock "ba05c01d-ae74-467c-a309-4d0ba904453d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:26:27 user nova-compute[95467]: DEBUG nova.compute.manager [req-5995d835-4407-4f48-9456-8b79f4d6cfbd req-22731f73-76f7-48cb-8ec0-5fae91e2e3ee service nova] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] No waiting events found dispatching network-vif-plugged-3738b806-4005-468d-87df-f879eb2ff43d {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:26:27 user nova-compute[95467]: WARNING nova.compute.manager [req-5995d835-4407-4f48-9456-8b79f4d6cfbd req-22731f73-76f7-48cb-8ec0-5fae91e2e3ee service nova] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Received unexpected event network-vif-plugged-3738b806-4005-468d-87df-f879eb2ff43d for instance with vm_state rescued and task_state None.
Nov 15 08:26:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:26:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:26:29 user nova-compute[95467]: DEBUG nova.compute.manager [req-1ea248fa-9c75-4d34-8d5d-4862f3a9da96 req-f314b086-cb70-45f8-9928-4c0015959d17 service nova] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] Received event network-changed-28b18ef7-c90a-4036-be3b-46cb5a2793f5 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:26:29 user nova-compute[95467]: DEBUG nova.compute.manager [req-1ea248fa-9c75-4d34-8d5d-4862f3a9da96 req-f314b086-cb70-45f8-9928-4c0015959d17 service nova] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] Refreshing instance network info cache due to event network-changed-28b18ef7-c90a-4036-be3b-46cb5a2793f5. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:26:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-1ea248fa-9c75-4d34-8d5d-4862f3a9da96 req-f314b086-cb70-45f8-9928-4c0015959d17 service nova] Acquiring lock "refresh_cache-7f14502f-8c4d-400a-a68a-f3f9c3d48524" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:26:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-1ea248fa-9c75-4d34-8d5d-4862f3a9da96 req-f314b086-cb70-45f8-9928-4c0015959d17 service nova] Acquired lock "refresh_cache-7f14502f-8c4d-400a-a68a-f3f9c3d48524" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:26:29 user nova-compute[95467]: DEBUG nova.network.neutron [req-1ea248fa-9c75-4d34-8d5d-4862f3a9da96 req-f314b086-cb70-45f8-9928-4c0015959d17 service nova] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] Refreshing network info cache for port 28b18ef7-c90a-4036-be3b-46cb5a2793f5 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:26:29 user nova-compute[95467]: DEBUG nova.network.neutron [req-1ea248fa-9c75-4d34-8d5d-4862f3a9da96 req-f314b086-cb70-45f8-9928-4c0015959d17 service nova] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] Updated VIF entry in instance network info cache for port 28b18ef7-c90a-4036-be3b-46cb5a2793f5. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:26:29 user nova-compute[95467]: DEBUG nova.network.neutron [req-1ea248fa-9c75-4d34-8d5d-4862f3a9da96 req-f314b086-cb70-45f8-9928-4c0015959d17 service nova] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] Updating instance_info_cache with network_info: [{"id": "28b18ef7-c90a-4036-be3b-46cb5a2793f5", "address": "fa:16:3e:0b:69:75", "network": {"id": "304f39cf-cfb1-462f-8f2e-2ee6fd1fd47b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-226476785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "544d63a64ba74f95b1eea2ea7f1241a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28b18ef7-c9", "ovs_interfaceid": "28b18ef7-c90a-4036-be3b-46cb5a2793f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:26:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-1ea248fa-9c75-4d34-8d5d-4862f3a9da96 req-f314b086-cb70-45f8-9928-4c0015959d17 service nova] Releasing lock "refresh_cache-7f14502f-8c4d-400a-a68a-f3f9c3d48524" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:26:31 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-bc5e38a8-43d8-47d2-b73a-7f7b34156a11 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Acquiring lock "7f14502f-8c4d-400a-a68a-f3f9c3d48524" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:26:31 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-bc5e38a8-43d8-47d2-b73a-7f7b34156a11 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Lock "7f14502f-8c4d-400a-a68a-f3f9c3d48524" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:26:31 user nova-compute[95467]: DEBUG nova.objects.instance [None req-bc5e38a8-43d8-47d2-b73a-7f7b34156a11 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Lazy-loading 'flavor' on Instance uuid 7f14502f-8c4d-400a-a68a-f3f9c3d48524 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:26:31 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-bc5e38a8-43d8-47d2-b73a-7f7b34156a11 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Lock "7f14502f-8c4d-400a-a68a-f3f9c3d48524" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:26:31 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-bc5e38a8-43d8-47d2-b73a-7f7b34156a11 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Acquiring lock "7f14502f-8c4d-400a-a68a-f3f9c3d48524" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:26:31 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-bc5e38a8-43d8-47d2-b73a-7f7b34156a11 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Lock "7f14502f-8c4d-400a-a68a-f3f9c3d48524" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:26:31 user nova-compute[95467]: INFO nova.compute.manager [None req-bc5e38a8-43d8-47d2-b73a-7f7b34156a11 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] Attaching volume 632dba98-1498-4789-81ef-816c66cd5c82 to /dev/vdb
Nov 15 08:26:31 user nova-compute[95467]: DEBUG os_brick.utils [None req-bc5e38a8-43d8-47d2-b73a-7f7b34156a11 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:26:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:26:31 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d7ab53-c8fb-44a6-85f4-930b85345163]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:882ae90641f\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:26:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:26:31 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[10761be2-8c6c-4701-8653-169aa2d5c539]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:26:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:26:31 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bbbcd18-8808-4675-bbc8-6767d5bb8f02]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:26:31 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d7cda9-d7c2-4c21-8394-e8426ed04b5a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:26:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-bc5e38a8-43d8-47d2-b73a-7f7b34156a11 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Running cmd (subprocess): nvme version {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-bc5e38a8-43d8-47d2-b73a-7f7b34156a11 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] 'nvme version' failed. Not Retrying. {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:26:31 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bc5e38a8-43d8-47d2-b73a-7f7b34156a11 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] nvme not present on system {{(pid=95467) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 08:26:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:26:31 user nova-compute[95467]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 08:26:31 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[385bc821-1480-43f3-8814-21f21269bc78]: (4, '') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:26:31 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-bc5e38a8-43d8-47d2-b73a-7f7b34156a11 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=95467) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 08:26:31 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-bc5e38a8-43d8-47d2-b73a-7f7b34156a11 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 08:26:31 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-bc5e38a8-43d8-47d2-b73a-7f7b34156a11 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] LIGHTOS: no hostnqn found. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 08:26:31 user nova-compute[95467]: DEBUG os_brick.utils [None req-bc5e38a8-43d8-47d2-b73a-7f7b34156a11 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:882ae90641f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:26:31 user nova-compute[95467]: DEBUG nova.virt.block_device [None req-bc5e38a8-43d8-47d2-b73a-7f7b34156a11 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] Updating existing volume attachment record: 25f064c7-182d-4428-a14c-e1f2a4cebb70 {{(pid=95467) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 08:26:31 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._sync_power_states {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:26:32 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Triggering sync for uuid 73fe8852-c47a-47ab-a56f-6864c8ed5479 {{(pid=95467) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 08:26:32 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Triggering sync for uuid 21cf2ada-b15c-490d-ac37-96e9c87e9056 {{(pid=95467) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 08:26:32 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Triggering sync for uuid b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67 {{(pid=95467) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 08:26:32 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Triggering sync for uuid 10d73b73-ca65-4192-8954-288dc1df9f24 {{(pid=95467) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 08:26:32 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Triggering sync for uuid 3825a691-ac5c-4c06-b4a4-2a0b40c638c4 {{(pid=95467) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 08:26:32 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Triggering sync for uuid a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80 {{(pid=95467) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 08:26:32 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Triggering sync for uuid 091612cf-b737-480b-984e-a05b522676b6 {{(pid=95467) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 08:26:32 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Triggering sync for uuid d22eb02b-7e8d-4755-9f1e-3eee56ddec0c {{(pid=95467) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 08:26:32 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Triggering sync for uuid 843b778c-f823-4bee-aa76-ab44345be9a7 {{(pid=95467) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 08:26:32 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Triggering sync for uuid 739645e6-9952-40db-a876-f23d02d4e411 {{(pid=95467) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 08:26:32 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Triggering sync for uuid ba05c01d-ae74-467c-a309-4d0ba904453d {{(pid=95467) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 08:26:32 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Triggering sync for uuid 7f14502f-8c4d-400a-a68a-f3f9c3d48524 {{(pid=95467) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 08:26:32 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Triggering sync for uuid 218f0d21-181c-4634-b6f7-20137fe30520 {{(pid=95467) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 08:26:32 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Triggering sync for uuid 7eb1f0ce-72bd-4015-993c-a32404f15481 {{(pid=95467) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 08:26:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "73fe8852-c47a-47ab-a56f-6864c8ed5479" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:26:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "73fe8852-c47a-47ab-a56f-6864c8ed5479" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:26:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "21cf2ada-b15c-490d-ac37-96e9c87e9056" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:26:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "21cf2ada-b15c-490d-ac37-96e9c87e9056" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:26:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:26:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:26:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "10d73b73-ca65-4192-8954-288dc1df9f24" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:26:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "10d73b73-ca65-4192-8954-288dc1df9f24" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:26:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "3825a691-ac5c-4c06-b4a4-2a0b40c638c4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:26:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "3825a691-ac5c-4c06-b4a4-2a0b40c638c4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:26:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:26:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:26:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "091612cf-b737-480b-984e-a05b522676b6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:26:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "091612cf-b737-480b-984e-a05b522676b6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:26:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "d22eb02b-7e8d-4755-9f1e-3eee56ddec0c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:26:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "d22eb02b-7e8d-4755-9f1e-3eee56ddec0c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:26:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "843b778c-f823-4bee-aa76-ab44345be9a7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:26:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "843b778c-f823-4bee-aa76-ab44345be9a7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:26:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "739645e6-9952-40db-a876-f23d02d4e411" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:26:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "739645e6-9952-40db-a876-f23d02d4e411" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:26:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "ba05c01d-ae74-467c-a309-4d0ba904453d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:26:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "ba05c01d-ae74-467c-a309-4d0ba904453d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:26:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "7f14502f-8c4d-400a-a68a-f3f9c3d48524" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:26:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "218f0d21-181c-4634-b6f7-20137fe30520" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:26:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "218f0d21-181c-4634-b6f7-20137fe30520" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:26:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "7eb1f0ce-72bd-4015-993c-a32404f15481" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:26:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "7eb1f0ce-72bd-4015-993c-a32404f15481" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:26:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "21cf2ada-b15c-490d-ac37-96e9c87e9056" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:26:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "73fe8852-c47a-47ab-a56f-6864c8ed5479" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.059s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:26:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.060s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:26:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "3825a691-ac5c-4c06-b4a4-2a0b40c638c4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.072s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:26:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "10d73b73-ca65-4192-8954-288dc1df9f24" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:26:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "091612cf-b737-480b-984e-a05b522676b6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.082s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:26:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "d22eb02b-7e8d-4755-9f1e-3eee56ddec0c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.091s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:26:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.094s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:26:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "739645e6-9952-40db-a876-f23d02d4e411" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.103s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:26:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "ba05c01d-ae74-467c-a309-4d0ba904453d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.105s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:26:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "843b778c-f823-4bee-aa76-ab44345be9a7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.114s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:26:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "7eb1f0ce-72bd-4015-993c-a32404f15481" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.117s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:26:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "218f0d21-181c-4634-b6f7-20137fe30520" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.120s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:26:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:26:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:26:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-80b8a411-8587-46a5-9388-b598f0c0ceb0 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Acquiring lock "218f0d21-181c-4634-b6f7-20137fe30520" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:26:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-80b8a411-8587-46a5-9388-b598f0c0ceb0 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Lock "218f0d21-181c-4634-b6f7-20137fe30520" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:26:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-80b8a411-8587-46a5-9388-b598f0c0ceb0 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Acquiring lock "218f0d21-181c-4634-b6f7-20137fe30520-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:26:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-80b8a411-8587-46a5-9388-b598f0c0ceb0 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Lock "218f0d21-181c-4634-b6f7-20137fe30520-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:26:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-80b8a411-8587-46a5-9388-b598f0c0ceb0 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Lock "218f0d21-181c-4634-b6f7-20137fe30520-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:26:34 user nova-compute[95467]: INFO nova.compute.manager [None req-80b8a411-8587-46a5-9388-b598f0c0ceb0 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 218f0d21-181c-4634-b6f7-20137fe30520] Terminating instance
Nov 15 08:26:34 user nova-compute[95467]: DEBUG nova.compute.manager [None req-80b8a411-8587-46a5-9388-b598f0c0ceb0 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 218f0d21-181c-4634-b6f7-20137fe30520] Start destroying the instance on the hypervisor. {{(pid=95467) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 08:26:34 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:26:34 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:26:34 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:26:34 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:26:34 user nova-compute[95467]: DEBUG nova.compute.manager [req-dd200198-57df-450f-9020-fe84a2ec4297 req-0bcf0b1d-6fe0-4919-b56c-2e9a95ae2be7 service nova] [instance: 218f0d21-181c-4634-b6f7-20137fe30520] Received event network-vif-unplugged-33bb6ea0-983d-4a4a-960e-ca26aade5062 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:26:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-dd200198-57df-450f-9020-fe84a2ec4297 req-0bcf0b1d-6fe0-4919-b56c-2e9a95ae2be7 service nova] Acquiring lock "218f0d21-181c-4634-b6f7-20137fe30520-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:26:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-dd200198-57df-450f-9020-fe84a2ec4297 req-0bcf0b1d-6fe0-4919-b56c-2e9a95ae2be7 service nova] Lock "218f0d21-181c-4634-b6f7-20137fe30520-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:26:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-dd200198-57df-450f-9020-fe84a2ec4297 req-0bcf0b1d-6fe0-4919-b56c-2e9a95ae2be7 service nova] Lock "218f0d21-181c-4634-b6f7-20137fe30520-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:26:34 user nova-compute[95467]: DEBUG nova.compute.manager [req-dd200198-57df-450f-9020-fe84a2ec4297 req-0bcf0b1d-6fe0-4919-b56c-2e9a95ae2be7 service nova] [instance: 218f0d21-181c-4634-b6f7-20137fe30520] No waiting events found dispatching network-vif-unplugged-33bb6ea0-983d-4a4a-960e-ca26aade5062 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:26:34 user nova-compute[95467]: DEBUG nova.compute.manager [req-dd200198-57df-450f-9020-fe84a2ec4297 req-0bcf0b1d-6fe0-4919-b56c-2e9a95ae2be7 service nova] [instance: 218f0d21-181c-4634-b6f7-20137fe30520] Received event network-vif-unplugged-33bb6ea0-983d-4a4a-960e-ca26aade5062 for instance with task_state deleting. {{(pid=95467) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 08:26:34 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 218f0d21-181c-4634-b6f7-20137fe30520] Instance destroyed successfully.
Nov 15 08:26:34 user nova-compute[95467]: DEBUG nova.objects.instance [None req-80b8a411-8587-46a5-9388-b598f0c0ceb0 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Lazy-loading 'resources' on Instance uuid 218f0d21-181c-4634-b6f7-20137fe30520 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:26:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-80b8a411-8587-46a5-9388-b598f0c0ceb0 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:24:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1086256702',display_name='tempest-VolumesActionsTest-instance-1086256702',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1086256702',id=43,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:24:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e179db7f977c4d98abb497c6a3b4f5e9',ramdisk_id='',reservation_id='r-r0gk7g66',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1524883282',owner_user_name='tempest-VolumesActionsTest-1524883282-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:24:51Z,user_data=None,user_id='21abcb55c48d44af8a215cdc4013a065',uuid=218f0d21-181c-4634-b6f7-20137fe30520,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "33bb6ea0-983d-4a4a-960e-ca26aade5062", "address": "fa:16:3e:c9:9f:d2", "network": {"id": "3bb97374-8e3e-4364-a350-dbe265332087", "bridge": "br-int", "label": "tempest-VolumesActionsTest-966132722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e179db7f977c4d98abb497c6a3b4f5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33bb6ea0-98", "ovs_interfaceid": "33bb6ea0-983d-4a4a-960e-ca26aade5062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:26:34 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-80b8a411-8587-46a5-9388-b598f0c0ceb0 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Converting VIF {"id": "33bb6ea0-983d-4a4a-960e-ca26aade5062", "address": "fa:16:3e:c9:9f:d2", "network": {"id": "3bb97374-8e3e-4364-a350-dbe265332087", "bridge": "br-int", "label": "tempest-VolumesActionsTest-966132722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e179db7f977c4d98abb497c6a3b4f5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33bb6ea0-98", "ovs_interfaceid": "33bb6ea0-983d-4a4a-960e-ca26aade5062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:26:34 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-80b8a411-8587-46a5-9388-b598f0c0ceb0 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:9f:d2,bridge_name='br-int',has_traffic_filtering=True,id=33bb6ea0-983d-4a4a-960e-ca26aade5062,network=Network(3bb97374-8e3e-4364-a350-dbe265332087),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33bb6ea0-98') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:26:34 user nova-compute[95467]: DEBUG os_vif [None req-80b8a411-8587-46a5-9388-b598f0c0ceb0 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:9f:d2,bridge_name='br-int',has_traffic_filtering=True,id=33bb6ea0-983d-4a4a-960e-ca26aade5062,network=Network(3bb97374-8e3e-4364-a350-dbe265332087),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33bb6ea0-98') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:26:34 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:26:34 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap33bb6ea0-98, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:26:34 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:26:34 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:26:34 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:26:34 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9e4ade4f-067c-49eb-b8d3-932f78606fbd) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:26:34 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:26:34 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:26:34 user nova-compute[95467]: INFO os_vif [None req-80b8a411-8587-46a5-9388-b598f0c0ceb0 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:9f:d2,bridge_name='br-int',has_traffic_filtering=True,id=33bb6ea0-983d-4a4a-960e-ca26aade5062,network=Network(3bb97374-8e3e-4364-a350-dbe265332087),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33bb6ea0-98')
Nov 15 08:26:34 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-80b8a411-8587-46a5-9388-b598f0c0ceb0 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 218f0d21-181c-4634-b6f7-20137fe30520] Deleting instance files /opt/stack/data/nova/instances/218f0d21-181c-4634-b6f7-20137fe30520_del
Nov 15 08:26:34 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-80b8a411-8587-46a5-9388-b598f0c0ceb0 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 218f0d21-181c-4634-b6f7-20137fe30520] Deletion of /opt/stack/data/nova/instances/218f0d21-181c-4634-b6f7-20137fe30520_del complete
Nov 15 08:26:35 user nova-compute[95467]: INFO nova.compute.manager [None req-80b8a411-8587-46a5-9388-b598f0c0ceb0 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 218f0d21-181c-4634-b6f7-20137fe30520] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 15 08:26:35 user nova-compute[95467]: DEBUG oslo.service.loopingcall [None req-80b8a411-8587-46a5-9388-b598f0c0ceb0 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=95467) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 08:26:35 user nova-compute[95467]: DEBUG nova.compute.manager [-] [instance: 218f0d21-181c-4634-b6f7-20137fe30520] Deallocating network for instance {{(pid=95467) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 08:26:35 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: 218f0d21-181c-4634-b6f7-20137fe30520] deallocate_for_instance() {{(pid=95467) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 08:26:35 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: 218f0d21-181c-4634-b6f7-20137fe30520] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:26:35 user nova-compute[95467]: INFO nova.compute.manager [-] [instance: 218f0d21-181c-4634-b6f7-20137fe30520] Took 0.55 seconds to deallocate network for instance.
Nov 15 08:26:35 user nova-compute[95467]: DEBUG nova.compute.manager [req-68708aa1-4668-4265-a0e3-bf22f8ce9047 req-4eacf112-1a79-4fd5-8fca-f45e61eaa543 service nova] [instance: 218f0d21-181c-4634-b6f7-20137fe30520] Received event network-vif-deleted-33bb6ea0-983d-4a4a-960e-ca26aade5062 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:26:35 user nova-compute[95467]: INFO nova.compute.manager [req-68708aa1-4668-4265-a0e3-bf22f8ce9047 req-4eacf112-1a79-4fd5-8fca-f45e61eaa543 service nova] [instance: 218f0d21-181c-4634-b6f7-20137fe30520] Neutron deleted interface 33bb6ea0-983d-4a4a-960e-ca26aade5062; detaching it from the instance and deleting it from the info cache
Nov 15 08:26:35 user nova-compute[95467]: DEBUG nova.network.neutron [req-68708aa1-4668-4265-a0e3-bf22f8ce9047 req-4eacf112-1a79-4fd5-8fca-f45e61eaa543 service nova] [instance: 218f0d21-181c-4634-b6f7-20137fe30520] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:26:35 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-51a0c2ea-b272-4d87-8d58-845c8bb48f69 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Acquiring lock "843b778c-f823-4bee-aa76-ab44345be9a7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:26:35 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-51a0c2ea-b272-4d87-8d58-845c8bb48f69 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Lock "843b778c-f823-4bee-aa76-ab44345be9a7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:26:35 user nova-compute[95467]: INFO nova.compute.manager [None req-51a0c2ea-b272-4d87-8d58-845c8bb48f69 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Detaching volume c72f2f38-cf4d-48aa-98b2-cceddbc99cd8
Nov 15 08:26:35 user nova-compute[95467]: DEBUG nova.compute.manager [req-68708aa1-4668-4265-a0e3-bf22f8ce9047 req-4eacf112-1a79-4fd5-8fca-f45e61eaa543 service nova] [instance: 218f0d21-181c-4634-b6f7-20137fe30520] Detach interface failed, port_id=33bb6ea0-983d-4a4a-960e-ca26aade5062, reason: Instance 218f0d21-181c-4634-b6f7-20137fe30520 could not be found. {{(pid=95467) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 08:26:35 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-80b8a411-8587-46a5-9388-b598f0c0ceb0 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:26:35 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-80b8a411-8587-46a5-9388-b598f0c0ceb0 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:26:35 user nova-compute[95467]: INFO nova.virt.block_device [None req-51a0c2ea-b272-4d87-8d58-845c8bb48f69 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Attempting to driver detach volume c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 from mountpoint /dev/vdb
Nov 15 08:26:35 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-51a0c2ea-b272-4d87-8d58-845c8bb48f69 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Attempting to detach device vdb from instance 843b778c-f823-4bee-aa76-ab44345be9a7 from the persistent domain config. {{(pid=95467) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 08:26:35 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-51a0c2ea-b272-4d87-8d58-845c8bb48f69 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 08:26:35 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:26:35 user nova-compute[95467]:   <source dev="/dev/sde"/>
Nov 15 08:26:35 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:26:35 user nova-compute[95467]:   <serial>c72f2f38-cf4d-48aa-98b2-cceddbc99cd8</serial>
Nov 15 08:26:35 user nova-compute[95467]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 08:26:35 user nova-compute[95467]: </disk>
Nov 15 08:26:35 user nova-compute[95467]:  {{(pid=95467) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 08:26:35 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-51a0c2ea-b272-4d87-8d58-845c8bb48f69 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Successfully detached device vdb from instance 843b778c-f823-4bee-aa76-ab44345be9a7 from the persistent domain config.
Nov 15 08:26:35 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-51a0c2ea-b272-4d87-8d58-845c8bb48f69 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 843b778c-f823-4bee-aa76-ab44345be9a7 from the live domain config. {{(pid=95467) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 08:26:35 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-51a0c2ea-b272-4d87-8d58-845c8bb48f69 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 08:26:35 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:26:35 user nova-compute[95467]:   <source dev="/dev/sde"/>
Nov 15 08:26:35 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:26:35 user nova-compute[95467]:   <serial>c72f2f38-cf4d-48aa-98b2-cceddbc99cd8</serial>
Nov 15 08:26:35 user nova-compute[95467]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 08:26:35 user nova-compute[95467]: </disk>
Nov 15 08:26:35 user nova-compute[95467]:  {{(pid=95467) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 08:26:36 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-80b8a411-8587-46a5-9388-b598f0c0ceb0 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:26:36 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-80b8a411-8587-46a5-9388-b598f0c0ceb0 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:26:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-80b8a411-8587-46a5-9388-b598f0c0ceb0 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.510s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:26:36 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-51a0c2ea-b272-4d87-8d58-845c8bb48f69 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 843b778c-f823-4bee-aa76-ab44345be9a7 {{(pid=95467) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 08:26:36 user nova-compute[95467]: INFO nova.scheduler.client.report [None req-80b8a411-8587-46a5-9388-b598f0c0ceb0 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Deleted allocations for instance 218f0d21-181c-4634-b6f7-20137fe30520
Nov 15 08:26:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-80b8a411-8587-46a5-9388-b598f0c0ceb0 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Lock "218f0d21-181c-4634-b6f7-20137fe30520" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.199s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:26:36 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc5e38a8-43d8-47d2-b73a-7f7b34156a11 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] Calling os-brick to attach iSCSI Volume {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 08:26:36 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5e38a8-43d8-47d2-b73a-7f7b34156a11 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:632dba98-1498-4789-81ef-816c66cd5c82', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JHVuMQme', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:26:36 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-bc5e38a8-43d8-47d2-b73a-7f7b34156a11 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:26:36 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-bc5e38a8-43d8-47d2-b73a-7f7b34156a11 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:26:36 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-bc5e38a8-43d8-47d2-b73a-7f7b34156a11 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:26:36 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-bc5e38a8-43d8-47d2-b73a-7f7b34156a11 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:26:36 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-bc5e38a8-43d8-47d2-b73a-7f7b34156a11 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:632dba98-1498-4789-81ef-816c66cd5c82" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:26:36 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-bc5e38a8-43d8-47d2-b73a-7f7b34156a11 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:632dba98-1498-4789-81ef-816c66cd5c82" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:26:36 user nova-compute[95467]: INFO os_brick.initiator.connectors.iscsi [None req-bc5e38a8-43d8-47d2-b73a-7f7b34156a11 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 08:26:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:632dba98-1498-4789-81ef-816c66cd5c82 -p 172.16.0.220:3260 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:632dba98-1498-4789-81ef-816c66cd5c82 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:26:36 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4b6055-150f-4d2c-8ac3-12dab6599a4f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:26:36 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5e38a8-43d8-47d2-b73a-7f7b34156a11 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 08:26:36 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:26:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:632dba98-1498-4789-81ef-816c66cd5c82 -p 172.16.0.220:3260 --interface default --op new {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:36 user nova-compute[95467]: DEBUG nova.compute.manager [req-402211fc-38db-416a-80a0-24122e30e465 req-93c5b06b-7cfb-4a26-9402-9a07138a9cad service nova] [instance: 218f0d21-181c-4634-b6f7-20137fe30520] Received event network-vif-plugged-33bb6ea0-983d-4a4a-960e-ca26aade5062 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:26:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-402211fc-38db-416a-80a0-24122e30e465 req-93c5b06b-7cfb-4a26-9402-9a07138a9cad service nova] Acquiring lock "218f0d21-181c-4634-b6f7-20137fe30520-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:26:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-402211fc-38db-416a-80a0-24122e30e465 req-93c5b06b-7cfb-4a26-9402-9a07138a9cad service nova] Lock "218f0d21-181c-4634-b6f7-20137fe30520-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:26:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-402211fc-38db-416a-80a0-24122e30e465 req-93c5b06b-7cfb-4a26-9402-9a07138a9cad service nova] Lock "218f0d21-181c-4634-b6f7-20137fe30520-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:26:36 user nova-compute[95467]: DEBUG nova.compute.manager [req-402211fc-38db-416a-80a0-24122e30e465 req-93c5b06b-7cfb-4a26-9402-9a07138a9cad service nova] [instance: 218f0d21-181c-4634-b6f7-20137fe30520] No waiting events found dispatching network-vif-plugged-33bb6ea0-983d-4a4a-960e-ca26aade5062 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:26:36 user nova-compute[95467]: WARNING nova.compute.manager [req-402211fc-38db-416a-80a0-24122e30e465 req-93c5b06b-7cfb-4a26-9402-9a07138a9cad service nova] [instance: 218f0d21-181c-4634-b6f7-20137fe30520] Received unexpected event network-vif-plugged-33bb6ea0-983d-4a4a-960e-ca26aade5062 for instance with vm_state deleted and task_state None.
Nov 15 08:26:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:632dba98-1498-4789-81ef-816c66cd5c82 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:26:36 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[7774a30d-7685-45f8-ae43-7238b9400a7d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:632dba98-1498-4789-81ef-816c66cd5c82] added\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:26:36 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5e38a8-43d8-47d2-b73a-7f7b34156a11 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:632dba98-1498-4789-81ef-816c66cd5c82] added
Nov 15 08:26:36 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:26:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:632dba98-1498-4789-81ef-816c66cd5c82 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:632dba98-1498-4789-81ef-816c66cd5c82 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:26:36 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a1de9a-09da-4fc1-b3b7-c129418e9bad]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:26:36 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5e38a8-43d8-47d2-b73a-7f7b34156a11 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:26:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:632dba98-1498-4789-81ef-816c66cd5c82 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:632dba98-1498-4789-81ef-816c66cd5c82 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:26:36 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[e016fb60-4dbb-4c68-8438-1d166f03d1e9]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:26:36 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5e38a8-43d8-47d2-b73a-7f7b34156a11 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:26:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:632dba98-1498-4789-81ef-816c66cd5c82 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JHVuMQme {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:632dba98-1498-4789-81ef-816c66cd5c82 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JHVuMQme" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:26:36 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a4d901-5960-4dc9-a9d6-741dc7ec476a]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:26:36 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5e38a8-43d8-47d2-b73a-7f7b34156a11 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JHVuMQme'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:26:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:632dba98-1498-4789-81ef-816c66cd5c82 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:632dba98-1498-4789-81ef-816c66cd5c82 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:26:36 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[289614bd-222d-4ca7-8280-47b203dfe1b6]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:26:36 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5e38a8-43d8-47d2-b73a-7f7b34156a11 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:26:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:26:36 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eacbc09-91ec-433b-adf4-4fdd88af5cbd]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:26:36 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5e38a8-43d8-47d2-b73a-7f7b34156a11 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:26:36 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:26:36 user nova-compute[95467]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)
Nov 15 08:26:36 user nova-compute[95467]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:26:36 user nova-compute[95467]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 (non-flash)
Nov 15 08:26:36 user nova-compute[95467]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 (non-flash)
Nov 15 08:26:36 user nova-compute[95467]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 (non-flash)
Nov 15 08:26:36 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:26:36 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5e38a8-43d8-47d2-b73a-7f7b34156a11 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:26:36 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:26:36 user nova-compute[95467]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)
Nov 15 08:26:36 user nova-compute[95467]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:26:36 user nova-compute[95467]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 (non-flash)
Nov 15 08:26:36 user nova-compute[95467]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 (non-flash)
Nov 15 08:26:36 user nova-compute[95467]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 (non-flash)
Nov 15 08:26:36 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:26:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:632dba98-1498-4789-81ef-816c66cd5c82 -p 172.16.0.220:3260 --login {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:632dba98-1498-4789-81ef-816c66cd5c82 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:26:36 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[0923b6d7-4acb-49ef-9670-8bdcb638a463]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:632dba98-1498-4789-81ef-816c66cd5c82, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:632dba98-1498-4789-81ef-816c66cd5c82, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:26:36 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5e38a8-43d8-47d2-b73a-7f7b34156a11 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:632dba98-1498-4789-81ef-816c66cd5c82, portal: 172.16.0.220,3260]
Nov 15 08:26:36 user nova-compute[95467]: Login to [iface: default, target: iqn.2010-10.org.openstack:632dba98-1498-4789-81ef-816c66cd5c82, portal: 172.16.0.220,3260] successful.
Nov 15 08:26:36 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:26:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:632dba98-1498-4789-81ef-816c66cd5c82 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:632dba98-1498-4789-81ef-816c66cd5c82 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:26:36 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4c8b04-2bfa-4ef8-b383-878c438fd993]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:26:36 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5e38a8-43d8-47d2-b73a-7f7b34156a11 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:26:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:26:36 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e95c7d-7da5-46d7-b4e4-292f9a58c2c3]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:632dba98-1498-4789-81ef-816c66cd5c82 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:26:36 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5e38a8-43d8-47d2-b73a-7f7b34156a11 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:26:36 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:26:36 user nova-compute[95467]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)
Nov 15 08:26:36 user nova-compute[95467]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:26:36 user nova-compute[95467]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 (non-flash)
Nov 15 08:26:36 user nova-compute[95467]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 (non-flash)
Nov 15 08:26:36 user nova-compute[95467]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 (non-flash)
Nov 15 08:26:36 user nova-compute[95467]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:632dba98-1498-4789-81ef-816c66cd5c82 (non-flash)
Nov 15 08:26:36 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:26:36 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5e38a8-43d8-47d2-b73a-7f7b34156a11 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:26:36 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:26:36 user nova-compute[95467]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)
Nov 15 08:26:36 user nova-compute[95467]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:26:36 user nova-compute[95467]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 (non-flash)
Nov 15 08:26:36 user nova-compute[95467]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 (non-flash)
Nov 15 08:26:36 user nova-compute[95467]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 (non-flash)
Nov 15 08:26:36 user nova-compute[95467]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:632dba98-1498-4789-81ef-816c66cd5c82 (non-flash)
Nov 15 08:26:36 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:26:36 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-bc5e38a8-43d8-47d2-b73a-7f7b34156a11 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:632dba98-1498-4789-81ef-816c66cd5c82" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:26:36 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5e38a8-43d8-47d2-b73a-7f7b34156a11 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Connected to 172.16.0.220:3260 {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 08:26:36 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-bc5e38a8-43d8-47d2-b73a-7f7b34156a11 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] HCTL ('40', '-', '-', 0) found on session 49 with lun 0 {{(pid=95467) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 08:26:36 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-bc5e38a8-43d8-47d2-b73a-7f7b34156a11 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=95467) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 08:26:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:26:36 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf511307-349b-4889-a2d3-ec59f19c256f]: (4, ('- - 0', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:26:36 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-bc5e38a8-43d8-47d2-b73a-7f7b34156a11 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Searching for a device in session 49 and hctl ['40', '*', '*', 0] yield: None {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:26:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:26:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:26:37 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-bc5e38a8-43d8-47d2-b73a-7f7b34156a11 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Searching for a device in session 49 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:26:37 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5e38a8-43d8-47d2-b73a-7f7b34156a11 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:632dba98-1498-4789-81ef-816c66cd5c82', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JHVuMQme', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 08:26:37 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-bc5e38a8-43d8-47d2-b73a-7f7b34156a11 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:26:37 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5e38a8-43d8-47d2-b73a-7f7b34156a11 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '23430373433666134', 'path': '/dev/sdi'} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:26:37 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc5e38a8-43d8-47d2-b73a-7f7b34156a11 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23430373433666134', 'path': '/dev/sdi'} {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 08:26:37 user nova-compute[95467]: DEBUG nova.objects.instance [None req-bc5e38a8-43d8-47d2-b73a-7f7b34156a11 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Lazy-loading 'flavor' on Instance uuid 7f14502f-8c4d-400a-a68a-f3f9c3d48524 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:26:37 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-bc5e38a8-43d8-47d2-b73a-7f7b34156a11 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 08:26:37 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:26:37 user nova-compute[95467]:   <source dev="/dev/sdi"/>
Nov 15 08:26:37 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:26:37 user nova-compute[95467]:   <serial>632dba98-1498-4789-81ef-816c66cd5c82</serial>
Nov 15 08:26:37 user nova-compute[95467]: </disk>
Nov 15 08:26:37 user nova-compute[95467]:  {{(pid=95467) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 08:26:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-bc5e38a8-43d8-47d2-b73a-7f7b34156a11 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:26:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-bc5e38a8-43d8-47d2-b73a-7f7b34156a11 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] No BDM found with device name vdb, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:26:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-bc5e38a8-43d8-47d2-b73a-7f7b34156a11 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] No VIF found with MAC fa:16:3e:0b:69:75, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:26:38 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-bc5e38a8-43d8-47d2-b73a-7f7b34156a11 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Lock "7f14502f-8c4d-400a-a68a-f3f9c3d48524" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.019s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:26:38 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "7f14502f-8c4d-400a-a68a-f3f9c3d48524" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 6.371s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:26:38 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "7f14502f-8c4d-400a-a68a-f3f9c3d48524" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:26:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f3c0c232-95e7-4f50-9500-3859bab58dc6 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Acquiring lock "7f14502f-8c4d-400a-a68a-f3f9c3d48524" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:26:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f3c0c232-95e7-4f50-9500-3859bab58dc6 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Lock "7f14502f-8c4d-400a-a68a-f3f9c3d48524" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:26:39 user nova-compute[95467]: INFO nova.compute.manager [None req-f3c0c232-95e7-4f50-9500-3859bab58dc6 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] Detaching volume 632dba98-1498-4789-81ef-816c66cd5c82
Nov 15 08:26:39 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:26:39 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:26:39 user nova-compute[95467]: INFO nova.virt.block_device [None req-f3c0c232-95e7-4f50-9500-3859bab58dc6 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] Attempting to driver detach volume 632dba98-1498-4789-81ef-816c66cd5c82 from mountpoint /dev/vdb
Nov 15 08:26:39 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-f3c0c232-95e7-4f50-9500-3859bab58dc6 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Attempting to detach device vdb from instance 7f14502f-8c4d-400a-a68a-f3f9c3d48524 from the persistent domain config. {{(pid=95467) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 08:26:39 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-f3c0c232-95e7-4f50-9500-3859bab58dc6 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 08:26:39 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:26:39 user nova-compute[95467]:   <source dev="/dev/sdi"/>
Nov 15 08:26:39 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:26:39 user nova-compute[95467]:   <serial>632dba98-1498-4789-81ef-816c66cd5c82</serial>
Nov 15 08:26:39 user nova-compute[95467]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 08:26:39 user nova-compute[95467]: </disk>
Nov 15 08:26:39 user nova-compute[95467]:  {{(pid=95467) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 08:26:39 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-f3c0c232-95e7-4f50-9500-3859bab58dc6 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Successfully detached device vdb from instance 7f14502f-8c4d-400a-a68a-f3f9c3d48524 from the persistent domain config.
Nov 15 08:26:39 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-f3c0c232-95e7-4f50-9500-3859bab58dc6 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7f14502f-8c4d-400a-a68a-f3f9c3d48524 from the live domain config. {{(pid=95467) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 08:26:39 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-f3c0c232-95e7-4f50-9500-3859bab58dc6 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 08:26:39 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:26:39 user nova-compute[95467]:   <source dev="/dev/sdi"/>
Nov 15 08:26:39 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:26:39 user nova-compute[95467]:   <serial>632dba98-1498-4789-81ef-816c66cd5c82</serial>
Nov 15 08:26:39 user nova-compute[95467]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 08:26:39 user nova-compute[95467]: </disk>
Nov 15 08:26:39 user nova-compute[95467]:  {{(pid=95467) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 08:26:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:26:40 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-f3c0c232-95e7-4f50-9500-3859bab58dc6 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7f14502f-8c4d-400a-a68a-f3f9c3d48524 {{(pid=95467) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 08:26:42 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:26:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:26:47 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:26:49 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:26:49 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:26:49 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:26:49 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=95467) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 08:26:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:26:50 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager.update_available_resource {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:26:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:26:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:26:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:26:50 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Auditing locally available compute resources for user (node: user) {{(pid=95467) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 08:26:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d22eb02b-7e8d-4755-9f1e-3eee56ddec0c/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d22eb02b-7e8d-4755-9f1e-3eee56ddec0c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:26:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d22eb02b-7e8d-4755-9f1e-3eee56ddec0c/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d22eb02b-7e8d-4755-9f1e-3eee56ddec0c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:26:51 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:26:51 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:26:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba05c01d-ae74-467c-a309-4d0ba904453d/disk.rescue --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba05c01d-ae74-467c-a309-4d0ba904453d/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:26:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba05c01d-ae74-467c-a309-4d0ba904453d/disk.rescue --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba05c01d-ae74-467c-a309-4d0ba904453d/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:26:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:26:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:26:51 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:26:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/843b778c-f823-4bee-aa76-ab44345be9a7/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/843b778c-f823-4bee-aa76-ab44345be9a7/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:26:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/843b778c-f823-4bee-aa76-ab44345be9a7/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/843b778c-f823-4bee-aa76-ab44345be9a7/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:26:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk.rescue --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:52 user nova-compute[95467]: INFO nova.compute.manager [None req-43ffde70-b6b0-4b37-b238-226fd44c0819 tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Get console output
Nov 15 08:26:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:26:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk.rescue --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:52 user nova-compute[95467]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 15 08:26:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:26:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:52 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:26:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:26:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:26:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:26:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:26:53 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:26:53 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:26:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:26:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:26:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f14502f-8c4d-400a-a68a-f3f9c3d48524/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f14502f-8c4d-400a-a68a-f3f9c3d48524/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:26:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f14502f-8c4d-400a-a68a-f3f9c3d48524/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f14502f-8c4d-400a-a68a-f3f9c3d48524/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:26:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091612cf-b737-480b-984e-a05b522676b6/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091612cf-b737-480b-984e-a05b522676b6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:26:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091612cf-b737-480b-984e-a05b522676b6/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091612cf-b737-480b-984e-a05b522676b6/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:26:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/739645e6-9952-40db-a876-f23d02d4e411/disk.rescue --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/739645e6-9952-40db-a876-f23d02d4e411/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:26:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/739645e6-9952-40db-a876-f23d02d4e411/disk.rescue --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:26:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/739645e6-9952-40db-a876-f23d02d4e411/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:26:54 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /opt/stack/data/nova/instances/739645e6-9952-40db-a876-f23d02d4e411/disk (vdb) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:26:55 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:26:55 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:26:55 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Hypervisor/Node resource view: name=user free_ram=7068MB free_disk=24.830364227294922GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=95467) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 08:26:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:26:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:26:55 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Applying migration context for instance d22eb02b-7e8d-4755-9f1e-3eee56ddec0c as it has an incoming, in-progress migration 69284ce8-8fa6-4f81-b112-d885cdea390d. Migration status is finished {{(pid=95467) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 15 08:26:55 user nova-compute[95467]: INFO nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Updating resource usage from migration 69284ce8-8fa6-4f81-b112-d885cdea390d
Nov 15 08:26:55 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 73fe8852-c47a-47ab-a56f-6864c8ed5479 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:26:55 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 21cf2ada-b15c-490d-ac37-96e9c87e9056 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:26:55 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:26:55 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 10d73b73-ca65-4192-8954-288dc1df9f24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:26:55 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 3825a691-ac5c-4c06-b4a4-2a0b40c638c4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:26:55 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 091612cf-b737-480b-984e-a05b522676b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:26:55 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:26:55 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 843b778c-f823-4bee-aa76-ab44345be9a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:26:55 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 739645e6-9952-40db-a876-f23d02d4e411 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:26:55 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance ba05c01d-ae74-467c-a309-4d0ba904453d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:26:55 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 7f14502f-8c4d-400a-a68a-f3f9c3d48524 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:26:55 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 7eb1f0ce-72bd-4015-993c-a32404f15481 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:26:55 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Migration 69284ce8-8fa6-4f81-b112-d885cdea390d is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 15 08:26:55 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance d22eb02b-7e8d-4755-9f1e-3eee56ddec0c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:26:55 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 08:26:55 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Final resource view: name=user phys_ram=16011MB used_ram=10752MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 08:26:55 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:26:56 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:26:56 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Compute_service record updated for user:user {{(pid=95467) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 08:26:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.629s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:26:56 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-51a0c2ea-b272-4d87-8d58-845c8bb48f69 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 843b778c-f823-4bee-aa76-ab44345be9a7 is timed out.
Nov 15 08:26:56 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-51a0c2ea-b272-4d87-8d58-845c8bb48f69 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Successfully detached device vdb from instance 843b778c-f823-4bee-aa76-ab44345be9a7 from the live domain config.
Nov 15 08:26:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51a0c2ea-b272-4d87-8d58-845c8bb48f69 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] calling os-brick to detach iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 08:26:56 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a0c2ea-b272-4d87-8d58-845c8bb48f69 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, {'target_iqn': 'iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ewCbqZTQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:26:56 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-51a0c2ea-b272-4d87-8d58-845c8bb48f69 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:26:56 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-51a0c2ea-b272-4d87-8d58-845c8bb48f69 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:26:56 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-51a0c2ea-b272-4d87-8d58-845c8bb48f69 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:26:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:26:56 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdbe4455-462c-406d-bee3-958418ee89d9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:632dba98-1498-4789-81ef-816c66cd5c82\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:26:56 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a0c2ea-b272-4d87-8d58-845c8bb48f69 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 08:26:56 user nova-compute[95467]: No targets found.
Nov 15 08:26:56 user nova-compute[95467]: iSNS:
Nov 15 08:26:56 user nova-compute[95467]: No targets found.
Nov 15 08:26:56 user nova-compute[95467]: STATIC:
Nov 15 08:26:56 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:632dba98-1498-4789-81ef-816c66cd5c82
Nov 15 08:26:56 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:26:56 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:26:56 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24
Nov 15 08:26:56 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:26:56 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:26:56 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b
Nov 15 08:26:56 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:26:56 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:26:56 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0
Nov 15 08:26:56 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:26:56 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:26:56 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e
Nov 15 08:26:56 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:26:56 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:26:56 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373
Nov 15 08:26:56 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:26:56 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:26:56 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400
Nov 15 08:26:56 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:26:56 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:26:56 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8
Nov 15 08:26:56 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:26:56 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:26:56 user nova-compute[95467]: FIRMWARE:
Nov 15 08:26:56 user nova-compute[95467]: No targets found.
Nov 15 08:26:56 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:26:56 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a0c2ea-b272-4d87-8d58-845c8bb48f69 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 08:26:56 user nova-compute[95467]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 08:26:56 user nova-compute[95467]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=95467) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 08:26:56 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a0c2ea-b272-4d87-8d58-845c8bb48f69 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8', 0)] {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 08:26:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:26:56 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed617114-17cf-4f35-b24c-8c8db9c0df60]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:632dba98-1498-4789-81ef-816c66cd5c82\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:26:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:26:56 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8ef0da-ac85-48fc-a5f7-63663fd74021]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:632dba98-1498-4789-81ef-816c66cd5c82 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:26:56 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a0c2ea-b272-4d87-8d58-845c8bb48f69 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:26:56 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:26:56 user nova-compute[95467]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)
Nov 15 08:26:56 user nova-compute[95467]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:26:56 user nova-compute[95467]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 (non-flash)
Nov 15 08:26:56 user nova-compute[95467]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 (non-flash)
Nov 15 08:26:56 user nova-compute[95467]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 (non-flash)
Nov 15 08:26:56 user nova-compute[95467]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:632dba98-1498-4789-81ef-816c66cd5c82 (non-flash)
Nov 15 08:26:56 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:26:56 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a0c2ea-b272-4d87-8d58-845c8bb48f69 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:26:56 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:26:56 user nova-compute[95467]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)
Nov 15 08:26:56 user nova-compute[95467]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:26:56 user nova-compute[95467]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 (non-flash)
Nov 15 08:26:56 user nova-compute[95467]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 (non-flash)
Nov 15 08:26:56 user nova-compute[95467]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 (non-flash)
Nov 15 08:26:56 user nova-compute[95467]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:632dba98-1498-4789-81ef-816c66cd5c82 (non-flash)
Nov 15 08:26:56 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:26:56 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a0c2ea-b272-4d87-8d58-845c8bb48f69 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efed8436cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8'): ({'sde'}, set())}) {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 08:26:56 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-51a0c2ea-b272-4d87-8d58-845c8bb48f69 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Removing single pathed devices sde {{(pid=95467) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 08:26:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:26:56 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[76221dcf-c3f1-41d5-98e9-3f9925845ddc]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:26:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:26:56 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b656005-b962-47fe-9dc6-88b91c0bc585]: (4, ('ok\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:26:56 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-51a0c2ea-b272-4d87-8d58-845c8bb48f69 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Flushing IO for device /dev/sde {{(pid=95467) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 08:26:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:26:56 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[7913c2f9-5804-49cb-97e4-f616735997bc]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:26:56 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-51a0c2ea-b272-4d87-8d58-845c8bb48f69 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=95467) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 08:26:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:26:56 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ebbf16-c203-4a99-b9df-e14f3c94ea44]: (4, ('1', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:26:56 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-51a0c2ea-b272-4d87-8d58-845c8bb48f69 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 08:26:56 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-51a0c2ea-b272-4d87-8d58-845c8bb48f69 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] SCSI volumes sde have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 08:26:56 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a0c2ea-b272-4d87-8d58-845c8bb48f69 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8')] {{(pid=95467) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 08:26:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:26:56 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d21789-ae12-4dbd-b88b-0c5ff7a6ce34]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:26:56 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a0c2ea-b272-4d87-8d58-845c8bb48f69 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:26:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 -p 172.16.0.220:3260 --logout {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:26:56 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[3965ab64-1f48-46aa-8446-6d81a7af0f80]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:26:56 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a0c2ea-b272-4d87-8d58-845c8bb48f69 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8, portal: 172.16.0.220,3260]
Nov 15 08:26:56 user nova-compute[95467]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8, portal: 172.16.0.220,3260] successful.
Nov 15 08:26:56 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:26:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 -p 172.16.0.220:3260 --op delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:26:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c72f2f38-cf4d-48aa-98b2-cceddbc99cd8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:26:56 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[758c127f-9da8-4b5e-a10c-1d69c2935552]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:26:56 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a0c2ea-b272-4d87-8d58-845c8bb48f69 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:26:56 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-51a0c2ea-b272-4d87-8d58-845c8bb48f69 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:26:56 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a0c2ea-b272-4d87-8d58-845c8bb48f69 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] <== disconnect_volume: return (352ms) None {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:26:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51a0c2ea-b272-4d87-8d58-845c8bb48f69 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Disconnected iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 08:26:57 user nova-compute[95467]: DEBUG nova.objects.instance [None req-51a0c2ea-b272-4d87-8d58-845c8bb48f69 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Lazy-loading 'flavor' on Instance uuid 843b778c-f823-4bee-aa76-ab44345be9a7 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:26:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-51a0c2ea-b272-4d87-8d58-845c8bb48f69 tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Lock "843b778c-f823-4bee-aa76-ab44345be9a7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.725s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:26:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:26:58 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:26:58 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:26:58 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Starting heal instance info cache {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 08:26:58 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "refresh_cache-21cf2ada-b15c-490d-ac37-96e9c87e9056" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:26:58 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquired lock "refresh_cache-21cf2ada-b15c-490d-ac37-96e9c87e9056" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:26:58 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Forcefully refreshing network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 08:26:58 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Updating instance_info_cache with network_info: [{"id": "1e52d31b-a56a-41e1-8a39-b79dacfe70b9", "address": "fa:16:3e:7f:8e:61", "network": {"id": "ac9a381d-25fe-4419-b151-f03333413813", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1183680999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34d65a8000347feb2b3966b7ce0d785", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e52d31b-a5", "ovs_interfaceid": "1e52d31b-a56a-41e1-8a39-b79dacfe70b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:26:58 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Releasing lock "refresh_cache-21cf2ada-b15c-490d-ac37-96e9c87e9056" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:26:58 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Updated the network info_cache for instance {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 08:26:58 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:26:58 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:26:58 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:26:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:00 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-f3c0c232-95e7-4f50-9500-3859bab58dc6 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7f14502f-8c4d-400a-a68a-f3f9c3d48524 is timed out.
Nov 15 08:27:00 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-f3c0c232-95e7-4f50-9500-3859bab58dc6 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Successfully detached device vdb from instance 7f14502f-8c4d-400a-a68a-f3f9c3d48524 from the live domain config.
Nov 15 08:27:00 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3c0c232-95e7-4f50-9500-3859bab58dc6 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] calling os-brick to detach iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 08:27:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c0c232-95e7-4f50-9500-3859bab58dc6 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, {'target_iqn': 'iqn.2010-10.org.openstack:632dba98-1498-4789-81ef-816c66cd5c82', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JHVuMQme', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:27:00 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-f3c0c232-95e7-4f50-9500-3859bab58dc6 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:27:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-f3c0c232-95e7-4f50-9500-3859bab58dc6 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:27:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-f3c0c232-95e7-4f50-9500-3859bab58dc6 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:27:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:00 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd88130-9358-417d-8acf-44dd85ad5f68]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:632dba98-1498-4789-81ef-816c66cd5c82\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:27:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c0c232-95e7-4f50-9500-3859bab58dc6 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 08:27:00 user nova-compute[95467]: No targets found.
Nov 15 08:27:00 user nova-compute[95467]: iSNS:
Nov 15 08:27:00 user nova-compute[95467]: No targets found.
Nov 15 08:27:00 user nova-compute[95467]: STATIC:
Nov 15 08:27:00 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:632dba98-1498-4789-81ef-816c66cd5c82
Nov 15 08:27:00 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:27:00 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:27:00 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24
Nov 15 08:27:00 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:27:00 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:27:00 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b
Nov 15 08:27:00 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:27:00 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:27:00 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0
Nov 15 08:27:00 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:27:00 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:27:00 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e
Nov 15 08:27:00 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:27:00 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:27:00 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373
Nov 15 08:27:00 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:27:00 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:27:00 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400
Nov 15 08:27:00 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:27:00 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:27:00 user nova-compute[95467]: FIRMWARE:
Nov 15 08:27:00 user nova-compute[95467]: No targets found.
Nov 15 08:27:00 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:27:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c0c232-95e7-4f50-9500-3859bab58dc6 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 08:27:00 user nova-compute[95467]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 08:27:00 user nova-compute[95467]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=95467) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 08:27:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c0c232-95e7-4f50-9500-3859bab58dc6 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:632dba98-1498-4789-81ef-816c66cd5c82', 0)] {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 08:27:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:00 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5fdcb5c-35f6-4aa7-8e2e-f48bdfa84d97]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:632dba98-1498-4789-81ef-816c66cd5c82\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:27:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:00 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[25be1255-fbc3-4f5e-8876-2e892c62f424]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:632dba98-1498-4789-81ef-816c66cd5c82 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:27:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c0c232-95e7-4f50-9500-3859bab58dc6 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:27:00 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:27:00 user nova-compute[95467]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)
Nov 15 08:27:00 user nova-compute[95467]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:27:00 user nova-compute[95467]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 (non-flash)
Nov 15 08:27:00 user nova-compute[95467]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 (non-flash)
Nov 15 08:27:00 user nova-compute[95467]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:632dba98-1498-4789-81ef-816c66cd5c82 (non-flash)
Nov 15 08:27:00 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:27:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c0c232-95e7-4f50-9500-3859bab58dc6 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:27:00 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:27:00 user nova-compute[95467]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)
Nov 15 08:27:00 user nova-compute[95467]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:27:00 user nova-compute[95467]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 (non-flash)
Nov 15 08:27:00 user nova-compute[95467]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 (non-flash)
Nov 15 08:27:00 user nova-compute[95467]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:632dba98-1498-4789-81ef-816c66cd5c82 (non-flash)
Nov 15 08:27:00 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:27:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c0c232-95e7-4f50-9500-3859bab58dc6 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efec8307d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:632dba98-1498-4789-81ef-816c66cd5c82'): ({'sdi'}, set())}) {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 08:27:00 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-f3c0c232-95e7-4f50-9500-3859bab58dc6 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Removing single pathed devices sdi {{(pid=95467) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 08:27:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:00 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f009617-6dda-4a46-b537-6bd6bae05bb9]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:27:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:00 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[acdc7861-9624-404e-929e-c3038cbb777d]: (4, ('ok\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:27:00 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-f3c0c232-95e7-4f50-9500-3859bab58dc6 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Flushing IO for device /dev/sdi {{(pid=95467) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 08:27:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:00 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f4a378-0675-4123-94b2-cc63b99f28d8]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:27:00 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-f3c0c232-95e7-4f50-9500-3859bab58dc6 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=95467) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 08:27:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.050s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:00 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[77acaecf-3ee1-4505-aa7d-3bb9aecb1338]: (4, ('1', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:27:00 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-f3c0c232-95e7-4f50-9500-3859bab58dc6 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 08:27:00 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-f3c0c232-95e7-4f50-9500-3859bab58dc6 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] SCSI volumes sdi have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 08:27:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c0c232-95e7-4f50-9500-3859bab58dc6 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:632dba98-1498-4789-81ef-816c66cd5c82')] {{(pid=95467) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 08:27:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:632dba98-1498-4789-81ef-816c66cd5c82 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:632dba98-1498-4789-81ef-816c66cd5c82 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:00 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7fce25-bc70-49e0-ba5a-6cc8cd317892]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:27:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c0c232-95e7-4f50-9500-3859bab58dc6 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:27:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:632dba98-1498-4789-81ef-816c66cd5c82 -p 172.16.0.220:3260 --logout {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:632dba98-1498-4789-81ef-816c66cd5c82 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:00 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc93a8d7-3740-464d-a587-99809321bc94]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:632dba98-1498-4789-81ef-816c66cd5c82, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:632dba98-1498-4789-81ef-816c66cd5c82, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:27:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c0c232-95e7-4f50-9500-3859bab58dc6 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:632dba98-1498-4789-81ef-816c66cd5c82, portal: 172.16.0.220,3260]
Nov 15 08:27:00 user nova-compute[95467]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:632dba98-1498-4789-81ef-816c66cd5c82, portal: 172.16.0.220,3260] successful.
Nov 15 08:27:00 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:27:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:632dba98-1498-4789-81ef-816c66cd5c82 -p 172.16.0.220:3260 --op delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:632dba98-1498-4789-81ef-816c66cd5c82 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:00 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c60fb40-122a-49d0-9f7d-1676815e1037]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:27:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c0c232-95e7-4f50-9500-3859bab58dc6 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:27:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-f3c0c232-95e7-4f50-9500-3859bab58dc6 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:27:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c0c232-95e7-4f50-9500-3859bab58dc6 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] <== disconnect_volume: return (363ms) None {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:27:00 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3c0c232-95e7-4f50-9500-3859bab58dc6 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] Disconnected iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 08:27:01 user nova-compute[95467]: DEBUG nova.compute.manager [req-24c87027-f3b1-4045-8653-823d563164eb req-feae2325-3ba5-4404-b384-6076bb3c3717 service nova] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Received event network-changed-f4caa0ae-9571-4c82-9717-07935e6991a2 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:27:01 user nova-compute[95467]: DEBUG nova.compute.manager [req-24c87027-f3b1-4045-8653-823d563164eb req-feae2325-3ba5-4404-b384-6076bb3c3717 service nova] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Refreshing instance network info cache due to event network-changed-f4caa0ae-9571-4c82-9717-07935e6991a2. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:27:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-24c87027-f3b1-4045-8653-823d563164eb req-feae2325-3ba5-4404-b384-6076bb3c3717 service nova] Acquiring lock "refresh_cache-7eb1f0ce-72bd-4015-993c-a32404f15481" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:27:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-24c87027-f3b1-4045-8653-823d563164eb req-feae2325-3ba5-4404-b384-6076bb3c3717 service nova] Acquired lock "refresh_cache-7eb1f0ce-72bd-4015-993c-a32404f15481" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:27:01 user nova-compute[95467]: DEBUG nova.network.neutron [req-24c87027-f3b1-4045-8653-823d563164eb req-feae2325-3ba5-4404-b384-6076bb3c3717 service nova] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Refreshing network info cache for port f4caa0ae-9571-4c82-9717-07935e6991a2 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:27:01 user nova-compute[95467]: DEBUG nova.objects.instance [None req-f3c0c232-95e7-4f50-9500-3859bab58dc6 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Lazy-loading 'flavor' on Instance uuid 7f14502f-8c4d-400a-a68a-f3f9c3d48524 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:27:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f3c0c232-95e7-4f50-9500-3859bab58dc6 tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Lock "7f14502f-8c4d-400a-a68a-f3f9c3d48524" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.837s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:27:01 user nova-compute[95467]: DEBUG nova.network.neutron [req-24c87027-f3b1-4045-8653-823d563164eb req-feae2325-3ba5-4404-b384-6076bb3c3717 service nova] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Updated VIF entry in instance network info cache for port f4caa0ae-9571-4c82-9717-07935e6991a2. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:27:01 user nova-compute[95467]: DEBUG nova.network.neutron [req-24c87027-f3b1-4045-8653-823d563164eb req-feae2325-3ba5-4404-b384-6076bb3c3717 service nova] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Updating instance_info_cache with network_info: [{"id": "f4caa0ae-9571-4c82-9717-07935e6991a2", "address": "fa:16:3e:22:a5:e5", "network": {"id": "96d9262b-11fb-497d-8e38-fa46076c010f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2069167691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7791bd92c7c488aa72474ecde2e1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4caa0ae-95", "ovs_interfaceid": "f4caa0ae-9571-4c82-9717-07935e6991a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:27:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-24c87027-f3b1-4045-8653-823d563164eb req-feae2325-3ba5-4404-b384-6076bb3c3717 service nova] Releasing lock "refresh_cache-7eb1f0ce-72bd-4015-993c-a32404f15481" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:27:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:04 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:07 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Acquiring lock "2838af21-2749-4e6b-b4d3-c0d79379dfb5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:27:07 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "2838af21-2749-4e6b-b4d3-c0d79379dfb5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:27:07 user nova-compute[95467]: DEBUG nova.compute.manager [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Starting instance... {{(pid=95467) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 08:27:07 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:07 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:27:07 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:27:07 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=95467) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 08:27:07 user nova-compute[95467]: INFO nova.compute.claims [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Claim successful on node user
Nov 15 08:27:07 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:27:07 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:27:07 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.542s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:27:07 user nova-compute[95467]: DEBUG nova.compute.manager [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Start building networks asynchronously for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 08:27:07 user nova-compute[95467]: DEBUG nova.compute.manager [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Allocating IP information in the background. {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 08:27:07 user nova-compute[95467]: DEBUG nova.network.neutron [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] allocate_for_instance() {{(pid=95467) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 08:27:07 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 08:27:07 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:07 user nova-compute[95467]: DEBUG nova.compute.manager [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Start building block device mappings for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 08:27:07 user nova-compute[95467]: INFO nova.virt.block_device [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Booting with volume 2dbf6208-1a82-45a0-a862-3296f3c690e4 at /dev/vda
Nov 15 08:27:07 user nova-compute[95467]: DEBUG nova.policy [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '11bbbd3ef322402cb5dc60455a54319b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7791bd92c7c488aa72474ecde2e1155', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95467) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 08:27:07 user nova-compute[95467]: DEBUG os_brick.utils [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:27:07 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:08 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:08 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a75720-d434-457b-84be-ae545df2c4c3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:882ae90641f\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:27:08 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:08 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:08 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[0317fc4d-1fb6-4bb2-8fb7-d3792857249e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:27:08 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:08 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:08 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[59952ba1-dbf6-44a5-a776-1a6e0f8582a4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:27:08 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0f044f-ed6e-4d17-846e-f6c799f7890b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:27:08 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Running cmd (subprocess): nvme version {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:08 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] 'nvme version' failed. Not Retrying. {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:27:08 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.nvmeof [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] nvme not present on system {{(pid=95467) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 08:27:08 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:08 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:27:08 user nova-compute[95467]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 08:27:08 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[31956c45-a114-4e92-b084-78b5ecde6616]: (4, '') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:27:08 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=95467) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 08:27:08 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 08:27:08 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] LIGHTOS: no hostnqn found. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 08:27:08 user nova-compute[95467]: DEBUG os_brick.utils [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:882ae90641f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:27:08 user nova-compute[95467]: DEBUG nova.virt.block_device [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Updating existing volume attachment record: d86ef6d9-d7af-4d65-9190-1c819cc451a2 {{(pid=95467) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 08:27:09 user nova-compute[95467]: DEBUG nova.network.neutron [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Successfully created port: fcfde46b-01e2-414d-a7ab-0d393dd98e3b {{(pid=95467) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 08:27:09 user nova-compute[95467]: DEBUG nova.network.neutron [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Successfully updated port: fcfde46b-01e2-414d-a7ab-0d393dd98e3b {{(pid=95467) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 08:27:09 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Acquiring lock "refresh_cache-2838af21-2749-4e6b-b4d3-c0d79379dfb5" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:27:09 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Acquired lock "refresh_cache-2838af21-2749-4e6b-b4d3-c0d79379dfb5" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:27:09 user nova-compute[95467]: DEBUG nova.network.neutron [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:27:09 user nova-compute[95467]: DEBUG nova.compute.manager [req-9641489e-7b2b-4384-81ee-269758d3528a req-c95808df-f9d7-48e3-a186-cf442523631c service nova] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Received event network-changed-fcfde46b-01e2-414d-a7ab-0d393dd98e3b {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:27:09 user nova-compute[95467]: DEBUG nova.compute.manager [req-9641489e-7b2b-4384-81ee-269758d3528a req-c95808df-f9d7-48e3-a186-cf442523631c service nova] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Refreshing instance network info cache due to event network-changed-fcfde46b-01e2-414d-a7ab-0d393dd98e3b. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:27:09 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-9641489e-7b2b-4384-81ee-269758d3528a req-c95808df-f9d7-48e3-a186-cf442523631c service nova] Acquiring lock "refresh_cache-2838af21-2749-4e6b-b4d3-c0d79379dfb5" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:27:09 user nova-compute[95467]: DEBUG nova.network.neutron [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Instance cache missing network info. {{(pid=95467) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 08:27:09 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:10 user nova-compute[95467]: DEBUG nova.network.neutron [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Updating instance_info_cache with network_info: [{"id": "fcfde46b-01e2-414d-a7ab-0d393dd98e3b", "address": "fa:16:3e:1c:d7:29", "network": {"id": "96d9262b-11fb-497d-8e38-fa46076c010f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2069167691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7791bd92c7c488aa72474ecde2e1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcfde46b-01", "ovs_interfaceid": "fcfde46b-01e2-414d-a7ab-0d393dd98e3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:27:10 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Releasing lock "refresh_cache-2838af21-2749-4e6b-b4d3-c0d79379dfb5" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:27:10 user nova-compute[95467]: DEBUG nova.compute.manager [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Instance network_info: |[{"id": "fcfde46b-01e2-414d-a7ab-0d393dd98e3b", "address": "fa:16:3e:1c:d7:29", "network": {"id": "96d9262b-11fb-497d-8e38-fa46076c010f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2069167691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7791bd92c7c488aa72474ecde2e1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcfde46b-01", "ovs_interfaceid": "fcfde46b-01e2-414d-a7ab-0d393dd98e3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 08:27:10 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-9641489e-7b2b-4384-81ee-269758d3528a req-c95808df-f9d7-48e3-a186-cf442523631c service nova] Acquired lock "refresh_cache-2838af21-2749-4e6b-b4d3-c0d79379dfb5" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:27:10 user nova-compute[95467]: DEBUG nova.network.neutron [req-9641489e-7b2b-4384-81ee-269758d3528a req-c95808df-f9d7-48e3-a186-cf442523631c service nova] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Refreshing network info cache for port fcfde46b-01e2-414d-a7ab-0d393dd98e3b {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:27:10 user nova-compute[95467]: DEBUG nova.network.neutron [req-9641489e-7b2b-4384-81ee-269758d3528a req-c95808df-f9d7-48e3-a186-cf442523631c service nova] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Updated VIF entry in instance network info cache for port fcfde46b-01e2-414d-a7ab-0d393dd98e3b. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:27:10 user nova-compute[95467]: DEBUG nova.network.neutron [req-9641489e-7b2b-4384-81ee-269758d3528a req-c95808df-f9d7-48e3-a186-cf442523631c service nova] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Updating instance_info_cache with network_info: [{"id": "fcfde46b-01e2-414d-a7ab-0d393dd98e3b", "address": "fa:16:3e:1c:d7:29", "network": {"id": "96d9262b-11fb-497d-8e38-fa46076c010f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2069167691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7791bd92c7c488aa72474ecde2e1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcfde46b-01", "ovs_interfaceid": "fcfde46b-01e2-414d-a7ab-0d393dd98e3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:27:10 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-9641489e-7b2b-4384-81ee-269758d3528a req-c95808df-f9d7-48e3-a186-cf442523631c service nova] Releasing lock "refresh_cache-2838af21-2749-4e6b-b4d3-c0d79379dfb5" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:27:10 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG nova.compute.manager [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Start spawning the instance on the hypervisor. {{(pid=95467) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Creating instance directory {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 08:27:13 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Creating image(s)
Nov 15 08:27:13 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Did not create local disks {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Ensure instance console log exists: /opt/stack/data/nova/instances/2838af21-2749-4e6b-b4d3-c0d79379dfb5/console.log {{(pid=95467) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Start _get_guest_xml network_info=[{"id": "fcfde46b-01e2-414d-a7ab-0d393dd98e3b", "address": "fa:16:3e:1c:d7:29", "network": {"id": "96d9262b-11fb-497d-8e38-fa46076c010f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2069167691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7791bd92c7c488aa72474ecde2e1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcfde46b-01", "ovs_interfaceid": "fcfde46b-01e2-414d-a7ab-0d393dd98e3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'd86ef6d9-d7af-4d65-9190-1c819cc451a2', 'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2dbf6208-1a82-45a0-a862-3296f3c690e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NTiDFpKI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2838af21-2749-4e6b-b4d3-c0d79379dfb5', 'attached_at': '', 'detached_at': '', 'volume_id': '2dbf6208-1a82-45a0-a862-3296f3c690e4', 'serial': '2dbf6208-1a82-45a0-a862-3296f3c690e4'}, 'volume_type': None} {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:27:13 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:27:13 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:27:13 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Calling os-brick to attach iSCSI Volume {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2dbf6208-1a82-45a0-a862-3296f3c690e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NTiDFpKI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:27:13 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:27:13 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:27:13 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:27:13 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2dbf6208-1a82-45a0-a862-3296f3c690e4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2dbf6208-1a82-45a0-a862-3296f3c690e4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:27:13 user nova-compute[95467]: INFO os_brick.initiator.connectors.iscsi [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 08:27:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dbf6208-1a82-45a0-a862-3296f3c690e4 -p 172.16.0.220:3260 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dbf6208-1a82-45a0-a862-3296f3c690e4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[88452a22-1fe8-4025-9fa0-d9074cb63c7c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 08:27:13 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dbf6208-1a82-45a0-a862-3296f3c690e4 -p 172.16.0.220:3260 --interface default --op new {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dbf6208-1a82-45a0-a862-3296f3c690e4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfee9974-f531-4381-8fe9-72c6b2a378bc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2dbf6208-1a82-45a0-a862-3296f3c690e4] added\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2dbf6208-1a82-45a0-a862-3296f3c690e4] added
Nov 15 08:27:13 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dbf6208-1a82-45a0-a862-3296f3c690e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dbf6208-1a82-45a0-a862-3296f3c690e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d924c04d-67e3-4d78-9db6-3c0865618ad0]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dbf6208-1a82-45a0-a862-3296f3c690e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dbf6208-1a82-45a0-a862-3296f3c690e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f26613-1ba6-42b0-8edb-587e8d84ed7f]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dbf6208-1a82-45a0-a862-3296f3c690e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NTiDFpKI {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dbf6208-1a82-45a0-a862-3296f3c690e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NTiDFpKI" returned: 0 in 0.025s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[7130afd0-7673-4dd8-94be-386ae5632316]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NTiDFpKI'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dbf6208-1a82-45a0-a862-3296f3c690e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dbf6208-1a82-45a0-a862-3296f3c690e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c781288d-1178-4e27-91b2-86392def345e]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[929ba12e-22d8-4e47-94f1-46d142f01a16]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:27:13 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:27:13 user nova-compute[95467]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)
Nov 15 08:27:13 user nova-compute[95467]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:27:13 user nova-compute[95467]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 (non-flash)
Nov 15 08:27:13 user nova-compute[95467]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 (non-flash)
Nov 15 08:27:13 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:27:13 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:27:13 user nova-compute[95467]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)
Nov 15 08:27:13 user nova-compute[95467]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:27:13 user nova-compute[95467]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 (non-flash)
Nov 15 08:27:13 user nova-compute[95467]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 (non-flash)
Nov 15 08:27:13 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dbf6208-1a82-45a0-a862-3296f3c690e4 -p 172.16.0.220:3260 --login {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dbf6208-1a82-45a0-a862-3296f3c690e4 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[584bfc0a-690b-469e-85e6-a6734a10eda5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2dbf6208-1a82-45a0-a862-3296f3c690e4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2dbf6208-1a82-45a0-a862-3296f3c690e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2dbf6208-1a82-45a0-a862-3296f3c690e4, portal: 172.16.0.220,3260]
Nov 15 08:27:13 user nova-compute[95467]: Login to [iface: default, target: iqn.2010-10.org.openstack:2dbf6208-1a82-45a0-a862-3296f3c690e4, portal: 172.16.0.220,3260] successful.
Nov 15 08:27:13 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dbf6208-1a82-45a0-a862-3296f3c690e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dbf6208-1a82-45a0-a862-3296f3c690e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9734092-32e5-4ddc-9e08-386222b58f6a]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0a740a-0ab3-4a7e-9865-e04e1951ae7a]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dbf6208-1a82-45a0-a862-3296f3c690e4 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:27:13 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:27:13 user nova-compute[95467]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)
Nov 15 08:27:13 user nova-compute[95467]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:27:13 user nova-compute[95467]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 (non-flash)
Nov 15 08:27:13 user nova-compute[95467]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 (non-flash)
Nov 15 08:27:13 user nova-compute[95467]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dbf6208-1a82-45a0-a862-3296f3c690e4 (non-flash)
Nov 15 08:27:13 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:27:13 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:27:13 user nova-compute[95467]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)
Nov 15 08:27:13 user nova-compute[95467]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:27:13 user nova-compute[95467]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 (non-flash)
Nov 15 08:27:13 user nova-compute[95467]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 (non-flash)
Nov 15 08:27:13 user nova-compute[95467]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dbf6208-1a82-45a0-a862-3296f3c690e4 (non-flash)
Nov 15 08:27:13 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2dbf6208-1a82-45a0-a862-3296f3c690e4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Connected to 172.16.0.220:3260 {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] HCTL ('36', '-', '-', 0) found on session 50 with lun 0 {{(pid=95467) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=95467) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42a871c-f5d0-4bec-b0ce-2e22e25e0c53]: (4, ('- - 0', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Searching for a device in session 50 and hctl ['36', '*', '*', 0] yield: sde {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:27:13 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:2dbf6208-1a82-45a0-a862-3296f3c690e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NTiDFpKI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 08:27:14 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:27:14 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '23164376364323866', 'path': '/dev/sde'} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:27:14 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23164376364323866', 'path': '/dev/sde'} {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 08:27:14 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:27:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1279975625',display_name='tempest-TestVolumeBootPattern-server-1279975625',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1279975625',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGn1slhlv/lpfM2oYeApx9piTNh8psQp9CpZOaXQ+Ydt2JJikCfOrBRqv7qZ3oUV5yn53tl6dDTEsiUIm5m/x3Q62LZpqk25/AJiUoLr4SnG2Qg5vjpEqPX27JlljHO+ew==',key_name='tempest-TestVolumeBootPattern-1986786502',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7791bd92c7c488aa72474ecde2e1155',ramdisk_id='',reservation_id='r-3a81a6y8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-978207351',owner_user_name='tempest-TestVolumeBootPattern-978207351-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:27:08Z,user_data=None,user_id='11bbbd3ef322402cb5dc60455a54319b',uuid=2838af21-2749-4e6b-b4d3-c0d79379dfb5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fcfde46b-01e2-414d-a7ab-0d393dd98e3b", "address": "fa:16:3e:1c:d7:29", "network": {"id": "96d9262b-11fb-497d-8e38-fa46076c010f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2069167691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7791bd92c7c488aa72474ecde2e1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcfde46b-01", "ovs_interfaceid": "fcfde46b-01e2-414d-a7ab-0d393dd98e3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:27:14 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Converting VIF {"id": "fcfde46b-01e2-414d-a7ab-0d393dd98e3b", "address": "fa:16:3e:1c:d7:29", "network": {"id": "96d9262b-11fb-497d-8e38-fa46076c010f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2069167691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7791bd92c7c488aa72474ecde2e1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcfde46b-01", "ovs_interfaceid": "fcfde46b-01e2-414d-a7ab-0d393dd98e3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:27:14 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:d7:29,bridge_name='br-int',has_traffic_filtering=True,id=fcfde46b-01e2-414d-a7ab-0d393dd98e3b,network=Network(96d9262b-11fb-497d-8e38-fa46076c010f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcfde46b-01') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:27:14 user nova-compute[95467]: DEBUG nova.objects.instance [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lazy-loading 'pci_devices' on Instance uuid 2838af21-2749-4e6b-b4d3-c0d79379dfb5 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:27:14 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:27:14 user nova-compute[95467]:   <uuid>2838af21-2749-4e6b-b4d3-c0d79379dfb5</uuid>
Nov 15 08:27:14 user nova-compute[95467]:   <name>instance-0000002d</name>
Nov 15 08:27:14 user nova-compute[95467]:   <memory>524288</memory>
Nov 15 08:27:14 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:27:14 user nova-compute[95467]:   <metadata>
Nov 15 08:27:14 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:27:14 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:27:14 user nova-compute[95467]:       <nova:name>tempest-TestVolumeBootPattern-server-1279975625</nova:name>
Nov 15 08:27:14 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:27:13</nova:creationTime>
Nov 15 08:27:14 user nova-compute[95467]:       <nova:flavor name="m1.tiny">
Nov 15 08:27:14 user nova-compute[95467]:         <nova:memory>512</nova:memory>
Nov 15 08:27:14 user nova-compute[95467]:         <nova:disk>1</nova:disk>
Nov 15 08:27:14 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:27:14 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:27:14 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:27:14 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:27:14 user nova-compute[95467]:       <nova:owner>
Nov 15 08:27:14 user nova-compute[95467]:         <nova:user uuid="11bbbd3ef322402cb5dc60455a54319b">tempest-TestVolumeBootPattern-978207351-project-member</nova:user>
Nov 15 08:27:14 user nova-compute[95467]:         <nova:project uuid="e7791bd92c7c488aa72474ecde2e1155">tempest-TestVolumeBootPattern-978207351</nova:project>
Nov 15 08:27:14 user nova-compute[95467]:       </nova:owner>
Nov 15 08:27:14 user nova-compute[95467]:       <nova:ports>
Nov 15 08:27:14 user nova-compute[95467]:         <nova:port uuid="fcfde46b-01e2-414d-a7ab-0d393dd98e3b">
Nov 15 08:27:14 user nova-compute[95467]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 08:27:14 user nova-compute[95467]:         </nova:port>
Nov 15 08:27:14 user nova-compute[95467]:       </nova:ports>
Nov 15 08:27:14 user nova-compute[95467]:     </nova:instance>
Nov 15 08:27:14 user nova-compute[95467]:   </metadata>
Nov 15 08:27:14 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:27:14 user nova-compute[95467]:     <system>
Nov 15 08:27:14 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:27:14 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:27:14 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:27:14 user nova-compute[95467]:       <entry name="serial">2838af21-2749-4e6b-b4d3-c0d79379dfb5</entry>
Nov 15 08:27:14 user nova-compute[95467]:       <entry name="uuid">2838af21-2749-4e6b-b4d3-c0d79379dfb5</entry>
Nov 15 08:27:14 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:27:14 user nova-compute[95467]:     </system>
Nov 15 08:27:14 user nova-compute[95467]:   </sysinfo>
Nov 15 08:27:14 user nova-compute[95467]:   <os>
Nov 15 08:27:14 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:27:14 user nova-compute[95467]:     <boot dev="hd"/>
Nov 15 08:27:14 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:27:14 user nova-compute[95467]:   </os>
Nov 15 08:27:14 user nova-compute[95467]:   <features>
Nov 15 08:27:14 user nova-compute[95467]:     <acpi/>
Nov 15 08:27:14 user nova-compute[95467]:     <apic/>
Nov 15 08:27:14 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:27:14 user nova-compute[95467]:   </features>
Nov 15 08:27:14 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:27:14 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:27:14 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:27:14 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:27:14 user nova-compute[95467]:   </clock>
Nov 15 08:27:14 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:27:14 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:27:14 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:27:14 user nova-compute[95467]:   </cpu>
Nov 15 08:27:14 user nova-compute[95467]:   <devices>
Nov 15 08:27:14 user nova-compute[95467]:     <disk type="block" device="disk">
Nov 15 08:27:14 user nova-compute[95467]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:27:14 user nova-compute[95467]:       <source dev="/dev/sde"/>
Nov 15 08:27:14 user nova-compute[95467]:       <target dev="vda" bus="virtio"/>
Nov 15 08:27:14 user nova-compute[95467]:       <serial>2dbf6208-1a82-45a0-a862-3296f3c690e4</serial>
Nov 15 08:27:14 user nova-compute[95467]:     </disk>
Nov 15 08:27:14 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:27:14 user nova-compute[95467]:       <mac address="fa:16:3e:1c:d7:29"/>
Nov 15 08:27:14 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:27:14 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:27:14 user nova-compute[95467]:       <target dev="tapfcfde46b-01"/>
Nov 15 08:27:14 user nova-compute[95467]:     </interface>
Nov 15 08:27:14 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:27:14 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/2838af21-2749-4e6b-b4d3-c0d79379dfb5/console.log" append="off"/>
Nov 15 08:27:14 user nova-compute[95467]:     </serial>
Nov 15 08:27:14 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:27:14 user nova-compute[95467]:     <video>
Nov 15 08:27:14 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:27:14 user nova-compute[95467]:     </video>
Nov 15 08:27:14 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:27:14 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:27:14 user nova-compute[95467]:     </rng>
Nov 15 08:27:14 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:27:14 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:27:14 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:27:14 user nova-compute[95467]:     </memballoon>
Nov 15 08:27:14 user nova-compute[95467]:   </devices>
Nov 15 08:27:14 user nova-compute[95467]: </domain>
Nov 15 08:27:14 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:27:14 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:27:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1279975625',display_name='tempest-TestVolumeBootPattern-server-1279975625',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1279975625',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGn1slhlv/lpfM2oYeApx9piTNh8psQp9CpZOaXQ+Ydt2JJikCfOrBRqv7qZ3oUV5yn53tl6dDTEsiUIm5m/x3Q62LZpqk25/AJiUoLr4SnG2Qg5vjpEqPX27JlljHO+ew==',key_name='tempest-TestVolumeBootPattern-1986786502',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7791bd92c7c488aa72474ecde2e1155',ramdisk_id='',reservation_id='r-3a81a6y8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-978207351',owner_user_name='tempest-TestVolumeBootPattern-978207351-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:27:08Z,user_data=None,user_id='11bbbd3ef322402cb5dc60455a54319b',uuid=2838af21-2749-4e6b-b4d3-c0d79379dfb5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fcfde46b-01e2-414d-a7ab-0d393dd98e3b", "address": "fa:16:3e:1c:d7:29", "network": {"id": "96d9262b-11fb-497d-8e38-fa46076c010f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2069167691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7791bd92c7c488aa72474ecde2e1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcfde46b-01", "ovs_interfaceid": "fcfde46b-01e2-414d-a7ab-0d393dd98e3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:27:14 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Converting VIF {"id": "fcfde46b-01e2-414d-a7ab-0d393dd98e3b", "address": "fa:16:3e:1c:d7:29", "network": {"id": "96d9262b-11fb-497d-8e38-fa46076c010f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2069167691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7791bd92c7c488aa72474ecde2e1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcfde46b-01", "ovs_interfaceid": "fcfde46b-01e2-414d-a7ab-0d393dd98e3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:27:14 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:d7:29,bridge_name='br-int',has_traffic_filtering=True,id=fcfde46b-01e2-414d-a7ab-0d393dd98e3b,network=Network(96d9262b-11fb-497d-8e38-fa46076c010f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcfde46b-01') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:27:14 user nova-compute[95467]: DEBUG os_vif [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:d7:29,bridge_name='br-int',has_traffic_filtering=True,id=fcfde46b-01e2-414d-a7ab-0d393dd98e3b,network=Network(96d9262b-11fb-497d-8e38-fa46076c010f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcfde46b-01') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:27:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:27:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:27:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8b1120ba-4ca5-5672-bb4e-684d560823b8', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:27:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfcfde46b-01, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:27:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfcfde46b-01, col_values=(('qos', UUID('6672315d-eb32-4d2b-8427-31e37474de10')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:27:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfcfde46b-01, col_values=(('external_ids', {'iface-id': 'fcfde46b-01e2-414d-a7ab-0d393dd98e3b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:d7:29', 'vm-uuid': '2838af21-2749-4e6b-b4d3-c0d79379dfb5'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:27:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:27:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:14 user nova-compute[95467]: INFO os_vif [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:d7:29,bridge_name='br-int',has_traffic_filtering=True,id=fcfde46b-01e2-414d-a7ab-0d393dd98e3b,network=Network(96d9262b-11fb-497d-8e38-fa46076c010f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcfde46b-01')
Nov 15 08:27:14 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:27:14 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] No VIF found with MAC fa:16:3e:1c:d7:29, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:27:15 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:15 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:15 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:16 user nova-compute[95467]: DEBUG nova.compute.manager [req-ee248e29-3a90-4908-b3cf-5cc642a72d15 req-802be052-269e-4b35-9a68-8a1b4e3b073a service nova] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Received event network-vif-plugged-fcfde46b-01e2-414d-a7ab-0d393dd98e3b {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:27:16 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ee248e29-3a90-4908-b3cf-5cc642a72d15 req-802be052-269e-4b35-9a68-8a1b4e3b073a service nova] Acquiring lock "2838af21-2749-4e6b-b4d3-c0d79379dfb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:27:16 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ee248e29-3a90-4908-b3cf-5cc642a72d15 req-802be052-269e-4b35-9a68-8a1b4e3b073a service nova] Lock "2838af21-2749-4e6b-b4d3-c0d79379dfb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:27:16 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ee248e29-3a90-4908-b3cf-5cc642a72d15 req-802be052-269e-4b35-9a68-8a1b4e3b073a service nova] Lock "2838af21-2749-4e6b-b4d3-c0d79379dfb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:27:16 user nova-compute[95467]: DEBUG nova.compute.manager [req-ee248e29-3a90-4908-b3cf-5cc642a72d15 req-802be052-269e-4b35-9a68-8a1b4e3b073a service nova] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] No waiting events found dispatching network-vif-plugged-fcfde46b-01e2-414d-a7ab-0d393dd98e3b {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:27:16 user nova-compute[95467]: WARNING nova.compute.manager [req-ee248e29-3a90-4908-b3cf-5cc642a72d15 req-802be052-269e-4b35-9a68-8a1b4e3b073a service nova] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Received unexpected event network-vif-plugged-fcfde46b-01e2-414d-a7ab-0d393dd98e3b for instance with vm_state building and task_state spawning.
Nov 15 08:27:16 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:16 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:17 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:17 user nova-compute[95467]: DEBUG nova.compute.manager [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Instance event wait completed in 0 seconds for  {{(pid=95467) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 08:27:17 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Guest created on hypervisor {{(pid=95467) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 08:27:17 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Instance spawned successfully.
Nov 15 08:27:17 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 08:27:17 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Found default for hw_cdrom_bus of ide {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:27:17 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Found default for hw_disk_bus of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:27:17 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Found default for hw_input_bus of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:27:17 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Found default for hw_pointer_model of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:27:17 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Found default for hw_video_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:27:17 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Found default for hw_vif_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:27:18 user nova-compute[95467]: INFO nova.compute.manager [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Took 4.95 seconds to spawn the instance on the hypervisor.
Nov 15 08:27:18 user nova-compute[95467]: DEBUG nova.compute.manager [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:27:18 user nova-compute[95467]: DEBUG nova.compute.manager [req-3cb8950b-dbb0-44f7-86fa-8f51336c00a2 req-78cf8707-c728-44ba-8a81-dd7f4140179d service nova] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Received event network-vif-plugged-fcfde46b-01e2-414d-a7ab-0d393dd98e3b {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:27:18 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-3cb8950b-dbb0-44f7-86fa-8f51336c00a2 req-78cf8707-c728-44ba-8a81-dd7f4140179d service nova] Acquiring lock "2838af21-2749-4e6b-b4d3-c0d79379dfb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:27:18 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-3cb8950b-dbb0-44f7-86fa-8f51336c00a2 req-78cf8707-c728-44ba-8a81-dd7f4140179d service nova] Lock "2838af21-2749-4e6b-b4d3-c0d79379dfb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:27:18 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-3cb8950b-dbb0-44f7-86fa-8f51336c00a2 req-78cf8707-c728-44ba-8a81-dd7f4140179d service nova] Lock "2838af21-2749-4e6b-b4d3-c0d79379dfb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:27:18 user nova-compute[95467]: DEBUG nova.compute.manager [req-3cb8950b-dbb0-44f7-86fa-8f51336c00a2 req-78cf8707-c728-44ba-8a81-dd7f4140179d service nova] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] No waiting events found dispatching network-vif-plugged-fcfde46b-01e2-414d-a7ab-0d393dd98e3b {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:27:18 user nova-compute[95467]: WARNING nova.compute.manager [req-3cb8950b-dbb0-44f7-86fa-8f51336c00a2 req-78cf8707-c728-44ba-8a81-dd7f4140179d service nova] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Received unexpected event network-vif-plugged-fcfde46b-01e2-414d-a7ab-0d393dd98e3b for instance with vm_state building and task_state spawning.
Nov 15 08:27:18 user nova-compute[95467]: INFO nova.compute.manager [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Took 10.95 seconds to build instance.
Nov 15 08:27:18 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-44ef9cb7-fa6b-4999-b3ad-14489eb72bb5 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "2838af21-2749-4e6b-b4d3-c0d79379dfb5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.060s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:27:19 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:24 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Acquiring lock "4ab4ef11-de3f-44a9-9242-916753481479" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:27:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Lock "4ab4ef11-de3f-44a9-9242-916753481479" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:27:25 user nova-compute[95467]: DEBUG nova.compute.manager [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 4ab4ef11-de3f-44a9-9242-916753481479] Starting instance... {{(pid=95467) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 08:27:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:27:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:27:25 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=95467) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 08:27:25 user nova-compute[95467]: INFO nova.compute.claims [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 4ab4ef11-de3f-44a9-9242-916753481479] Claim successful on node user
Nov 15 08:27:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-5f6ee0a2-e59a-4803-8fdc-9e3845c4acff tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Acquiring lock "843b778c-f823-4bee-aa76-ab44345be9a7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:27:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-5f6ee0a2-e59a-4803-8fdc-9e3845c4acff tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Lock "843b778c-f823-4bee-aa76-ab44345be9a7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:27:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-5f6ee0a2-e59a-4803-8fdc-9e3845c4acff tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Acquiring lock "843b778c-f823-4bee-aa76-ab44345be9a7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:27:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-5f6ee0a2-e59a-4803-8fdc-9e3845c4acff tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Lock "843b778c-f823-4bee-aa76-ab44345be9a7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:27:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-5f6ee0a2-e59a-4803-8fdc-9e3845c4acff tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Lock "843b778c-f823-4bee-aa76-ab44345be9a7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:27:26 user nova-compute[95467]: INFO nova.compute.manager [None req-5f6ee0a2-e59a-4803-8fdc-9e3845c4acff tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Terminating instance
Nov 15 08:27:26 user nova-compute[95467]: DEBUG nova.compute.manager [None req-5f6ee0a2-e59a-4803-8fdc-9e3845c4acff tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Start destroying the instance on the hypervisor. {{(pid=95467) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 08:27:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:26 user nova-compute[95467]: DEBUG nova.compute.manager [req-cd7ada2b-5430-478a-bec0-c50887f9a365 req-0ec8b59d-376f-4542-abc2-22c4233613e9 service nova] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Received event network-vif-unplugged-4572a8d9-9e56-47da-b59d-013b88b32e8b {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:27:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-cd7ada2b-5430-478a-bec0-c50887f9a365 req-0ec8b59d-376f-4542-abc2-22c4233613e9 service nova] Acquiring lock "843b778c-f823-4bee-aa76-ab44345be9a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:27:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-cd7ada2b-5430-478a-bec0-c50887f9a365 req-0ec8b59d-376f-4542-abc2-22c4233613e9 service nova] Lock "843b778c-f823-4bee-aa76-ab44345be9a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:27:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-cd7ada2b-5430-478a-bec0-c50887f9a365 req-0ec8b59d-376f-4542-abc2-22c4233613e9 service nova] Lock "843b778c-f823-4bee-aa76-ab44345be9a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:27:26 user nova-compute[95467]: DEBUG nova.compute.manager [req-cd7ada2b-5430-478a-bec0-c50887f9a365 req-0ec8b59d-376f-4542-abc2-22c4233613e9 service nova] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] No waiting events found dispatching network-vif-unplugged-4572a8d9-9e56-47da-b59d-013b88b32e8b {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:27:26 user nova-compute[95467]: DEBUG nova.compute.manager [req-cd7ada2b-5430-478a-bec0-c50887f9a365 req-0ec8b59d-376f-4542-abc2-22c4233613e9 service nova] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Received event network-vif-unplugged-4572a8d9-9e56-47da-b59d-013b88b32e8b for instance with task_state deleting. {{(pid=95467) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 08:27:26 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:27:26 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:27:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.701s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:27:26 user nova-compute[95467]: DEBUG nova.compute.manager [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 4ab4ef11-de3f-44a9-9242-916753481479] Start building networks asynchronously for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 08:27:26 user nova-compute[95467]: DEBUG nova.compute.manager [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 4ab4ef11-de3f-44a9-9242-916753481479] Allocating IP information in the background. {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 08:27:26 user nova-compute[95467]: DEBUG nova.network.neutron [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 4ab4ef11-de3f-44a9-9242-916753481479] allocate_for_instance() {{(pid=95467) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 08:27:26 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 4ab4ef11-de3f-44a9-9242-916753481479] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 08:27:26 user nova-compute[95467]: DEBUG nova.compute.manager [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 4ab4ef11-de3f-44a9-9242-916753481479] Start building block device mappings for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 08:27:26 user nova-compute[95467]: DEBUG nova.policy [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '21abcb55c48d44af8a215cdc4013a065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e179db7f977c4d98abb497c6a3b4f5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95467) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 08:27:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:26 user nova-compute[95467]: DEBUG nova.compute.manager [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 4ab4ef11-de3f-44a9-9242-916753481479] Start spawning the instance on the hypervisor. {{(pid=95467) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 08:27:26 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 4ab4ef11-de3f-44a9-9242-916753481479] Creating instance directory {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 08:27:26 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 4ab4ef11-de3f-44a9-9242-916753481479] Creating image(s)
Nov 15 08:27:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Acquiring lock "/opt/stack/data/nova/instances/4ab4ef11-de3f-44a9-9242-916753481479/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:27:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Lock "/opt/stack/data/nova/instances/4ab4ef11-de3f-44a9-9242-916753481479/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:27:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Lock "/opt/stack/data/nova/instances/4ab4ef11-de3f-44a9-9242-916753481479/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:27:26 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:26 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Instance destroyed successfully.
Nov 15 08:27:26 user nova-compute[95467]: DEBUG nova.objects.instance [None req-5f6ee0a2-e59a-4803-8fdc-9e3845c4acff tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Lazy-loading 'resources' on Instance uuid 843b778c-f823-4bee-aa76-ab44345be9a7 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:27:26 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-5f6ee0a2-e59a-4803-8fdc-9e3845c4acff tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:23:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-217296366',display_name='tempest-TestServerVolumeAttachmentScenario-server-217296366',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-217296366',id=39,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF+lcfu/nvHsnk/6Gwk8D0QBtWBp//jnxtatY7hRUCnEPCIyXaUj7LZd5fLikSO7hUHx6NJ8dIROzhkOIJrdZab7uyAVcRNKmEbdjc8IDIMXo7ULTlpxCEMNToBrSYGAIA==',key_name='tempest-keypair-1977680203',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:23:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a6fb970c784b4c3c8e64abd04523885a',ramdisk_id='',reservation_id='r-v5u24366',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1144112499',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1144112499-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:23:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b6b2de671674fa8b9f2489fcbba90f4',uuid=843b778c-f823-4bee-aa76-ab44345be9a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4572a8d9-9e56-47da-b59d-013b88b32e8b", "address": "fa:16:3e:08:74:0a", "network": {"id": "bdae4fa0-34fd-4b85-8c8b-7d68b7e80282", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-680251229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6fb970c784b4c3c8e64abd04523885a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4572a8d9-9e", "ovs_interfaceid": "4572a8d9-9e56-47da-b59d-013b88b32e8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:27:26 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-5f6ee0a2-e59a-4803-8fdc-9e3845c4acff tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Converting VIF {"id": "4572a8d9-9e56-47da-b59d-013b88b32e8b", "address": "fa:16:3e:08:74:0a", "network": {"id": "bdae4fa0-34fd-4b85-8c8b-7d68b7e80282", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-680251229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6fb970c784b4c3c8e64abd04523885a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4572a8d9-9e", "ovs_interfaceid": "4572a8d9-9e56-47da-b59d-013b88b32e8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:27:26 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-5f6ee0a2-e59a-4803-8fdc-9e3845c4acff tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:74:0a,bridge_name='br-int',has_traffic_filtering=True,id=4572a8d9-9e56-47da-b59d-013b88b32e8b,network=Network(bdae4fa0-34fd-4b85-8c8b-7d68b7e80282),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4572a8d9-9e') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:27:26 user nova-compute[95467]: DEBUG os_vif [None req-5f6ee0a2-e59a-4803-8fdc-9e3845c4acff tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:74:0a,bridge_name='br-int',has_traffic_filtering=True,id=4572a8d9-9e56-47da-b59d-013b88b32e8b,network=Network(bdae4fa0-34fd-4b85-8c8b-7d68b7e80282),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4572a8d9-9e') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:27:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4572a8d9-9e, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:27:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:27:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=71da8768-9a1c-4259-b034-892fea1c3b0b) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:27:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:26 user nova-compute[95467]: INFO os_vif [None req-5f6ee0a2-e59a-4803-8fdc-9e3845c4acff tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:74:0a,bridge_name='br-int',has_traffic_filtering=True,id=4572a8d9-9e56-47da-b59d-013b88b32e8b,network=Network(bdae4fa0-34fd-4b85-8c8b-7d68b7e80282),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4572a8d9-9e')
Nov 15 08:27:26 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-5f6ee0a2-e59a-4803-8fdc-9e3845c4acff tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Deleting instance files /opt/stack/data/nova/instances/843b778c-f823-4bee-aa76-ab44345be9a7_del
Nov 15 08:27:27 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-5f6ee0a2-e59a-4803-8fdc-9e3845c4acff tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Deletion of /opt/stack/data/nova/instances/843b778c-f823-4bee-aa76-ab44345be9a7_del complete
Nov 15 08:27:27 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.217s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Acquiring lock "a3fcf60225fcefd310404971cd18ab9851c548dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:27:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:27:27 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:27 user nova-compute[95467]: INFO nova.compute.manager [None req-5f6ee0a2-e59a-4803-8fdc-9e3845c4acff tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 15 08:27:27 user nova-compute[95467]: DEBUG oslo.service.loopingcall [None req-5f6ee0a2-e59a-4803-8fdc-9e3845c4acff tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=95467) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 08:27:27 user nova-compute[95467]: DEBUG nova.compute.manager [-] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Deallocating network for instance {{(pid=95467) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 08:27:27 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] deallocate_for_instance() {{(pid=95467) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 08:27:27 user nova-compute[95467]: INFO nova.compute.manager [None req-08d33fdb-1b0d-4e45-aa56-822c6eeffc4f tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Unrescuing
Nov 15 08:27:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-08d33fdb-1b0d-4e45-aa56-822c6eeffc4f tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Acquiring lock "refresh_cache-739645e6-9952-40db-a876-f23d02d4e411" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:27:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-08d33fdb-1b0d-4e45-aa56-822c6eeffc4f tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Acquired lock "refresh_cache-739645e6-9952-40db-a876-f23d02d4e411" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:27:27 user nova-compute[95467]: DEBUG nova.network.neutron [None req-08d33fdb-1b0d-4e45-aa56-822c6eeffc4f tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:27:27 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.281s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:27 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/4ab4ef11-de3f-44a9-9242-916753481479/disk 1073741824 {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:27 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/4ab4ef11-de3f-44a9-9242-916753481479/disk 1073741824" returned: 0 in 0.083s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.371s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:27:27 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:27 user nova-compute[95467]: DEBUG nova.network.neutron [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 4ab4ef11-de3f-44a9-9242-916753481479] Successfully created port: fa02d839-91a1-4f1f-a8f1-046aa61a7f70 {{(pid=95467) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 08:27:27 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.191s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:27 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4ab4ef11-de3f-44a9-9242-916753481479/disk. size=1073741824 {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 08:27:27 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ab4ef11-de3f-44a9-9242-916753481479/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:27 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ab4ef11-de3f-44a9-9242-916753481479/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:27 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Cannot resize image /opt/stack/data/nova/instances/4ab4ef11-de3f-44a9-9242-916753481479/disk to a smaller size. {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 08:27:27 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 4ab4ef11-de3f-44a9-9242-916753481479] Created local disks {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 08:27:27 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 4ab4ef11-de3f-44a9-9242-916753481479] Ensure instance console log exists: /opt/stack/data/nova/instances/4ab4ef11-de3f-44a9-9242-916753481479/console.log {{(pid=95467) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 08:27:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:27:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:27:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:27:28 user nova-compute[95467]: DEBUG nova.network.neutron [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 4ab4ef11-de3f-44a9-9242-916753481479] Successfully updated port: fa02d839-91a1-4f1f-a8f1-046aa61a7f70 {{(pid=95467) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 08:27:28 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Acquiring lock "refresh_cache-4ab4ef11-de3f-44a9-9242-916753481479" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:27:28 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Acquired lock "refresh_cache-4ab4ef11-de3f-44a9-9242-916753481479" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:27:28 user nova-compute[95467]: DEBUG nova.network.neutron [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 4ab4ef11-de3f-44a9-9242-916753481479] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:27:28 user nova-compute[95467]: DEBUG nova.network.neutron [None req-08d33fdb-1b0d-4e45-aa56-822c6eeffc4f tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Updating instance_info_cache with network_info: [{"id": "a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae", "address": "fa:16:3e:13:89:c0", "network": {"id": "369d2a6f-60b7-4c92-8b2d-1f3828f6698b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1491709218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd281be4e94a4d31a47a13267d51d9b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6f2f30d-af", "ovs_interfaceid": "a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:27:28 user nova-compute[95467]: DEBUG nova.compute.manager [req-0517c6c6-5f29-4472-bdfa-2be2d1a1d93e req-71ef9696-7262-4860-b7f8-0e449d42597f service nova] [instance: 4ab4ef11-de3f-44a9-9242-916753481479] Received event network-changed-fa02d839-91a1-4f1f-a8f1-046aa61a7f70 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:27:28 user nova-compute[95467]: DEBUG nova.compute.manager [req-0517c6c6-5f29-4472-bdfa-2be2d1a1d93e req-71ef9696-7262-4860-b7f8-0e449d42597f service nova] [instance: 4ab4ef11-de3f-44a9-9242-916753481479] Refreshing instance network info cache due to event network-changed-fa02d839-91a1-4f1f-a8f1-046aa61a7f70. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:27:28 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-0517c6c6-5f29-4472-bdfa-2be2d1a1d93e req-71ef9696-7262-4860-b7f8-0e449d42597f service nova] Acquiring lock "refresh_cache-4ab4ef11-de3f-44a9-9242-916753481479" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:27:28 user nova-compute[95467]: DEBUG nova.network.neutron [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 4ab4ef11-de3f-44a9-9242-916753481479] Instance cache missing network info. {{(pid=95467) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 08:27:28 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-08d33fdb-1b0d-4e45-aa56-822c6eeffc4f tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Releasing lock "refresh_cache-739645e6-9952-40db-a876-f23d02d4e411" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:27:28 user nova-compute[95467]: DEBUG nova.objects.instance [None req-08d33fdb-1b0d-4e45-aa56-822c6eeffc4f tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lazy-loading 'flavor' on Instance uuid 739645e6-9952-40db-a876-f23d02d4e411 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:27:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:28 user nova-compute[95467]: DEBUG nova.compute.manager [req-bd1918ee-c670-459b-8d9e-261671632a11 req-2ecf4b42-89ba-48bf-bde5-ec82b20a48cc service nova] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Received event network-vif-plugged-4572a8d9-9e56-47da-b59d-013b88b32e8b {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:27:28 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-bd1918ee-c670-459b-8d9e-261671632a11 req-2ecf4b42-89ba-48bf-bde5-ec82b20a48cc service nova] Acquiring lock "843b778c-f823-4bee-aa76-ab44345be9a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:27:28 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-bd1918ee-c670-459b-8d9e-261671632a11 req-2ecf4b42-89ba-48bf-bde5-ec82b20a48cc service nova] Lock "843b778c-f823-4bee-aa76-ab44345be9a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:27:28 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-bd1918ee-c670-459b-8d9e-261671632a11 req-2ecf4b42-89ba-48bf-bde5-ec82b20a48cc service nova] Lock "843b778c-f823-4bee-aa76-ab44345be9a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:27:28 user nova-compute[95467]: DEBUG nova.compute.manager [req-bd1918ee-c670-459b-8d9e-261671632a11 req-2ecf4b42-89ba-48bf-bde5-ec82b20a48cc service nova] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] No waiting events found dispatching network-vif-plugged-4572a8d9-9e56-47da-b59d-013b88b32e8b {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:27:28 user nova-compute[95467]: WARNING nova.compute.manager [req-bd1918ee-c670-459b-8d9e-261671632a11 req-2ecf4b42-89ba-48bf-bde5-ec82b20a48cc service nova] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Received unexpected event network-vif-plugged-4572a8d9-9e56-47da-b59d-013b88b32e8b for instance with vm_state active and task_state deleting.
Nov 15 08:27:28 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:27:28 user nova-compute[95467]: INFO nova.compute.manager [-] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Took 1.40 seconds to deallocate network for instance.
Nov 15 08:27:28 user nova-compute[95467]: DEBUG nova.network.neutron [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 4ab4ef11-de3f-44a9-9242-916753481479] Updating instance_info_cache with network_info: [{"id": "fa02d839-91a1-4f1f-a8f1-046aa61a7f70", "address": "fa:16:3e:56:6f:ab", "network": {"id": "3bb97374-8e3e-4364-a350-dbe265332087", "bridge": "br-int", "label": "tempest-VolumesActionsTest-966132722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e179db7f977c4d98abb497c6a3b4f5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa02d839-91", "ovs_interfaceid": "fa02d839-91a1-4f1f-a8f1-046aa61a7f70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:27:28 user nova-compute[95467]: DEBUG nova.compute.manager [req-c92a7480-05c3-42a1-a82e-3a05fb551574 req-3b0a0dcf-0e7b-488e-b727-724b41239301 service nova] [instance: 843b778c-f823-4bee-aa76-ab44345be9a7] Received event network-vif-deleted-4572a8d9-9e56-47da-b59d-013b88b32e8b {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:27:28 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Releasing lock "refresh_cache-4ab4ef11-de3f-44a9-9242-916753481479" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:27:28 user nova-compute[95467]: DEBUG nova.compute.manager [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 4ab4ef11-de3f-44a9-9242-916753481479] Instance network_info: |[{"id": "fa02d839-91a1-4f1f-a8f1-046aa61a7f70", "address": "fa:16:3e:56:6f:ab", "network": {"id": "3bb97374-8e3e-4364-a350-dbe265332087", "bridge": "br-int", "label": "tempest-VolumesActionsTest-966132722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e179db7f977c4d98abb497c6a3b4f5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa02d839-91", "ovs_interfaceid": "fa02d839-91a1-4f1f-a8f1-046aa61a7f70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 08:27:28 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-0517c6c6-5f29-4472-bdfa-2be2d1a1d93e req-71ef9696-7262-4860-b7f8-0e449d42597f service nova] Acquired lock "refresh_cache-4ab4ef11-de3f-44a9-9242-916753481479" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:27:28 user nova-compute[95467]: DEBUG nova.network.neutron [req-0517c6c6-5f29-4472-bdfa-2be2d1a1d93e req-71ef9696-7262-4860-b7f8-0e449d42597f service nova] [instance: 4ab4ef11-de3f-44a9-9242-916753481479] Refreshing network info cache for port fa02d839-91a1-4f1f-a8f1-046aa61a7f70 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:27:28 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 4ab4ef11-de3f-44a9-9242-916753481479] Start _get_guest_xml network_info=[{"id": "fa02d839-91a1-4f1f-a8f1-046aa61a7f70", "address": "fa:16:3e:56:6f:ab", "network": {"id": "3bb97374-8e3e-4364-a350-dbe265332087", "bridge": "br-int", "label": "tempest-VolumesActionsTest-966132722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e179db7f977c4d98abb497c6a3b4f5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa02d839-91", "ovs_interfaceid": "fa02d839-91a1-4f1f-a8f1-046aa61a7f70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'ed9c48aa-ce73-4b3b-9db1-235898be671b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:27:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:28 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:27:28 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:27:28 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-5f6ee0a2-e59a-4803-8fdc-9e3845c4acff tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:27:28 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-5f6ee0a2-e59a-4803-8fdc-9e3845c4acff tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:27:28 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:27:28 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:27:28 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:27:28 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:27:28 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:27:28 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:27:28 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:27:28 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:27:28 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:27:28 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:27:28 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:27:28 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:27:28 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:27:28 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:27:28 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:27:28 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:27:28 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:27:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1368499512',display_name='tempest-VolumesActionsTest-instance-1368499512',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1368499512',id=46,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e179db7f977c4d98abb497c6a3b4f5e9',ramdisk_id='',reservation_id='r-2vv3xjry',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1524883282',owner_user_name='tempest-VolumesActionsTest-1524883282-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:27:27Z,user_data=None,user_id='21abcb55c48d44af8a215cdc4013a065',uuid=4ab4ef11-de3f-44a9-9242-916753481479,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa02d839-91a1-4f1f-a8f1-046aa61a7f70", "address": "fa:16:3e:56:6f:ab", "network": {"id": "3bb97374-8e3e-4364-a350-dbe265332087", "bridge": "br-int", "label": "tempest-VolumesActionsTest-966132722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e179db7f977c4d98abb497c6a3b4f5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa02d839-91", "ovs_interfaceid": "fa02d839-91a1-4f1f-a8f1-046aa61a7f70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:27:28 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Converting VIF {"id": "fa02d839-91a1-4f1f-a8f1-046aa61a7f70", "address": "fa:16:3e:56:6f:ab", "network": {"id": "3bb97374-8e3e-4364-a350-dbe265332087", "bridge": "br-int", "label": "tempest-VolumesActionsTest-966132722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e179db7f977c4d98abb497c6a3b4f5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa02d839-91", "ovs_interfaceid": "fa02d839-91a1-4f1f-a8f1-046aa61a7f70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:27:28 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:6f:ab,bridge_name='br-int',has_traffic_filtering=True,id=fa02d839-91a1-4f1f-a8f1-046aa61a7f70,network=Network(3bb97374-8e3e-4364-a350-dbe265332087),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa02d839-91') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:27:28 user nova-compute[95467]: DEBUG nova.objects.instance [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Lazy-loading 'pci_devices' on Instance uuid 4ab4ef11-de3f-44a9-9242-916753481479 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:27:28 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 4ab4ef11-de3f-44a9-9242-916753481479] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:27:28 user nova-compute[95467]:   <uuid>4ab4ef11-de3f-44a9-9242-916753481479</uuid>
Nov 15 08:27:28 user nova-compute[95467]:   <name>instance-0000002e</name>
Nov 15 08:27:28 user nova-compute[95467]:   <memory>524288</memory>
Nov 15 08:27:28 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:27:28 user nova-compute[95467]:   <metadata>
Nov 15 08:27:28 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:27:28 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:27:28 user nova-compute[95467]:       <nova:name>tempest-VolumesActionsTest-instance-1368499512</nova:name>
Nov 15 08:27:28 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:27:28</nova:creationTime>
Nov 15 08:27:28 user nova-compute[95467]:       <nova:flavor name="m1.tiny">
Nov 15 08:27:28 user nova-compute[95467]:         <nova:memory>512</nova:memory>
Nov 15 08:27:28 user nova-compute[95467]:         <nova:disk>1</nova:disk>
Nov 15 08:27:28 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:27:28 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:27:28 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:27:28 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:27:28 user nova-compute[95467]:       <nova:owner>
Nov 15 08:27:28 user nova-compute[95467]:         <nova:user uuid="21abcb55c48d44af8a215cdc4013a065">tempest-VolumesActionsTest-1524883282-project-member</nova:user>
Nov 15 08:27:28 user nova-compute[95467]:         <nova:project uuid="e179db7f977c4d98abb497c6a3b4f5e9">tempest-VolumesActionsTest-1524883282</nova:project>
Nov 15 08:27:28 user nova-compute[95467]:       </nova:owner>
Nov 15 08:27:28 user nova-compute[95467]:       <nova:root type="image" uuid="ed9c48aa-ce73-4b3b-9db1-235898be671b"/>
Nov 15 08:27:28 user nova-compute[95467]:       <nova:ports>
Nov 15 08:27:28 user nova-compute[95467]:         <nova:port uuid="fa02d839-91a1-4f1f-a8f1-046aa61a7f70">
Nov 15 08:27:28 user nova-compute[95467]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 08:27:28 user nova-compute[95467]:         </nova:port>
Nov 15 08:27:28 user nova-compute[95467]:       </nova:ports>
Nov 15 08:27:28 user nova-compute[95467]:     </nova:instance>
Nov 15 08:27:28 user nova-compute[95467]:   </metadata>
Nov 15 08:27:28 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:27:28 user nova-compute[95467]:     <system>
Nov 15 08:27:28 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:27:28 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:27:28 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:27:28 user nova-compute[95467]:       <entry name="serial">4ab4ef11-de3f-44a9-9242-916753481479</entry>
Nov 15 08:27:28 user nova-compute[95467]:       <entry name="uuid">4ab4ef11-de3f-44a9-9242-916753481479</entry>
Nov 15 08:27:28 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:27:28 user nova-compute[95467]:     </system>
Nov 15 08:27:28 user nova-compute[95467]:   </sysinfo>
Nov 15 08:27:28 user nova-compute[95467]:   <os>
Nov 15 08:27:28 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:27:28 user nova-compute[95467]:     <boot dev="hd"/>
Nov 15 08:27:28 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:27:28 user nova-compute[95467]:   </os>
Nov 15 08:27:28 user nova-compute[95467]:   <features>
Nov 15 08:27:28 user nova-compute[95467]:     <acpi/>
Nov 15 08:27:28 user nova-compute[95467]:     <apic/>
Nov 15 08:27:28 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:27:28 user nova-compute[95467]:   </features>
Nov 15 08:27:28 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:27:28 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:27:28 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:27:28 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:27:28 user nova-compute[95467]:   </clock>
Nov 15 08:27:28 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:27:28 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:27:28 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:27:28 user nova-compute[95467]:   </cpu>
Nov 15 08:27:28 user nova-compute[95467]:   <devices>
Nov 15 08:27:28 user nova-compute[95467]:     <disk type="file" device="disk">
Nov 15 08:27:28 user nova-compute[95467]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 08:27:28 user nova-compute[95467]:       <source file="/opt/stack/data/nova/instances/4ab4ef11-de3f-44a9-9242-916753481479/disk"/>
Nov 15 08:27:28 user nova-compute[95467]:       <target dev="vda" bus="virtio"/>
Nov 15 08:27:28 user nova-compute[95467]:     </disk>
Nov 15 08:27:28 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:27:28 user nova-compute[95467]:       <mac address="fa:16:3e:56:6f:ab"/>
Nov 15 08:27:28 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:27:28 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:27:28 user nova-compute[95467]:       <target dev="tapfa02d839-91"/>
Nov 15 08:27:28 user nova-compute[95467]:     </interface>
Nov 15 08:27:28 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:27:28 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/4ab4ef11-de3f-44a9-9242-916753481479/console.log" append="off"/>
Nov 15 08:27:28 user nova-compute[95467]:     </serial>
Nov 15 08:27:28 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:27:28 user nova-compute[95467]:     <video>
Nov 15 08:27:28 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:27:28 user nova-compute[95467]:     </video>
Nov 15 08:27:28 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:27:28 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:27:28 user nova-compute[95467]:     </rng>
Nov 15 08:27:28 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:27:28 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:27:28 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:27:28 user nova-compute[95467]:     </memballoon>
Nov 15 08:27:28 user nova-compute[95467]:   </devices>
Nov 15 08:27:28 user nova-compute[95467]: </domain>
Nov 15 08:27:28 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:27:28 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:27:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1368499512',display_name='tempest-VolumesActionsTest-instance-1368499512',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1368499512',id=46,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e179db7f977c4d98abb497c6a3b4f5e9',ramdisk_id='',reservation_id='r-2vv3xjry',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1524883282',owner_user_name='tempest-VolumesActionsTest-1524883282-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:27:27Z,user_data=None,user_id='21abcb55c48d44af8a215cdc4013a065',uuid=4ab4ef11-de3f-44a9-9242-916753481479,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa02d839-91a1-4f1f-a8f1-046aa61a7f70", "address": "fa:16:3e:56:6f:ab", "network": {"id": "3bb97374-8e3e-4364-a350-dbe265332087", "bridge": "br-int", "label": "tempest-VolumesActionsTest-966132722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e179db7f977c4d98abb497c6a3b4f5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa02d839-91", "ovs_interfaceid": "fa02d839-91a1-4f1f-a8f1-046aa61a7f70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:27:28 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Converting VIF {"id": "fa02d839-91a1-4f1f-a8f1-046aa61a7f70", "address": "fa:16:3e:56:6f:ab", "network": {"id": "3bb97374-8e3e-4364-a350-dbe265332087", "bridge": "br-int", "label": "tempest-VolumesActionsTest-966132722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e179db7f977c4d98abb497c6a3b4f5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa02d839-91", "ovs_interfaceid": "fa02d839-91a1-4f1f-a8f1-046aa61a7f70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:27:28 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:6f:ab,bridge_name='br-int',has_traffic_filtering=True,id=fa02d839-91a1-4f1f-a8f1-046aa61a7f70,network=Network(3bb97374-8e3e-4364-a350-dbe265332087),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa02d839-91') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:27:28 user nova-compute[95467]: DEBUG os_vif [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:6f:ab,bridge_name='br-int',has_traffic_filtering=True,id=fa02d839-91a1-4f1f-a8f1-046aa61a7f70,network=Network(3bb97374-8e3e-4364-a350-dbe265332087),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa02d839-91') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:27:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:27:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:27:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7302e825-4e18-56bb-bdaf-f4c8e7b88f10', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:27:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:27:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfa02d839-91, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:27:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfa02d839-91, col_values=(('qos', UUID('46bc0896-6191-48da-afef-46a36e655747')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:27:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfa02d839-91, col_values=(('external_ids', {'iface-id': 'fa02d839-91a1-4f1f-a8f1-046aa61a7f70', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:6f:ab', 'vm-uuid': '4ab4ef11-de3f-44a9-9242-916753481479'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:27:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:27:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:28 user nova-compute[95467]: INFO os_vif [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:6f:ab,bridge_name='br-int',has_traffic_filtering=True,id=fa02d839-91a1-4f1f-a8f1-046aa61a7f70,network=Network(3bb97374-8e3e-4364-a350-dbe265332087),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa02d839-91')
Nov 15 08:27:28 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:27:28 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] No VIF found with MAC fa:16:3e:56:6f:ab, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:27:29 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-5f6ee0a2-e59a-4803-8fdc-9e3845c4acff tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:27:29 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-5f6ee0a2-e59a-4803-8fdc-9e3845c4acff tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:27:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-5f6ee0a2-e59a-4803-8fdc-9e3845c4acff tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.549s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:27:29 user nova-compute[95467]: INFO nova.scheduler.client.report [None req-5f6ee0a2-e59a-4803-8fdc-9e3845c4acff tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Deleted allocations for instance 843b778c-f823-4bee-aa76-ab44345be9a7
Nov 15 08:27:29 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Instance destroyed successfully.
Nov 15 08:27:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-5f6ee0a2-e59a-4803-8fdc-9e3845c4acff tempest-TestServerVolumeAttachmentScenario-1144112499 tempest-TestServerVolumeAttachmentScenario-1144112499-project-member] Lock "843b778c-f823-4bee-aa76-ab44345be9a7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.317s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:27:29 user nova-compute[95467]: DEBUG nova.network.neutron [req-0517c6c6-5f29-4472-bdfa-2be2d1a1d93e req-71ef9696-7262-4860-b7f8-0e449d42597f service nova] [instance: 4ab4ef11-de3f-44a9-9242-916753481479] Updated VIF entry in instance network info cache for port fa02d839-91a1-4f1f-a8f1-046aa61a7f70. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:27:29 user nova-compute[95467]: DEBUG nova.network.neutron [req-0517c6c6-5f29-4472-bdfa-2be2d1a1d93e req-71ef9696-7262-4860-b7f8-0e449d42597f service nova] [instance: 4ab4ef11-de3f-44a9-9242-916753481479] Updating instance_info_cache with network_info: [{"id": "fa02d839-91a1-4f1f-a8f1-046aa61a7f70", "address": "fa:16:3e:56:6f:ab", "network": {"id": "3bb97374-8e3e-4364-a350-dbe265332087", "bridge": "br-int", "label": "tempest-VolumesActionsTest-966132722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e179db7f977c4d98abb497c6a3b4f5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa02d839-91", "ovs_interfaceid": "fa02d839-91a1-4f1f-a8f1-046aa61a7f70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:27:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-0517c6c6-5f29-4472-bdfa-2be2d1a1d93e req-71ef9696-7262-4860-b7f8-0e449d42597f service nova] Releasing lock "refresh_cache-4ab4ef11-de3f-44a9-9242-916753481479" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:27:30 user nova-compute[95467]: DEBUG nova.compute.manager [req-25ee64bc-92d9-44c8-89c5-7683c97ae802 req-006d5bd0-19ce-4fc1-a3e7-14c9f5fca57c service nova] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Received event network-vif-unplugged-a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:27:30 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-25ee64bc-92d9-44c8-89c5-7683c97ae802 req-006d5bd0-19ce-4fc1-a3e7-14c9f5fca57c service nova] Acquiring lock "739645e6-9952-40db-a876-f23d02d4e411-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:27:30 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-25ee64bc-92d9-44c8-89c5-7683c97ae802 req-006d5bd0-19ce-4fc1-a3e7-14c9f5fca57c service nova] Lock "739645e6-9952-40db-a876-f23d02d4e411-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:27:30 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-25ee64bc-92d9-44c8-89c5-7683c97ae802 req-006d5bd0-19ce-4fc1-a3e7-14c9f5fca57c service nova] Lock "739645e6-9952-40db-a876-f23d02d4e411-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:27:30 user nova-compute[95467]: DEBUG nova.compute.manager [req-25ee64bc-92d9-44c8-89c5-7683c97ae802 req-006d5bd0-19ce-4fc1-a3e7-14c9f5fca57c service nova] [instance: 739645e6-9952-40db-a876-f23d02d4e411] No waiting events found dispatching network-vif-unplugged-a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:27:30 user nova-compute[95467]: WARNING nova.compute.manager [req-25ee64bc-92d9-44c8-89c5-7683c97ae802 req-006d5bd0-19ce-4fc1-a3e7-14c9f5fca57c service nova] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Received unexpected event network-vif-unplugged-a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae for instance with vm_state rescued and task_state unrescuing.
Nov 15 08:27:30 user nova-compute[95467]: DEBUG nova.compute.manager [req-25ee64bc-92d9-44c8-89c5-7683c97ae802 req-006d5bd0-19ce-4fc1-a3e7-14c9f5fca57c service nova] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Received event network-vif-plugged-a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:27:30 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-25ee64bc-92d9-44c8-89c5-7683c97ae802 req-006d5bd0-19ce-4fc1-a3e7-14c9f5fca57c service nova] Acquiring lock "739645e6-9952-40db-a876-f23d02d4e411-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:27:30 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-25ee64bc-92d9-44c8-89c5-7683c97ae802 req-006d5bd0-19ce-4fc1-a3e7-14c9f5fca57c service nova] Lock "739645e6-9952-40db-a876-f23d02d4e411-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:27:30 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-25ee64bc-92d9-44c8-89c5-7683c97ae802 req-006d5bd0-19ce-4fc1-a3e7-14c9f5fca57c service nova] Lock "739645e6-9952-40db-a876-f23d02d4e411-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:27:30 user nova-compute[95467]: DEBUG nova.compute.manager [req-25ee64bc-92d9-44c8-89c5-7683c97ae802 req-006d5bd0-19ce-4fc1-a3e7-14c9f5fca57c service nova] [instance: 739645e6-9952-40db-a876-f23d02d4e411] No waiting events found dispatching network-vif-plugged-a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:27:30 user nova-compute[95467]: WARNING nova.compute.manager [req-25ee64bc-92d9-44c8-89c5-7683c97ae802 req-006d5bd0-19ce-4fc1-a3e7-14c9f5fca57c service nova] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Received unexpected event network-vif-plugged-a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae for instance with vm_state rescued and task_state unrescuing.
Nov 15 08:27:31 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:31 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:31 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:31 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:31 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:31 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:31 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:31 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:31 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:31 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:31 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-c2480a53-3687-4096-a6cb-4ef2b20ed8eb tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Acquiring lock "7f14502f-8c4d-400a-a68a-f3f9c3d48524" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:27:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-c2480a53-3687-4096-a6cb-4ef2b20ed8eb tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Lock "7f14502f-8c4d-400a-a68a-f3f9c3d48524" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:27:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-c2480a53-3687-4096-a6cb-4ef2b20ed8eb tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Acquiring lock "7f14502f-8c4d-400a-a68a-f3f9c3d48524-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:27:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-c2480a53-3687-4096-a6cb-4ef2b20ed8eb tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Lock "7f14502f-8c4d-400a-a68a-f3f9c3d48524-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:27:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-c2480a53-3687-4096-a6cb-4ef2b20ed8eb tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Lock "7f14502f-8c4d-400a-a68a-f3f9c3d48524-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:27:32 user nova-compute[95467]: INFO nova.compute.manager [None req-c2480a53-3687-4096-a6cb-4ef2b20ed8eb tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] Terminating instance
Nov 15 08:27:32 user nova-compute[95467]: DEBUG nova.compute.manager [None req-c2480a53-3687-4096-a6cb-4ef2b20ed8eb tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] Start destroying the instance on the hypervisor. {{(pid=95467) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 08:27:32 user nova-compute[95467]: DEBUG nova.compute.manager [req-d3f98eb2-c42d-4be3-ad26-8e8a84fe6fbe req-12cce05a-70d5-4a7c-afac-f4ee2afdccc6 service nova] [instance: 4ab4ef11-de3f-44a9-9242-916753481479] Received event network-vif-plugged-fa02d839-91a1-4f1f-a8f1-046aa61a7f70 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:27:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-d3f98eb2-c42d-4be3-ad26-8e8a84fe6fbe req-12cce05a-70d5-4a7c-afac-f4ee2afdccc6 service nova] Acquiring lock "4ab4ef11-de3f-44a9-9242-916753481479-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:27:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-d3f98eb2-c42d-4be3-ad26-8e8a84fe6fbe req-12cce05a-70d5-4a7c-afac-f4ee2afdccc6 service nova] Lock "4ab4ef11-de3f-44a9-9242-916753481479-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:27:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-d3f98eb2-c42d-4be3-ad26-8e8a84fe6fbe req-12cce05a-70d5-4a7c-afac-f4ee2afdccc6 service nova] Lock "4ab4ef11-de3f-44a9-9242-916753481479-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:27:32 user nova-compute[95467]: DEBUG nova.compute.manager [req-d3f98eb2-c42d-4be3-ad26-8e8a84fe6fbe req-12cce05a-70d5-4a7c-afac-f4ee2afdccc6 service nova] [instance: 4ab4ef11-de3f-44a9-9242-916753481479] No waiting events found dispatching network-vif-plugged-fa02d839-91a1-4f1f-a8f1-046aa61a7f70 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:27:32 user nova-compute[95467]: WARNING nova.compute.manager [req-d3f98eb2-c42d-4be3-ad26-8e8a84fe6fbe req-12cce05a-70d5-4a7c-afac-f4ee2afdccc6 service nova] [instance: 4ab4ef11-de3f-44a9-9242-916753481479] Received unexpected event network-vif-plugged-fa02d839-91a1-4f1f-a8f1-046aa61a7f70 for instance with vm_state building and task_state spawning.
Nov 15 08:27:32 user nova-compute[95467]: DEBUG nova.compute.manager [req-d3f98eb2-c42d-4be3-ad26-8e8a84fe6fbe req-12cce05a-70d5-4a7c-afac-f4ee2afdccc6 service nova] [instance: 4ab4ef11-de3f-44a9-9242-916753481479] Received event network-vif-plugged-fa02d839-91a1-4f1f-a8f1-046aa61a7f70 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:27:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-d3f98eb2-c42d-4be3-ad26-8e8a84fe6fbe req-12cce05a-70d5-4a7c-afac-f4ee2afdccc6 service nova] Acquiring lock "4ab4ef11-de3f-44a9-9242-916753481479-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:27:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-d3f98eb2-c42d-4be3-ad26-8e8a84fe6fbe req-12cce05a-70d5-4a7c-afac-f4ee2afdccc6 service nova] Lock "4ab4ef11-de3f-44a9-9242-916753481479-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:27:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-d3f98eb2-c42d-4be3-ad26-8e8a84fe6fbe req-12cce05a-70d5-4a7c-afac-f4ee2afdccc6 service nova] Lock "4ab4ef11-de3f-44a9-9242-916753481479-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:27:32 user nova-compute[95467]: DEBUG nova.compute.manager [req-d3f98eb2-c42d-4be3-ad26-8e8a84fe6fbe req-12cce05a-70d5-4a7c-afac-f4ee2afdccc6 service nova] [instance: 4ab4ef11-de3f-44a9-9242-916753481479] No waiting events found dispatching network-vif-plugged-fa02d839-91a1-4f1f-a8f1-046aa61a7f70 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:27:32 user nova-compute[95467]: WARNING nova.compute.manager [req-d3f98eb2-c42d-4be3-ad26-8e8a84fe6fbe req-12cce05a-70d5-4a7c-afac-f4ee2afdccc6 service nova] [instance: 4ab4ef11-de3f-44a9-9242-916753481479] Received unexpected event network-vif-plugged-fa02d839-91a1-4f1f-a8f1-046aa61a7f70 for instance with vm_state building and task_state spawning.
Nov 15 08:27:32 user nova-compute[95467]: DEBUG nova.compute.manager [req-d3f98eb2-c42d-4be3-ad26-8e8a84fe6fbe req-12cce05a-70d5-4a7c-afac-f4ee2afdccc6 service nova] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Received event network-vif-plugged-a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:27:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-d3f98eb2-c42d-4be3-ad26-8e8a84fe6fbe req-12cce05a-70d5-4a7c-afac-f4ee2afdccc6 service nova] Acquiring lock "739645e6-9952-40db-a876-f23d02d4e411-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:27:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-d3f98eb2-c42d-4be3-ad26-8e8a84fe6fbe req-12cce05a-70d5-4a7c-afac-f4ee2afdccc6 service nova] Lock "739645e6-9952-40db-a876-f23d02d4e411-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:27:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-d3f98eb2-c42d-4be3-ad26-8e8a84fe6fbe req-12cce05a-70d5-4a7c-afac-f4ee2afdccc6 service nova] Lock "739645e6-9952-40db-a876-f23d02d4e411-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:27:32 user nova-compute[95467]: DEBUG nova.compute.manager [req-d3f98eb2-c42d-4be3-ad26-8e8a84fe6fbe req-12cce05a-70d5-4a7c-afac-f4ee2afdccc6 service nova] [instance: 739645e6-9952-40db-a876-f23d02d4e411] No waiting events found dispatching network-vif-plugged-a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:27:32 user nova-compute[95467]: WARNING nova.compute.manager [req-d3f98eb2-c42d-4be3-ad26-8e8a84fe6fbe req-12cce05a-70d5-4a7c-afac-f4ee2afdccc6 service nova] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Received unexpected event network-vif-plugged-a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae for instance with vm_state rescued and task_state unrescuing.
Nov 15 08:27:32 user nova-compute[95467]: DEBUG nova.compute.manager [req-d3f98eb2-c42d-4be3-ad26-8e8a84fe6fbe req-12cce05a-70d5-4a7c-afac-f4ee2afdccc6 service nova] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Received event network-vif-plugged-a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:27:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-d3f98eb2-c42d-4be3-ad26-8e8a84fe6fbe req-12cce05a-70d5-4a7c-afac-f4ee2afdccc6 service nova] Acquiring lock "739645e6-9952-40db-a876-f23d02d4e411-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:27:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-d3f98eb2-c42d-4be3-ad26-8e8a84fe6fbe req-12cce05a-70d5-4a7c-afac-f4ee2afdccc6 service nova] Lock "739645e6-9952-40db-a876-f23d02d4e411-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:27:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-d3f98eb2-c42d-4be3-ad26-8e8a84fe6fbe req-12cce05a-70d5-4a7c-afac-f4ee2afdccc6 service nova] Lock "739645e6-9952-40db-a876-f23d02d4e411-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:27:32 user nova-compute[95467]: DEBUG nova.compute.manager [req-d3f98eb2-c42d-4be3-ad26-8e8a84fe6fbe req-12cce05a-70d5-4a7c-afac-f4ee2afdccc6 service nova] [instance: 739645e6-9952-40db-a876-f23d02d4e411] No waiting events found dispatching network-vif-plugged-a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:27:32 user nova-compute[95467]: WARNING nova.compute.manager [req-d3f98eb2-c42d-4be3-ad26-8e8a84fe6fbe req-12cce05a-70d5-4a7c-afac-f4ee2afdccc6 service nova] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Received unexpected event network-vif-plugged-a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae for instance with vm_state rescued and task_state unrescuing.
Nov 15 08:27:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:32 user nova-compute[95467]: DEBUG nova.network.neutron [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Port 62cba8e1-074b-41db-bb58-3363138fb060 binding to destination host user is already ACTIVE {{(pid=95467) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 15 08:27:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Acquiring lock "refresh_cache-d22eb02b-7e8d-4755-9f1e-3eee56ddec0c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:27:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Acquired lock "refresh_cache-d22eb02b-7e8d-4755-9f1e-3eee56ddec0c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:27:32 user nova-compute[95467]: DEBUG nova.network.neutron [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:27:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:33 user nova-compute[95467]: DEBUG nova.network.neutron [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Updating instance_info_cache with network_info: [{"id": "62cba8e1-074b-41db-bb58-3363138fb060", "address": "fa:16:3e:e4:27:f3", "network": {"id": "439fd8f9-3cf0-449d-b7e1-eba4d33109f9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-399225774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7f46c4dc5bf438cad677a366bdd5b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62cba8e1-07", "ovs_interfaceid": "62cba8e1-074b-41db-bb58-3363138fb060", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:27:33 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Releasing lock "refresh_cache-d22eb02b-7e8d-4755-9f1e-3eee56ddec0c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:27:33 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Creating tmpfile /opt/stack/data/nova/instances/d22eb02b-7e8d-4755-9f1e-3eee56ddec0c/tmpwg7a9bks to verify with other compute node that the instance is on the same shared storage. {{(pid=95467) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 15 08:27:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:33 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] Instance destroyed successfully.
Nov 15 08:27:33 user nova-compute[95467]: DEBUG nova.objects.instance [None req-c2480a53-3687-4096-a6cb-4ef2b20ed8eb tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Lazy-loading 'resources' on Instance uuid 7f14502f-8c4d-400a-a68a-f3f9c3d48524 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:27:33 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-c2480a53-3687-4096-a6cb-4ef2b20ed8eb tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:24:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1991254971',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1991254971',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1991254',id=42,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPuyFm/Z/l5Dl1Y+kjqAOyOdq7eUXt4Ptl0Kmd9IRqD1zfmeUUxxJ0Imi+2wOi0McSTJp1hwsW+TWB+Jbv3nU4aeo6sRGk3uWM/Kuh24A+hDqZn9thb9s0Ha0xm5oDvwpw==',key_name='tempest-keypair-1007709814',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:24:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='544d63a64ba74f95b1eea2ea7f1241a0',ramdisk_id='',reservation_id='r-s4vfc2dl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-383911196',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:24:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19ea481e3ed04dada51185d22951cb93',uuid=7f14502f-8c4d-400a-a68a-f3f9c3d48524,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "28b18ef7-c90a-4036-be3b-46cb5a2793f5", "address": "fa:16:3e:0b:69:75", "network": {"id": "304f39cf-cfb1-462f-8f2e-2ee6fd1fd47b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-226476785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "544d63a64ba74f95b1eea2ea7f1241a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28b18ef7-c9", "ovs_interfaceid": "28b18ef7-c90a-4036-be3b-46cb5a2793f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:27:33 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-c2480a53-3687-4096-a6cb-4ef2b20ed8eb tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Converting VIF {"id": "28b18ef7-c90a-4036-be3b-46cb5a2793f5", "address": "fa:16:3e:0b:69:75", "network": {"id": "304f39cf-cfb1-462f-8f2e-2ee6fd1fd47b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-226476785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "544d63a64ba74f95b1eea2ea7f1241a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28b18ef7-c9", "ovs_interfaceid": "28b18ef7-c90a-4036-be3b-46cb5a2793f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:27:33 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-c2480a53-3687-4096-a6cb-4ef2b20ed8eb tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0b:69:75,bridge_name='br-int',has_traffic_filtering=True,id=28b18ef7-c90a-4036-be3b-46cb5a2793f5,network=Network(304f39cf-cfb1-462f-8f2e-2ee6fd1fd47b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28b18ef7-c9') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:27:33 user nova-compute[95467]: DEBUG os_vif [None req-c2480a53-3687-4096-a6cb-4ef2b20ed8eb tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:69:75,bridge_name='br-int',has_traffic_filtering=True,id=28b18ef7-c90a-4036-be3b-46cb5a2793f5,network=Network(304f39cf-cfb1-462f-8f2e-2ee6fd1fd47b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28b18ef7-c9') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:27:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap28b18ef7-c9, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:27:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:27:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a9c6ac81-b6c6-44fc-a889-066d4d4da1ea) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:27:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:27:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:33 user nova-compute[95467]: INFO os_vif [None req-c2480a53-3687-4096-a6cb-4ef2b20ed8eb tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:69:75,bridge_name='br-int',has_traffic_filtering=True,id=28b18ef7-c90a-4036-be3b-46cb5a2793f5,network=Network(304f39cf-cfb1-462f-8f2e-2ee6fd1fd47b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28b18ef7-c9')
Nov 15 08:27:33 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-c2480a53-3687-4096-a6cb-4ef2b20ed8eb tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] Deleting instance files /opt/stack/data/nova/instances/7f14502f-8c4d-400a-a68a-f3f9c3d48524_del
Nov 15 08:27:33 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-c2480a53-3687-4096-a6cb-4ef2b20ed8eb tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] Deletion of /opt/stack/data/nova/instances/7f14502f-8c4d-400a-a68a-f3f9c3d48524_del complete
Nov 15 08:27:33 user nova-compute[95467]: DEBUG nova.compute.manager [req-db96857a-1525-4f73-af34-b5df4317703e req-b4202000-b1d5-4fe6-b24d-ebbae20a2587 service nova] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Received event network-vif-unplugged-62cba8e1-074b-41db-bb58-3363138fb060 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:27:33 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-db96857a-1525-4f73-af34-b5df4317703e req-b4202000-b1d5-4fe6-b24d-ebbae20a2587 service nova] Acquiring lock "d22eb02b-7e8d-4755-9f1e-3eee56ddec0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:27:33 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-db96857a-1525-4f73-af34-b5df4317703e req-b4202000-b1d5-4fe6-b24d-ebbae20a2587 service nova] Lock "d22eb02b-7e8d-4755-9f1e-3eee56ddec0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:27:33 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-db96857a-1525-4f73-af34-b5df4317703e req-b4202000-b1d5-4fe6-b24d-ebbae20a2587 service nova] Lock "d22eb02b-7e8d-4755-9f1e-3eee56ddec0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:27:33 user nova-compute[95467]: DEBUG nova.compute.manager [req-db96857a-1525-4f73-af34-b5df4317703e req-b4202000-b1d5-4fe6-b24d-ebbae20a2587 service nova] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] No waiting events found dispatching network-vif-unplugged-62cba8e1-074b-41db-bb58-3363138fb060 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:27:33 user nova-compute[95467]: WARNING nova.compute.manager [req-db96857a-1525-4f73-af34-b5df4317703e req-b4202000-b1d5-4fe6-b24d-ebbae20a2587 service nova] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Received unexpected event network-vif-unplugged-62cba8e1-074b-41db-bb58-3363138fb060 for instance with vm_state resized and task_state resize_reverting.
Nov 15 08:27:33 user nova-compute[95467]: INFO nova.compute.manager [None req-c2480a53-3687-4096-a6cb-4ef2b20ed8eb tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 15 08:27:33 user nova-compute[95467]: DEBUG oslo.service.loopingcall [None req-c2480a53-3687-4096-a6cb-4ef2b20ed8eb tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=95467) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 08:27:33 user nova-compute[95467]: DEBUG nova.compute.manager [-] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] Deallocating network for instance {{(pid=95467) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 08:27:33 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] deallocate_for_instance() {{(pid=95467) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 08:27:33 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Instance destroyed successfully.
Nov 15 08:27:33 user nova-compute[95467]: DEBUG nova.objects.instance [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Lazy-loading 'resources' on Instance uuid d22eb02b-7e8d-4755-9f1e-3eee56ddec0c {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:27:33 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:21:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-748321325',display_name='tempest-ServerActionsTestOtherB-server-748321325',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-748321325',id=37,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4fkN7k+peQ5MHRVAmSWsJ4XWACmBTaERqxpnxcsdjwMrROQbOXtjSL/x5jDo9fewvV0xuNQFNzIDf7IiXE/hxIrMO+qPlCpDl2ne6370CaB1c+V4MsUeGSWpmCOrmyfA==',key_name='tempest-keypair-1354708686',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:25:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b7f46c4dc5bf438cad677a366bdd5b5f',ramdisk_id='',reservation_id='r-1rd2gc25',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-220421987',owner_user_name='tempest-ServerActionsTestOtherB-220421987-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:26:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53a0c2be5d1f4831961aa1cc29c4d46f',uuid=d22eb02b-7e8d-4755-9f1e-3eee56ddec0c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "62cba8e1-074b-41db-bb58-3363138fb060", "address": "fa:16:3e:e4:27:f3", "network": {"id": "439fd8f9-3cf0-449d-b7e1-eba4d33109f9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-399225774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7f46c4dc5bf438cad677a366bdd5b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62cba8e1-07", "ovs_interfaceid": "62cba8e1-074b-41db-bb58-3363138fb060", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:27:33 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Converting VIF {"id": "62cba8e1-074b-41db-bb58-3363138fb060", "address": "fa:16:3e:e4:27:f3", "network": {"id": "439fd8f9-3cf0-449d-b7e1-eba4d33109f9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-399225774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7f46c4dc5bf438cad677a366bdd5b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62cba8e1-07", "ovs_interfaceid": "62cba8e1-074b-41db-bb58-3363138fb060", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:27:33 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:27:f3,bridge_name='br-int',has_traffic_filtering=True,id=62cba8e1-074b-41db-bb58-3363138fb060,network=Network(439fd8f9-3cf0-449d-b7e1-eba4d33109f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62cba8e1-07') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:27:33 user nova-compute[95467]: DEBUG os_vif [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:27:f3,bridge_name='br-int',has_traffic_filtering=True,id=62cba8e1-074b-41db-bb58-3363138fb060,network=Network(439fd8f9-3cf0-449d-b7e1-eba4d33109f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62cba8e1-07') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:27:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap62cba8e1-07, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:27:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:27:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=af4949b8-58b8-43ee-8fcb-11313cd095dc) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:27:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:27:33 user nova-compute[95467]: INFO os_vif [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:27:f3,bridge_name='br-int',has_traffic_filtering=True,id=62cba8e1-074b-41db-bb58-3363138fb060,network=Network(439fd8f9-3cf0-449d-b7e1-eba4d33109f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62cba8e1-07')
Nov 15 08:27:33 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] calling os-brick to detach iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 08:27:33 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, {'target_iqn': 'iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kVIbNLMg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:27:33 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:27:33 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:27:33 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:27:33 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:33 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:33 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3d2859-b4f3-4437-b9f3-defb114d1f92]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2dbf6208-1a82-45a0-a862-3296f3c690e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:27:33 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 08:27:33 user nova-compute[95467]: No targets found.
Nov 15 08:27:33 user nova-compute[95467]: iSNS:
Nov 15 08:27:33 user nova-compute[95467]: No targets found.
Nov 15 08:27:33 user nova-compute[95467]: STATIC:
Nov 15 08:27:33 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24
Nov 15 08:27:33 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:27:33 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:27:33 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b
Nov 15 08:27:33 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:27:33 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:27:33 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0
Nov 15 08:27:33 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:27:33 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:27:33 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e
Nov 15 08:27:33 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:27:33 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:27:33 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373
Nov 15 08:27:33 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:27:33 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:27:33 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400
Nov 15 08:27:33 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:27:33 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:27:33 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:2dbf6208-1a82-45a0-a862-3296f3c690e4
Nov 15 08:27:33 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:27:33 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:27:33 user nova-compute[95467]: FIRMWARE:
Nov 15 08:27:33 user nova-compute[95467]: No targets found.
Nov 15 08:27:33 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:27:33 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 08:27:33 user nova-compute[95467]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 08:27:33 user nova-compute[95467]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=95467) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 08:27:33 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0', 0)] {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 08:27:33 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:33 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:33 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[338d079b-f263-4cb1-895e-d261cdc6d760]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2dbf6208-1a82-45a0-a862-3296f3c690e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:27:33 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:33 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:33 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a176610d-93a9-4d7b-af88-8e872bf7a17a]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dbf6208-1a82-45a0-a862-3296f3c690e4 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:27:33 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:27:33 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:27:33 user nova-compute[95467]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)
Nov 15 08:27:33 user nova-compute[95467]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:27:33 user nova-compute[95467]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 (non-flash)
Nov 15 08:27:33 user nova-compute[95467]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 (non-flash)
Nov 15 08:27:33 user nova-compute[95467]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dbf6208-1a82-45a0-a862-3296f3c690e4 (non-flash)
Nov 15 08:27:33 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:27:33 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:27:33 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:27:33 user nova-compute[95467]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)
Nov 15 08:27:33 user nova-compute[95467]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:27:33 user nova-compute[95467]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 (non-flash)
Nov 15 08:27:33 user nova-compute[95467]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 (non-flash)
Nov 15 08:27:33 user nova-compute[95467]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dbf6208-1a82-45a0-a862-3296f3c690e4 (non-flash)
Nov 15 08:27:33 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:27:33 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efec82d8940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0'): ({'sdf'}, set())}) {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 08:27:33 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Removing single pathed devices sdf {{(pid=95467) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 08:27:34 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:34 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:34 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[285447d7-9920-4aee-ab6b-7a90c4d265c2]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:27:34 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:34 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:34 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8b8402-31af-4a12-8ca8-e304b3b61cca]: (4, ('ok\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:27:34 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Flushing IO for device /dev/sdf {{(pid=95467) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 08:27:34 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:34 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:34 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f179f8e9-a427-4542-8aed-bc82c90d0851]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:27:34 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=95467) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 08:27:34 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:34 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:34 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7cb21cb-0208-4506-a245-6f6fc996c29a]: (4, ('1', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:27:34 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 08:27:34 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] SCSI volumes sdf have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 08:27:34 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0')] {{(pid=95467) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 08:27:34 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:34 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:34 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a772b22-ceb8-4e06-8a52-ea64d8f25997]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:27:34 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:27:34 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 -p 172.16.0.220:3260 --logout {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:34 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:34 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb4d461-7568-4820-9b16-c1ada18191f0]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:27:34 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0, portal: 172.16.0.220,3260]
Nov 15 08:27:34 user nova-compute[95467]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0, portal: 172.16.0.220,3260] successful.
Nov 15 08:27:34 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:27:34 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 -p 172.16.0.220:3260 --op delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:34 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.061s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:34 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed7a307-3b99-4a7e-abe1-1f19f001d32c]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:27:34 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:27:34 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.392s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:27:34 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] <== disconnect_volume: return (394ms) None {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:27:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Disconnected iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 08:27:34 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:27:34 user nova-compute[95467]: DEBUG nova.compute.manager [req-72bd11f4-b8e5-442c-a6bc-0cc4e7ec9450 req-95044bec-16e5-4d4d-831a-2a0ea2213a46 service nova] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] Received event network-vif-deleted-28b18ef7-c90a-4036-be3b-46cb5a2793f5 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:27:34 user nova-compute[95467]: INFO nova.compute.manager [req-72bd11f4-b8e5-442c-a6bc-0cc4e7ec9450 req-95044bec-16e5-4d4d-831a-2a0ea2213a46 service nova] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] Neutron deleted interface 28b18ef7-c90a-4036-be3b-46cb5a2793f5; detaching it from the instance and deleting it from the info cache
Nov 15 08:27:34 user nova-compute[95467]: DEBUG nova.network.neutron [req-72bd11f4-b8e5-442c-a6bc-0cc4e7ec9450 req-95044bec-16e5-4d4d-831a-2a0ea2213a46 service nova] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:27:34 user nova-compute[95467]: INFO nova.compute.manager [-] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] Took 0.87 seconds to deallocate network for instance.
Nov 15 08:27:34 user nova-compute[95467]: DEBUG nova.compute.manager [req-72bd11f4-b8e5-442c-a6bc-0cc4e7ec9450 req-95044bec-16e5-4d4d-831a-2a0ea2213a46 service nova] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] Detach interface failed, port_id=28b18ef7-c90a-4036-be3b-46cb5a2793f5, reason: Instance 7f14502f-8c4d-400a-a68a-f3f9c3d48524 could not be found. {{(pid=95467) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 08:27:34 user nova-compute[95467]: DEBUG nova.compute.manager [None req-08d33fdb-1b0d-4e45-aa56-822c6eeffc4f tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:27:34 user nova-compute[95467]: DEBUG nova.compute.manager [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 4ab4ef11-de3f-44a9-9242-916753481479] Instance event wait completed in 0 seconds for  {{(pid=95467) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 08:27:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 4ab4ef11-de3f-44a9-9242-916753481479] Guest created on hypervisor {{(pid=95467) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 08:27:34 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 4ab4ef11-de3f-44a9-9242-916753481479] Instance spawned successfully.
Nov 15 08:27:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 4ab4ef11-de3f-44a9-9242-916753481479] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 08:27:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-c2480a53-3687-4096-a6cb-4ef2b20ed8eb tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:27:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-c2480a53-3687-4096-a6cb-4ef2b20ed8eb tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:27:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 4ab4ef11-de3f-44a9-9242-916753481479] Found default for hw_cdrom_bus of ide {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:27:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 4ab4ef11-de3f-44a9-9242-916753481479] Found default for hw_disk_bus of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:27:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 4ab4ef11-de3f-44a9-9242-916753481479] Found default for hw_input_bus of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:27:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 4ab4ef11-de3f-44a9-9242-916753481479] Found default for hw_pointer_model of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:27:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 4ab4ef11-de3f-44a9-9242-916753481479] Found default for hw_video_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:27:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 4ab4ef11-de3f-44a9-9242-916753481479] Found default for hw_vif_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:27:34 user nova-compute[95467]: INFO nova.compute.manager [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 4ab4ef11-de3f-44a9-9242-916753481479] Took 7.67 seconds to spawn the instance on the hypervisor.
Nov 15 08:27:34 user nova-compute[95467]: DEBUG nova.compute.manager [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 4ab4ef11-de3f-44a9-9242-916753481479] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:27:34 user nova-compute[95467]: DEBUG nova.compute.manager [req-30c4ec5f-f3f7-487e-943b-be90e87bc0d2 req-da49e572-0d25-4fe0-9c88-110ff3fb9ea2 service nova] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] Received event network-vif-unplugged-28b18ef7-c90a-4036-be3b-46cb5a2793f5 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:27:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-30c4ec5f-f3f7-487e-943b-be90e87bc0d2 req-da49e572-0d25-4fe0-9c88-110ff3fb9ea2 service nova] Acquiring lock "7f14502f-8c4d-400a-a68a-f3f9c3d48524-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:27:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-30c4ec5f-f3f7-487e-943b-be90e87bc0d2 req-da49e572-0d25-4fe0-9c88-110ff3fb9ea2 service nova] Lock "7f14502f-8c4d-400a-a68a-f3f9c3d48524-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:27:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-30c4ec5f-f3f7-487e-943b-be90e87bc0d2 req-da49e572-0d25-4fe0-9c88-110ff3fb9ea2 service nova] Lock "7f14502f-8c4d-400a-a68a-f3f9c3d48524-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:27:34 user nova-compute[95467]: DEBUG nova.compute.manager [req-30c4ec5f-f3f7-487e-943b-be90e87bc0d2 req-da49e572-0d25-4fe0-9c88-110ff3fb9ea2 service nova] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] No waiting events found dispatching network-vif-unplugged-28b18ef7-c90a-4036-be3b-46cb5a2793f5 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:27:34 user nova-compute[95467]: WARNING nova.compute.manager [req-30c4ec5f-f3f7-487e-943b-be90e87bc0d2 req-da49e572-0d25-4fe0-9c88-110ff3fb9ea2 service nova] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] Received unexpected event network-vif-unplugged-28b18ef7-c90a-4036-be3b-46cb5a2793f5 for instance with vm_state deleted and task_state None.
Nov 15 08:27:34 user nova-compute[95467]: DEBUG nova.compute.manager [req-30c4ec5f-f3f7-487e-943b-be90e87bc0d2 req-da49e572-0d25-4fe0-9c88-110ff3fb9ea2 service nova] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] Received event network-vif-plugged-28b18ef7-c90a-4036-be3b-46cb5a2793f5 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:27:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-30c4ec5f-f3f7-487e-943b-be90e87bc0d2 req-da49e572-0d25-4fe0-9c88-110ff3fb9ea2 service nova] Acquiring lock "7f14502f-8c4d-400a-a68a-f3f9c3d48524-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:27:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-30c4ec5f-f3f7-487e-943b-be90e87bc0d2 req-da49e572-0d25-4fe0-9c88-110ff3fb9ea2 service nova] Lock "7f14502f-8c4d-400a-a68a-f3f9c3d48524-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:27:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-30c4ec5f-f3f7-487e-943b-be90e87bc0d2 req-da49e572-0d25-4fe0-9c88-110ff3fb9ea2 service nova] Lock "7f14502f-8c4d-400a-a68a-f3f9c3d48524-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:27:34 user nova-compute[95467]: DEBUG nova.compute.manager [req-30c4ec5f-f3f7-487e-943b-be90e87bc0d2 req-da49e572-0d25-4fe0-9c88-110ff3fb9ea2 service nova] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] No waiting events found dispatching network-vif-plugged-28b18ef7-c90a-4036-be3b-46cb5a2793f5 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:27:34 user nova-compute[95467]: WARNING nova.compute.manager [req-30c4ec5f-f3f7-487e-943b-be90e87bc0d2 req-da49e572-0d25-4fe0-9c88-110ff3fb9ea2 service nova] [instance: 7f14502f-8c4d-400a-a68a-f3f9c3d48524] Received unexpected event network-vif-plugged-28b18ef7-c90a-4036-be3b-46cb5a2793f5 for instance with vm_state deleted and task_state None.
Nov 15 08:27:34 user nova-compute[95467]: INFO nova.compute.manager [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 4ab4ef11-de3f-44a9-9242-916753481479] Took 8.86 seconds to build instance.
Nov 15 08:27:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-7087aa56-85a0-4876-9e29-d7e8d91d6cd9 tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Lock "4ab4ef11-de3f-44a9-9242-916753481479" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.955s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:27:34 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-c2480a53-3687-4096-a6cb-4ef2b20ed8eb tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:27:34 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-c2480a53-3687-4096-a6cb-4ef2b20ed8eb tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:27:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-c2480a53-3687-4096-a6cb-4ef2b20ed8eb tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.518s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:27:34 user nova-compute[95467]: INFO nova.scheduler.client.report [None req-c2480a53-3687-4096-a6cb-4ef2b20ed8eb tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Deleted allocations for instance 7f14502f-8c4d-400a-a68a-f3f9c3d48524
Nov 15 08:27:35 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-c2480a53-3687-4096-a6cb-4ef2b20ed8eb tempest-TestServerVolumeAttachScenarioOldVersion-383911196 tempest-TestServerVolumeAttachScenarioOldVersion-383911196-project-member] Lock "7f14502f-8c4d-400a-a68a-f3f9c3d48524" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.531s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:27:35 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:27:35 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:27:35 user nova-compute[95467]: DEBUG nova.objects.instance [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Lazy-loading 'migration_context' on Instance uuid d22eb02b-7e8d-4755-9f1e-3eee56ddec0c {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:27:35 user nova-compute[95467]: DEBUG nova.objects.base [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Object Instance<d22eb02b-7e8d-4755-9f1e-3eee56ddec0c> lazy-loaded attributes: resources,migration_context {{(pid=95467) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 08:27:35 user nova-compute[95467]: DEBUG nova.compute.manager [req-539b3261-46d9-43b2-950f-c64e822bd8a3 req-ab1096d5-c294-4712-926b-e813f2bd69c0 service nova] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Received event network-vif-plugged-62cba8e1-074b-41db-bb58-3363138fb060 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:27:35 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-539b3261-46d9-43b2-950f-c64e822bd8a3 req-ab1096d5-c294-4712-926b-e813f2bd69c0 service nova] Acquiring lock "d22eb02b-7e8d-4755-9f1e-3eee56ddec0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:27:35 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-539b3261-46d9-43b2-950f-c64e822bd8a3 req-ab1096d5-c294-4712-926b-e813f2bd69c0 service nova] Lock "d22eb02b-7e8d-4755-9f1e-3eee56ddec0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:27:35 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-539b3261-46d9-43b2-950f-c64e822bd8a3 req-ab1096d5-c294-4712-926b-e813f2bd69c0 service nova] Lock "d22eb02b-7e8d-4755-9f1e-3eee56ddec0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:27:35 user nova-compute[95467]: DEBUG nova.compute.manager [req-539b3261-46d9-43b2-950f-c64e822bd8a3 req-ab1096d5-c294-4712-926b-e813f2bd69c0 service nova] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] No waiting events found dispatching network-vif-plugged-62cba8e1-074b-41db-bb58-3363138fb060 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:27:35 user nova-compute[95467]: WARNING nova.compute.manager [req-539b3261-46d9-43b2-950f-c64e822bd8a3 req-ab1096d5-c294-4712-926b-e813f2bd69c0 service nova] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Received unexpected event network-vif-plugged-62cba8e1-074b-41db-bb58-3363138fb060 for instance with vm_state resized and task_state resize_reverting.
Nov 15 08:27:35 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:27:35 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:27:35 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.525s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:27:36 user nova-compute[95467]: INFO nova.compute.manager [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Swapping old allocation on dict_keys(['f56c3524-ed11-494e-82e4-b1a23920d1ae']) held by migration 69284ce8-8fa6-4f81-b112-d885cdea390d for instance
Nov 15 08:27:36 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Overwriting current allocation {'allocations': {'f56c3524-ed11-494e-82e4-b1a23920d1ae': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 56}}, 'project_id': 'b7f46c4dc5bf438cad677a366bdd5b5f', 'user_id': '53a0c2be5d1f4831961aa1cc29c4d46f', 'consumer_generation': 1} on consumer d22eb02b-7e8d-4755-9f1e-3eee56ddec0c {{(pid=95467) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 15 08:27:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Acquiring lock "refresh_cache-d22eb02b-7e8d-4755-9f1e-3eee56ddec0c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:27:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Acquired lock "refresh_cache-d22eb02b-7e8d-4755-9f1e-3eee56ddec0c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:27:36 user nova-compute[95467]: DEBUG nova.network.neutron [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:27:36 user nova-compute[95467]: DEBUG nova.network.neutron [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Updating instance_info_cache with network_info: [{"id": "62cba8e1-074b-41db-bb58-3363138fb060", "address": "fa:16:3e:e4:27:f3", "network": {"id": "439fd8f9-3cf0-449d-b7e1-eba4d33109f9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-399225774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7f46c4dc5bf438cad677a366bdd5b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62cba8e1-07", "ovs_interfaceid": "62cba8e1-074b-41db-bb58-3363138fb060", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:27:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Releasing lock "refresh_cache-d22eb02b-7e8d-4755-9f1e-3eee56ddec0c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:27:36 user nova-compute[95467]: DEBUG os_brick.utils [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:27:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:36 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3428a2-4bed-444c-881a-8822d797130b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:882ae90641f\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:27:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:36 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[6312cca5-5201-4a94-a767-61a937adae79]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:27:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:36 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d87261-7e19-496a-9e83-026ff71c380d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:27:36 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e72b82-65c5-4b92-acbc-5dea57fce966]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:27:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Running cmd (subprocess): nvme version {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] 'nvme version' failed. Not Retrying. {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:27:36 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] nvme not present on system {{(pid=95467) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 08:27:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:27:36 user nova-compute[95467]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 08:27:36 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5eff9e2-b1a2-4e3b-b2d0-101592796414]: (4, '') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:27:36 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=95467) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 08:27:36 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 08:27:36 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] LIGHTOS: no hostnqn found. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 08:27:36 user nova-compute[95467]: DEBUG os_brick.utils [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:882ae90641f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:27:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:38 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:41 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Starting finish_revert_migration {{(pid=95467) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 15 08:27:41 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Start _get_guest_xml network_info=[{"id": "62cba8e1-074b-41db-bb58-3363138fb060", "address": "fa:16:3e:e4:27:f3", "network": {"id": "439fd8f9-3cf0-449d-b7e1-eba4d33109f9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-399225774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7f46c4dc5bf438cad677a366bdd5b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62cba8e1-07", "ovs_interfaceid": "62cba8e1-074b-41db-bb58-3363138fb060", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'ed9c48aa-ce73-4b3b-9db1-235898be671b'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '1d11e189-2d86-4019-afb6-162e7713ef11', 'delete_on_termination': False, 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kVIbNLMg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'd22eb02b-7e8d-4755-9f1e-3eee56ddec0c', 'attached_at': '2023-11-15T08:27:42.000000', 'detached_at': '', 'volume_id': 'c086dbf2-482f-40d5-815e-a7fff977a3a0', 'serial': 'c086dbf2-482f-40d5-815e-a7fff977a3a0'}, 'volume_type': None} {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:27:41 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:27:41 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:27:41 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:27:41 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:27:41 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:27:41 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:27:41 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:27:41 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:27:41 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:27:41 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:27:41 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:27:41 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:27:41 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:27:41 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:27:41 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:27:41 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:27:41 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:27:41 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:27:41 user nova-compute[95467]: DEBUG nova.objects.instance [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Lazy-loading 'vcpu_model' on Instance uuid d22eb02b-7e8d-4755-9f1e-3eee56ddec0c {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:27:41 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Calling os-brick to attach iSCSI Volume {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 08:27:41 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kVIbNLMg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:27:41 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:27:41 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:27:41 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:27:41 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:27:41 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:27:41 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:27:41 user nova-compute[95467]: INFO os_brick.initiator.connectors.iscsi [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 08:27:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 -p 172.16.0.220:3260 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:41 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d88f8470-2d31-4817-9c63-058e20278bfa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:27:41 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 08:27:41 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:27:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 -p 172.16.0.220:3260 --interface default --op new {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:42 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6b4c63-1f57-4a53-b774-c3c6662f7554]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0] added\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:27:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0] added
Nov 15 08:27:42 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:27:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:42 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[62cde2f0-29f4-4748-8c3c-b9eda8667dc0]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:27:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:27:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:42 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9b8a13-55ab-43c2-81e5-919bb81784d1]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:27:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:27:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kVIbNLMg {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kVIbNLMg" returned: 0 in 0.024s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:42 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc2f290-8763-43e9-828a-28a6933cc227]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:27:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kVIbNLMg'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:27:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:42 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af3b56a-0922-4fe1-a0e2-e0bc1a112b73]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:27:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:27:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:42 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[718ca7c3-c2c9-4d59-8448-aed4bee4f5b3]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dbf6208-1a82-45a0-a862-3296f3c690e4 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:27:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:27:42 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:27:42 user nova-compute[95467]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)
Nov 15 08:27:42 user nova-compute[95467]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:27:42 user nova-compute[95467]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 (non-flash)
Nov 15 08:27:42 user nova-compute[95467]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dbf6208-1a82-45a0-a862-3296f3c690e4 (non-flash)
Nov 15 08:27:42 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:27:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:27:42 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:27:42 user nova-compute[95467]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)
Nov 15 08:27:42 user nova-compute[95467]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:27:42 user nova-compute[95467]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 (non-flash)
Nov 15 08:27:42 user nova-compute[95467]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dbf6208-1a82-45a0-a862-3296f3c690e4 (non-flash)
Nov 15 08:27:42 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:27:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 -p 172.16.0.220:3260 --login {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:42 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[61615a43-35b6-4052-b86b-0ba44169a1ae]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:27:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0, portal: 172.16.0.220,3260]
Nov 15 08:27:42 user nova-compute[95467]: Login to [iface: default, target: iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0, portal: 172.16.0.220,3260] successful.
Nov 15 08:27:42 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:27:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:42 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df1e832-cec0-4de5-a472-168bc91046ec]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:27:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:27:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:42 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc3c29d-bcf9-4ffe-a799-48eca6300566]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dbf6208-1a82-45a0-a862-3296f3c690e4 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:27:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:27:42 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:27:42 user nova-compute[95467]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)
Nov 15 08:27:42 user nova-compute[95467]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:27:42 user nova-compute[95467]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 (non-flash)
Nov 15 08:27:42 user nova-compute[95467]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dbf6208-1a82-45a0-a862-3296f3c690e4 (non-flash)
Nov 15 08:27:42 user nova-compute[95467]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 (non-flash)
Nov 15 08:27:42 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:27:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:27:42 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:27:42 user nova-compute[95467]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)
Nov 15 08:27:42 user nova-compute[95467]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:27:42 user nova-compute[95467]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 (non-flash)
Nov 15 08:27:42 user nova-compute[95467]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dbf6208-1a82-45a0-a862-3296f3c690e4 (non-flash)
Nov 15 08:27:42 user nova-compute[95467]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 (non-flash)
Nov 15 08:27:42 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:27:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:27:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Connected to 172.16.0.220:3260 {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 08:27:42 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] HCTL ('37', '-', '-', 0) found on session 51 with lun 0 {{(pid=95467) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 08:27:42 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=95467) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 08:27:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:42 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f71639-bf64-4de6-a0a0-22bcddf03018]: (4, ('- - 0', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:27:42 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Searching for a device in session 51 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:27:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kVIbNLMg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 08:27:42 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:27:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '23137343362303231', 'path': '/dev/sdf'} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:27:43 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23137343362303231', 'path': '/dev/sdf'} {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 08:27:43 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:21:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-748321325',display_name='tempest-ServerActionsTestOtherB-server-748321325',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-748321325',id=37,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4fkN7k+peQ5MHRVAmSWsJ4XWACmBTaERqxpnxcsdjwMrROQbOXtjSL/x5jDo9fewvV0xuNQFNzIDf7IiXE/hxIrMO+qPlCpDl2ne6370CaB1c+V4MsUeGSWpmCOrmyfA==',key_name='tempest-keypair-1354708686',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:25:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b7f46c4dc5bf438cad677a366bdd5b5f',ramdisk_id='',reservation_id='r-1rd2gc25',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-220421987',owner_user_name='tempest-ServerActionsTestOtherB-220421987-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:27:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53a0c2be5d1f4831961aa1cc29c4d46f',uuid=d22eb02b-7e8d-4755-9f1e-3eee56ddec0c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "62cba8e1-074b-41db-bb58-3363138fb060", "address": "fa:16:3e:e4:27:f3", "network": {"id": "439fd8f9-3cf0-449d-b7e1-eba4d33109f9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-399225774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7f46c4dc5bf438cad677a366bdd5b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62cba8e1-07", "ovs_interfaceid": "62cba8e1-074b-41db-bb58-3363138fb060", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:27:43 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Converting VIF {"id": "62cba8e1-074b-41db-bb58-3363138fb060", "address": "fa:16:3e:e4:27:f3", "network": {"id": "439fd8f9-3cf0-449d-b7e1-eba4d33109f9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-399225774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7f46c4dc5bf438cad677a366bdd5b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62cba8e1-07", "ovs_interfaceid": "62cba8e1-074b-41db-bb58-3363138fb060", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:27:43 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:27:f3,bridge_name='br-int',has_traffic_filtering=True,id=62cba8e1-074b-41db-bb58-3363138fb060,network=Network(439fd8f9-3cf0-449d-b7e1-eba4d33109f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62cba8e1-07') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:27:43 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:27:43 user nova-compute[95467]:   <uuid>d22eb02b-7e8d-4755-9f1e-3eee56ddec0c</uuid>
Nov 15 08:27:43 user nova-compute[95467]:   <name>instance-00000025</name>
Nov 15 08:27:43 user nova-compute[95467]:   <memory>524288</memory>
Nov 15 08:27:43 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:27:43 user nova-compute[95467]:   <metadata>
Nov 15 08:27:43 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:27:43 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:27:43 user nova-compute[95467]:       <nova:name>tempest-ServerActionsTestOtherB-server-748321325</nova:name>
Nov 15 08:27:43 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:27:41</nova:creationTime>
Nov 15 08:27:43 user nova-compute[95467]:       <nova:flavor name="m1.tiny">
Nov 15 08:27:43 user nova-compute[95467]:         <nova:memory>512</nova:memory>
Nov 15 08:27:43 user nova-compute[95467]:         <nova:disk>1</nova:disk>
Nov 15 08:27:43 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:27:43 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:27:43 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:27:43 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:27:43 user nova-compute[95467]:       <nova:owner>
Nov 15 08:27:43 user nova-compute[95467]:         <nova:user uuid="53a0c2be5d1f4831961aa1cc29c4d46f">tempest-ServerActionsTestOtherB-220421987-project-member</nova:user>
Nov 15 08:27:43 user nova-compute[95467]:         <nova:project uuid="b7f46c4dc5bf438cad677a366bdd5b5f">tempest-ServerActionsTestOtherB-220421987</nova:project>
Nov 15 08:27:43 user nova-compute[95467]:       </nova:owner>
Nov 15 08:27:43 user nova-compute[95467]:       <nova:root type="image" uuid="ed9c48aa-ce73-4b3b-9db1-235898be671b"/>
Nov 15 08:27:43 user nova-compute[95467]:       <nova:ports>
Nov 15 08:27:43 user nova-compute[95467]:         <nova:port uuid="62cba8e1-074b-41db-bb58-3363138fb060">
Nov 15 08:27:43 user nova-compute[95467]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 15 08:27:43 user nova-compute[95467]:         </nova:port>
Nov 15 08:27:43 user nova-compute[95467]:       </nova:ports>
Nov 15 08:27:43 user nova-compute[95467]:     </nova:instance>
Nov 15 08:27:43 user nova-compute[95467]:   </metadata>
Nov 15 08:27:43 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:27:43 user nova-compute[95467]:     <system>
Nov 15 08:27:43 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:27:43 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:27:43 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:27:43 user nova-compute[95467]:       <entry name="serial">d22eb02b-7e8d-4755-9f1e-3eee56ddec0c</entry>
Nov 15 08:27:43 user nova-compute[95467]:       <entry name="uuid">d22eb02b-7e8d-4755-9f1e-3eee56ddec0c</entry>
Nov 15 08:27:43 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:27:43 user nova-compute[95467]:     </system>
Nov 15 08:27:43 user nova-compute[95467]:   </sysinfo>
Nov 15 08:27:43 user nova-compute[95467]:   <os>
Nov 15 08:27:43 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:27:43 user nova-compute[95467]:     <boot dev="hd"/>
Nov 15 08:27:43 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:27:43 user nova-compute[95467]:   </os>
Nov 15 08:27:43 user nova-compute[95467]:   <features>
Nov 15 08:27:43 user nova-compute[95467]:     <acpi/>
Nov 15 08:27:43 user nova-compute[95467]:     <apic/>
Nov 15 08:27:43 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:27:43 user nova-compute[95467]:   </features>
Nov 15 08:27:43 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:27:43 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:27:43 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:27:43 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:27:43 user nova-compute[95467]:   </clock>
Nov 15 08:27:43 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:27:43 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:27:43 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:27:43 user nova-compute[95467]:   </cpu>
Nov 15 08:27:43 user nova-compute[95467]:   <devices>
Nov 15 08:27:43 user nova-compute[95467]:     <disk type="file" device="disk">
Nov 15 08:27:43 user nova-compute[95467]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 08:27:43 user nova-compute[95467]:       <source file="/opt/stack/data/nova/instances/d22eb02b-7e8d-4755-9f1e-3eee56ddec0c/disk"/>
Nov 15 08:27:43 user nova-compute[95467]:       <target dev="vda" bus="virtio"/>
Nov 15 08:27:43 user nova-compute[95467]:     </disk>
Nov 15 08:27:43 user nova-compute[95467]:     <disk type="block" device="disk">
Nov 15 08:27:43 user nova-compute[95467]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:27:43 user nova-compute[95467]:       <source dev="/dev/sdf"/>
Nov 15 08:27:43 user nova-compute[95467]:       <target dev="vdb" bus="virtio"/>
Nov 15 08:27:43 user nova-compute[95467]:       <serial>c086dbf2-482f-40d5-815e-a7fff977a3a0</serial>
Nov 15 08:27:43 user nova-compute[95467]:     </disk>
Nov 15 08:27:43 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:27:43 user nova-compute[95467]:       <mac address="fa:16:3e:e4:27:f3"/>
Nov 15 08:27:43 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:27:43 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:27:43 user nova-compute[95467]:       <target dev="tap62cba8e1-07"/>
Nov 15 08:27:43 user nova-compute[95467]:     </interface>
Nov 15 08:27:43 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:27:43 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/d22eb02b-7e8d-4755-9f1e-3eee56ddec0c/console.log" append="off"/>
Nov 15 08:27:43 user nova-compute[95467]:     </serial>
Nov 15 08:27:43 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:27:43 user nova-compute[95467]:     <video>
Nov 15 08:27:43 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:27:43 user nova-compute[95467]:     </video>
Nov 15 08:27:43 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:27:43 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:27:43 user nova-compute[95467]:     </rng>
Nov 15 08:27:43 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:27:43 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:27:43 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:27:43 user nova-compute[95467]:     </memballoon>
Nov 15 08:27:43 user nova-compute[95467]:   </devices>
Nov 15 08:27:43 user nova-compute[95467]: </domain>
Nov 15 08:27:43 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:27:43 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:21:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-748321325',display_name='tempest-ServerActionsTestOtherB-server-748321325',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-748321325',id=37,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4fkN7k+peQ5MHRVAmSWsJ4XWACmBTaERqxpnxcsdjwMrROQbOXtjSL/x5jDo9fewvV0xuNQFNzIDf7IiXE/hxIrMO+qPlCpDl2ne6370CaB1c+V4MsUeGSWpmCOrmyfA==',key_name='tempest-keypair-1354708686',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:25:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b7f46c4dc5bf438cad677a366bdd5b5f',ramdisk_id='',reservation_id='r-1rd2gc25',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-220421987',owner_user_name='tempest-ServerActionsTestOtherB-220421987-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:27:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53a0c2be5d1f4831961aa1cc29c4d46f',uuid=d22eb02b-7e8d-4755-9f1e-3eee56ddec0c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "62cba8e1-074b-41db-bb58-3363138fb060", "address": "fa:16:3e:e4:27:f3", "network": {"id": "439fd8f9-3cf0-449d-b7e1-eba4d33109f9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-399225774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7f46c4dc5bf438cad677a366bdd5b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62cba8e1-07", "ovs_interfaceid": "62cba8e1-074b-41db-bb58-3363138fb060", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:27:43 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Converting VIF {"id": "62cba8e1-074b-41db-bb58-3363138fb060", "address": "fa:16:3e:e4:27:f3", "network": {"id": "439fd8f9-3cf0-449d-b7e1-eba4d33109f9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-399225774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7f46c4dc5bf438cad677a366bdd5b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62cba8e1-07", "ovs_interfaceid": "62cba8e1-074b-41db-bb58-3363138fb060", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:27:43 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:27:f3,bridge_name='br-int',has_traffic_filtering=True,id=62cba8e1-074b-41db-bb58-3363138fb060,network=Network(439fd8f9-3cf0-449d-b7e1-eba4d33109f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62cba8e1-07') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:27:43 user nova-compute[95467]: DEBUG os_vif [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:27:f3,bridge_name='br-int',has_traffic_filtering=True,id=62cba8e1-074b-41db-bb58-3363138fb060,network=Network(439fd8f9-3cf0-449d-b7e1-eba4d33109f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62cba8e1-07') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:27:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:27:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:27:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f5d761f3-0679-5756-b53a-16721bb0b0f8', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:27:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:27:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap62cba8e1-07, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:27:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap62cba8e1-07, col_values=(('qos', UUID('5e03fdae-523a-4f8e-8b06-c3779b31f0cc')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:27:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap62cba8e1-07, col_values=(('external_ids', {'iface-id': '62cba8e1-074b-41db-bb58-3363138fb060', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:27:f3', 'vm-uuid': 'd22eb02b-7e8d-4755-9f1e-3eee56ddec0c'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:27:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:27:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:43 user nova-compute[95467]: INFO os_vif [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:27:f3,bridge_name='br-int',has_traffic_filtering=True,id=62cba8e1-074b-41db-bb58-3363138fb060,network=Network(439fd8f9-3cf0-449d-b7e1-eba4d33109f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62cba8e1-07')
Nov 15 08:27:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:45 user nova-compute[95467]: DEBUG nova.compute.manager [req-7188b601-c1a9-4c17-b177-77cbd76a3d08 req-6549d769-a7f6-4526-a024-be1b764616db service nova] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Received event network-vif-plugged-62cba8e1-074b-41db-bb58-3363138fb060 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:27:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-7188b601-c1a9-4c17-b177-77cbd76a3d08 req-6549d769-a7f6-4526-a024-be1b764616db service nova] Acquiring lock "d22eb02b-7e8d-4755-9f1e-3eee56ddec0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:27:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-7188b601-c1a9-4c17-b177-77cbd76a3d08 req-6549d769-a7f6-4526-a024-be1b764616db service nova] Lock "d22eb02b-7e8d-4755-9f1e-3eee56ddec0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:27:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-7188b601-c1a9-4c17-b177-77cbd76a3d08 req-6549d769-a7f6-4526-a024-be1b764616db service nova] Lock "d22eb02b-7e8d-4755-9f1e-3eee56ddec0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:27:45 user nova-compute[95467]: DEBUG nova.compute.manager [req-7188b601-c1a9-4c17-b177-77cbd76a3d08 req-6549d769-a7f6-4526-a024-be1b764616db service nova] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] No waiting events found dispatching network-vif-plugged-62cba8e1-074b-41db-bb58-3363138fb060 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:27:45 user nova-compute[95467]: WARNING nova.compute.manager [req-7188b601-c1a9-4c17-b177-77cbd76a3d08 req-6549d769-a7f6-4526-a024-be1b764616db service nova] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Received unexpected event network-vif-plugged-62cba8e1-074b-41db-bb58-3363138fb060 for instance with vm_state resized and task_state resize_reverting.
Nov 15 08:27:45 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:45 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:45 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:45 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:47 user nova-compute[95467]: DEBUG nova.compute.manager [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Instance event wait completed in 0 seconds for  {{(pid=95467) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 08:27:47 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Instance running successfully.
Nov 15 08:27:47 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] finish_revert_migration finished successfully. {{(pid=95467) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 15 08:27:47 user nova-compute[95467]: DEBUG nova.compute.manager [req-4d87b8d8-2982-48f3-aeb3-8c64763fc306 req-5638241f-2a54-4ab7-84a7-5c43ad8e6aff service nova] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Received event network-vif-plugged-62cba8e1-074b-41db-bb58-3363138fb060 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:27:47 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-4d87b8d8-2982-48f3-aeb3-8c64763fc306 req-5638241f-2a54-4ab7-84a7-5c43ad8e6aff service nova] Acquiring lock "d22eb02b-7e8d-4755-9f1e-3eee56ddec0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:27:47 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-4d87b8d8-2982-48f3-aeb3-8c64763fc306 req-5638241f-2a54-4ab7-84a7-5c43ad8e6aff service nova] Lock "d22eb02b-7e8d-4755-9f1e-3eee56ddec0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:27:47 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-4d87b8d8-2982-48f3-aeb3-8c64763fc306 req-5638241f-2a54-4ab7-84a7-5c43ad8e6aff service nova] Lock "d22eb02b-7e8d-4755-9f1e-3eee56ddec0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:27:47 user nova-compute[95467]: DEBUG nova.compute.manager [req-4d87b8d8-2982-48f3-aeb3-8c64763fc306 req-5638241f-2a54-4ab7-84a7-5c43ad8e6aff service nova] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] No waiting events found dispatching network-vif-plugged-62cba8e1-074b-41db-bb58-3363138fb060 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:27:47 user nova-compute[95467]: WARNING nova.compute.manager [req-4d87b8d8-2982-48f3-aeb3-8c64763fc306 req-5638241f-2a54-4ab7-84a7-5c43ad8e6aff service nova] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Received unexpected event network-vif-plugged-62cba8e1-074b-41db-bb58-3363138fb060 for instance with vm_state resized and task_state resize_reverting.
Nov 15 08:27:47 user nova-compute[95467]: INFO nova.compute.manager [None req-1fdad3e6-8703-49d0-bb20-8d55f9ce7562 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Updating instance to original state: 'active'
Nov 15 08:27:47 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:48 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:49 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:27:49 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=95467) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 08:27:50 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:27:50 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager.update_available_resource {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:27:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:27:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:27:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:27:50 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Auditing locally available compute resources for user (node: user) {{(pid=95467) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 08:27:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d22eb02b-7e8d-4755-9f1e-3eee56ddec0c/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d22eb02b-7e8d-4755-9f1e-3eee56ddec0c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d22eb02b-7e8d-4755-9f1e-3eee56ddec0c/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d22eb02b-7e8d-4755-9f1e-3eee56ddec0c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:51 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:27:51 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:27:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba05c01d-ae74-467c-a309-4d0ba904453d/disk.rescue --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba05c01d-ae74-467c-a309-4d0ba904453d/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba05c01d-ae74-467c-a309-4d0ba904453d/disk.rescue --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba05c01d-ae74-467c-a309-4d0ba904453d/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:52 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:27:52 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:27:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk.rescue --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk.rescue --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ab4ef11-de3f-44a9-9242-916753481479/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:52 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ab4ef11-de3f-44a9-9242-916753481479/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ab4ef11-de3f-44a9-9242-916753481479/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ab4ef11-de3f-44a9-9242-916753481479/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:53 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0d2ebe95-1c8c-454d-9811-3c4af48b982d tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Acquiring lock "a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:27:53 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0d2ebe95-1c8c-454d-9811-3c4af48b982d tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.007s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:27:53 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0d2ebe95-1c8c-454d-9811-3c4af48b982d tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Acquiring lock "a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:27:53 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0d2ebe95-1c8c-454d-9811-3c4af48b982d tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:27:53 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0d2ebe95-1c8c-454d-9811-3c4af48b982d tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:27:53 user nova-compute[95467]: INFO nova.compute.manager [None req-0d2ebe95-1c8c-454d-9811-3c4af48b982d tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Terminating instance
Nov 15 08:27:53 user nova-compute[95467]: DEBUG nova.compute.manager [None req-0d2ebe95-1c8c-454d-9811-3c4af48b982d tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Start destroying the instance on the hypervisor. {{(pid=95467) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 08:27:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:53 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:27:53 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:27:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:53 user nova-compute[95467]: DEBUG nova.compute.manager [req-57e2c556-81e0-4d73-bf8a-857d05f4145b req-dc0b5a76-56d1-4a98-9736-d513b16e2a1f service nova] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Received event network-vif-unplugged-cb099600-0c5c-4e0d-adfe-91a6ba3e0f08 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:27:53 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-57e2c556-81e0-4d73-bf8a-857d05f4145b req-dc0b5a76-56d1-4a98-9736-d513b16e2a1f service nova] Acquiring lock "a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:27:53 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-57e2c556-81e0-4d73-bf8a-857d05f4145b req-dc0b5a76-56d1-4a98-9736-d513b16e2a1f service nova] Lock "a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:27:53 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-57e2c556-81e0-4d73-bf8a-857d05f4145b req-dc0b5a76-56d1-4a98-9736-d513b16e2a1f service nova] Lock "a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:27:53 user nova-compute[95467]: DEBUG nova.compute.manager [req-57e2c556-81e0-4d73-bf8a-857d05f4145b req-dc0b5a76-56d1-4a98-9736-d513b16e2a1f service nova] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] No waiting events found dispatching network-vif-unplugged-cb099600-0c5c-4e0d-adfe-91a6ba3e0f08 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:27:53 user nova-compute[95467]: DEBUG nova.compute.manager [req-57e2c556-81e0-4d73-bf8a-857d05f4145b req-dc0b5a76-56d1-4a98-9736-d513b16e2a1f service nova] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Received event network-vif-unplugged-cb099600-0c5c-4e0d-adfe-91a6ba3e0f08 for instance with task_state deleting. {{(pid=95467) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 08:27:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091612cf-b737-480b-984e-a05b522676b6/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091612cf-b737-480b-984e-a05b522676b6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091612cf-b737-480b-984e-a05b522676b6/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:54 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Instance destroyed successfully.
Nov 15 08:27:54 user nova-compute[95467]: DEBUG nova.objects.instance [None req-0d2ebe95-1c8c-454d-9811-3c4af48b982d tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lazy-loading 'resources' on Instance uuid a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:27:54 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-0d2ebe95-1c8c-454d-9811-3c4af48b982d tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:21:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-884527110',display_name='tempest-ServerActionsTestOtherA-server-884527110',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-884527110',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYstiTKN6pNWftTYd849nYQtMIuEgDEUeKiw28UGbiftMSf1b7pXDFCSUnmvZj4PjTG3wPVLUk+MQqv7tZDYQ9Hh/tLAdBctcsd51z7x2h0dxB9v2l2G0kVC6Lobby9rA==',key_name='tempest-keypair-124047716',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:23:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0a1aa4f562c64545a94157d4aaf8d14e',ramdisk_id='',reservation_id='r-0emjo4p0',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-937420730',owner_user_name='tempest-ServerActionsTestOtherA-937420730-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:25:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d9b34339b404facac21f500f40b1686',uuid=a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb099600-0c5c-4e0d-adfe-91a6ba3e0f08", "address": "fa:16:3e:1d:28:85", "network": {"id": "d8a362dc-0dc8-49dd-b2da-0e0749d5edca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-256373617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a1aa4f562c64545a94157d4aaf8d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb099600-0c", "ovs_interfaceid": "cb099600-0c5c-4e0d-adfe-91a6ba3e0f08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:27:54 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-0d2ebe95-1c8c-454d-9811-3c4af48b982d tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Converting VIF {"id": "cb099600-0c5c-4e0d-adfe-91a6ba3e0f08", "address": "fa:16:3e:1d:28:85", "network": {"id": "d8a362dc-0dc8-49dd-b2da-0e0749d5edca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-256373617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a1aa4f562c64545a94157d4aaf8d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb099600-0c", "ovs_interfaceid": "cb099600-0c5c-4e0d-adfe-91a6ba3e0f08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:27:54 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-0d2ebe95-1c8c-454d-9811-3c4af48b982d tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1d:28:85,bridge_name='br-int',has_traffic_filtering=True,id=cb099600-0c5c-4e0d-adfe-91a6ba3e0f08,network=Network(d8a362dc-0dc8-49dd-b2da-0e0749d5edca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb099600-0c') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:27:54 user nova-compute[95467]: DEBUG os_vif [None req-0d2ebe95-1c8c-454d-9811-3c4af48b982d tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:28:85,bridge_name='br-int',has_traffic_filtering=True,id=cb099600-0c5c-4e0d-adfe-91a6ba3e0f08,network=Network(d8a362dc-0dc8-49dd-b2da-0e0749d5edca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb099600-0c') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:27:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcb099600-0c, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:27:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:27:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c6a771e1-f484-4e5c-908e-f1d884e6ee3c) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:27:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:54 user nova-compute[95467]: INFO os_vif [None req-0d2ebe95-1c8c-454d-9811-3c4af48b982d tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:28:85,bridge_name='br-int',has_traffic_filtering=True,id=cb099600-0c5c-4e0d-adfe-91a6ba3e0f08,network=Network(d8a362dc-0dc8-49dd-b2da-0e0749d5edca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb099600-0c')
Nov 15 08:27:54 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d2ebe95-1c8c-454d-9811-3c4af48b982d tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] calling os-brick to detach iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 08:27:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2ebe95-1c8c-454d-9811-3c4af48b982d tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, {'target_iqn': 'iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kFxqhEAV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:27:54 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-0d2ebe95-1c8c-454d-9811-3c4af48b982d tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:27:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-0d2ebe95-1c8c-454d-9811-3c4af48b982d tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:27:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-0d2ebe95-1c8c-454d-9811-3c4af48b982d tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:27:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:54 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4958e01-33a2-4785-b80d-ee053c6ca7aa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2dbf6208-1a82-45a0-a862-3296f3c690e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:27:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2ebe95-1c8c-454d-9811-3c4af48b982d tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 08:27:54 user nova-compute[95467]: No targets found.
Nov 15 08:27:54 user nova-compute[95467]: iSNS:
Nov 15 08:27:54 user nova-compute[95467]: No targets found.
Nov 15 08:27:54 user nova-compute[95467]: STATIC:
Nov 15 08:27:54 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24
Nov 15 08:27:54 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:27:54 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:27:54 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b
Nov 15 08:27:54 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:27:54 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:27:54 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0
Nov 15 08:27:54 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:27:54 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:27:54 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e
Nov 15 08:27:54 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:27:54 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:27:54 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373
Nov 15 08:27:54 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:27:54 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:27:54 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400
Nov 15 08:27:54 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:27:54 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:27:54 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:2dbf6208-1a82-45a0-a862-3296f3c690e4
Nov 15 08:27:54 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:27:54 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:27:54 user nova-compute[95467]: FIRMWARE:
Nov 15 08:27:54 user nova-compute[95467]: No targets found.
Nov 15 08:27:54 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:27:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2ebe95-1c8c-454d-9811-3c4af48b982d tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 08:27:54 user nova-compute[95467]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 08:27:54 user nova-compute[95467]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=95467) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 08:27:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2ebe95-1c8c-454d-9811-3c4af48b982d tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400', 0)] {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 08:27:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.036s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:54 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[0485dda0-252a-4ea6-a212-2bc924252787]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2dbf6208-1a82-45a0-a862-3296f3c690e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:27:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091612cf-b737-480b-984e-a05b522676b6/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/739645e6-9952-40db-a876-f23d02d4e411/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:54 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2167907-ccf2-4c3c-a8f4-85c0048c899e]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dbf6208-1a82-45a0-a862-3296f3c690e4 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:27:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2ebe95-1c8c-454d-9811-3c4af48b982d tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:27:54 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:27:54 user nova-compute[95467]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)
Nov 15 08:27:54 user nova-compute[95467]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:27:54 user nova-compute[95467]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 (non-flash)
Nov 15 08:27:54 user nova-compute[95467]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dbf6208-1a82-45a0-a862-3296f3c690e4 (non-flash)
Nov 15 08:27:54 user nova-compute[95467]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 (non-flash)
Nov 15 08:27:54 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:27:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2ebe95-1c8c-454d-9811-3c4af48b982d tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:27:54 user nova-compute[95467]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 (non-flash)
Nov 15 08:27:54 user nova-compute[95467]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)
Nov 15 08:27:54 user nova-compute[95467]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:27:54 user nova-compute[95467]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 (non-flash)
Nov 15 08:27:54 user nova-compute[95467]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dbf6208-1a82-45a0-a862-3296f3c690e4 (non-flash)
Nov 15 08:27:54 user nova-compute[95467]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 (non-flash)
Nov 15 08:27:54 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:27:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2ebe95-1c8c-454d-9811-3c4af48b982d tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efec8249090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400'): ({'sdd'}, set())}) {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 08:27:54 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-0d2ebe95-1c8c-454d-9811-3c4af48b982d tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Removing single pathed devices sdd {{(pid=95467) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 08:27:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:54 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[88759195-a5b7-4759-9cec-c24e16c8e861]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:27:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:54 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfcbeecb-11b9-41c0-9405-aa8b107f9896]: (4, ('ok\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:27:54 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-0d2ebe95-1c8c-454d-9811-3c4af48b982d tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Flushing IO for device /dev/sdd {{(pid=95467) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 08:27:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:54 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[14788e0e-8f75-4c55-8de7-997d27410511]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:27:54 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-0d2ebe95-1c8c-454d-9811-3c4af48b982d tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=95467) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 08:27:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/739645e6-9952-40db-a876-f23d02d4e411/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/739645e6-9952-40db-a876-f23d02d4e411/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.094s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:54 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df888b5-c8d9-4910-b450-bbc5740b1909]: (4, ('1', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:27:54 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-0d2ebe95-1c8c-454d-9811-3c4af48b982d tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 08:27:54 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-0d2ebe95-1c8c-454d-9811-3c4af48b982d tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] SCSI volumes sdd have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 08:27:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2ebe95-1c8c-454d-9811-3c4af48b982d tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400')] {{(pid=95467) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 08:27:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:54 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[458d960c-a1ec-4464-91b2-761e0a0460b7]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:27:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2ebe95-1c8c-454d-9811-3c4af48b982d tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:27:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 -p 172.16.0.220:3260 --logout {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:54 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e39489-fa61-490f-b416-c375e9928621]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:27:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2ebe95-1c8c-454d-9811-3c4af48b982d tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400, portal: 172.16.0.220,3260]
Nov 15 08:27:54 user nova-compute[95467]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400, portal: 172.16.0.220,3260] successful.
Nov 15 08:27:54 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:27:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 -p 172.16.0.220:3260 --op delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:27:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:769e646a-dfe3-48d6-800c-7533bb9a7400 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:54 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4b6150-f318-4cd3-9e16-aed71eb6848b]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:27:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2ebe95-1c8c-454d-9811-3c4af48b982d tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:27:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-0d2ebe95-1c8c-454d-9811-3c4af48b982d tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.473s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:27:54 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2ebe95-1c8c-454d-9811-3c4af48b982d tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] <== disconnect_volume: return (476ms) None {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:27:54 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d2ebe95-1c8c-454d-9811-3c4af48b982d tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Disconnected iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 08:27:54 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-0d2ebe95-1c8c-454d-9811-3c4af48b982d tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Deleting instance files /opt/stack/data/nova/instances/a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80_del
Nov 15 08:27:54 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-0d2ebe95-1c8c-454d-9811-3c4af48b982d tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Deletion of /opt/stack/data/nova/instances/a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80_del complete
Nov 15 08:27:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/739645e6-9952-40db-a876-f23d02d4e411/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:27:54 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:27:55 user nova-compute[95467]: INFO nova.compute.manager [None req-0d2ebe95-1c8c-454d-9811-3c4af48b982d tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Took 1.75 seconds to destroy the instance on the hypervisor.
Nov 15 08:27:55 user nova-compute[95467]: DEBUG oslo.service.loopingcall [None req-0d2ebe95-1c8c-454d-9811-3c4af48b982d tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=95467) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 08:27:55 user nova-compute[95467]: DEBUG nova.compute.manager [-] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Deallocating network for instance {{(pid=95467) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 08:27:55 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] deallocate_for_instance() {{(pid=95467) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 08:27:55 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:27:55 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:27:55 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Hypervisor/Node resource view: name=user free_ram=7276MB free_disk=24.882034301757812GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=95467) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 08:27:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:27:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:27:55 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 73fe8852-c47a-47ab-a56f-6864c8ed5479 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:27:55 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 21cf2ada-b15c-490d-ac37-96e9c87e9056 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:27:55 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:27:55 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 10d73b73-ca65-4192-8954-288dc1df9f24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:27:55 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 3825a691-ac5c-4c06-b4a4-2a0b40c638c4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:27:55 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 091612cf-b737-480b-984e-a05b522676b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:27:55 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:27:55 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 739645e6-9952-40db-a876-f23d02d4e411 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:27:55 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance ba05c01d-ae74-467c-a309-4d0ba904453d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:27:55 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 7eb1f0ce-72bd-4015-993c-a32404f15481 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:27:55 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance d22eb02b-7e8d-4755-9f1e-3eee56ddec0c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:27:55 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 2838af21-2749-4e6b-b4d3-c0d79379dfb5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:27:55 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 4ab4ef11-de3f-44a9-9242-916753481479 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:27:55 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 08:27:55 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 08:27:55 user nova-compute[95467]: DEBUG nova.compute.manager [req-6a7cef81-35e6-4b97-b2d1-93a1d66ad5de req-fcc8457f-23a9-4c17-85c0-5b4eb8d3e3af service nova] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Received event network-vif-plugged-cb099600-0c5c-4e0d-adfe-91a6ba3e0f08 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:27:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-6a7cef81-35e6-4b97-b2d1-93a1d66ad5de req-fcc8457f-23a9-4c17-85c0-5b4eb8d3e3af service nova] Acquiring lock "a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:27:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-6a7cef81-35e6-4b97-b2d1-93a1d66ad5de req-fcc8457f-23a9-4c17-85c0-5b4eb8d3e3af service nova] Lock "a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:27:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-6a7cef81-35e6-4b97-b2d1-93a1d66ad5de req-fcc8457f-23a9-4c17-85c0-5b4eb8d3e3af service nova] Lock "a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:27:55 user nova-compute[95467]: DEBUG nova.compute.manager [req-6a7cef81-35e6-4b97-b2d1-93a1d66ad5de req-fcc8457f-23a9-4c17-85c0-5b4eb8d3e3af service nova] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] No waiting events found dispatching network-vif-plugged-cb099600-0c5c-4e0d-adfe-91a6ba3e0f08 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:27:55 user nova-compute[95467]: WARNING nova.compute.manager [req-6a7cef81-35e6-4b97-b2d1-93a1d66ad5de req-fcc8457f-23a9-4c17-85c0-5b4eb8d3e3af service nova] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Received unexpected event network-vif-plugged-cb099600-0c5c-4e0d-adfe-91a6ba3e0f08 for instance with vm_state active and task_state deleting.
Nov 15 08:27:55 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:27:55 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:27:55 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Compute_service record updated for user:user {{(pid=95467) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 08:27:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.622s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:27:55 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:27:55 user nova-compute[95467]: INFO nova.compute.manager [-] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Took 0.77 seconds to deallocate network for instance.
Nov 15 08:27:55 user nova-compute[95467]: DEBUG nova.compute.manager [req-39d6c1b6-043b-4f27-8410-0235dd5856d3 req-acaee67f-8e59-4c5a-b419-e592ee743316 service nova] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Received event network-vif-deleted-cb099600-0c5c-4e0d-adfe-91a6ba3e0f08 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:27:56 user nova-compute[95467]: INFO nova.compute.manager [None req-0d2ebe95-1c8c-454d-9811-3c4af48b982d tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Took 0.77 seconds to detach 1 volumes for instance.
Nov 15 08:27:56 user nova-compute[95467]: DEBUG nova.compute.manager [None req-0d2ebe95-1c8c-454d-9811-3c4af48b982d tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80] Deleting volume: 769e646a-dfe3-48d6-800c-7533bb9a7400 {{(pid=95467) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 08:27:56 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:27:56 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:27:56 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Starting heal instance info cache {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 08:27:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0d2ebe95-1c8c-454d-9811-3c4af48b982d tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:27:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0d2ebe95-1c8c-454d-9811-3c4af48b982d tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:27:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "refresh_cache-b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:27:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquired lock "refresh_cache-b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:27:56 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Forcefully refreshing network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 08:27:57 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Updating instance_info_cache with network_info: [{"id": "1436eae1-0899-4fc5-8bbe-575fa2c70d42", "address": "fa:16:3e:08:e7:36", "network": {"id": "369d2a6f-60b7-4c92-8b2d-1f3828f6698b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1491709218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd281be4e94a4d31a47a13267d51d9b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1436eae1-08", "ovs_interfaceid": "1436eae1-0899-4fc5-8bbe-575fa2c70d42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:27:57 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-0d2ebe95-1c8c-454d-9811-3c4af48b982d tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:27:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Releasing lock "refresh_cache-b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:27:57 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Updated the network info_cache for instance {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 08:27:57 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:27:57 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:27:57 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:27:57 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-0d2ebe95-1c8c-454d-9811-3c4af48b982d tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:27:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0d2ebe95-1c8c-454d-9811-3c4af48b982d tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.513s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:27:57 user nova-compute[95467]: INFO nova.scheduler.client.report [None req-0d2ebe95-1c8c-454d-9811-3c4af48b982d tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Deleted allocations for instance a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80
Nov 15 08:27:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0d2ebe95-1c8c-454d-9811-3c4af48b982d tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "a0f8c752-5eed-4ab8-bd0d-9ec76ab0ad80" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.111s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:27:57 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:27:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:27:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:28:00 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:28:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:28:04 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:28:07 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:28:09 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:28:10 user nova-compute[95467]: INFO nova.compute.manager [None req-bff2b74d-ee98-40cb-b5e0-16ebdf06038b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Unrescuing
Nov 15 08:28:10 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-bff2b74d-ee98-40cb-b5e0-16ebdf06038b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Acquiring lock "refresh_cache-ba05c01d-ae74-467c-a309-4d0ba904453d" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:28:10 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-bff2b74d-ee98-40cb-b5e0-16ebdf06038b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Acquired lock "refresh_cache-ba05c01d-ae74-467c-a309-4d0ba904453d" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:28:10 user nova-compute[95467]: DEBUG nova.network.neutron [None req-bff2b74d-ee98-40cb-b5e0-16ebdf06038b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:28:10 user nova-compute[95467]: DEBUG nova.network.neutron [None req-bff2b74d-ee98-40cb-b5e0-16ebdf06038b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Updating instance_info_cache with network_info: [{"id": "3738b806-4005-468d-87df-f879eb2ff43d", "address": "fa:16:3e:86:6f:d3", "network": {"id": "ac9a381d-25fe-4419-b151-f03333413813", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1183680999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34d65a8000347feb2b3966b7ce0d785", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3738b806-40", "ovs_interfaceid": "3738b806-4005-468d-87df-f879eb2ff43d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:28:10 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-bff2b74d-ee98-40cb-b5e0-16ebdf06038b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Releasing lock "refresh_cache-ba05c01d-ae74-467c-a309-4d0ba904453d" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:28:10 user nova-compute[95467]: DEBUG nova.objects.instance [None req-bff2b74d-ee98-40cb-b5e0-16ebdf06038b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lazy-loading 'flavor' on Instance uuid ba05c01d-ae74-467c-a309-4d0ba904453d {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:28:10 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:28:10 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:28:11 user nova-compute[95467]: DEBUG nova.compute.manager [req-5a7e3a2e-3df1-4ea2-8d30-a88131592290 req-d14d2871-5b17-4883-b7b9-fd44e4613d74 service nova] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Received event network-vif-unplugged-3738b806-4005-468d-87df-f879eb2ff43d {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:28:11 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-5a7e3a2e-3df1-4ea2-8d30-a88131592290 req-d14d2871-5b17-4883-b7b9-fd44e4613d74 service nova] Acquiring lock "ba05c01d-ae74-467c-a309-4d0ba904453d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:28:11 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-5a7e3a2e-3df1-4ea2-8d30-a88131592290 req-d14d2871-5b17-4883-b7b9-fd44e4613d74 service nova] Lock "ba05c01d-ae74-467c-a309-4d0ba904453d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:28:11 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-5a7e3a2e-3df1-4ea2-8d30-a88131592290 req-d14d2871-5b17-4883-b7b9-fd44e4613d74 service nova] Lock "ba05c01d-ae74-467c-a309-4d0ba904453d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:28:11 user nova-compute[95467]: DEBUG nova.compute.manager [req-5a7e3a2e-3df1-4ea2-8d30-a88131592290 req-d14d2871-5b17-4883-b7b9-fd44e4613d74 service nova] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] No waiting events found dispatching network-vif-unplugged-3738b806-4005-468d-87df-f879eb2ff43d {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:28:11 user nova-compute[95467]: WARNING nova.compute.manager [req-5a7e3a2e-3df1-4ea2-8d30-a88131592290 req-d14d2871-5b17-4883-b7b9-fd44e4613d74 service nova] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Received unexpected event network-vif-unplugged-3738b806-4005-468d-87df-f879eb2ff43d for instance with vm_state rescued and task_state unrescuing.
Nov 15 08:28:11 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:28:11 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:28:11 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Instance destroyed successfully.
Nov 15 08:28:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:28:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:28:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:28:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:28:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:28:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:28:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:28:13 user nova-compute[95467]: DEBUG nova.compute.manager [req-0c695537-cbb6-4b9a-b0f5-0799c7a8c200 req-e644bd6d-4fae-47de-b877-05e40afdda6e service nova] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Received event network-vif-plugged-3738b806-4005-468d-87df-f879eb2ff43d {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:28:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-0c695537-cbb6-4b9a-b0f5-0799c7a8c200 req-e644bd6d-4fae-47de-b877-05e40afdda6e service nova] Acquiring lock "ba05c01d-ae74-467c-a309-4d0ba904453d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:28:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-0c695537-cbb6-4b9a-b0f5-0799c7a8c200 req-e644bd6d-4fae-47de-b877-05e40afdda6e service nova] Lock "ba05c01d-ae74-467c-a309-4d0ba904453d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:28:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-0c695537-cbb6-4b9a-b0f5-0799c7a8c200 req-e644bd6d-4fae-47de-b877-05e40afdda6e service nova] Lock "ba05c01d-ae74-467c-a309-4d0ba904453d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:28:13 user nova-compute[95467]: DEBUG nova.compute.manager [req-0c695537-cbb6-4b9a-b0f5-0799c7a8c200 req-e644bd6d-4fae-47de-b877-05e40afdda6e service nova] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] No waiting events found dispatching network-vif-plugged-3738b806-4005-468d-87df-f879eb2ff43d {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:28:13 user nova-compute[95467]: WARNING nova.compute.manager [req-0c695537-cbb6-4b9a-b0f5-0799c7a8c200 req-e644bd6d-4fae-47de-b877-05e40afdda6e service nova] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Received unexpected event network-vif-plugged-3738b806-4005-468d-87df-f879eb2ff43d for instance with vm_state rescued and task_state unrescuing.
Nov 15 08:28:13 user nova-compute[95467]: DEBUG nova.compute.manager [req-0c695537-cbb6-4b9a-b0f5-0799c7a8c200 req-e644bd6d-4fae-47de-b877-05e40afdda6e service nova] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Received event network-vif-plugged-3738b806-4005-468d-87df-f879eb2ff43d {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:28:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-0c695537-cbb6-4b9a-b0f5-0799c7a8c200 req-e644bd6d-4fae-47de-b877-05e40afdda6e service nova] Acquiring lock "ba05c01d-ae74-467c-a309-4d0ba904453d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:28:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-0c695537-cbb6-4b9a-b0f5-0799c7a8c200 req-e644bd6d-4fae-47de-b877-05e40afdda6e service nova] Lock "ba05c01d-ae74-467c-a309-4d0ba904453d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:28:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-0c695537-cbb6-4b9a-b0f5-0799c7a8c200 req-e644bd6d-4fae-47de-b877-05e40afdda6e service nova] Lock "ba05c01d-ae74-467c-a309-4d0ba904453d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:28:13 user nova-compute[95467]: DEBUG nova.compute.manager [req-0c695537-cbb6-4b9a-b0f5-0799c7a8c200 req-e644bd6d-4fae-47de-b877-05e40afdda6e service nova] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] No waiting events found dispatching network-vif-plugged-3738b806-4005-468d-87df-f879eb2ff43d {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:28:13 user nova-compute[95467]: WARNING nova.compute.manager [req-0c695537-cbb6-4b9a-b0f5-0799c7a8c200 req-e644bd6d-4fae-47de-b877-05e40afdda6e service nova] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Received unexpected event network-vif-plugged-3738b806-4005-468d-87df-f879eb2ff43d for instance with vm_state rescued and task_state unrescuing.
Nov 15 08:28:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:28:14 user nova-compute[95467]: DEBUG nova.compute.manager [None req-bff2b74d-ee98-40cb-b5e0-16ebdf06038b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:28:15 user nova-compute[95467]: DEBUG nova.compute.manager [req-75386c8d-1a91-47d4-8a33-698611aae670 req-13a3c89b-6e2d-4b31-9c20-0b6b855ed09c service nova] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Received event network-vif-plugged-3738b806-4005-468d-87df-f879eb2ff43d {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:28:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-75386c8d-1a91-47d4-8a33-698611aae670 req-13a3c89b-6e2d-4b31-9c20-0b6b855ed09c service nova] Acquiring lock "ba05c01d-ae74-467c-a309-4d0ba904453d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:28:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-75386c8d-1a91-47d4-8a33-698611aae670 req-13a3c89b-6e2d-4b31-9c20-0b6b855ed09c service nova] Lock "ba05c01d-ae74-467c-a309-4d0ba904453d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:28:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-75386c8d-1a91-47d4-8a33-698611aae670 req-13a3c89b-6e2d-4b31-9c20-0b6b855ed09c service nova] Lock "ba05c01d-ae74-467c-a309-4d0ba904453d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:28:15 user nova-compute[95467]: DEBUG nova.compute.manager [req-75386c8d-1a91-47d4-8a33-698611aae670 req-13a3c89b-6e2d-4b31-9c20-0b6b855ed09c service nova] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] No waiting events found dispatching network-vif-plugged-3738b806-4005-468d-87df-f879eb2ff43d {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:28:15 user nova-compute[95467]: WARNING nova.compute.manager [req-75386c8d-1a91-47d4-8a33-698611aae670 req-13a3c89b-6e2d-4b31-9c20-0b6b855ed09c service nova] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Received unexpected event network-vif-plugged-3738b806-4005-468d-87df-f879eb2ff43d for instance with vm_state active and task_state None.
Nov 15 08:28:17 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:28:19 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:28:24 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:28:24 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:28:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:28:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:28:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:28:30 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:28:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:28:34 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:28:36 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:28:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:28:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:28:39 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:28:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:28:42 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:28:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:28:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:28:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f116cfe9-61d6-4677-9f79-a693d9638b6f tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Acquiring lock "73fe8852-c47a-47ab-a56f-6864c8ed5479" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:28:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f116cfe9-61d6-4677-9f79-a693d9638b6f tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "73fe8852-c47a-47ab-a56f-6864c8ed5479" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:28:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f116cfe9-61d6-4677-9f79-a693d9638b6f tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Acquiring lock "73fe8852-c47a-47ab-a56f-6864c8ed5479-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:28:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f116cfe9-61d6-4677-9f79-a693d9638b6f tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "73fe8852-c47a-47ab-a56f-6864c8ed5479-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:28:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f116cfe9-61d6-4677-9f79-a693d9638b6f tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "73fe8852-c47a-47ab-a56f-6864c8ed5479-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:28:46 user nova-compute[95467]: INFO nova.compute.manager [None req-f116cfe9-61d6-4677-9f79-a693d9638b6f tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] Terminating instance
Nov 15 08:28:46 user nova-compute[95467]: DEBUG nova.compute.manager [None req-f116cfe9-61d6-4677-9f79-a693d9638b6f tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] Start destroying the instance on the hypervisor. {{(pid=95467) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 08:28:46 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:28:46 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:28:46 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:28:46 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:28:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Acquiring lock "aaa2d1c7-dbda-4bf2-8706-3e941b44b076" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:28:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Lock "aaa2d1c7-dbda-4bf2-8706-3e941b44b076" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:28:46 user nova-compute[95467]: DEBUG nova.compute.manager [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Starting instance... {{(pid=95467) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 08:28:46 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] Instance destroyed successfully.
Nov 15 08:28:46 user nova-compute[95467]: DEBUG nova.objects.instance [None req-f116cfe9-61d6-4677-9f79-a693d9638b6f tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lazy-loading 'resources' on Instance uuid 73fe8852-c47a-47ab-a56f-6864c8ed5479 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:28:47 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-f116cfe9-61d6-4677-9f79-a693d9638b6f tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:09:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-655759995',display_name='tempest-ServerActionsTestOtherA-server-655759995',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-655759995',id=4,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYstiTKN6pNWftTYd849nYQtMIuEgDEUeKiw28UGbiftMSf1b7pXDFCSUnmvZj4PjTG3wPVLUk+MQqv7tZDYQ9Hh/tLAdBctcsd51z7x2h0dxB9v2l2G0kVC6Lobby9rA==',key_name='tempest-keypair-124047716',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:10:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0a1aa4f562c64545a94157d4aaf8d14e',ramdisk_id='',reservation_id='r-32hgmua9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-937420730',owner_user_name='tempest-ServerActionsTestOtherA-937420730-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:10:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d9b34339b404facac21f500f40b1686',uuid=73fe8852-c47a-47ab-a56f-6864c8ed5479,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d7e5ca44-eee3-4452-9649-5fcbfe5ed5ad", "address": "fa:16:3e:e5:16:8b", "network": {"id": "d8a362dc-0dc8-49dd-b2da-0e0749d5edca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-256373617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a1aa4f562c64545a94157d4aaf8d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7e5ca44-ee", "ovs_interfaceid": "d7e5ca44-eee3-4452-9649-5fcbfe5ed5ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:28:47 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-f116cfe9-61d6-4677-9f79-a693d9638b6f tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Converting VIF {"id": "d7e5ca44-eee3-4452-9649-5fcbfe5ed5ad", "address": "fa:16:3e:e5:16:8b", "network": {"id": "d8a362dc-0dc8-49dd-b2da-0e0749d5edca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-256373617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a1aa4f562c64545a94157d4aaf8d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7e5ca44-ee", "ovs_interfaceid": "d7e5ca44-eee3-4452-9649-5fcbfe5ed5ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:28:47 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-f116cfe9-61d6-4677-9f79-a693d9638b6f tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:16:8b,bridge_name='br-int',has_traffic_filtering=True,id=d7e5ca44-eee3-4452-9649-5fcbfe5ed5ad,network=Network(d8a362dc-0dc8-49dd-b2da-0e0749d5edca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7e5ca44-ee') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:28:47 user nova-compute[95467]: DEBUG os_vif [None req-f116cfe9-61d6-4677-9f79-a693d9638b6f tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:16:8b,bridge_name='br-int',has_traffic_filtering=True,id=d7e5ca44-eee3-4452-9649-5fcbfe5ed5ad,network=Network(d8a362dc-0dc8-49dd-b2da-0e0749d5edca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7e5ca44-ee') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:28:47 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:28:47 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd7e5ca44-ee, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:28:47 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:28:47 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:28:47 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:28:47 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3acf65a2-73a8-461c-b2ef-11ef086c838c) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:28:47 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:28:47 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:28:47 user nova-compute[95467]: INFO os_vif [None req-f116cfe9-61d6-4677-9f79-a693d9638b6f tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:16:8b,bridge_name='br-int',has_traffic_filtering=True,id=d7e5ca44-eee3-4452-9649-5fcbfe5ed5ad,network=Network(d8a362dc-0dc8-49dd-b2da-0e0749d5edca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7e5ca44-ee')
Nov 15 08:28:47 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-f116cfe9-61d6-4677-9f79-a693d9638b6f tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] Deleting instance files /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479_del
Nov 15 08:28:47 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-f116cfe9-61d6-4677-9f79-a693d9638b6f tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] Deletion of /opt/stack/data/nova/instances/73fe8852-c47a-47ab-a56f-6864c8ed5479_del complete
Nov 15 08:28:47 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:28:47 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:28:47 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=95467) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 08:28:47 user nova-compute[95467]: INFO nova.compute.claims [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Claim successful on node user
Nov 15 08:28:47 user nova-compute[95467]: INFO nova.compute.manager [None req-f116cfe9-61d6-4677-9f79-a693d9638b6f tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] Took 0.67 seconds to destroy the instance on the hypervisor.
Nov 15 08:28:47 user nova-compute[95467]: DEBUG oslo.service.loopingcall [None req-f116cfe9-61d6-4677-9f79-a693d9638b6f tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=95467) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 08:28:47 user nova-compute[95467]: DEBUG nova.compute.manager [-] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] Deallocating network for instance {{(pid=95467) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 08:28:47 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] deallocate_for_instance() {{(pid=95467) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 08:28:47 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:28:47 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:28:47 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.495s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:28:47 user nova-compute[95467]: DEBUG nova.compute.manager [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Start building networks asynchronously for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 08:28:47 user nova-compute[95467]: DEBUG nova.compute.manager [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Allocating IP information in the background. {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 08:28:47 user nova-compute[95467]: DEBUG nova.network.neutron [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] allocate_for_instance() {{(pid=95467) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 08:28:47 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 08:28:47 user nova-compute[95467]: DEBUG nova.compute.manager [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Start building block device mappings for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 08:28:47 user nova-compute[95467]: DEBUG nova.policy [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0b1403873af04f78a6c2cbadcec38867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4ba53c039b4d699865e97ea1105843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95467) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 08:28:47 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:28:47 user nova-compute[95467]: INFO nova.compute.manager [-] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] Took 0.63 seconds to deallocate network for instance.
Nov 15 08:28:47 user nova-compute[95467]: DEBUG nova.compute.manager [req-0d45895a-75ff-48d6-8734-e0a617a35542 req-8911eb7e-34b0-40c6-ac8d-a22d345ffb5c service nova] [instance: 73fe8852-c47a-47ab-a56f-6864c8ed5479] Received event network-vif-deleted-d7e5ca44-eee3-4452-9649-5fcbfe5ed5ad {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:28:47 user nova-compute[95467]: DEBUG nova.compute.manager [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Start spawning the instance on the hypervisor. {{(pid=95467) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 08:28:47 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Creating instance directory {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 08:28:47 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Creating image(s)
Nov 15 08:28:47 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Acquiring lock "/opt/stack/data/nova/instances/aaa2d1c7-dbda-4bf2-8706-3e941b44b076/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:28:47 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Lock "/opt/stack/data/nova/instances/aaa2d1c7-dbda-4bf2-8706-3e941b44b076/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:28:47 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Lock "/opt/stack/data/nova/instances/aaa2d1c7-dbda-4bf2-8706-3e941b44b076/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:28:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:28:47 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f116cfe9-61d6-4677-9f79-a693d9638b6f tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:28:47 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f116cfe9-61d6-4677-9f79-a693d9638b6f tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:28:47 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:28:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.192s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:28:47 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Acquiring lock "a3fcf60225fcefd310404971cd18ab9851c548dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:28:47 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:28:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:28:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.173s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:28:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/aaa2d1c7-dbda-4bf2-8706-3e941b44b076/disk 1073741824 {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:28:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/aaa2d1c7-dbda-4bf2-8706-3e941b44b076/disk 1073741824" returned: 0 in 0.054s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:28:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:28:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:28:48 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-f116cfe9-61d6-4677-9f79-a693d9638b6f tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:28:48 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-f116cfe9-61d6-4677-9f79-a693d9638b6f tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:28:48 user nova-compute[95467]: DEBUG nova.network.neutron [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Successfully created port: 6130058a-f78c-4f81-b4a8-233863e6ae8c {{(pid=95467) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 08:28:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f116cfe9-61d6-4677-9f79-a693d9638b6f tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.557s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:28:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.205s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:28:48 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aaa2d1c7-dbda-4bf2-8706-3e941b44b076/disk. size=1073741824 {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 08:28:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaa2d1c7-dbda-4bf2-8706-3e941b44b076/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:28:48 user nova-compute[95467]: INFO nova.scheduler.client.report [None req-f116cfe9-61d6-4677-9f79-a693d9638b6f tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Deleted allocations for instance 73fe8852-c47a-47ab-a56f-6864c8ed5479
Nov 15 08:28:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f116cfe9-61d6-4677-9f79-a693d9638b6f tempest-ServerActionsTestOtherA-937420730 tempest-ServerActionsTestOtherA-937420730-project-member] Lock "73fe8852-c47a-47ab-a56f-6864c8ed5479" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.138s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:28:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaa2d1c7-dbda-4bf2-8706-3e941b44b076/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:28:48 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Cannot resize image /opt/stack/data/nova/instances/aaa2d1c7-dbda-4bf2-8706-3e941b44b076/disk to a smaller size. {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 08:28:48 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Created local disks {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 08:28:48 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Ensure instance console log exists: /opt/stack/data/nova/instances/aaa2d1c7-dbda-4bf2-8706-3e941b44b076/console.log {{(pid=95467) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 08:28:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:28:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:28:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:28:48 user nova-compute[95467]: DEBUG nova.network.neutron [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Successfully updated port: 6130058a-f78c-4f81-b4a8-233863e6ae8c {{(pid=95467) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 08:28:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Acquiring lock "refresh_cache-aaa2d1c7-dbda-4bf2-8706-3e941b44b076" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:28:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Acquired lock "refresh_cache-aaa2d1c7-dbda-4bf2-8706-3e941b44b076" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:28:48 user nova-compute[95467]: DEBUG nova.network.neutron [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:28:48 user nova-compute[95467]: DEBUG nova.compute.manager [req-5abcad9a-a940-4de3-90ae-623a9d9d9dd0 req-257de439-3caa-4546-b000-7576d2186684 service nova] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Received event network-changed-6130058a-f78c-4f81-b4a8-233863e6ae8c {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:28:48 user nova-compute[95467]: DEBUG nova.compute.manager [req-5abcad9a-a940-4de3-90ae-623a9d9d9dd0 req-257de439-3caa-4546-b000-7576d2186684 service nova] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Refreshing instance network info cache due to event network-changed-6130058a-f78c-4f81-b4a8-233863e6ae8c. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:28:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-5abcad9a-a940-4de3-90ae-623a9d9d9dd0 req-257de439-3caa-4546-b000-7576d2186684 service nova] Acquiring lock "refresh_cache-aaa2d1c7-dbda-4bf2-8706-3e941b44b076" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:28:48 user nova-compute[95467]: DEBUG nova.network.neutron [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Instance cache missing network info. {{(pid=95467) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 08:28:49 user nova-compute[95467]: DEBUG nova.network.neutron [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Updating instance_info_cache with network_info: [{"id": "6130058a-f78c-4f81-b4a8-233863e6ae8c", "address": "fa:16:3e:15:19:18", "network": {"id": "a0f0cb10-26c8-4299-8a7e-4d34cfd26c82", "bridge": "br-int", "label": "tempest-TestStampPattern-737883783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b4ba53c039b4d699865e97ea1105843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6130058a-f7", "ovs_interfaceid": "6130058a-f78c-4f81-b4a8-233863e6ae8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:28:49 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Releasing lock "refresh_cache-aaa2d1c7-dbda-4bf2-8706-3e941b44b076" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:28:49 user nova-compute[95467]: DEBUG nova.compute.manager [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Instance network_info: |[{"id": "6130058a-f78c-4f81-b4a8-233863e6ae8c", "address": "fa:16:3e:15:19:18", "network": {"id": "a0f0cb10-26c8-4299-8a7e-4d34cfd26c82", "bridge": "br-int", "label": "tempest-TestStampPattern-737883783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b4ba53c039b4d699865e97ea1105843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6130058a-f7", "ovs_interfaceid": "6130058a-f78c-4f81-b4a8-233863e6ae8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 08:28:49 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-5abcad9a-a940-4de3-90ae-623a9d9d9dd0 req-257de439-3caa-4546-b000-7576d2186684 service nova] Acquired lock "refresh_cache-aaa2d1c7-dbda-4bf2-8706-3e941b44b076" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:28:49 user nova-compute[95467]: DEBUG nova.network.neutron [req-5abcad9a-a940-4de3-90ae-623a9d9d9dd0 req-257de439-3caa-4546-b000-7576d2186684 service nova] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Refreshing network info cache for port 6130058a-f78c-4f81-b4a8-233863e6ae8c {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:28:49 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Start _get_guest_xml network_info=[{"id": "6130058a-f78c-4f81-b4a8-233863e6ae8c", "address": "fa:16:3e:15:19:18", "network": {"id": "a0f0cb10-26c8-4299-8a7e-4d34cfd26c82", "bridge": "br-int", "label": "tempest-TestStampPattern-737883783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b4ba53c039b4d699865e97ea1105843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6130058a-f7", "ovs_interfaceid": "6130058a-f78c-4f81-b4a8-233863e6ae8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'ed9c48aa-ce73-4b3b-9db1-235898be671b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:28:49 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:28:49 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:28:49 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:28:49 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:28:49 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:28:49 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:28:49 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:28:49 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:28:49 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:28:49 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:28:49 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:28:49 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:28:49 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:28:49 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:28:49 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:28:49 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:28:49 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:28:49 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:28:49 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:28:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-190117512',display_name='tempest-TestStampPattern-server-190117512',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-190117512',id=47,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGn0oxsNrNpRwH5qXJYkx21obo8Lj9sdybiQDlMglXKMhHyYV0IVC0OwmijdhcVEz8KfHXfjwjg/GO8OGaIkn6LxI/No3ftDsuwo7JsF5I0wAs7c8mGozFfZJ8NKgWtVJA==',key_name='tempest-TestStampPattern-1164290551',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b4ba53c039b4d699865e97ea1105843',ramdisk_id='',reservation_id='r-qb22x3mj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-89436842',owner_user_name='tempest-TestStampPattern-89436842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:28:48Z,user_data=None,user_id='0b1403873af04f78a6c2cbadcec38867',uuid=aaa2d1c7-dbda-4bf2-8706-3e941b44b076,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6130058a-f78c-4f81-b4a8-233863e6ae8c", "address": "fa:16:3e:15:19:18", "network": {"id": "a0f0cb10-26c8-4299-8a7e-4d34cfd26c82", "bridge": "br-int", "label": "tempest-TestStampPattern-737883783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b4ba53c039b4d699865e97ea1105843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6130058a-f7", "ovs_interfaceid": "6130058a-f78c-4f81-b4a8-233863e6ae8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:28:49 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Converting VIF {"id": "6130058a-f78c-4f81-b4a8-233863e6ae8c", "address": "fa:16:3e:15:19:18", "network": {"id": "a0f0cb10-26c8-4299-8a7e-4d34cfd26c82", "bridge": "br-int", "label": "tempest-TestStampPattern-737883783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b4ba53c039b4d699865e97ea1105843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6130058a-f7", "ovs_interfaceid": "6130058a-f78c-4f81-b4a8-233863e6ae8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:28:49 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:19:18,bridge_name='br-int',has_traffic_filtering=True,id=6130058a-f78c-4f81-b4a8-233863e6ae8c,network=Network(a0f0cb10-26c8-4299-8a7e-4d34cfd26c82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6130058a-f7') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:28:49 user nova-compute[95467]: DEBUG nova.objects.instance [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Lazy-loading 'pci_devices' on Instance uuid aaa2d1c7-dbda-4bf2-8706-3e941b44b076 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:28:49 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:28:49 user nova-compute[95467]:   <uuid>aaa2d1c7-dbda-4bf2-8706-3e941b44b076</uuid>
Nov 15 08:28:49 user nova-compute[95467]:   <name>instance-0000002f</name>
Nov 15 08:28:49 user nova-compute[95467]:   <memory>524288</memory>
Nov 15 08:28:49 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:28:49 user nova-compute[95467]:   <metadata>
Nov 15 08:28:49 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:28:49 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:28:49 user nova-compute[95467]:       <nova:name>tempest-TestStampPattern-server-190117512</nova:name>
Nov 15 08:28:49 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:28:49</nova:creationTime>
Nov 15 08:28:49 user nova-compute[95467]:       <nova:flavor name="m1.tiny">
Nov 15 08:28:49 user nova-compute[95467]:         <nova:memory>512</nova:memory>
Nov 15 08:28:49 user nova-compute[95467]:         <nova:disk>1</nova:disk>
Nov 15 08:28:49 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:28:49 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:28:49 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:28:49 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:28:49 user nova-compute[95467]:       <nova:owner>
Nov 15 08:28:49 user nova-compute[95467]:         <nova:user uuid="0b1403873af04f78a6c2cbadcec38867">tempest-TestStampPattern-89436842-project-member</nova:user>
Nov 15 08:28:49 user nova-compute[95467]:         <nova:project uuid="0b4ba53c039b4d699865e97ea1105843">tempest-TestStampPattern-89436842</nova:project>
Nov 15 08:28:49 user nova-compute[95467]:       </nova:owner>
Nov 15 08:28:49 user nova-compute[95467]:       <nova:root type="image" uuid="ed9c48aa-ce73-4b3b-9db1-235898be671b"/>
Nov 15 08:28:49 user nova-compute[95467]:       <nova:ports>
Nov 15 08:28:49 user nova-compute[95467]:         <nova:port uuid="6130058a-f78c-4f81-b4a8-233863e6ae8c">
Nov 15 08:28:49 user nova-compute[95467]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 08:28:49 user nova-compute[95467]:         </nova:port>
Nov 15 08:28:49 user nova-compute[95467]:       </nova:ports>
Nov 15 08:28:49 user nova-compute[95467]:     </nova:instance>
Nov 15 08:28:49 user nova-compute[95467]:   </metadata>
Nov 15 08:28:49 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:28:49 user nova-compute[95467]:     <system>
Nov 15 08:28:49 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:28:49 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:28:49 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:28:49 user nova-compute[95467]:       <entry name="serial">aaa2d1c7-dbda-4bf2-8706-3e941b44b076</entry>
Nov 15 08:28:49 user nova-compute[95467]:       <entry name="uuid">aaa2d1c7-dbda-4bf2-8706-3e941b44b076</entry>
Nov 15 08:28:49 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:28:49 user nova-compute[95467]:     </system>
Nov 15 08:28:49 user nova-compute[95467]:   </sysinfo>
Nov 15 08:28:49 user nova-compute[95467]:   <os>
Nov 15 08:28:49 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:28:49 user nova-compute[95467]:     <boot dev="hd"/>
Nov 15 08:28:49 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:28:49 user nova-compute[95467]:   </os>
Nov 15 08:28:49 user nova-compute[95467]:   <features>
Nov 15 08:28:49 user nova-compute[95467]:     <acpi/>
Nov 15 08:28:49 user nova-compute[95467]:     <apic/>
Nov 15 08:28:49 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:28:49 user nova-compute[95467]:   </features>
Nov 15 08:28:49 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:28:49 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:28:49 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:28:49 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:28:49 user nova-compute[95467]:   </clock>
Nov 15 08:28:49 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:28:49 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:28:49 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:28:49 user nova-compute[95467]:   </cpu>
Nov 15 08:28:49 user nova-compute[95467]:   <devices>
Nov 15 08:28:49 user nova-compute[95467]:     <disk type="file" device="disk">
Nov 15 08:28:49 user nova-compute[95467]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 08:28:49 user nova-compute[95467]:       <source file="/opt/stack/data/nova/instances/aaa2d1c7-dbda-4bf2-8706-3e941b44b076/disk"/>
Nov 15 08:28:49 user nova-compute[95467]:       <target dev="vda" bus="virtio"/>
Nov 15 08:28:49 user nova-compute[95467]:     </disk>
Nov 15 08:28:49 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:28:49 user nova-compute[95467]:       <mac address="fa:16:3e:15:19:18"/>
Nov 15 08:28:49 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:28:49 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:28:49 user nova-compute[95467]:       <target dev="tap6130058a-f7"/>
Nov 15 08:28:49 user nova-compute[95467]:     </interface>
Nov 15 08:28:49 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:28:49 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/aaa2d1c7-dbda-4bf2-8706-3e941b44b076/console.log" append="off"/>
Nov 15 08:28:49 user nova-compute[95467]:     </serial>
Nov 15 08:28:49 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:28:49 user nova-compute[95467]:     <video>
Nov 15 08:28:49 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:28:49 user nova-compute[95467]:     </video>
Nov 15 08:28:49 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:28:49 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:28:49 user nova-compute[95467]:     </rng>
Nov 15 08:28:49 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:28:49 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:28:49 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:28:49 user nova-compute[95467]:     </memballoon>
Nov 15 08:28:49 user nova-compute[95467]:   </devices>
Nov 15 08:28:49 user nova-compute[95467]: </domain>
Nov 15 08:28:49 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:28:49 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:28:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-190117512',display_name='tempest-TestStampPattern-server-190117512',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-190117512',id=47,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGn0oxsNrNpRwH5qXJYkx21obo8Lj9sdybiQDlMglXKMhHyYV0IVC0OwmijdhcVEz8KfHXfjwjg/GO8OGaIkn6LxI/No3ftDsuwo7JsF5I0wAs7c8mGozFfZJ8NKgWtVJA==',key_name='tempest-TestStampPattern-1164290551',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b4ba53c039b4d699865e97ea1105843',ramdisk_id='',reservation_id='r-qb22x3mj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-89436842',owner_user_name='tempest-TestStampPattern-89436842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:28:48Z,user_data=None,user_id='0b1403873af04f78a6c2cbadcec38867',uuid=aaa2d1c7-dbda-4bf2-8706-3e941b44b076,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6130058a-f78c-4f81-b4a8-233863e6ae8c", "address": "fa:16:3e:15:19:18", "network": {"id": "a0f0cb10-26c8-4299-8a7e-4d34cfd26c82", "bridge": "br-int", "label": "tempest-TestStampPattern-737883783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b4ba53c039b4d699865e97ea1105843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6130058a-f7", "ovs_interfaceid": "6130058a-f78c-4f81-b4a8-233863e6ae8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:28:49 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Converting VIF {"id": "6130058a-f78c-4f81-b4a8-233863e6ae8c", "address": "fa:16:3e:15:19:18", "network": {"id": "a0f0cb10-26c8-4299-8a7e-4d34cfd26c82", "bridge": "br-int", "label": "tempest-TestStampPattern-737883783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b4ba53c039b4d699865e97ea1105843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6130058a-f7", "ovs_interfaceid": "6130058a-f78c-4f81-b4a8-233863e6ae8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:28:49 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:19:18,bridge_name='br-int',has_traffic_filtering=True,id=6130058a-f78c-4f81-b4a8-233863e6ae8c,network=Network(a0f0cb10-26c8-4299-8a7e-4d34cfd26c82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6130058a-f7') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:28:49 user nova-compute[95467]: DEBUG os_vif [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:19:18,bridge_name='br-int',has_traffic_filtering=True,id=6130058a-f78c-4f81-b4a8-233863e6ae8c,network=Network(a0f0cb10-26c8-4299-8a7e-4d34cfd26c82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6130058a-f7') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:28:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:28:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:28:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:28:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:28:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '42b23783-bf70-5851-b067-3609f2369575', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:28:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:28:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:28:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:28:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6130058a-f7, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:28:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6130058a-f7, col_values=(('qos', UUID('05db1819-986f-4c8e-8a9b-7b61618fe96d')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:28:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6130058a-f7, col_values=(('external_ids', {'iface-id': '6130058a-f78c-4f81-b4a8-233863e6ae8c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:19:18', 'vm-uuid': 'aaa2d1c7-dbda-4bf2-8706-3e941b44b076'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:28:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:28:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:28:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:28:49 user nova-compute[95467]: INFO os_vif [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:19:18,bridge_name='br-int',has_traffic_filtering=True,id=6130058a-f78c-4f81-b4a8-233863e6ae8c,network=Network(a0f0cb10-26c8-4299-8a7e-4d34cfd26c82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6130058a-f7')
Nov 15 08:28:49 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:28:49 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] No VIF found with MAC fa:16:3e:15:19:18, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:28:49 user nova-compute[95467]: DEBUG nova.network.neutron [req-5abcad9a-a940-4de3-90ae-623a9d9d9dd0 req-257de439-3caa-4546-b000-7576d2186684 service nova] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Updated VIF entry in instance network info cache for port 6130058a-f78c-4f81-b4a8-233863e6ae8c. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:28:49 user nova-compute[95467]: DEBUG nova.network.neutron [req-5abcad9a-a940-4de3-90ae-623a9d9d9dd0 req-257de439-3caa-4546-b000-7576d2186684 service nova] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Updating instance_info_cache with network_info: [{"id": "6130058a-f78c-4f81-b4a8-233863e6ae8c", "address": "fa:16:3e:15:19:18", "network": {"id": "a0f0cb10-26c8-4299-8a7e-4d34cfd26c82", "bridge": "br-int", "label": "tempest-TestStampPattern-737883783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b4ba53c039b4d699865e97ea1105843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6130058a-f7", "ovs_interfaceid": "6130058a-f78c-4f81-b4a8-233863e6ae8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:28:49 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:28:49 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=95467) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 08:28:49 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-5abcad9a-a940-4de3-90ae-623a9d9d9dd0 req-257de439-3caa-4546-b000-7576d2186684 service nova] Releasing lock "refresh_cache-aaa2d1c7-dbda-4bf2-8706-3e941b44b076" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:28:50 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:28:50 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:28:50 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:28:50 user nova-compute[95467]: DEBUG nova.compute.manager [req-d7ec23ea-24d8-46ee-8339-22b96c28239b req-fdb8db23-fd07-4191-9ad6-1de7b4e16c29 service nova] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Received event network-vif-plugged-6130058a-f78c-4f81-b4a8-233863e6ae8c {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:28:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-d7ec23ea-24d8-46ee-8339-22b96c28239b req-fdb8db23-fd07-4191-9ad6-1de7b4e16c29 service nova] Acquiring lock "aaa2d1c7-dbda-4bf2-8706-3e941b44b076-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:28:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-d7ec23ea-24d8-46ee-8339-22b96c28239b req-fdb8db23-fd07-4191-9ad6-1de7b4e16c29 service nova] Lock "aaa2d1c7-dbda-4bf2-8706-3e941b44b076-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:28:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-d7ec23ea-24d8-46ee-8339-22b96c28239b req-fdb8db23-fd07-4191-9ad6-1de7b4e16c29 service nova] Lock "aaa2d1c7-dbda-4bf2-8706-3e941b44b076-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:28:50 user nova-compute[95467]: DEBUG nova.compute.manager [req-d7ec23ea-24d8-46ee-8339-22b96c28239b req-fdb8db23-fd07-4191-9ad6-1de7b4e16c29 service nova] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] No waiting events found dispatching network-vif-plugged-6130058a-f78c-4f81-b4a8-233863e6ae8c {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:28:50 user nova-compute[95467]: WARNING nova.compute.manager [req-d7ec23ea-24d8-46ee-8339-22b96c28239b req-fdb8db23-fd07-4191-9ad6-1de7b4e16c29 service nova] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Received unexpected event network-vif-plugged-6130058a-f78c-4f81-b4a8-233863e6ae8c for instance with vm_state building and task_state spawning.
Nov 15 08:28:51 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:28:51 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:28:51 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:28:51 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:28:51 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager.update_available_resource {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:28:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:28:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:28:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:28:51 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Auditing locally available compute resources for user (node: user) {{(pid=95467) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 08:28:52 user nova-compute[95467]: DEBUG nova.compute.manager [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Instance event wait completed in 0 seconds for  {{(pid=95467) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 08:28:52 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Guest created on hypervisor {{(pid=95467) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 08:28:52 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Instance spawned successfully.
Nov 15 08:28:52 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 08:28:52 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Found default for hw_cdrom_bus of ide {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:28:52 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Found default for hw_disk_bus of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:28:52 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Found default for hw_input_bus of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:28:52 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Found default for hw_pointer_model of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:28:52 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Found default for hw_video_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:28:52 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Found default for hw_vif_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:28:52 user nova-compute[95467]: INFO nova.compute.manager [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Took 5.07 seconds to spawn the instance on the hypervisor.
Nov 15 08:28:52 user nova-compute[95467]: DEBUG nova.compute.manager [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:28:52 user nova-compute[95467]: DEBUG nova.compute.manager [req-804fcbba-d0b8-44ee-ab25-d31046b30cfa req-8135091d-d1c9-4d3d-87ec-e3c36f489e09 service nova] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Received event network-vif-plugged-6130058a-f78c-4f81-b4a8-233863e6ae8c {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:28:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-804fcbba-d0b8-44ee-ab25-d31046b30cfa req-8135091d-d1c9-4d3d-87ec-e3c36f489e09 service nova] Acquiring lock "aaa2d1c7-dbda-4bf2-8706-3e941b44b076-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:28:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-804fcbba-d0b8-44ee-ab25-d31046b30cfa req-8135091d-d1c9-4d3d-87ec-e3c36f489e09 service nova] Lock "aaa2d1c7-dbda-4bf2-8706-3e941b44b076-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:28:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-804fcbba-d0b8-44ee-ab25-d31046b30cfa req-8135091d-d1c9-4d3d-87ec-e3c36f489e09 service nova] Lock "aaa2d1c7-dbda-4bf2-8706-3e941b44b076-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:28:52 user nova-compute[95467]: DEBUG nova.compute.manager [req-804fcbba-d0b8-44ee-ab25-d31046b30cfa req-8135091d-d1c9-4d3d-87ec-e3c36f489e09 service nova] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] No waiting events found dispatching network-vif-plugged-6130058a-f78c-4f81-b4a8-233863e6ae8c {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:28:52 user nova-compute[95467]: WARNING nova.compute.manager [req-804fcbba-d0b8-44ee-ab25-d31046b30cfa req-8135091d-d1c9-4d3d-87ec-e3c36f489e09 service nova] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Received unexpected event network-vif-plugged-6130058a-f78c-4f81-b4a8-233863e6ae8c for instance with vm_state building and task_state spawning.
Nov 15 08:28:52 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:28:52 user nova-compute[95467]: INFO nova.compute.manager [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Took 5.96 seconds to build instance.
Nov 15 08:28:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d22eb02b-7e8d-4755-9f1e-3eee56ddec0c/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:28:53 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-162212cf-7baf-47a0-aa4d-64a7fc97724c tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Lock "aaa2d1c7-dbda-4bf2-8706-3e941b44b076" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.127s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:28:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d22eb02b-7e8d-4755-9f1e-3eee56ddec0c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:28:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d22eb02b-7e8d-4755-9f1e-3eee56ddec0c/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:28:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d22eb02b-7e8d-4755-9f1e-3eee56ddec0c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:28:53 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:28:53 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:28:53 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:28:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk.rescue --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:28:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:28:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk.rescue --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:28:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:28:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:28:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:28:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:28:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:28:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ab4ef11-de3f-44a9-9242-916753481479/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:28:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ab4ef11-de3f-44a9-9242-916753481479/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:28:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ab4ef11-de3f-44a9-9242-916753481479/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:28:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:28:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ab4ef11-de3f-44a9-9242-916753481479/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:28:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaa2d1c7-dbda-4bf2-8706-3e941b44b076/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:28:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaa2d1c7-dbda-4bf2-8706-3e941b44b076/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:28:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaa2d1c7-dbda-4bf2-8706-3e941b44b076/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:28:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaa2d1c7-dbda-4bf2-8706-3e941b44b076/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:28:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:28:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:28:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:28:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:28:55 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:28:55 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:28:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:28:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:28:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:28:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:28:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091612cf-b737-480b-984e-a05b522676b6/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:28:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091612cf-b737-480b-984e-a05b522676b6/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:28:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091612cf-b737-480b-984e-a05b522676b6/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:28:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091612cf-b737-480b-984e-a05b522676b6/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:28:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/739645e6-9952-40db-a876-f23d02d4e411/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:28:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/739645e6-9952-40db-a876-f23d02d4e411/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:28:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/739645e6-9952-40db-a876-f23d02d4e411/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:28:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/739645e6-9952-40db-a876-f23d02d4e411/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:28:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:28:56 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:28:56 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:28:56 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Hypervisor/Node resource view: name=user free_ram=7447MB free_disk=24.89681625366211GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=95467) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 08:28:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:28:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:28:56 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 21cf2ada-b15c-490d-ac37-96e9c87e9056 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:28:56 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:28:56 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 10d73b73-ca65-4192-8954-288dc1df9f24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:28:56 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 3825a691-ac5c-4c06-b4a4-2a0b40c638c4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:28:56 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 091612cf-b737-480b-984e-a05b522676b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:28:56 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 739645e6-9952-40db-a876-f23d02d4e411 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:28:56 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance ba05c01d-ae74-467c-a309-4d0ba904453d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:28:56 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 7eb1f0ce-72bd-4015-993c-a32404f15481 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:28:56 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance d22eb02b-7e8d-4755-9f1e-3eee56ddec0c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:28:56 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 2838af21-2749-4e6b-b4d3-c0d79379dfb5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:28:56 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 4ab4ef11-de3f-44a9-9242-916753481479 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:28:56 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance aaa2d1c7-dbda-4bf2-8706-3e941b44b076 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:28:56 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 08:28:56 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 08:28:57 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:28:57 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:28:57 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Compute_service record updated for user:user {{(pid=95467) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 08:28:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.841s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:28:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:28:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:28:58 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:28:58 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:28:58 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Starting heal instance info cache {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 08:28:58 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "refresh_cache-10d73b73-ca65-4192-8954-288dc1df9f24" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:28:58 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquired lock "refresh_cache-10d73b73-ca65-4192-8954-288dc1df9f24" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:28:58 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Forcefully refreshing network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 08:28:59 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Updating instance_info_cache with network_info: [{"id": "b88ee27b-7174-45f5-a5a5-45db71caac08", "address": "fa:16:3e:a0:3b:16", "network": {"id": "369d2a6f-60b7-4c92-8b2d-1f3828f6698b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1491709218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd281be4e94a4d31a47a13267d51d9b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb88ee27b-71", "ovs_interfaceid": "b88ee27b-7174-45f5-a5a5-45db71caac08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:28:59 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Releasing lock "refresh_cache-10d73b73-ca65-4192-8954-288dc1df9f24" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:28:59 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Updated the network info_cache for instance {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 08:28:59 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:28:59 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:28:59 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:28:59 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:28:59 user nova-compute[95467]: DEBUG nova.compute.manager [req-736d84ea-0a09-4804-a75b-60bd20fc14be req-3ca0cc92-b6b6-4b11-9e1d-a52cd0f2db44 service nova] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Received event network-changed-fcfde46b-01e2-414d-a7ab-0d393dd98e3b {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:28:59 user nova-compute[95467]: DEBUG nova.compute.manager [req-736d84ea-0a09-4804-a75b-60bd20fc14be req-3ca0cc92-b6b6-4b11-9e1d-a52cd0f2db44 service nova] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Refreshing instance network info cache due to event network-changed-fcfde46b-01e2-414d-a7ab-0d393dd98e3b. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:28:59 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-736d84ea-0a09-4804-a75b-60bd20fc14be req-3ca0cc92-b6b6-4b11-9e1d-a52cd0f2db44 service nova] Acquiring lock "refresh_cache-2838af21-2749-4e6b-b4d3-c0d79379dfb5" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:28:59 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-736d84ea-0a09-4804-a75b-60bd20fc14be req-3ca0cc92-b6b6-4b11-9e1d-a52cd0f2db44 service nova] Acquired lock "refresh_cache-2838af21-2749-4e6b-b4d3-c0d79379dfb5" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:28:59 user nova-compute[95467]: DEBUG nova.network.neutron [req-736d84ea-0a09-4804-a75b-60bd20fc14be req-3ca0cc92-b6b6-4b11-9e1d-a52cd0f2db44 service nova] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Refreshing network info cache for port fcfde46b-01e2-414d-a7ab-0d393dd98e3b {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:28:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:28:59 user nova-compute[95467]: DEBUG nova.network.neutron [req-736d84ea-0a09-4804-a75b-60bd20fc14be req-3ca0cc92-b6b6-4b11-9e1d-a52cd0f2db44 service nova] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Updated VIF entry in instance network info cache for port fcfde46b-01e2-414d-a7ab-0d393dd98e3b. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:28:59 user nova-compute[95467]: DEBUG nova.network.neutron [req-736d84ea-0a09-4804-a75b-60bd20fc14be req-3ca0cc92-b6b6-4b11-9e1d-a52cd0f2db44 service nova] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Updating instance_info_cache with network_info: [{"id": "fcfde46b-01e2-414d-a7ab-0d393dd98e3b", "address": "fa:16:3e:1c:d7:29", "network": {"id": "96d9262b-11fb-497d-8e38-fa46076c010f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2069167691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7791bd92c7c488aa72474ecde2e1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcfde46b-01", "ovs_interfaceid": "fcfde46b-01e2-414d-a7ab-0d393dd98e3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:28:59 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-736d84ea-0a09-4804-a75b-60bd20fc14be req-3ca0cc92-b6b6-4b11-9e1d-a52cd0f2db44 service nova] Releasing lock "refresh_cache-2838af21-2749-4e6b-b4d3-c0d79379dfb5" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:28:59 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:29:00 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-b038e17f-0cdb-441f-bb82-0d083bb54134 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Acquiring lock "2838af21-2749-4e6b-b4d3-c0d79379dfb5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:29:00 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-b038e17f-0cdb-441f-bb82-0d083bb54134 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "2838af21-2749-4e6b-b4d3-c0d79379dfb5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:29:00 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-b038e17f-0cdb-441f-bb82-0d083bb54134 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Acquiring lock "2838af21-2749-4e6b-b4d3-c0d79379dfb5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:29:00 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-b038e17f-0cdb-441f-bb82-0d083bb54134 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "2838af21-2749-4e6b-b4d3-c0d79379dfb5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:29:00 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-b038e17f-0cdb-441f-bb82-0d083bb54134 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "2838af21-2749-4e6b-b4d3-c0d79379dfb5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:29:00 user nova-compute[95467]: INFO nova.compute.manager [None req-b038e17f-0cdb-441f-bb82-0d083bb54134 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Terminating instance
Nov 15 08:29:00 user nova-compute[95467]: DEBUG nova.compute.manager [None req-b038e17f-0cdb-441f-bb82-0d083bb54134 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Start destroying the instance on the hypervisor. {{(pid=95467) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 08:29:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:29:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:29:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:29:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:29:00 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Instance destroyed successfully.
Nov 15 08:29:00 user nova-compute[95467]: DEBUG nova.objects.instance [None req-b038e17f-0cdb-441f-bb82-0d083bb54134 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lazy-loading 'resources' on Instance uuid 2838af21-2749-4e6b-b4d3-c0d79379dfb5 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:29:00 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-b038e17f-0cdb-441f-bb82-0d083bb54134 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:27:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1279975625',display_name='tempest-TestVolumeBootPattern-server-1279975625',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1279975625',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGn1slhlv/lpfM2oYeApx9piTNh8psQp9CpZOaXQ+Ydt2JJikCfOrBRqv7qZ3oUV5yn53tl6dDTEsiUIm5m/x3Q62LZpqk25/AJiUoLr4SnG2Qg5vjpEqPX27JlljHO+ew==',key_name='tempest-TestVolumeBootPattern-1986786502',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:27:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e7791bd92c7c488aa72474ecde2e1155',ramdisk_id='',reservation_id='r-3a81a6y8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-978207351',owner_user_name='tempest-TestVolumeBootPattern-978207351-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:27:18Z,user_data=None,user_id='11bbbd3ef322402cb5dc60455a54319b',uuid=2838af21-2749-4e6b-b4d3-c0d79379dfb5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fcfde46b-01e2-414d-a7ab-0d393dd98e3b", "address": "fa:16:3e:1c:d7:29", "network": {"id": "96d9262b-11fb-497d-8e38-fa46076c010f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2069167691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7791bd92c7c488aa72474ecde2e1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcfde46b-01", "ovs_interfaceid": "fcfde46b-01e2-414d-a7ab-0d393dd98e3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:29:00 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-b038e17f-0cdb-441f-bb82-0d083bb54134 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Converting VIF {"id": "fcfde46b-01e2-414d-a7ab-0d393dd98e3b", "address": "fa:16:3e:1c:d7:29", "network": {"id": "96d9262b-11fb-497d-8e38-fa46076c010f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2069167691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7791bd92c7c488aa72474ecde2e1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcfde46b-01", "ovs_interfaceid": "fcfde46b-01e2-414d-a7ab-0d393dd98e3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:29:00 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-b038e17f-0cdb-441f-bb82-0d083bb54134 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:d7:29,bridge_name='br-int',has_traffic_filtering=True,id=fcfde46b-01e2-414d-a7ab-0d393dd98e3b,network=Network(96d9262b-11fb-497d-8e38-fa46076c010f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcfde46b-01') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:29:00 user nova-compute[95467]: DEBUG os_vif [None req-b038e17f-0cdb-441f-bb82-0d083bb54134 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:d7:29,bridge_name='br-int',has_traffic_filtering=True,id=fcfde46b-01e2-414d-a7ab-0d393dd98e3b,network=Network(96d9262b-11fb-497d-8e38-fa46076c010f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcfde46b-01') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:29:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:29:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfcfde46b-01, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:29:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:29:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:29:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:29:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6672315d-eb32-4d2b-8427-31e37474de10) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:29:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:29:00 user nova-compute[95467]: INFO os_vif [None req-b038e17f-0cdb-441f-bb82-0d083bb54134 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:d7:29,bridge_name='br-int',has_traffic_filtering=True,id=fcfde46b-01e2-414d-a7ab-0d393dd98e3b,network=Network(96d9262b-11fb-497d-8e38-fa46076c010f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcfde46b-01')
Nov 15 08:29:00 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b038e17f-0cdb-441f-bb82-0d083bb54134 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] calling os-brick to detach iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 08:29:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-b038e17f-0cdb-441f-bb82-0d083bb54134 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, {'target_iqn': 'iqn.2010-10.org.openstack:2dbf6208-1a82-45a0-a862-3296f3c690e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NTiDFpKI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:29:00 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-b038e17f-0cdb-441f-bb82-0d083bb54134 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:29:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-b038e17f-0cdb-441f-bb82-0d083bb54134 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:29:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-b038e17f-0cdb-441f-bb82-0d083bb54134 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:29:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:29:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.043s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:29:00 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfeeb885-ccdf-4671-a040-5bf288e7576c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2dbf6208-1a82-45a0-a862-3296f3c690e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:29:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-b038e17f-0cdb-441f-bb82-0d083bb54134 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 08:29:00 user nova-compute[95467]: No targets found.
Nov 15 08:29:00 user nova-compute[95467]: iSNS:
Nov 15 08:29:00 user nova-compute[95467]: No targets found.
Nov 15 08:29:00 user nova-compute[95467]: STATIC:
Nov 15 08:29:00 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24
Nov 15 08:29:00 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:29:00 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:29:00 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b
Nov 15 08:29:00 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:29:00 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:29:00 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0
Nov 15 08:29:00 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:29:00 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:29:00 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e
Nov 15 08:29:00 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:29:00 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:29:00 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373
Nov 15 08:29:00 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:29:00 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:29:00 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:2dbf6208-1a82-45a0-a862-3296f3c690e4
Nov 15 08:29:00 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:29:00 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:29:00 user nova-compute[95467]: FIRMWARE:
Nov 15 08:29:00 user nova-compute[95467]: No targets found.
Nov 15 08:29:00 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:29:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-b038e17f-0cdb-441f-bb82-0d083bb54134 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 08:29:00 user nova-compute[95467]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 08:29:00 user nova-compute[95467]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=95467) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 08:29:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-b038e17f-0cdb-441f-bb82-0d083bb54134 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2dbf6208-1a82-45a0-a862-3296f3c690e4', 0)] {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 08:29:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:29:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:29:00 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d5f4dba-c72e-4121-8601-6c89f0113a27]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2dbf6208-1a82-45a0-a862-3296f3c690e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:29:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:29:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:29:00 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8e0c81-5c25-4665-b689-3d42ff133be3]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dbf6208-1a82-45a0-a862-3296f3c690e4 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:29:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-b038e17f-0cdb-441f-bb82-0d083bb54134 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:29:00 user nova-compute[95467]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)
Nov 15 08:29:00 user nova-compute[95467]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:29:00 user nova-compute[95467]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 (non-flash)
Nov 15 08:29:00 user nova-compute[95467]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dbf6208-1a82-45a0-a862-3296f3c690e4 (non-flash)
Nov 15 08:29:00 user nova-compute[95467]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 (non-flash)
Nov 15 08:29:00 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:29:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-b038e17f-0cdb-441f-bb82-0d083bb54134 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:29:00 user nova-compute[95467]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)
Nov 15 08:29:00 user nova-compute[95467]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:29:00 user nova-compute[95467]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 (non-flash)
Nov 15 08:29:00 user nova-compute[95467]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dbf6208-1a82-45a0-a862-3296f3c690e4 (non-flash)
Nov 15 08:29:00 user nova-compute[95467]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 (non-flash)
Nov 15 08:29:00 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:29:00 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-b038e17f-0cdb-441f-bb82-0d083bb54134 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efed8434040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2dbf6208-1a82-45a0-a862-3296f3c690e4'): ({'sde'}, set())}) {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 08:29:00 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-b038e17f-0cdb-441f-bb82-0d083bb54134 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Removing single pathed devices sde {{(pid=95467) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 08:29:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:29:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:29:00 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5bbc25c-7999-4f3c-b42c-61919f36a216]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:29:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:29:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:29:00 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[533bed74-4df5-4df4-8bd2-9aa9ec42f4a7]: (4, ('ok\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:29:00 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-b038e17f-0cdb-441f-bb82-0d083bb54134 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Flushing IO for device /dev/sde {{(pid=95467) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 08:29:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:29:01 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:29:01 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[86cb5165-59f0-422f-8f69-c8fdc00958bd]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:29:01 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-b038e17f-0cdb-441f-bb82-0d083bb54134 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=95467) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 08:29:01 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:29:01 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.038s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:29:01 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[48980711-8224-4a81-a750-529666ba5fbc]: (4, ('1', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:29:01 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-b038e17f-0cdb-441f-bb82-0d083bb54134 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 08:29:01 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-b038e17f-0cdb-441f-bb82-0d083bb54134 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] SCSI volumes sde have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 08:29:01 user nova-compute[95467]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_f1a2abe7', '/dev/disk/by-id/scsi-23164376364323866', '/dev/disk/by-id/scsi-1SCST_BIOf1a2abe7-1d7cd28ff9c47b72') {{(pid=105611) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 08:29:01 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a5713a-5ac1-491f-848b-3d153bb9db49]: (4, None) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:29:01 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-b038e17f-0cdb-441f-bb82-0d083bb54134 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2dbf6208-1a82-45a0-a862-3296f3c690e4')] {{(pid=95467) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 08:29:01 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dbf6208-1a82-45a0-a862-3296f3c690e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:29:01 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dbf6208-1a82-45a0-a862-3296f3c690e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:29:01 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb1e09c-0a0d-46ec-9e08-3b945de58e94]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:29:01 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-b038e17f-0cdb-441f-bb82-0d083bb54134 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:29:01 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dbf6208-1a82-45a0-a862-3296f3c690e4 -p 172.16.0.220:3260 --logout {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:29:01 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dbf6208-1a82-45a0-a862-3296f3c690e4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:29:01 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67350e1-251d-4cb5-8419-d7cc1ac9f62c]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:2dbf6208-1a82-45a0-a862-3296f3c690e4, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:2dbf6208-1a82-45a0-a862-3296f3c690e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:29:01 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-b038e17f-0cdb-441f-bb82-0d083bb54134 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:2dbf6208-1a82-45a0-a862-3296f3c690e4, portal: 172.16.0.220,3260]
Nov 15 08:29:01 user nova-compute[95467]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:2dbf6208-1a82-45a0-a862-3296f3c690e4, portal: 172.16.0.220,3260] successful.
Nov 15 08:29:01 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:29:01 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dbf6208-1a82-45a0-a862-3296f3c690e4 -p 172.16.0.220:3260 --op delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:29:01 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dbf6208-1a82-45a0-a862-3296f3c690e4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:29:01 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db8d674-604e-4230-ac9d-dba6eba2b189]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:29:01 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-b038e17f-0cdb-441f-bb82-0d083bb54134 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:29:01 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-b038e17f-0cdb-441f-bb82-0d083bb54134 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:29:01 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-b038e17f-0cdb-441f-bb82-0d083bb54134 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] <== disconnect_volume: return (369ms) None {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:29:01 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b038e17f-0cdb-441f-bb82-0d083bb54134 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Disconnected iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 08:29:01 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-b038e17f-0cdb-441f-bb82-0d083bb54134 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Deleting instance files /opt/stack/data/nova/instances/2838af21-2749-4e6b-b4d3-c0d79379dfb5_del
Nov 15 08:29:01 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-b038e17f-0cdb-441f-bb82-0d083bb54134 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Deletion of /opt/stack/data/nova/instances/2838af21-2749-4e6b-b4d3-c0d79379dfb5_del complete
Nov 15 08:29:01 user nova-compute[95467]: DEBUG nova.compute.manager [req-e9cc1931-6993-42af-85c1-f41eac037970 req-04c6abf6-ca94-4318-bc4e-01b8ccea877a service nova] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Received event network-changed-fcfde46b-01e2-414d-a7ab-0d393dd98e3b {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:29:01 user nova-compute[95467]: DEBUG nova.compute.manager [req-e9cc1931-6993-42af-85c1-f41eac037970 req-04c6abf6-ca94-4318-bc4e-01b8ccea877a service nova] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Refreshing instance network info cache due to event network-changed-fcfde46b-01e2-414d-a7ab-0d393dd98e3b. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:29:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-e9cc1931-6993-42af-85c1-f41eac037970 req-04c6abf6-ca94-4318-bc4e-01b8ccea877a service nova] Acquiring lock "refresh_cache-2838af21-2749-4e6b-b4d3-c0d79379dfb5" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:29:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-e9cc1931-6993-42af-85c1-f41eac037970 req-04c6abf6-ca94-4318-bc4e-01b8ccea877a service nova] Acquired lock "refresh_cache-2838af21-2749-4e6b-b4d3-c0d79379dfb5" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:29:01 user nova-compute[95467]: DEBUG nova.network.neutron [req-e9cc1931-6993-42af-85c1-f41eac037970 req-04c6abf6-ca94-4318-bc4e-01b8ccea877a service nova] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Refreshing network info cache for port fcfde46b-01e2-414d-a7ab-0d393dd98e3b {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:29:01 user nova-compute[95467]: INFO nova.compute.manager [None req-b038e17f-0cdb-441f-bb82-0d083bb54134 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Took 1.24 seconds to destroy the instance on the hypervisor.
Nov 15 08:29:01 user nova-compute[95467]: DEBUG oslo.service.loopingcall [None req-b038e17f-0cdb-441f-bb82-0d083bb54134 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=95467) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 08:29:01 user nova-compute[95467]: DEBUG nova.compute.manager [-] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Deallocating network for instance {{(pid=95467) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 08:29:01 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] deallocate_for_instance() {{(pid=95467) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 08:29:01 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:29:01 user nova-compute[95467]: INFO nova.compute.manager [-] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Took 0.53 seconds to deallocate network for instance.
Nov 15 08:29:01 user nova-compute[95467]: DEBUG nova.compute.manager [req-398afe21-51ef-45f5-8ec0-4aa88d99d71a req-202031c5-709b-4e3b-8f46-a893d46d35a9 service nova] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Received event network-vif-deleted-fcfde46b-01e2-414d-a7ab-0d393dd98e3b {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:29:02 user nova-compute[95467]: DEBUG nova.network.neutron [req-e9cc1931-6993-42af-85c1-f41eac037970 req-04c6abf6-ca94-4318-bc4e-01b8ccea877a service nova] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Updated VIF entry in instance network info cache for port fcfde46b-01e2-414d-a7ab-0d393dd98e3b. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:29:02 user nova-compute[95467]: DEBUG nova.network.neutron [req-e9cc1931-6993-42af-85c1-f41eac037970 req-04c6abf6-ca94-4318-bc4e-01b8ccea877a service nova] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Updating instance_info_cache with network_info: [{"id": "fcfde46b-01e2-414d-a7ab-0d393dd98e3b", "address": "fa:16:3e:1c:d7:29", "network": {"id": "96d9262b-11fb-497d-8e38-fa46076c010f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2069167691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7791bd92c7c488aa72474ecde2e1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcfde46b-01", "ovs_interfaceid": "fcfde46b-01e2-414d-a7ab-0d393dd98e3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:29:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-e9cc1931-6993-42af-85c1-f41eac037970 req-04c6abf6-ca94-4318-bc4e-01b8ccea877a service nova] Releasing lock "refresh_cache-2838af21-2749-4e6b-b4d3-c0d79379dfb5" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:29:02 user nova-compute[95467]: DEBUG nova.compute.manager [req-e9cc1931-6993-42af-85c1-f41eac037970 req-04c6abf6-ca94-4318-bc4e-01b8ccea877a service nova] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Received event network-vif-unplugged-fcfde46b-01e2-414d-a7ab-0d393dd98e3b {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:29:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-e9cc1931-6993-42af-85c1-f41eac037970 req-04c6abf6-ca94-4318-bc4e-01b8ccea877a service nova] Acquiring lock "2838af21-2749-4e6b-b4d3-c0d79379dfb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:29:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-e9cc1931-6993-42af-85c1-f41eac037970 req-04c6abf6-ca94-4318-bc4e-01b8ccea877a service nova] Lock "2838af21-2749-4e6b-b4d3-c0d79379dfb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:29:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-e9cc1931-6993-42af-85c1-f41eac037970 req-04c6abf6-ca94-4318-bc4e-01b8ccea877a service nova] Lock "2838af21-2749-4e6b-b4d3-c0d79379dfb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:29:02 user nova-compute[95467]: DEBUG nova.compute.manager [req-e9cc1931-6993-42af-85c1-f41eac037970 req-04c6abf6-ca94-4318-bc4e-01b8ccea877a service nova] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] No waiting events found dispatching network-vif-unplugged-fcfde46b-01e2-414d-a7ab-0d393dd98e3b {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:29:02 user nova-compute[95467]: DEBUG nova.compute.manager [req-e9cc1931-6993-42af-85c1-f41eac037970 req-04c6abf6-ca94-4318-bc4e-01b8ccea877a service nova] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Received event network-vif-unplugged-fcfde46b-01e2-414d-a7ab-0d393dd98e3b for instance with task_state deleting. {{(pid=95467) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 08:29:02 user nova-compute[95467]: DEBUG nova.compute.manager [req-e9cc1931-6993-42af-85c1-f41eac037970 req-04c6abf6-ca94-4318-bc4e-01b8ccea877a service nova] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Received event network-vif-plugged-fcfde46b-01e2-414d-a7ab-0d393dd98e3b {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:29:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-e9cc1931-6993-42af-85c1-f41eac037970 req-04c6abf6-ca94-4318-bc4e-01b8ccea877a service nova] Acquiring lock "2838af21-2749-4e6b-b4d3-c0d79379dfb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:29:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-e9cc1931-6993-42af-85c1-f41eac037970 req-04c6abf6-ca94-4318-bc4e-01b8ccea877a service nova] Lock "2838af21-2749-4e6b-b4d3-c0d79379dfb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:29:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-e9cc1931-6993-42af-85c1-f41eac037970 req-04c6abf6-ca94-4318-bc4e-01b8ccea877a service nova] Lock "2838af21-2749-4e6b-b4d3-c0d79379dfb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:29:02 user nova-compute[95467]: DEBUG nova.compute.manager [req-e9cc1931-6993-42af-85c1-f41eac037970 req-04c6abf6-ca94-4318-bc4e-01b8ccea877a service nova] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] No waiting events found dispatching network-vif-plugged-fcfde46b-01e2-414d-a7ab-0d393dd98e3b {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:29:02 user nova-compute[95467]: WARNING nova.compute.manager [req-e9cc1931-6993-42af-85c1-f41eac037970 req-04c6abf6-ca94-4318-bc4e-01b8ccea877a service nova] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Received unexpected event network-vif-plugged-fcfde46b-01e2-414d-a7ab-0d393dd98e3b for instance with vm_state active and task_state deleting.
Nov 15 08:29:02 user nova-compute[95467]: INFO nova.compute.manager [None req-b038e17f-0cdb-441f-bb82-0d083bb54134 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 2838af21-2749-4e6b-b4d3-c0d79379dfb5] Took 0.85 seconds to detach 1 volumes for instance.
Nov 15 08:29:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-b038e17f-0cdb-441f-bb82-0d083bb54134 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:29:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-b038e17f-0cdb-441f-bb82-0d083bb54134 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:29:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:29:03 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-b038e17f-0cdb-441f-bb82-0d083bb54134 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:29:03 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-b038e17f-0cdb-441f-bb82-0d083bb54134 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:29:03 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-b038e17f-0cdb-441f-bb82-0d083bb54134 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.394s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:29:03 user nova-compute[95467]: INFO nova.scheduler.client.report [None req-b038e17f-0cdb-441f-bb82-0d083bb54134 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Deleted allocations for instance 2838af21-2749-4e6b-b4d3-c0d79379dfb5
Nov 15 08:29:03 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-b038e17f-0cdb-441f-bb82-0d083bb54134 tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "2838af21-2749-4e6b-b4d3-c0d79379dfb5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.184s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:29:05 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:29:07 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:29:10 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:29:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:29:15 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:29:16 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-37075788-ed36-4784-a556-0cf6e12ce43e tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Acquiring lock "4ab4ef11-de3f-44a9-9242-916753481479" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:29:16 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-37075788-ed36-4784-a556-0cf6e12ce43e tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Lock "4ab4ef11-de3f-44a9-9242-916753481479" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:29:16 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-37075788-ed36-4784-a556-0cf6e12ce43e tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Acquiring lock "4ab4ef11-de3f-44a9-9242-916753481479-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:29:16 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-37075788-ed36-4784-a556-0cf6e12ce43e tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Lock "4ab4ef11-de3f-44a9-9242-916753481479-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:29:16 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-37075788-ed36-4784-a556-0cf6e12ce43e tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Lock "4ab4ef11-de3f-44a9-9242-916753481479-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:29:16 user nova-compute[95467]: INFO nova.compute.manager [None req-37075788-ed36-4784-a556-0cf6e12ce43e tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 4ab4ef11-de3f-44a9-9242-916753481479] Terminating instance
Nov 15 08:29:16 user nova-compute[95467]: DEBUG nova.compute.manager [None req-37075788-ed36-4784-a556-0cf6e12ce43e tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 4ab4ef11-de3f-44a9-9242-916753481479] Start destroying the instance on the hypervisor. {{(pid=95467) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 08:29:16 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:29:16 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:29:16 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:29:16 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:29:16 user nova-compute[95467]: DEBUG nova.compute.manager [req-329b354a-0d0c-4150-a7f0-18547b1a5153 req-d34c2f95-1839-4f9a-9a20-c3a68577f590 service nova] [instance: 4ab4ef11-de3f-44a9-9242-916753481479] Received event network-vif-unplugged-fa02d839-91a1-4f1f-a8f1-046aa61a7f70 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:29:16 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-329b354a-0d0c-4150-a7f0-18547b1a5153 req-d34c2f95-1839-4f9a-9a20-c3a68577f590 service nova] Acquiring lock "4ab4ef11-de3f-44a9-9242-916753481479-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:29:16 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-329b354a-0d0c-4150-a7f0-18547b1a5153 req-d34c2f95-1839-4f9a-9a20-c3a68577f590 service nova] Lock "4ab4ef11-de3f-44a9-9242-916753481479-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:29:16 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-329b354a-0d0c-4150-a7f0-18547b1a5153 req-d34c2f95-1839-4f9a-9a20-c3a68577f590 service nova] Lock "4ab4ef11-de3f-44a9-9242-916753481479-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:29:16 user nova-compute[95467]: DEBUG nova.compute.manager [req-329b354a-0d0c-4150-a7f0-18547b1a5153 req-d34c2f95-1839-4f9a-9a20-c3a68577f590 service nova] [instance: 4ab4ef11-de3f-44a9-9242-916753481479] No waiting events found dispatching network-vif-unplugged-fa02d839-91a1-4f1f-a8f1-046aa61a7f70 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:29:16 user nova-compute[95467]: DEBUG nova.compute.manager [req-329b354a-0d0c-4150-a7f0-18547b1a5153 req-d34c2f95-1839-4f9a-9a20-c3a68577f590 service nova] [instance: 4ab4ef11-de3f-44a9-9242-916753481479] Received event network-vif-unplugged-fa02d839-91a1-4f1f-a8f1-046aa61a7f70 for instance with task_state deleting. {{(pid=95467) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 08:29:17 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 4ab4ef11-de3f-44a9-9242-916753481479] Instance destroyed successfully.
Nov 15 08:29:17 user nova-compute[95467]: DEBUG nova.objects.instance [None req-37075788-ed36-4784-a556-0cf6e12ce43e tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Lazy-loading 'resources' on Instance uuid 4ab4ef11-de3f-44a9-9242-916753481479 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:29:17 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-37075788-ed36-4784-a556-0cf6e12ce43e tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:27:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1368499512',display_name='tempest-VolumesActionsTest-instance-1368499512',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1368499512',id=46,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:27:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e179db7f977c4d98abb497c6a3b4f5e9',ramdisk_id='',reservation_id='r-2vv3xjry',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1524883282',owner_user_name='tempest-VolumesActionsTest-1524883282-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:27:35Z,user_data=None,user_id='21abcb55c48d44af8a215cdc4013a065',uuid=4ab4ef11-de3f-44a9-9242-916753481479,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fa02d839-91a1-4f1f-a8f1-046aa61a7f70", "address": "fa:16:3e:56:6f:ab", "network": {"id": "3bb97374-8e3e-4364-a350-dbe265332087", "bridge": "br-int", "label": "tempest-VolumesActionsTest-966132722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e179db7f977c4d98abb497c6a3b4f5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa02d839-91", "ovs_interfaceid": "fa02d839-91a1-4f1f-a8f1-046aa61a7f70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:29:17 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-37075788-ed36-4784-a556-0cf6e12ce43e tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Converting VIF {"id": "fa02d839-91a1-4f1f-a8f1-046aa61a7f70", "address": "fa:16:3e:56:6f:ab", "network": {"id": "3bb97374-8e3e-4364-a350-dbe265332087", "bridge": "br-int", "label": "tempest-VolumesActionsTest-966132722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e179db7f977c4d98abb497c6a3b4f5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa02d839-91", "ovs_interfaceid": "fa02d839-91a1-4f1f-a8f1-046aa61a7f70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:29:17 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-37075788-ed36-4784-a556-0cf6e12ce43e tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:6f:ab,bridge_name='br-int',has_traffic_filtering=True,id=fa02d839-91a1-4f1f-a8f1-046aa61a7f70,network=Network(3bb97374-8e3e-4364-a350-dbe265332087),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa02d839-91') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:29:17 user nova-compute[95467]: DEBUG os_vif [None req-37075788-ed36-4784-a556-0cf6e12ce43e tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:6f:ab,bridge_name='br-int',has_traffic_filtering=True,id=fa02d839-91a1-4f1f-a8f1-046aa61a7f70,network=Network(3bb97374-8e3e-4364-a350-dbe265332087),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa02d839-91') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:29:17 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:29:17 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfa02d839-91, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:29:17 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:29:17 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:29:17 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:29:17 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=46bc0896-6191-48da-afef-46a36e655747) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:29:17 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:29:17 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:29:17 user nova-compute[95467]: INFO os_vif [None req-37075788-ed36-4784-a556-0cf6e12ce43e tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:6f:ab,bridge_name='br-int',has_traffic_filtering=True,id=fa02d839-91a1-4f1f-a8f1-046aa61a7f70,network=Network(3bb97374-8e3e-4364-a350-dbe265332087),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa02d839-91')
Nov 15 08:29:17 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-37075788-ed36-4784-a556-0cf6e12ce43e tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 4ab4ef11-de3f-44a9-9242-916753481479] Deleting instance files /opt/stack/data/nova/instances/4ab4ef11-de3f-44a9-9242-916753481479_del
Nov 15 08:29:17 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-37075788-ed36-4784-a556-0cf6e12ce43e tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 4ab4ef11-de3f-44a9-9242-916753481479] Deletion of /opt/stack/data/nova/instances/4ab4ef11-de3f-44a9-9242-916753481479_del complete
Nov 15 08:29:17 user nova-compute[95467]: INFO nova.compute.manager [None req-37075788-ed36-4784-a556-0cf6e12ce43e tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] [instance: 4ab4ef11-de3f-44a9-9242-916753481479] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 15 08:29:17 user nova-compute[95467]: DEBUG oslo.service.loopingcall [None req-37075788-ed36-4784-a556-0cf6e12ce43e tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=95467) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 08:29:17 user nova-compute[95467]: DEBUG nova.compute.manager [-] [instance: 4ab4ef11-de3f-44a9-9242-916753481479] Deallocating network for instance {{(pid=95467) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 08:29:17 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: 4ab4ef11-de3f-44a9-9242-916753481479] deallocate_for_instance() {{(pid=95467) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 08:29:17 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: 4ab4ef11-de3f-44a9-9242-916753481479] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:29:17 user nova-compute[95467]: INFO nova.compute.manager [-] [instance: 4ab4ef11-de3f-44a9-9242-916753481479] Took 0.54 seconds to deallocate network for instance.
Nov 15 08:29:17 user nova-compute[95467]: DEBUG nova.compute.manager [req-0110bba9-0edd-4d35-9147-f8fdc14cba54 req-dd14c1db-f4e5-4b18-8aaf-1c608d367e8d service nova] [instance: 4ab4ef11-de3f-44a9-9242-916753481479] Received event network-vif-deleted-fa02d839-91a1-4f1f-a8f1-046aa61a7f70 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:29:17 user nova-compute[95467]: INFO nova.compute.manager [req-0110bba9-0edd-4d35-9147-f8fdc14cba54 req-dd14c1db-f4e5-4b18-8aaf-1c608d367e8d service nova] [instance: 4ab4ef11-de3f-44a9-9242-916753481479] Neutron deleted interface fa02d839-91a1-4f1f-a8f1-046aa61a7f70; detaching it from the instance and deleting it from the info cache
Nov 15 08:29:17 user nova-compute[95467]: DEBUG nova.network.neutron [req-0110bba9-0edd-4d35-9147-f8fdc14cba54 req-dd14c1db-f4e5-4b18-8aaf-1c608d367e8d service nova] [instance: 4ab4ef11-de3f-44a9-9242-916753481479] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:29:17 user nova-compute[95467]: DEBUG nova.compute.manager [req-0110bba9-0edd-4d35-9147-f8fdc14cba54 req-dd14c1db-f4e5-4b18-8aaf-1c608d367e8d service nova] [instance: 4ab4ef11-de3f-44a9-9242-916753481479] Detach interface failed, port_id=fa02d839-91a1-4f1f-a8f1-046aa61a7f70, reason: Instance 4ab4ef11-de3f-44a9-9242-916753481479 could not be found. {{(pid=95467) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 08:29:17 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-37075788-ed36-4784-a556-0cf6e12ce43e tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:29:17 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-37075788-ed36-4784-a556-0cf6e12ce43e tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:29:17 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:29:18 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-37075788-ed36-4784-a556-0cf6e12ce43e tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:29:18 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-37075788-ed36-4784-a556-0cf6e12ce43e tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:29:18 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-37075788-ed36-4784-a556-0cf6e12ce43e tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.339s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:29:18 user nova-compute[95467]: INFO nova.scheduler.client.report [None req-37075788-ed36-4784-a556-0cf6e12ce43e tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Deleted allocations for instance 4ab4ef11-de3f-44a9-9242-916753481479
Nov 15 08:29:18 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-37075788-ed36-4784-a556-0cf6e12ce43e tempest-VolumesActionsTest-1524883282 tempest-VolumesActionsTest-1524883282-project-member] Lock "4ab4ef11-de3f-44a9-9242-916753481479" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.931s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:29:18 user nova-compute[95467]: DEBUG nova.compute.manager [req-535d1957-dd1b-4af0-8eb6-2a474e94f0a6 req-0328fc68-fe71-4ec1-b133-38aa4416b5bb service nova] [instance: 4ab4ef11-de3f-44a9-9242-916753481479] Received event network-vif-plugged-fa02d839-91a1-4f1f-a8f1-046aa61a7f70 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:29:18 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-535d1957-dd1b-4af0-8eb6-2a474e94f0a6 req-0328fc68-fe71-4ec1-b133-38aa4416b5bb service nova] Acquiring lock "4ab4ef11-de3f-44a9-9242-916753481479-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:29:18 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-535d1957-dd1b-4af0-8eb6-2a474e94f0a6 req-0328fc68-fe71-4ec1-b133-38aa4416b5bb service nova] Lock "4ab4ef11-de3f-44a9-9242-916753481479-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:29:18 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-535d1957-dd1b-4af0-8eb6-2a474e94f0a6 req-0328fc68-fe71-4ec1-b133-38aa4416b5bb service nova] Lock "4ab4ef11-de3f-44a9-9242-916753481479-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:29:18 user nova-compute[95467]: DEBUG nova.compute.manager [req-535d1957-dd1b-4af0-8eb6-2a474e94f0a6 req-0328fc68-fe71-4ec1-b133-38aa4416b5bb service nova] [instance: 4ab4ef11-de3f-44a9-9242-916753481479] No waiting events found dispatching network-vif-plugged-fa02d839-91a1-4f1f-a8f1-046aa61a7f70 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:29:18 user nova-compute[95467]: WARNING nova.compute.manager [req-535d1957-dd1b-4af0-8eb6-2a474e94f0a6 req-0328fc68-fe71-4ec1-b133-38aa4416b5bb service nova] [instance: 4ab4ef11-de3f-44a9-9242-916753481479] Received unexpected event network-vif-plugged-fa02d839-91a1-4f1f-a8f1-046aa61a7f70 for instance with vm_state deleted and task_state None.
Nov 15 08:29:19 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e81dd998-d677-469d-87af-fa6dd7edfbb5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Acquiring lock "739645e6-9952-40db-a876-f23d02d4e411" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:29:19 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e81dd998-d677-469d-87af-fa6dd7edfbb5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "739645e6-9952-40db-a876-f23d02d4e411" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:29:19 user nova-compute[95467]: INFO nova.compute.manager [None req-e81dd998-d677-469d-87af-fa6dd7edfbb5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Detaching volume 3ecac43f-808f-4c62-a879-3ed80e24c373
Nov 15 08:29:19 user nova-compute[95467]: INFO nova.virt.block_device [None req-e81dd998-d677-469d-87af-fa6dd7edfbb5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Attempting to driver detach volume 3ecac43f-808f-4c62-a879-3ed80e24c373 from mountpoint /dev/vdb
Nov 15 08:29:19 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-e81dd998-d677-469d-87af-fa6dd7edfbb5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Attempting to detach device vdb from instance 739645e6-9952-40db-a876-f23d02d4e411 from the persistent domain config. {{(pid=95467) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 08:29:19 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-e81dd998-d677-469d-87af-fa6dd7edfbb5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 08:29:19 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:29:19 user nova-compute[95467]:   <source dev="/dev/sdh"/>
Nov 15 08:29:19 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:29:19 user nova-compute[95467]:   <serial>3ecac43f-808f-4c62-a879-3ed80e24c373</serial>
Nov 15 08:29:19 user nova-compute[95467]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 08:29:19 user nova-compute[95467]: </disk>
Nov 15 08:29:19 user nova-compute[95467]:  {{(pid=95467) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 08:29:19 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-e81dd998-d677-469d-87af-fa6dd7edfbb5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Successfully detached device vdb from instance 739645e6-9952-40db-a876-f23d02d4e411 from the persistent domain config.
Nov 15 08:29:19 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-e81dd998-d677-469d-87af-fa6dd7edfbb5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 739645e6-9952-40db-a876-f23d02d4e411 from the live domain config. {{(pid=95467) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 08:29:19 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-e81dd998-d677-469d-87af-fa6dd7edfbb5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 08:29:19 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:29:19 user nova-compute[95467]:   <source dev="/dev/sdh"/>
Nov 15 08:29:19 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:29:19 user nova-compute[95467]:   <serial>3ecac43f-808f-4c62-a879-3ed80e24c373</serial>
Nov 15 08:29:19 user nova-compute[95467]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 08:29:19 user nova-compute[95467]: </disk>
Nov 15 08:29:19 user nova-compute[95467]:  {{(pid=95467) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 08:29:20 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-e81dd998-d677-469d-87af-fa6dd7edfbb5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 739645e6-9952-40db-a876-f23d02d4e411 {{(pid=95467) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 08:29:20 user nova-compute[95467]: DEBUG nova.compute.manager [req-b280ec02-2119-4d8b-b343-0d69c190fa2f req-cbb12228-51e9-46c7-85f3-ad1ba1604d4b service nova] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Received event network-changed-a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:29:20 user nova-compute[95467]: DEBUG nova.compute.manager [req-b280ec02-2119-4d8b-b343-0d69c190fa2f req-cbb12228-51e9-46c7-85f3-ad1ba1604d4b service nova] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Refreshing instance network info cache due to event network-changed-a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:29:20 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b280ec02-2119-4d8b-b343-0d69c190fa2f req-cbb12228-51e9-46c7-85f3-ad1ba1604d4b service nova] Acquiring lock "refresh_cache-739645e6-9952-40db-a876-f23d02d4e411" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:29:20 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b280ec02-2119-4d8b-b343-0d69c190fa2f req-cbb12228-51e9-46c7-85f3-ad1ba1604d4b service nova] Acquired lock "refresh_cache-739645e6-9952-40db-a876-f23d02d4e411" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:29:20 user nova-compute[95467]: DEBUG nova.network.neutron [req-b280ec02-2119-4d8b-b343-0d69c190fa2f req-cbb12228-51e9-46c7-85f3-ad1ba1604d4b service nova] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Refreshing network info cache for port a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:29:21 user nova-compute[95467]: DEBUG nova.network.neutron [req-b280ec02-2119-4d8b-b343-0d69c190fa2f req-cbb12228-51e9-46c7-85f3-ad1ba1604d4b service nova] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Updated VIF entry in instance network info cache for port a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:29:21 user nova-compute[95467]: DEBUG nova.network.neutron [req-b280ec02-2119-4d8b-b343-0d69c190fa2f req-cbb12228-51e9-46c7-85f3-ad1ba1604d4b service nova] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Updating instance_info_cache with network_info: [{"id": "a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae", "address": "fa:16:3e:13:89:c0", "network": {"id": "369d2a6f-60b7-4c92-8b2d-1f3828f6698b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1491709218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd281be4e94a4d31a47a13267d51d9b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6f2f30d-af", "ovs_interfaceid": "a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:29:21 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b280ec02-2119-4d8b-b343-0d69c190fa2f req-cbb12228-51e9-46c7-85f3-ad1ba1604d4b service nova] Releasing lock "refresh_cache-739645e6-9952-40db-a876-f23d02d4e411" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:29:21 user nova-compute[95467]: DEBUG nova.compute.manager [req-b280ec02-2119-4d8b-b343-0d69c190fa2f req-cbb12228-51e9-46c7-85f3-ad1ba1604d4b service nova] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Received event network-changed-a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:29:21 user nova-compute[95467]: DEBUG nova.compute.manager [req-b280ec02-2119-4d8b-b343-0d69c190fa2f req-cbb12228-51e9-46c7-85f3-ad1ba1604d4b service nova] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Refreshing instance network info cache due to event network-changed-a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:29:21 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b280ec02-2119-4d8b-b343-0d69c190fa2f req-cbb12228-51e9-46c7-85f3-ad1ba1604d4b service nova] Acquiring lock "refresh_cache-739645e6-9952-40db-a876-f23d02d4e411" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:29:21 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b280ec02-2119-4d8b-b343-0d69c190fa2f req-cbb12228-51e9-46c7-85f3-ad1ba1604d4b service nova] Acquired lock "refresh_cache-739645e6-9952-40db-a876-f23d02d4e411" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:29:21 user nova-compute[95467]: DEBUG nova.network.neutron [req-b280ec02-2119-4d8b-b343-0d69c190fa2f req-cbb12228-51e9-46c7-85f3-ad1ba1604d4b service nova] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Refreshing network info cache for port a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:29:21 user nova-compute[95467]: DEBUG nova.network.neutron [req-b280ec02-2119-4d8b-b343-0d69c190fa2f req-cbb12228-51e9-46c7-85f3-ad1ba1604d4b service nova] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Updated VIF entry in instance network info cache for port a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:29:21 user nova-compute[95467]: DEBUG nova.network.neutron [req-b280ec02-2119-4d8b-b343-0d69c190fa2f req-cbb12228-51e9-46c7-85f3-ad1ba1604d4b service nova] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Updating instance_info_cache with network_info: [{"id": "a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae", "address": "fa:16:3e:13:89:c0", "network": {"id": "369d2a6f-60b7-4c92-8b2d-1f3828f6698b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1491709218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd281be4e94a4d31a47a13267d51d9b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6f2f30d-af", "ovs_interfaceid": "a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:29:21 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b280ec02-2119-4d8b-b343-0d69c190fa2f req-cbb12228-51e9-46c7-85f3-ad1ba1604d4b service nova] Releasing lock "refresh_cache-739645e6-9952-40db-a876-f23d02d4e411" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:29:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:29:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:29:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:29:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:29:36 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:29:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:29:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:29:40 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-e81dd998-d677-469d-87af-fa6dd7edfbb5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 739645e6-9952-40db-a876-f23d02d4e411 is timed out.
Nov 15 08:29:40 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-e81dd998-d677-469d-87af-fa6dd7edfbb5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Successfully detached device vdb from instance 739645e6-9952-40db-a876-f23d02d4e411 from the live domain config.
Nov 15 08:29:40 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e81dd998-d677-469d-87af-fa6dd7edfbb5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 739645e6-9952-40db-a876-f23d02d4e411] calling os-brick to detach iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 08:29:40 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e81dd998-d677-469d-87af-fa6dd7edfbb5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, {'target_iqn': 'iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gbxKIWwP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:29:40 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-e81dd998-d677-469d-87af-fa6dd7edfbb5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:29:40 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-e81dd998-d677-469d-87af-fa6dd7edfbb5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:29:40 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-e81dd998-d677-469d-87af-fa6dd7edfbb5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:29:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:29:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:29:40 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74d74bd-78a7-49ac-95fd-723bdd384fbf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:29:40 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e81dd998-d677-469d-87af-fa6dd7edfbb5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 08:29:40 user nova-compute[95467]: No targets found.
Nov 15 08:29:40 user nova-compute[95467]: iSNS:
Nov 15 08:29:40 user nova-compute[95467]: No targets found.
Nov 15 08:29:40 user nova-compute[95467]: STATIC:
Nov 15 08:29:40 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24
Nov 15 08:29:40 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:29:40 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:29:40 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b
Nov 15 08:29:40 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:29:40 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:29:40 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0
Nov 15 08:29:40 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:29:40 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:29:40 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e
Nov 15 08:29:40 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:29:40 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:29:40 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373
Nov 15 08:29:40 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:29:40 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:29:40 user nova-compute[95467]: FIRMWARE:
Nov 15 08:29:40 user nova-compute[95467]: No targets found.
Nov 15 08:29:40 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:29:40 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e81dd998-d677-469d-87af-fa6dd7edfbb5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 08:29:40 user nova-compute[95467]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 08:29:40 user nova-compute[95467]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=95467) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 08:29:40 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e81dd998-d677-469d-87af-fa6dd7edfbb5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373', 0)] {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 08:29:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:29:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:29:40 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[e383aca1-0d76-4714-b7e9-66b959dc2415]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:29:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:29:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:29:40 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[340e1297-94fb-4f86-b304-771e7d32f649]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:29:40 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e81dd998-d677-469d-87af-fa6dd7edfbb5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:29:40 user nova-compute[95467]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)
Nov 15 08:29:40 user nova-compute[95467]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:29:40 user nova-compute[95467]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 (non-flash)
Nov 15 08:29:40 user nova-compute[95467]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 (non-flash)
Nov 15 08:29:40 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:29:40 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e81dd998-d677-469d-87af-fa6dd7edfbb5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:29:40 user nova-compute[95467]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)
Nov 15 08:29:40 user nova-compute[95467]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:29:40 user nova-compute[95467]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 (non-flash)
Nov 15 08:29:40 user nova-compute[95467]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 (non-flash)
Nov 15 08:29:40 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:29:40 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e81dd998-d677-469d-87af-fa6dd7edfbb5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efec81197e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373'): ({'sdh'}, set())}) {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 08:29:40 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-e81dd998-d677-469d-87af-fa6dd7edfbb5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Removing single pathed devices sdh {{(pid=95467) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 08:29:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:29:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:29:40 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7332ff-b264-4c0e-ad79-eed7e737b236]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:29:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:29:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:29:40 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d8b2390-96dd-490e-a387-0ee6c698055f]: (4, ('ok\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:29:40 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-e81dd998-d677-469d-87af-fa6dd7edfbb5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Flushing IO for device /dev/sdh {{(pid=95467) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 08:29:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:29:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:29:40 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5811b8-8490-40ff-9cb8-0552b422f157]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:29:40 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-e81dd998-d677-469d-87af-fa6dd7edfbb5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=95467) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 08:29:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:29:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.049s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:29:40 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dac3205-55f3-4426-a4c4-4c5b0d36da4c]: (4, ('1', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:29:40 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-e81dd998-d677-469d-87af-fa6dd7edfbb5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 08:29:40 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-e81dd998-d677-469d-87af-fa6dd7edfbb5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] SCSI volumes sdh have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 08:29:40 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e81dd998-d677-469d-87af-fa6dd7edfbb5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373')] {{(pid=95467) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 08:29:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:29:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:29:40 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[674fc4ba-5b16-479a-8297-89a5fb5257b2]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:29:40 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e81dd998-d677-469d-87af-fa6dd7edfbb5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:29:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 -p 172.16.0.220:3260 --logout {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:29:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:29:40 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b226eae4-5cb8-4c35-9baf-a07300a30130]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:29:40 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e81dd998-d677-469d-87af-fa6dd7edfbb5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373, portal: 172.16.0.220,3260]
Nov 15 08:29:40 user nova-compute[95467]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373, portal: 172.16.0.220,3260] successful.
Nov 15 08:29:40 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:29:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 -p 172.16.0.220:3260 --op delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:29:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ecac43f-808f-4c62-a879-3ed80e24c373 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:29:40 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9c1b63-5711-4f48-8887-30190c4869a4]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:29:40 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e81dd998-d677-469d-87af-fa6dd7edfbb5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:29:40 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-e81dd998-d677-469d-87af-fa6dd7edfbb5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:29:40 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e81dd998-d677-469d-87af-fa6dd7edfbb5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] <== disconnect_volume: return (311ms) None {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:29:40 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e81dd998-d677-469d-87af-fa6dd7edfbb5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Disconnected iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 08:29:41 user nova-compute[95467]: DEBUG nova.objects.instance [None req-e81dd998-d677-469d-87af-fa6dd7edfbb5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lazy-loading 'flavor' on Instance uuid 739645e6-9952-40db-a876-f23d02d4e411 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:29:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e81dd998-d677-469d-87af-fa6dd7edfbb5 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "739645e6-9952-40db-a876-f23d02d4e411" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.629s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:29:42 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:29:47 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:29:49 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:29:49 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=95467) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 08:29:51 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager.update_available_resource {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:29:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:29:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:29:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:29:51 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Auditing locally available compute resources for user (node: user) {{(pid=95467) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 08:29:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d22eb02b-7e8d-4755-9f1e-3eee56ddec0c/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:29:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d22eb02b-7e8d-4755-9f1e-3eee56ddec0c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:29:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d22eb02b-7e8d-4755-9f1e-3eee56ddec0c/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:29:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d22eb02b-7e8d-4755-9f1e-3eee56ddec0c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:29:52 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:29:52 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:29:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk.rescue --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:29:52 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:29:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:29:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk.rescue --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:29:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:29:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:29:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:29:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:29:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:29:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaa2d1c7-dbda-4bf2-8706-3e941b44b076/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:29:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaa2d1c7-dbda-4bf2-8706-3e941b44b076/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:29:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaa2d1c7-dbda-4bf2-8706-3e941b44b076/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:29:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaa2d1c7-dbda-4bf2-8706-3e941b44b076/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:29:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:29:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:29:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:29:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:29:53 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:29:53 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:29:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:29:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:29:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:29:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:29:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091612cf-b737-480b-984e-a05b522676b6/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:29:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091612cf-b737-480b-984e-a05b522676b6/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:29:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091612cf-b737-480b-984e-a05b522676b6/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:29:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091612cf-b737-480b-984e-a05b522676b6/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:29:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/739645e6-9952-40db-a876-f23d02d4e411/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:29:54 user nova-compute[95467]: DEBUG nova.compute.manager [req-99a1577e-1305-4991-9cae-0d0c77bb63b6 req-f495df8f-b742-481f-8f48-804b301cbb09 service nova] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Received event network-changed-f4caa0ae-9571-4c82-9717-07935e6991a2 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:29:54 user nova-compute[95467]: DEBUG nova.compute.manager [req-99a1577e-1305-4991-9cae-0d0c77bb63b6 req-f495df8f-b742-481f-8f48-804b301cbb09 service nova] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Refreshing instance network info cache due to event network-changed-f4caa0ae-9571-4c82-9717-07935e6991a2. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:29:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-99a1577e-1305-4991-9cae-0d0c77bb63b6 req-f495df8f-b742-481f-8f48-804b301cbb09 service nova] Acquiring lock "refresh_cache-7eb1f0ce-72bd-4015-993c-a32404f15481" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:29:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-99a1577e-1305-4991-9cae-0d0c77bb63b6 req-f495df8f-b742-481f-8f48-804b301cbb09 service nova] Acquired lock "refresh_cache-7eb1f0ce-72bd-4015-993c-a32404f15481" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:29:54 user nova-compute[95467]: DEBUG nova.network.neutron [req-99a1577e-1305-4991-9cae-0d0c77bb63b6 req-f495df8f-b742-481f-8f48-804b301cbb09 service nova] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Refreshing network info cache for port f4caa0ae-9571-4c82-9717-07935e6991a2 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:29:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-bf40722c-ef2e-4019-adaa-219d0af324ff tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Acquiring lock "7eb1f0ce-72bd-4015-993c-a32404f15481" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:29:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-bf40722c-ef2e-4019-adaa-219d0af324ff tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "7eb1f0ce-72bd-4015-993c-a32404f15481" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:29:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-bf40722c-ef2e-4019-adaa-219d0af324ff tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Acquiring lock "7eb1f0ce-72bd-4015-993c-a32404f15481-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:29:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-bf40722c-ef2e-4019-adaa-219d0af324ff tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "7eb1f0ce-72bd-4015-993c-a32404f15481-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:29:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-bf40722c-ef2e-4019-adaa-219d0af324ff tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "7eb1f0ce-72bd-4015-993c-a32404f15481-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:29:54 user nova-compute[95467]: INFO nova.compute.manager [None req-bf40722c-ef2e-4019-adaa-219d0af324ff tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Terminating instance
Nov 15 08:29:54 user nova-compute[95467]: DEBUG nova.compute.manager [None req-bf40722c-ef2e-4019-adaa-219d0af324ff tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Start destroying the instance on the hypervisor. {{(pid=95467) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 08:29:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/739645e6-9952-40db-a876-f23d02d4e411/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:29:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/739645e6-9952-40db-a876-f23d02d4e411/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:29:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:29:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:29:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:29:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:29:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/739645e6-9952-40db-a876-f23d02d4e411/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG nova.compute.manager [req-c4b122cc-3cd5-4c3f-999e-a3e45179b62b req-b22a9371-a945-4ae3-b1f3-64bde880b4be service nova] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Received event network-vif-unplugged-f4caa0ae-9571-4c82-9717-07935e6991a2 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-c4b122cc-3cd5-4c3f-999e-a3e45179b62b req-b22a9371-a945-4ae3-b1f3-64bde880b4be service nova] Acquiring lock "7eb1f0ce-72bd-4015-993c-a32404f15481-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-c4b122cc-3cd5-4c3f-999e-a3e45179b62b req-b22a9371-a945-4ae3-b1f3-64bde880b4be service nova] Lock "7eb1f0ce-72bd-4015-993c-a32404f15481-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-c4b122cc-3cd5-4c3f-999e-a3e45179b62b req-b22a9371-a945-4ae3-b1f3-64bde880b4be service nova] Lock "7eb1f0ce-72bd-4015-993c-a32404f15481-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG nova.compute.manager [req-c4b122cc-3cd5-4c3f-999e-a3e45179b62b req-b22a9371-a945-4ae3-b1f3-64bde880b4be service nova] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] No waiting events found dispatching network-vif-unplugged-f4caa0ae-9571-4c82-9717-07935e6991a2 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG nova.compute.manager [req-c4b122cc-3cd5-4c3f-999e-a3e45179b62b req-b22a9371-a945-4ae3-b1f3-64bde880b4be service nova] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Received event network-vif-unplugged-f4caa0ae-9571-4c82-9717-07935e6991a2 for instance with task_state deleting. {{(pid=95467) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:29:55 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:29:55 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:29:55 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Hypervisor/Node resource view: name=user free_ram=7791MB free_disk=24.894447326660156GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=95467) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:29:55 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Instance destroyed successfully.
Nov 15 08:29:55 user nova-compute[95467]: DEBUG nova.objects.instance [None req-bf40722c-ef2e-4019-adaa-219d0af324ff tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lazy-loading 'resources' on Instance uuid 7eb1f0ce-72bd-4015-993c-a32404f15481 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-bf40722c-ef2e-4019-adaa-219d0af324ff tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:25:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-288305650',display_name='tempest-TestVolumeBootPattern-server-288305650',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-288305650',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGn1slhlv/lpfM2oYeApx9piTNh8psQp9CpZOaXQ+Ydt2JJikCfOrBRqv7qZ3oUV5yn53tl6dDTEsiUIm5m/x3Q62LZpqk25/AJiUoLr4SnG2Qg5vjpEqPX27JlljHO+ew==',key_name='tempest-TestVolumeBootPattern-1986786502',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:25:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e7791bd92c7c488aa72474ecde2e1155',ramdisk_id='',reservation_id='r-ipv6tx80',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-978207351',owner_user_name='tempest-TestVolumeBootPattern-978207351-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:25:21Z,user_data=None,user_id='11bbbd3ef322402cb5dc60455a54319b',uuid=7eb1f0ce-72bd-4015-993c-a32404f15481,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4caa0ae-9571-4c82-9717-07935e6991a2", "address": "fa:16:3e:22:a5:e5", "network": {"id": "96d9262b-11fb-497d-8e38-fa46076c010f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2069167691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7791bd92c7c488aa72474ecde2e1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4caa0ae-95", "ovs_interfaceid": "f4caa0ae-9571-4c82-9717-07935e6991a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-bf40722c-ef2e-4019-adaa-219d0af324ff tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Converting VIF {"id": "f4caa0ae-9571-4c82-9717-07935e6991a2", "address": "fa:16:3e:22:a5:e5", "network": {"id": "96d9262b-11fb-497d-8e38-fa46076c010f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2069167691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7791bd92c7c488aa72474ecde2e1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4caa0ae-95", "ovs_interfaceid": "f4caa0ae-9571-4c82-9717-07935e6991a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-bf40722c-ef2e-4019-adaa-219d0af324ff tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:a5:e5,bridge_name='br-int',has_traffic_filtering=True,id=f4caa0ae-9571-4c82-9717-07935e6991a2,network=Network(96d9262b-11fb-497d-8e38-fa46076c010f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4caa0ae-95') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG os_vif [None req-bf40722c-ef2e-4019-adaa-219d0af324ff tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:a5:e5,bridge_name='br-int',has_traffic_filtering=True,id=f4caa0ae-9571-4c82-9717-07935e6991a2,network=Network(96d9262b-11fb-497d-8e38-fa46076c010f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4caa0ae-95') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf4caa0ae-95, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=430c86a0-0638-4168-af81-2bc48dbc097c) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:29:55 user nova-compute[95467]: INFO os_vif [None req-bf40722c-ef2e-4019-adaa-219d0af324ff tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:a5:e5,bridge_name='br-int',has_traffic_filtering=True,id=f4caa0ae-9571-4c82-9717-07935e6991a2,network=Network(96d9262b-11fb-497d-8e38-fa46076c010f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4caa0ae-95')
Nov 15 08:29:55 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf40722c-ef2e-4019-adaa-219d0af324ff tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] calling os-brick to detach iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf40722c-ef2e-4019-adaa-219d0af324ff tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, {'target_iqn': 'iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AmMxUCDH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:29:55 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-bf40722c-ef2e-4019-adaa-219d0af324ff tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:29:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-bf40722c-ef2e-4019-adaa-219d0af324ff tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-bf40722c-ef2e-4019-adaa-219d0af324ff tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4241001-3319-477b-811a-f83f9eecbb95]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf40722c-ef2e-4019-adaa-219d0af324ff tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 08:29:55 user nova-compute[95467]: No targets found.
Nov 15 08:29:55 user nova-compute[95467]: iSNS:
Nov 15 08:29:55 user nova-compute[95467]: No targets found.
Nov 15 08:29:55 user nova-compute[95467]: STATIC:
Nov 15 08:29:55 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24
Nov 15 08:29:55 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:29:55 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:29:55 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b
Nov 15 08:29:55 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:29:55 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:29:55 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0
Nov 15 08:29:55 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:29:55 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:29:55 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e
Nov 15 08:29:55 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:29:55 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:29:55 user nova-compute[95467]: FIRMWARE:
Nov 15 08:29:55 user nova-compute[95467]: No targets found.
Nov 15 08:29:55 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf40722c-ef2e-4019-adaa-219d0af324ff tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 08:29:55 user nova-compute[95467]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 08:29:55 user nova-compute[95467]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=95467) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf40722c-ef2e-4019-adaa-219d0af324ff tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b', 0)] {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ef623c-4af3-44da-95d9-5b0a603b3371]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 21cf2ada-b15c-490d-ac37-96e9c87e9056 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 10d73b73-ca65-4192-8954-288dc1df9f24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 3825a691-ac5c-4c06-b4a4-2a0b40c638c4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 091612cf-b737-480b-984e-a05b522676b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 739645e6-9952-40db-a876-f23d02d4e411 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance ba05c01d-ae74-467c-a309-4d0ba904453d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 7eb1f0ce-72bd-4015-993c-a32404f15481 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance d22eb02b-7e8d-4755-9f1e-3eee56ddec0c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance aaa2d1c7-dbda-4bf2-8706-3e941b44b076 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd80a949-d304-40b2-b396-76004e2b0cf3]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf40722c-ef2e-4019-adaa-219d0af324ff tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:29:55 user nova-compute[95467]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)
Nov 15 08:29:55 user nova-compute[95467]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:29:55 user nova-compute[95467]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 (non-flash)
Nov 15 08:29:55 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf40722c-ef2e-4019-adaa-219d0af324ff tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:29:55 user nova-compute[95467]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)
Nov 15 08:29:55 user nova-compute[95467]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b (non-flash)
Nov 15 08:29:55 user nova-compute[95467]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 (non-flash)
Nov 15 08:29:55 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf40722c-ef2e-4019-adaa-219d0af324ff tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efec811ae60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b'): ({'sdg'}, set())}) {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-bf40722c-ef2e-4019-adaa-219d0af324ff tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Removing single pathed devices sdg {{(pid=95467) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG nova.network.neutron [req-99a1577e-1305-4991-9cae-0d0c77bb63b6 req-f495df8f-b742-481f-8f48-804b301cbb09 service nova] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Updated VIF entry in instance network info cache for port f4caa0ae-9571-4c82-9717-07935e6991a2. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG nova.network.neutron [req-99a1577e-1305-4991-9cae-0d0c77bb63b6 req-f495df8f-b742-481f-8f48-804b301cbb09 service nova] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Updating instance_info_cache with network_info: [{"id": "f4caa0ae-9571-4c82-9717-07935e6991a2", "address": "fa:16:3e:22:a5:e5", "network": {"id": "96d9262b-11fb-497d-8e38-fa46076c010f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2069167691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7791bd92c7c488aa72474ecde2e1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4caa0ae-95", "ovs_interfaceid": "f4caa0ae-9571-4c82-9717-07935e6991a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[66936353-dfa8-4d2e-8458-0e31ced2d2dc]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-99a1577e-1305-4991-9cae-0d0c77bb63b6 req-f495df8f-b742-481f-8f48-804b301cbb09 service nova] Releasing lock "refresh_cache-7eb1f0ce-72bd-4015-993c-a32404f15481" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.029s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[805bbdfd-7042-4430-89d4-8febc7752061]: (4, ('ok\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-bf40722c-ef2e-4019-adaa-219d0af324ff tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Flushing IO for device /dev/sdg {{(pid=95467) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9df9f0-c265-4b08-b317-40048ab9fb7b]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-bf40722c-ef2e-4019-adaa-219d0af324ff tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=95467) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.068s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2672c1-ae1f-45ab-9c9d-291275e36e6f]: (4, ('1', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-bf40722c-ef2e-4019-adaa-219d0af324ff tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-bf40722c-ef2e-4019-adaa-219d0af324ff tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] SCSI volumes sdg have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23130393335336366', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_b5792435', '/dev/disk/by-id/scsi-1SCST_BIOb5792435-109353cf9c5bd865') {{(pid=105611) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18242f4-3fd5-4e75-af4b-50649954642b]: (4, None) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf40722c-ef2e-4019-adaa-219d0af324ff tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b')] {{(pid=95467) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4169fa-1f59-419d-8cfc-42962c8de60f]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf40722c-ef2e-4019-adaa-219d0af324ff tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b -p 172.16.0.220:3260 --logout {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[50aacbed-4ca2-4d8b-9fc4-d88e29a48f59]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf40722c-ef2e-4019-adaa-219d0af324ff tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b, portal: 172.16.0.220,3260]
Nov 15 08:29:55 user nova-compute[95467]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b, portal: 172.16.0.220,3260] successful.
Nov 15 08:29:55 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b -p 172.16.0.220:3260 --op delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56e4d788-8159-47c4-bbea-a4b90cb6170b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[00572468-0747-4946-aad8-fd7e2af5a505]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf40722c-ef2e-4019-adaa-219d0af324ff tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-bf40722c-ef2e-4019-adaa-219d0af324ff tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.388s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf40722c-ef2e-4019-adaa-219d0af324ff tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] <== disconnect_volume: return (389ms) None {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf40722c-ef2e-4019-adaa-219d0af324ff tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Disconnected iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 08:29:55 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-bf40722c-ef2e-4019-adaa-219d0af324ff tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Deleting instance files /opt/stack/data/nova/instances/7eb1f0ce-72bd-4015-993c-a32404f15481_del
Nov 15 08:29:55 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-bf40722c-ef2e-4019-adaa-219d0af324ff tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Deletion of /opt/stack/data/nova/instances/7eb1f0ce-72bd-4015-993c-a32404f15481_del complete
Nov 15 08:29:55 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:29:55 user nova-compute[95467]: INFO nova.compute.manager [None req-bf40722c-ef2e-4019-adaa-219d0af324ff tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Took 1.29 seconds to destroy the instance on the hypervisor.
Nov 15 08:29:55 user nova-compute[95467]: DEBUG oslo.service.loopingcall [None req-bf40722c-ef2e-4019-adaa-219d0af324ff tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=95467) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG nova.compute.manager [-] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Deallocating network for instance {{(pid=95467) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] deallocate_for_instance() {{(pid=95467) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Compute_service record updated for user:user {{(pid=95467) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 08:29:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.579s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:29:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:29:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:29:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:29:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:29:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:29:56 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:29:56 user nova-compute[95467]: INFO nova.compute.manager [-] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Took 0.57 seconds to deallocate network for instance.
Nov 15 08:29:56 user nova-compute[95467]: DEBUG nova.compute.manager [req-2a6b9040-9b30-4dd6-9b9d-320bd5203ae7 req-01d1489c-8a15-42fd-aa52-3e76bccb8372 service nova] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Received event network-vif-deleted-f4caa0ae-9571-4c82-9717-07935e6991a2 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:29:56 user nova-compute[95467]: DEBUG nova.compute.manager [req-19be5d85-8710-490f-a953-dfe899df7e2b req-cedcc413-c726-4162-b55b-5715eb5d07ba service nova] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Received event network-vif-plugged-f4caa0ae-9571-4c82-9717-07935e6991a2 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:29:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-19be5d85-8710-490f-a953-dfe899df7e2b req-cedcc413-c726-4162-b55b-5715eb5d07ba service nova] Acquiring lock "7eb1f0ce-72bd-4015-993c-a32404f15481-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:29:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-19be5d85-8710-490f-a953-dfe899df7e2b req-cedcc413-c726-4162-b55b-5715eb5d07ba service nova] Lock "7eb1f0ce-72bd-4015-993c-a32404f15481-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:29:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-19be5d85-8710-490f-a953-dfe899df7e2b req-cedcc413-c726-4162-b55b-5715eb5d07ba service nova] Lock "7eb1f0ce-72bd-4015-993c-a32404f15481-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:29:56 user nova-compute[95467]: DEBUG nova.compute.manager [req-19be5d85-8710-490f-a953-dfe899df7e2b req-cedcc413-c726-4162-b55b-5715eb5d07ba service nova] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] No waiting events found dispatching network-vif-plugged-f4caa0ae-9571-4c82-9717-07935e6991a2 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:29:56 user nova-compute[95467]: WARNING nova.compute.manager [req-19be5d85-8710-490f-a953-dfe899df7e2b req-cedcc413-c726-4162-b55b-5715eb5d07ba service nova] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Received unexpected event network-vif-plugged-f4caa0ae-9571-4c82-9717-07935e6991a2 for instance with vm_state active and task_state deleting.
Nov 15 08:29:57 user nova-compute[95467]: INFO nova.compute.manager [None req-bf40722c-ef2e-4019-adaa-219d0af324ff tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] [instance: 7eb1f0ce-72bd-4015-993c-a32404f15481] Took 0.77 seconds to detach 1 volumes for instance.
Nov 15 08:29:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-bf40722c-ef2e-4019-adaa-219d0af324ff tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:29:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-bf40722c-ef2e-4019-adaa-219d0af324ff tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:29:57 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-bf40722c-ef2e-4019-adaa-219d0af324ff tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:29:57 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-bf40722c-ef2e-4019-adaa-219d0af324ff tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:29:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-bf40722c-ef2e-4019-adaa-219d0af324ff tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.291s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:29:57 user nova-compute[95467]: INFO nova.scheduler.client.report [None req-bf40722c-ef2e-4019-adaa-219d0af324ff tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Deleted allocations for instance 7eb1f0ce-72bd-4015-993c-a32404f15481
Nov 15 08:29:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-bf40722c-ef2e-4019-adaa-219d0af324ff tempest-TestVolumeBootPattern-978207351 tempest-TestVolumeBootPattern-978207351-project-member] Lock "7eb1f0ce-72bd-4015-993c-a32404f15481" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.112s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:29:57 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:29:57 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:29:57 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Starting heal instance info cache {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 08:29:58 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "refresh_cache-3825a691-ac5c-4c06-b4a4-2a0b40c638c4" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:29:58 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquired lock "refresh_cache-3825a691-ac5c-4c06-b4a4-2a0b40c638c4" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:29:58 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Forcefully refreshing network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 08:29:59 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Updating instance_info_cache with network_info: [{"id": "3fddc7dd-48af-4964-bc1a-a54623453f62", "address": "fa:16:3e:c6:49:ac", "network": {"id": "ac9a381d-25fe-4419-b151-f03333413813", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1183680999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34d65a8000347feb2b3966b7ce0d785", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fddc7dd-48", "ovs_interfaceid": "3fddc7dd-48af-4964-bc1a-a54623453f62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:29:59 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Releasing lock "refresh_cache-3825a691-ac5c-4c06-b4a4-2a0b40c638c4" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:29:59 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Updated the network info_cache for instance {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 08:29:59 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:29:59 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:29:59 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:29:59 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:30:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:30:00 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:30:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-73c58ca6-d282-4279-a395-8e26bbbbff37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Acquiring lock "ba05c01d-ae74-467c-a309-4d0ba904453d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:30:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-73c58ca6-d282-4279-a395-8e26bbbbff37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "ba05c01d-ae74-467c-a309-4d0ba904453d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:30:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-73c58ca6-d282-4279-a395-8e26bbbbff37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Acquiring lock "ba05c01d-ae74-467c-a309-4d0ba904453d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:30:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-73c58ca6-d282-4279-a395-8e26bbbbff37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "ba05c01d-ae74-467c-a309-4d0ba904453d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:30:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-73c58ca6-d282-4279-a395-8e26bbbbff37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "ba05c01d-ae74-467c-a309-4d0ba904453d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:30:01 user nova-compute[95467]: INFO nova.compute.manager [None req-73c58ca6-d282-4279-a395-8e26bbbbff37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Terminating instance
Nov 15 08:30:01 user nova-compute[95467]: DEBUG nova.compute.manager [None req-73c58ca6-d282-4279-a395-8e26bbbbff37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Start destroying the instance on the hypervisor. {{(pid=95467) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 08:30:01 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:30:01 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:30:01 user nova-compute[95467]: DEBUG nova.compute.manager [req-c4b1902f-1a30-4a80-bdb7-f52bd14a6b6a req-61b84094-7176-48d9-a11f-8021c9409442 service nova] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Received event network-vif-unplugged-3738b806-4005-468d-87df-f879eb2ff43d {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:30:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-c4b1902f-1a30-4a80-bdb7-f52bd14a6b6a req-61b84094-7176-48d9-a11f-8021c9409442 service nova] Acquiring lock "ba05c01d-ae74-467c-a309-4d0ba904453d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:30:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-c4b1902f-1a30-4a80-bdb7-f52bd14a6b6a req-61b84094-7176-48d9-a11f-8021c9409442 service nova] Lock "ba05c01d-ae74-467c-a309-4d0ba904453d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:30:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-c4b1902f-1a30-4a80-bdb7-f52bd14a6b6a req-61b84094-7176-48d9-a11f-8021c9409442 service nova] Lock "ba05c01d-ae74-467c-a309-4d0ba904453d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:30:01 user nova-compute[95467]: DEBUG nova.compute.manager [req-c4b1902f-1a30-4a80-bdb7-f52bd14a6b6a req-61b84094-7176-48d9-a11f-8021c9409442 service nova] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] No waiting events found dispatching network-vif-unplugged-3738b806-4005-468d-87df-f879eb2ff43d {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:30:01 user nova-compute[95467]: DEBUG nova.compute.manager [req-c4b1902f-1a30-4a80-bdb7-f52bd14a6b6a req-61b84094-7176-48d9-a11f-8021c9409442 service nova] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Received event network-vif-unplugged-3738b806-4005-468d-87df-f879eb2ff43d for instance with task_state deleting. {{(pid=95467) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 08:30:01 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:30:01 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:30:02 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Instance destroyed successfully.
Nov 15 08:30:02 user nova-compute[95467]: DEBUG nova.objects.instance [None req-73c58ca6-d282-4279-a395-8e26bbbbff37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lazy-loading 'resources' on Instance uuid ba05c01d-ae74-467c-a309-4d0ba904453d {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:30:02 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-73c58ca6-d282-4279-a395-8e26bbbbff37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:24:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-970128298',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-970128298',id=41,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:26:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c34d65a8000347feb2b3966b7ce0d785',ramdisk_id='',reservation_id='r-0wg1av9z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1903830225',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:28:15Z,user_data=None,user_id='6971581ab2604353aeb0c45c5252b4fb',uuid=ba05c01d-ae74-467c-a309-4d0ba904453d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3738b806-4005-468d-87df-f879eb2ff43d", "address": "fa:16:3e:86:6f:d3", "network": {"id": "ac9a381d-25fe-4419-b151-f03333413813", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1183680999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34d65a8000347feb2b3966b7ce0d785", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3738b806-40", "ovs_interfaceid": "3738b806-4005-468d-87df-f879eb2ff43d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:30:02 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-73c58ca6-d282-4279-a395-8e26bbbbff37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Converting VIF {"id": "3738b806-4005-468d-87df-f879eb2ff43d", "address": "fa:16:3e:86:6f:d3", "network": {"id": "ac9a381d-25fe-4419-b151-f03333413813", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1183680999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34d65a8000347feb2b3966b7ce0d785", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3738b806-40", "ovs_interfaceid": "3738b806-4005-468d-87df-f879eb2ff43d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:30:02 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-73c58ca6-d282-4279-a395-8e26bbbbff37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:6f:d3,bridge_name='br-int',has_traffic_filtering=True,id=3738b806-4005-468d-87df-f879eb2ff43d,network=Network(ac9a381d-25fe-4419-b151-f03333413813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3738b806-40') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:30:02 user nova-compute[95467]: DEBUG os_vif [None req-73c58ca6-d282-4279-a395-8e26bbbbff37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:6f:d3,bridge_name='br-int',has_traffic_filtering=True,id=3738b806-4005-468d-87df-f879eb2ff43d,network=Network(ac9a381d-25fe-4419-b151-f03333413813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3738b806-40') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:30:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:30:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3738b806-40, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:30:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:30:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:30:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:30:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2d17db79-0516-42ec-9f80-00cb1a582c09) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:30:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:30:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:30:02 user nova-compute[95467]: INFO os_vif [None req-73c58ca6-d282-4279-a395-8e26bbbbff37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:6f:d3,bridge_name='br-int',has_traffic_filtering=True,id=3738b806-4005-468d-87df-f879eb2ff43d,network=Network(ac9a381d-25fe-4419-b151-f03333413813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3738b806-40')
Nov 15 08:30:02 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73c58ca6-d282-4279-a395-8e26bbbbff37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] calling os-brick to detach iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 08:30:02 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c58ca6-d282-4279-a395-8e26bbbbff37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, {'target_iqn': 'iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hAzlOrmx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:30:02 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-73c58ca6-d282-4279-a395-8e26bbbbff37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:30:02 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-73c58ca6-d282-4279-a395-8e26bbbbff37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:30:02 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-73c58ca6-d282-4279-a395-8e26bbbbff37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:30:02 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:30:02 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:30:02 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a11077-57a4-4839-af75-3f7a16103f0d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:30:02 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c58ca6-d282-4279-a395-8e26bbbbff37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 08:30:02 user nova-compute[95467]: No targets found.
Nov 15 08:30:02 user nova-compute[95467]: iSNS:
Nov 15 08:30:02 user nova-compute[95467]: No targets found.
Nov 15 08:30:02 user nova-compute[95467]: STATIC:
Nov 15 08:30:02 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24
Nov 15 08:30:02 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:30:02 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:30:02 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0
Nov 15 08:30:02 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:30:02 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:30:02 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e
Nov 15 08:30:02 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:30:02 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:30:02 user nova-compute[95467]: FIRMWARE:
Nov 15 08:30:02 user nova-compute[95467]: No targets found.
Nov 15 08:30:02 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:30:02 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c58ca6-d282-4279-a395-8e26bbbbff37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 08:30:02 user nova-compute[95467]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 08:30:02 user nova-compute[95467]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=95467) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 08:30:02 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c58ca6-d282-4279-a395-8e26bbbbff37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24', 0)] {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 08:30:02 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:30:02 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:30:02 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[157d9d76-7146-4d29-8086-34b472a1bba6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:30:02 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:30:02 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:30:02 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4fd00f-cf94-4f64-956d-989dfffacc70]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:30:02 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c58ca6-d282-4279-a395-8e26bbbbff37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:30:02 user nova-compute[95467]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)
Nov 15 08:30:02 user nova-compute[95467]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 (non-flash)
Nov 15 08:30:02 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:30:02 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c58ca6-d282-4279-a395-8e26bbbbff37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:30:02 user nova-compute[95467]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 (non-flash)
Nov 15 08:30:02 user nova-compute[95467]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 (non-flash)
Nov 15 08:30:02 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:30:02 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c58ca6-d282-4279-a395-8e26bbbbff37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efed83345e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24'): ({'sdc'}, set())}) {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 08:30:02 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-73c58ca6-d282-4279-a395-8e26bbbbff37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Removing single pathed devices sdc {{(pid=95467) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 08:30:02 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:30:02 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:30:02 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f69e43-f899-4187-9c5d-d35f750f47c8]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:30:02 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:30:02 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:30:02 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1cd12f1-d125-42bb-8361-3aca3fa2491f]: (4, ('ok\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:30:02 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-73c58ca6-d282-4279-a395-8e26bbbbff37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Flushing IO for device /dev/sdc {{(pid=95467) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 08:30:02 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:30:02 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:30:02 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a496a7f7-702b-4a8c-b833-9397f84e6138]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:30:02 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-73c58ca6-d282-4279-a395-8e26bbbbff37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=95467) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 08:30:02 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:30:02 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:30:02 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[0379636e-633f-4bab-a180-4c710d0e153d]: (4, ('1', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:30:02 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-73c58ca6-d282-4279-a395-8e26bbbbff37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 08:30:02 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-73c58ca6-d282-4279-a395-8e26bbbbff37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] SCSI volumes sdc have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 08:30:02 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c58ca6-d282-4279-a395-8e26bbbbff37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24')] {{(pid=95467) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 08:30:02 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:30:02 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:30:02 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4bb06de-1491-4e37-90f0-acdf4b069e4a]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:30:02 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c58ca6-d282-4279-a395-8e26bbbbff37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:30:02 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 -p 172.16.0.220:3260 --logout {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:30:02 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:30:02 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c435e2d-bd64-4373-98c5-2f0aa9ac9cf8]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:30:02 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c58ca6-d282-4279-a395-8e26bbbbff37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24, portal: 172.16.0.220,3260]
Nov 15 08:30:02 user nova-compute[95467]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24, portal: 172.16.0.220,3260] successful.
Nov 15 08:30:02 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:30:02 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 -p 172.16.0.220:3260 --op delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:30:02 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24e79401-c916-4d6f-bee4-b169342acd24 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:30:02 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6be4e1-e69c-4f6f-b5eb-edce486cd63f]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:30:02 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c58ca6-d282-4279-a395-8e26bbbbff37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:30:02 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-73c58ca6-d282-4279-a395-8e26bbbbff37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:30:02 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c58ca6-d282-4279-a395-8e26bbbbff37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] <== disconnect_volume: return (294ms) None {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:30:02 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73c58ca6-d282-4279-a395-8e26bbbbff37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Disconnected iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 08:30:02 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-73c58ca6-d282-4279-a395-8e26bbbbff37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Deleting instance files /opt/stack/data/nova/instances/ba05c01d-ae74-467c-a309-4d0ba904453d_del
Nov 15 08:30:02 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-73c58ca6-d282-4279-a395-8e26bbbbff37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Deletion of /opt/stack/data/nova/instances/ba05c01d-ae74-467c-a309-4d0ba904453d_del complete
Nov 15 08:30:02 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:30:02 user nova-compute[95467]: INFO nova.compute.manager [None req-73c58ca6-d282-4279-a395-8e26bbbbff37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 15 08:30:02 user nova-compute[95467]: DEBUG oslo.service.loopingcall [None req-73c58ca6-d282-4279-a395-8e26bbbbff37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=95467) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 08:30:02 user nova-compute[95467]: DEBUG nova.compute.manager [-] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Deallocating network for instance {{(pid=95467) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 08:30:02 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] deallocate_for_instance() {{(pid=95467) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 08:30:03 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:30:03 user nova-compute[95467]: INFO nova.compute.manager [-] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Took 0.44 seconds to deallocate network for instance.
Nov 15 08:30:03 user nova-compute[95467]: DEBUG nova.compute.manager [req-332bf5fd-cb28-48f3-91a3-b363199cb5fb req-bc910688-3e1f-47bd-bef3-00350b2e8b2e service nova] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Received event network-vif-deleted-3738b806-4005-468d-87df-f879eb2ff43d {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:30:03 user nova-compute[95467]: DEBUG nova.compute.manager [req-4b05517c-e9ae-41b0-befc-ba179c3a2e75 req-21ecf7fb-cbce-4f27-8a4b-5b70fb01608b service nova] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Received event network-vif-plugged-3738b806-4005-468d-87df-f879eb2ff43d {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:30:03 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-4b05517c-e9ae-41b0-befc-ba179c3a2e75 req-21ecf7fb-cbce-4f27-8a4b-5b70fb01608b service nova] Acquiring lock "ba05c01d-ae74-467c-a309-4d0ba904453d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:30:03 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-4b05517c-e9ae-41b0-befc-ba179c3a2e75 req-21ecf7fb-cbce-4f27-8a4b-5b70fb01608b service nova] Lock "ba05c01d-ae74-467c-a309-4d0ba904453d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:30:03 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-4b05517c-e9ae-41b0-befc-ba179c3a2e75 req-21ecf7fb-cbce-4f27-8a4b-5b70fb01608b service nova] Lock "ba05c01d-ae74-467c-a309-4d0ba904453d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:30:03 user nova-compute[95467]: DEBUG nova.compute.manager [req-4b05517c-e9ae-41b0-befc-ba179c3a2e75 req-21ecf7fb-cbce-4f27-8a4b-5b70fb01608b service nova] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] No waiting events found dispatching network-vif-plugged-3738b806-4005-468d-87df-f879eb2ff43d {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:30:03 user nova-compute[95467]: WARNING nova.compute.manager [req-4b05517c-e9ae-41b0-befc-ba179c3a2e75 req-21ecf7fb-cbce-4f27-8a4b-5b70fb01608b service nova] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Received unexpected event network-vif-plugged-3738b806-4005-468d-87df-f879eb2ff43d for instance with vm_state active and task_state deleting.
Nov 15 08:30:03 user nova-compute[95467]: INFO nova.compute.manager [None req-73c58ca6-d282-4279-a395-8e26bbbbff37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: ba05c01d-ae74-467c-a309-4d0ba904453d] Took 0.77 seconds to detach 1 volumes for instance.
Nov 15 08:30:03 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-73c58ca6-d282-4279-a395-8e26bbbbff37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:30:03 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-73c58ca6-d282-4279-a395-8e26bbbbff37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:30:04 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-73c58ca6-d282-4279-a395-8e26bbbbff37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:30:04 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-73c58ca6-d282-4279-a395-8e26bbbbff37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:30:04 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-73c58ca6-d282-4279-a395-8e26bbbbff37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.275s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:30:04 user nova-compute[95467]: INFO nova.scheduler.client.report [None req-73c58ca6-d282-4279-a395-8e26bbbbff37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Deleted allocations for instance ba05c01d-ae74-467c-a309-4d0ba904453d
Nov 15 08:30:04 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-73c58ca6-d282-4279-a395-8e26bbbbff37 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "ba05c01d-ae74-467c-a309-4d0ba904453d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.836s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:30:07 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:30:10 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-baf07f26-dfd0-49e6-9119-752bd3fe33e9 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Acquiring lock "739645e6-9952-40db-a876-f23d02d4e411" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:30:10 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-baf07f26-dfd0-49e6-9119-752bd3fe33e9 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "739645e6-9952-40db-a876-f23d02d4e411" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:30:10 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-baf07f26-dfd0-49e6-9119-752bd3fe33e9 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Acquiring lock "739645e6-9952-40db-a876-f23d02d4e411-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:30:10 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-baf07f26-dfd0-49e6-9119-752bd3fe33e9 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "739645e6-9952-40db-a876-f23d02d4e411-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:30:10 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-baf07f26-dfd0-49e6-9119-752bd3fe33e9 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "739645e6-9952-40db-a876-f23d02d4e411-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:30:10 user nova-compute[95467]: INFO nova.compute.manager [None req-baf07f26-dfd0-49e6-9119-752bd3fe33e9 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Terminating instance
Nov 15 08:30:10 user nova-compute[95467]: DEBUG nova.compute.manager [None req-baf07f26-dfd0-49e6-9119-752bd3fe33e9 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Start destroying the instance on the hypervisor. {{(pid=95467) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 08:30:10 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:30:10 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:30:10 user nova-compute[95467]: DEBUG nova.compute.manager [req-08183835-e0a4-4804-848e-f4ee7a3c537a req-34054c87-ccc3-43b5-bb3b-14022936a15f service nova] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Received event network-vif-unplugged-a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:30:10 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-08183835-e0a4-4804-848e-f4ee7a3c537a req-34054c87-ccc3-43b5-bb3b-14022936a15f service nova] Acquiring lock "739645e6-9952-40db-a876-f23d02d4e411-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:30:10 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-08183835-e0a4-4804-848e-f4ee7a3c537a req-34054c87-ccc3-43b5-bb3b-14022936a15f service nova] Lock "739645e6-9952-40db-a876-f23d02d4e411-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:30:10 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-08183835-e0a4-4804-848e-f4ee7a3c537a req-34054c87-ccc3-43b5-bb3b-14022936a15f service nova] Lock "739645e6-9952-40db-a876-f23d02d4e411-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:30:10 user nova-compute[95467]: DEBUG nova.compute.manager [req-08183835-e0a4-4804-848e-f4ee7a3c537a req-34054c87-ccc3-43b5-bb3b-14022936a15f service nova] [instance: 739645e6-9952-40db-a876-f23d02d4e411] No waiting events found dispatching network-vif-unplugged-a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:30:10 user nova-compute[95467]: DEBUG nova.compute.manager [req-08183835-e0a4-4804-848e-f4ee7a3c537a req-34054c87-ccc3-43b5-bb3b-14022936a15f service nova] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Received event network-vif-unplugged-a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae for instance with task_state deleting. {{(pid=95467) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 08:30:10 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:30:10 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:30:10 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Instance destroyed successfully.
Nov 15 08:30:10 user nova-compute[95467]: DEBUG nova.objects.instance [None req-baf07f26-dfd0-49e6-9119-752bd3fe33e9 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lazy-loading 'resources' on Instance uuid 739645e6-9952-40db-a876-f23d02d4e411 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:30:10 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-baf07f26-dfd0-49e6-9119-752bd3fe33e9 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:23:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1308444358',display_name='tempest-ServerRescueNegativeTestJSON-server-1308444358',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1308444358',id=40,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKzoLkdMobeNcNbHKHSz6pf9KB3mnqKkGNlpbsfMF936yySn1GMTRgtnj4EoSqGo09dnRTYgYgXqxoNmiTwq5Zdq5EmI5cdClHP/6DwnQRnc+u/69gFrqzMpVc0XcKHOQ==',key_name='tempest-keypair-573508882',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:25:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bd281be4e94a4d31a47a13267d51d9b6',ramdisk_id='',reservation_id='r-qs39ggxa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1148442534',owner_user_name='tempest-ServerRescueNegativeTestJSON-1148442534-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:27:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c07f8dbc38004ecd973f61bba63606d4',uuid=739645e6-9952-40db-a876-f23d02d4e411,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae", "address": "fa:16:3e:13:89:c0", "network": {"id": "369d2a6f-60b7-4c92-8b2d-1f3828f6698b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1491709218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd281be4e94a4d31a47a13267d51d9b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6f2f30d-af", "ovs_interfaceid": "a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:30:10 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-baf07f26-dfd0-49e6-9119-752bd3fe33e9 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Converting VIF {"id": "a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae", "address": "fa:16:3e:13:89:c0", "network": {"id": "369d2a6f-60b7-4c92-8b2d-1f3828f6698b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1491709218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd281be4e94a4d31a47a13267d51d9b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6f2f30d-af", "ovs_interfaceid": "a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:30:10 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-baf07f26-dfd0-49e6-9119-752bd3fe33e9 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:13:89:c0,bridge_name='br-int',has_traffic_filtering=True,id=a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae,network=Network(369d2a6f-60b7-4c92-8b2d-1f3828f6698b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6f2f30d-af') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:30:10 user nova-compute[95467]: DEBUG os_vif [None req-baf07f26-dfd0-49e6-9119-752bd3fe33e9 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:89:c0,bridge_name='br-int',has_traffic_filtering=True,id=a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae,network=Network(369d2a6f-60b7-4c92-8b2d-1f3828f6698b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6f2f30d-af') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:30:10 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:30:10 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa6f2f30d-af, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:30:10 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:30:10 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:30:10 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:30:10 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=075c05ed-04fd-4ef8-8da5-a782a4036c04) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:30:10 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:30:10 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:30:10 user nova-compute[95467]: INFO os_vif [None req-baf07f26-dfd0-49e6-9119-752bd3fe33e9 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:89:c0,bridge_name='br-int',has_traffic_filtering=True,id=a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae,network=Network(369d2a6f-60b7-4c92-8b2d-1f3828f6698b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6f2f30d-af')
Nov 15 08:30:10 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-baf07f26-dfd0-49e6-9119-752bd3fe33e9 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Deleting instance files /opt/stack/data/nova/instances/739645e6-9952-40db-a876-f23d02d4e411_del
Nov 15 08:30:10 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-baf07f26-dfd0-49e6-9119-752bd3fe33e9 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Deletion of /opt/stack/data/nova/instances/739645e6-9952-40db-a876-f23d02d4e411_del complete
Nov 15 08:30:10 user nova-compute[95467]: INFO nova.compute.manager [None req-baf07f26-dfd0-49e6-9119-752bd3fe33e9 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 15 08:30:10 user nova-compute[95467]: DEBUG oslo.service.loopingcall [None req-baf07f26-dfd0-49e6-9119-752bd3fe33e9 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=95467) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 08:30:10 user nova-compute[95467]: DEBUG nova.compute.manager [-] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Deallocating network for instance {{(pid=95467) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 08:30:10 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: 739645e6-9952-40db-a876-f23d02d4e411] deallocate_for_instance() {{(pid=95467) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 08:30:11 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:30:11 user nova-compute[95467]: INFO nova.compute.manager [-] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Took 0.71 seconds to deallocate network for instance.
Nov 15 08:30:11 user nova-compute[95467]: DEBUG nova.compute.manager [req-653517c8-74ad-476c-b50f-5d38d3b87455 req-ea571961-d1fa-4044-86a0-34f156136779 service nova] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Received event network-vif-deleted-a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:30:11 user nova-compute[95467]: INFO nova.compute.manager [req-653517c8-74ad-476c-b50f-5d38d3b87455 req-ea571961-d1fa-4044-86a0-34f156136779 service nova] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Neutron deleted interface a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae; detaching it from the instance and deleting it from the info cache
Nov 15 08:30:11 user nova-compute[95467]: DEBUG nova.network.neutron [req-653517c8-74ad-476c-b50f-5d38d3b87455 req-ea571961-d1fa-4044-86a0-34f156136779 service nova] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:30:11 user nova-compute[95467]: DEBUG nova.compute.manager [req-653517c8-74ad-476c-b50f-5d38d3b87455 req-ea571961-d1fa-4044-86a0-34f156136779 service nova] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Detach interface failed, port_id=a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae, reason: Instance 739645e6-9952-40db-a876-f23d02d4e411 could not be found. {{(pid=95467) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 08:30:11 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-baf07f26-dfd0-49e6-9119-752bd3fe33e9 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:30:11 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-baf07f26-dfd0-49e6-9119-752bd3fe33e9 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:30:11 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-baf07f26-dfd0-49e6-9119-752bd3fe33e9 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:30:11 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-baf07f26-dfd0-49e6-9119-752bd3fe33e9 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:30:12 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-baf07f26-dfd0-49e6-9119-752bd3fe33e9 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.275s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:30:12 user nova-compute[95467]: INFO nova.scheduler.client.report [None req-baf07f26-dfd0-49e6-9119-752bd3fe33e9 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Deleted allocations for instance 739645e6-9952-40db-a876-f23d02d4e411
Nov 15 08:30:12 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-baf07f26-dfd0-49e6-9119-752bd3fe33e9 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "739645e6-9952-40db-a876-f23d02d4e411" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.042s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:30:12 user nova-compute[95467]: DEBUG nova.compute.manager [req-4d47c39d-a5ae-4b34-9010-57ac1de530cb req-d0c0e4e2-a145-47af-9837-e4050daab75f service nova] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Received event network-vif-plugged-a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:30:12 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-4d47c39d-a5ae-4b34-9010-57ac1de530cb req-d0c0e4e2-a145-47af-9837-e4050daab75f service nova] Acquiring lock "739645e6-9952-40db-a876-f23d02d4e411-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:30:12 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-4d47c39d-a5ae-4b34-9010-57ac1de530cb req-d0c0e4e2-a145-47af-9837-e4050daab75f service nova] Lock "739645e6-9952-40db-a876-f23d02d4e411-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:30:12 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-4d47c39d-a5ae-4b34-9010-57ac1de530cb req-d0c0e4e2-a145-47af-9837-e4050daab75f service nova] Lock "739645e6-9952-40db-a876-f23d02d4e411-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:30:12 user nova-compute[95467]: DEBUG nova.compute.manager [req-4d47c39d-a5ae-4b34-9010-57ac1de530cb req-d0c0e4e2-a145-47af-9837-e4050daab75f service nova] [instance: 739645e6-9952-40db-a876-f23d02d4e411] No waiting events found dispatching network-vif-plugged-a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:30:12 user nova-compute[95467]: WARNING nova.compute.manager [req-4d47c39d-a5ae-4b34-9010-57ac1de530cb req-d0c0e4e2-a145-47af-9837-e4050daab75f service nova] [instance: 739645e6-9952-40db-a876-f23d02d4e411] Received unexpected event network-vif-plugged-a6f2f30d-af8f-4ed6-b6f8-b78be4c9a2ae for instance with vm_state deleted and task_state None.
Nov 15 08:30:15 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:30:20 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:30:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-def23ab9-26b2-47c5-9031-8c0e6cd47ef7 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Acquiring lock "d22eb02b-7e8d-4755-9f1e-3eee56ddec0c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:30:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-def23ab9-26b2-47c5-9031-8c0e6cd47ef7 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Lock "d22eb02b-7e8d-4755-9f1e-3eee56ddec0c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:30:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-def23ab9-26b2-47c5-9031-8c0e6cd47ef7 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Acquiring lock "d22eb02b-7e8d-4755-9f1e-3eee56ddec0c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:30:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-def23ab9-26b2-47c5-9031-8c0e6cd47ef7 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Lock "d22eb02b-7e8d-4755-9f1e-3eee56ddec0c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:30:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-def23ab9-26b2-47c5-9031-8c0e6cd47ef7 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Lock "d22eb02b-7e8d-4755-9f1e-3eee56ddec0c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:30:24 user nova-compute[95467]: INFO nova.compute.manager [None req-def23ab9-26b2-47c5-9031-8c0e6cd47ef7 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Terminating instance
Nov 15 08:30:24 user nova-compute[95467]: DEBUG nova.compute.manager [None req-def23ab9-26b2-47c5-9031-8c0e6cd47ef7 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Start destroying the instance on the hypervisor. {{(pid=95467) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 08:30:24 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:30:24 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:30:24 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:30:24 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:30:24 user nova-compute[95467]: DEBUG nova.compute.manager [req-8cb4d27b-ba87-46bd-b943-5bc047662eb1 req-b8c6bb93-6799-4645-8a9c-9467fa31da4b service nova] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Received event network-vif-unplugged-62cba8e1-074b-41db-bb58-3363138fb060 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:30:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-8cb4d27b-ba87-46bd-b943-5bc047662eb1 req-b8c6bb93-6799-4645-8a9c-9467fa31da4b service nova] Acquiring lock "d22eb02b-7e8d-4755-9f1e-3eee56ddec0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:30:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-8cb4d27b-ba87-46bd-b943-5bc047662eb1 req-b8c6bb93-6799-4645-8a9c-9467fa31da4b service nova] Lock "d22eb02b-7e8d-4755-9f1e-3eee56ddec0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:30:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-8cb4d27b-ba87-46bd-b943-5bc047662eb1 req-b8c6bb93-6799-4645-8a9c-9467fa31da4b service nova] Lock "d22eb02b-7e8d-4755-9f1e-3eee56ddec0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:30:24 user nova-compute[95467]: DEBUG nova.compute.manager [req-8cb4d27b-ba87-46bd-b943-5bc047662eb1 req-b8c6bb93-6799-4645-8a9c-9467fa31da4b service nova] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] No waiting events found dispatching network-vif-unplugged-62cba8e1-074b-41db-bb58-3363138fb060 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:30:24 user nova-compute[95467]: DEBUG nova.compute.manager [req-8cb4d27b-ba87-46bd-b943-5bc047662eb1 req-b8c6bb93-6799-4645-8a9c-9467fa31da4b service nova] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Received event network-vif-unplugged-62cba8e1-074b-41db-bb58-3363138fb060 for instance with task_state deleting. {{(pid=95467) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 08:30:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:30:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:30:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:30:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:30:25 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Instance destroyed successfully.
Nov 15 08:30:25 user nova-compute[95467]: DEBUG nova.objects.instance [None req-def23ab9-26b2-47c5-9031-8c0e6cd47ef7 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Lazy-loading 'resources' on Instance uuid d22eb02b-7e8d-4755-9f1e-3eee56ddec0c {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:30:25 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-def23ab9-26b2-47c5-9031-8c0e6cd47ef7 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:21:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-748321325',display_name='tempest-ServerActionsTestOtherB-server-748321325',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-748321325',id=37,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4fkN7k+peQ5MHRVAmSWsJ4XWACmBTaERqxpnxcsdjwMrROQbOXtjSL/x5jDo9fewvV0xuNQFNzIDf7IiXE/hxIrMO+qPlCpDl2ne6370CaB1c+V4MsUeGSWpmCOrmyfA==',key_name='tempest-keypair-1354708686',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:27:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b7f46c4dc5bf438cad677a366bdd5b5f',ramdisk_id='',reservation_id='r-1rd2gc25',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-220421987',owner_user_name='tempest-ServerActionsTestOtherB-220421987-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:27:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53a0c2be5d1f4831961aa1cc29c4d46f',uuid=d22eb02b-7e8d-4755-9f1e-3eee56ddec0c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "62cba8e1-074b-41db-bb58-3363138fb060", "address": "fa:16:3e:e4:27:f3", "network": {"id": "439fd8f9-3cf0-449d-b7e1-eba4d33109f9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-399225774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7f46c4dc5bf438cad677a366bdd5b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62cba8e1-07", "ovs_interfaceid": "62cba8e1-074b-41db-bb58-3363138fb060", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:30:25 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-def23ab9-26b2-47c5-9031-8c0e6cd47ef7 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Converting VIF {"id": "62cba8e1-074b-41db-bb58-3363138fb060", "address": "fa:16:3e:e4:27:f3", "network": {"id": "439fd8f9-3cf0-449d-b7e1-eba4d33109f9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-399225774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7f46c4dc5bf438cad677a366bdd5b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62cba8e1-07", "ovs_interfaceid": "62cba8e1-074b-41db-bb58-3363138fb060", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:30:25 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-def23ab9-26b2-47c5-9031-8c0e6cd47ef7 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:27:f3,bridge_name='br-int',has_traffic_filtering=True,id=62cba8e1-074b-41db-bb58-3363138fb060,network=Network(439fd8f9-3cf0-449d-b7e1-eba4d33109f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62cba8e1-07') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:30:25 user nova-compute[95467]: DEBUG os_vif [None req-def23ab9-26b2-47c5-9031-8c0e6cd47ef7 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:27:f3,bridge_name='br-int',has_traffic_filtering=True,id=62cba8e1-074b-41db-bb58-3363138fb060,network=Network(439fd8f9-3cf0-449d-b7e1-eba4d33109f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62cba8e1-07') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:30:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:30:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap62cba8e1-07, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:30:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:30:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:30:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:30:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:30:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5e03fdae-523a-4f8e-8b06-c3779b31f0cc) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:30:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:30:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:30:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:30:25 user nova-compute[95467]: INFO os_vif [None req-def23ab9-26b2-47c5-9031-8c0e6cd47ef7 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:27:f3,bridge_name='br-int',has_traffic_filtering=True,id=62cba8e1-074b-41db-bb58-3363138fb060,network=Network(439fd8f9-3cf0-449d-b7e1-eba4d33109f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62cba8e1-07')
Nov 15 08:30:25 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-def23ab9-26b2-47c5-9031-8c0e6cd47ef7 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] calling os-brick to detach iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 08:30:25 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-def23ab9-26b2-47c5-9031-8c0e6cd47ef7 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, {'target_iqn': 'iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kVIbNLMg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:30:25 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-def23ab9-26b2-47c5-9031-8c0e6cd47ef7 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:30:25 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-def23ab9-26b2-47c5-9031-8c0e6cd47ef7 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:30:25 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-def23ab9-26b2-47c5-9031-8c0e6cd47ef7 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:30:25 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:30:25 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.037s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:30:25 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e0b471-739d-47f2-98bc-7c4fdde0b26e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b3958f9-74a7-47b0-bb4b-584bac224221\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:30:25 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-def23ab9-26b2-47c5-9031-8c0e6cd47ef7 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 08:30:25 user nova-compute[95467]: No targets found.
Nov 15 08:30:25 user nova-compute[95467]: iSNS:
Nov 15 08:30:25 user nova-compute[95467]: No targets found.
Nov 15 08:30:25 user nova-compute[95467]: STATIC:
Nov 15 08:30:25 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0
Nov 15 08:30:25 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:30:25 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:30:25 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e
Nov 15 08:30:25 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:30:25 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:30:25 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:0b3958f9-74a7-47b0-bb4b-584bac224221
Nov 15 08:30:25 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:30:25 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:30:25 user nova-compute[95467]: FIRMWARE:
Nov 15 08:30:25 user nova-compute[95467]: No targets found.
Nov 15 08:30:25 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:30:25 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-def23ab9-26b2-47c5-9031-8c0e6cd47ef7 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 08:30:25 user nova-compute[95467]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 08:30:25 user nova-compute[95467]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=95467) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 08:30:25 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-def23ab9-26b2-47c5-9031-8c0e6cd47ef7 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0', 0)] {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 08:30:25 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:30:25 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.032s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:30:25 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[89460b4e-d039-4da6-aa58-0c9c55cce9f9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b3958f9-74a7-47b0-bb4b-584bac224221\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:30:25 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:30:25 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:30:25 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5ff8e7-1e33-49e5-8648-79060c813691]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b3958f9-74a7-47b0-bb4b-584bac224221 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:30:25 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-def23ab9-26b2-47c5-9031-8c0e6cd47ef7 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:30:25 user nova-compute[95467]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 (non-flash)
Nov 15 08:30:25 user nova-compute[95467]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b3958f9-74a7-47b0-bb4b-584bac224221 (non-flash)
Nov 15 08:30:25 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:30:25 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-def23ab9-26b2-47c5-9031-8c0e6cd47ef7 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:30:25 user nova-compute[95467]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 (non-flash)
Nov 15 08:30:25 user nova-compute[95467]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b3958f9-74a7-47b0-bb4b-584bac224221 (non-flash)
Nov 15 08:30:25 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:30:25 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-def23ab9-26b2-47c5-9031-8c0e6cd47ef7 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efed857a200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0'): ({'sdf'}, set())}) {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 08:30:25 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-def23ab9-26b2-47c5-9031-8c0e6cd47ef7 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Removing single pathed devices sdf {{(pid=95467) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 08:30:25 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:30:25 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.069s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:30:25 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d64bbaa-fab0-4eba-866f-1a16bdbc7826]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:30:25 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:30:25 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.111s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:30:25 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b34d805-07e3-4242-948c-e7e2d03b996f]: (4, ('ok\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:30:25 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-def23ab9-26b2-47c5-9031-8c0e6cd47ef7 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Flushing IO for device /dev/sdf {{(pid=95467) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 08:30:25 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:30:25 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.059s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:30:25 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f130df8f-f6d2-4cc1-bbfd-a1f61abace9d]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:30:25 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-def23ab9-26b2-47c5-9031-8c0e6cd47ef7 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=95467) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 08:30:25 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:30:25 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.086s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:30:25 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5cb90d-ffe0-45db-af20-7adabd8160e2]: (4, ('1', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:30:25 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-def23ab9-26b2-47c5-9031-8c0e6cd47ef7 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 08:30:25 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-def23ab9-26b2-47c5-9031-8c0e6cd47ef7 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] SCSI volumes sdf have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 08:30:25 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-def23ab9-26b2-47c5-9031-8c0e6cd47ef7 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0')] {{(pid=95467) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 08:30:25 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:30:26 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:30:26 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[58fecab1-8bc2-4d1c-9ade-942d4c4f9ad9]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:30:26 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-def23ab9-26b2-47c5-9031-8c0e6cd47ef7 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:30:26 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 -p 172.16.0.220:3260 --logout {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:30:26 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:30:26 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca67ba0-c14c-4b22-ae62-e6a94e830116]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:30:26 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-def23ab9-26b2-47c5-9031-8c0e6cd47ef7 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0, portal: 172.16.0.220,3260]
Nov 15 08:30:26 user nova-compute[95467]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0, portal: 172.16.0.220,3260] successful.
Nov 15 08:30:26 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:30:26 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 -p 172.16.0.220:3260 --op delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:30:26 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c086dbf2-482f-40d5-815e-a7fff977a3a0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:30:26 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[19eaf019-c46a-4928-8e86-dec14fce28ad]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:30:26 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-def23ab9-26b2-47c5-9031-8c0e6cd47ef7 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:30:26 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-def23ab9-26b2-47c5-9031-8c0e6cd47ef7 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.592s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:30:26 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-def23ab9-26b2-47c5-9031-8c0e6cd47ef7 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] <== disconnect_volume: return (594ms) None {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:30:26 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-def23ab9-26b2-47c5-9031-8c0e6cd47ef7 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Disconnected iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 08:30:26 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-def23ab9-26b2-47c5-9031-8c0e6cd47ef7 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Deleting instance files /opt/stack/data/nova/instances/d22eb02b-7e8d-4755-9f1e-3eee56ddec0c_del
Nov 15 08:30:26 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-def23ab9-26b2-47c5-9031-8c0e6cd47ef7 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Deletion of /opt/stack/data/nova/instances/d22eb02b-7e8d-4755-9f1e-3eee56ddec0c_del complete
Nov 15 08:30:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:30:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:30:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:30:26 user nova-compute[95467]: INFO nova.compute.manager [None req-def23ab9-26b2-47c5-9031-8c0e6cd47ef7 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Took 2.11 seconds to destroy the instance on the hypervisor.
Nov 15 08:30:26 user nova-compute[95467]: DEBUG oslo.service.loopingcall [None req-def23ab9-26b2-47c5-9031-8c0e6cd47ef7 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=95467) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 08:30:26 user nova-compute[95467]: DEBUG nova.compute.manager [-] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Deallocating network for instance {{(pid=95467) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 08:30:26 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] deallocate_for_instance() {{(pid=95467) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 08:30:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:30:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:30:27 user nova-compute[95467]: DEBUG nova.compute.manager [req-728b6992-ad7c-45e4-a8e1-e78db18c0325 req-5f20c761-9925-47ed-858d-866e138d8945 service nova] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Received event network-vif-plugged-62cba8e1-074b-41db-bb58-3363138fb060 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:30:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-728b6992-ad7c-45e4-a8e1-e78db18c0325 req-5f20c761-9925-47ed-858d-866e138d8945 service nova] Acquiring lock "d22eb02b-7e8d-4755-9f1e-3eee56ddec0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:30:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-728b6992-ad7c-45e4-a8e1-e78db18c0325 req-5f20c761-9925-47ed-858d-866e138d8945 service nova] Lock "d22eb02b-7e8d-4755-9f1e-3eee56ddec0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:30:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-728b6992-ad7c-45e4-a8e1-e78db18c0325 req-5f20c761-9925-47ed-858d-866e138d8945 service nova] Lock "d22eb02b-7e8d-4755-9f1e-3eee56ddec0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:30:27 user nova-compute[95467]: DEBUG nova.compute.manager [req-728b6992-ad7c-45e4-a8e1-e78db18c0325 req-5f20c761-9925-47ed-858d-866e138d8945 service nova] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] No waiting events found dispatching network-vif-plugged-62cba8e1-074b-41db-bb58-3363138fb060 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:30:27 user nova-compute[95467]: WARNING nova.compute.manager [req-728b6992-ad7c-45e4-a8e1-e78db18c0325 req-5f20c761-9925-47ed-858d-866e138d8945 service nova] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Received unexpected event network-vif-plugged-62cba8e1-074b-41db-bb58-3363138fb060 for instance with vm_state active and task_state deleting.
Nov 15 08:30:27 user nova-compute[95467]: DEBUG nova.compute.manager [req-728b6992-ad7c-45e4-a8e1-e78db18c0325 req-5f20c761-9925-47ed-858d-866e138d8945 service nova] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Received event network-vif-plugged-62cba8e1-074b-41db-bb58-3363138fb060 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:30:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-728b6992-ad7c-45e4-a8e1-e78db18c0325 req-5f20c761-9925-47ed-858d-866e138d8945 service nova] Acquiring lock "d22eb02b-7e8d-4755-9f1e-3eee56ddec0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:30:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-728b6992-ad7c-45e4-a8e1-e78db18c0325 req-5f20c761-9925-47ed-858d-866e138d8945 service nova] Lock "d22eb02b-7e8d-4755-9f1e-3eee56ddec0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:30:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-728b6992-ad7c-45e4-a8e1-e78db18c0325 req-5f20c761-9925-47ed-858d-866e138d8945 service nova] Lock "d22eb02b-7e8d-4755-9f1e-3eee56ddec0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:30:27 user nova-compute[95467]: DEBUG nova.compute.manager [req-728b6992-ad7c-45e4-a8e1-e78db18c0325 req-5f20c761-9925-47ed-858d-866e138d8945 service nova] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] No waiting events found dispatching network-vif-plugged-62cba8e1-074b-41db-bb58-3363138fb060 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:30:27 user nova-compute[95467]: WARNING nova.compute.manager [req-728b6992-ad7c-45e4-a8e1-e78db18c0325 req-5f20c761-9925-47ed-858d-866e138d8945 service nova] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Received unexpected event network-vif-plugged-62cba8e1-074b-41db-bb58-3363138fb060 for instance with vm_state active and task_state deleting.
Nov 15 08:30:27 user nova-compute[95467]: DEBUG nova.compute.manager [req-728b6992-ad7c-45e4-a8e1-e78db18c0325 req-5f20c761-9925-47ed-858d-866e138d8945 service nova] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Received event network-vif-plugged-62cba8e1-074b-41db-bb58-3363138fb060 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:30:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-728b6992-ad7c-45e4-a8e1-e78db18c0325 req-5f20c761-9925-47ed-858d-866e138d8945 service nova] Acquiring lock "d22eb02b-7e8d-4755-9f1e-3eee56ddec0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:30:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-728b6992-ad7c-45e4-a8e1-e78db18c0325 req-5f20c761-9925-47ed-858d-866e138d8945 service nova] Lock "d22eb02b-7e8d-4755-9f1e-3eee56ddec0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:30:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-728b6992-ad7c-45e4-a8e1-e78db18c0325 req-5f20c761-9925-47ed-858d-866e138d8945 service nova] Lock "d22eb02b-7e8d-4755-9f1e-3eee56ddec0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:30:27 user nova-compute[95467]: DEBUG nova.compute.manager [req-728b6992-ad7c-45e4-a8e1-e78db18c0325 req-5f20c761-9925-47ed-858d-866e138d8945 service nova] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] No waiting events found dispatching network-vif-plugged-62cba8e1-074b-41db-bb58-3363138fb060 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:30:27 user nova-compute[95467]: WARNING nova.compute.manager [req-728b6992-ad7c-45e4-a8e1-e78db18c0325 req-5f20c761-9925-47ed-858d-866e138d8945 service nova] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Received unexpected event network-vif-plugged-62cba8e1-074b-41db-bb58-3363138fb060 for instance with vm_state active and task_state deleting.
Nov 15 08:30:27 user nova-compute[95467]: DEBUG nova.compute.manager [req-728b6992-ad7c-45e4-a8e1-e78db18c0325 req-5f20c761-9925-47ed-858d-866e138d8945 service nova] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Received event network-vif-unplugged-62cba8e1-074b-41db-bb58-3363138fb060 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:30:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-728b6992-ad7c-45e4-a8e1-e78db18c0325 req-5f20c761-9925-47ed-858d-866e138d8945 service nova] Acquiring lock "d22eb02b-7e8d-4755-9f1e-3eee56ddec0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:30:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-728b6992-ad7c-45e4-a8e1-e78db18c0325 req-5f20c761-9925-47ed-858d-866e138d8945 service nova] Lock "d22eb02b-7e8d-4755-9f1e-3eee56ddec0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:30:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-728b6992-ad7c-45e4-a8e1-e78db18c0325 req-5f20c761-9925-47ed-858d-866e138d8945 service nova] Lock "d22eb02b-7e8d-4755-9f1e-3eee56ddec0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:30:27 user nova-compute[95467]: DEBUG nova.compute.manager [req-728b6992-ad7c-45e4-a8e1-e78db18c0325 req-5f20c761-9925-47ed-858d-866e138d8945 service nova] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] No waiting events found dispatching network-vif-unplugged-62cba8e1-074b-41db-bb58-3363138fb060 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:30:27 user nova-compute[95467]: DEBUG nova.compute.manager [req-728b6992-ad7c-45e4-a8e1-e78db18c0325 req-5f20c761-9925-47ed-858d-866e138d8945 service nova] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Received event network-vif-unplugged-62cba8e1-074b-41db-bb58-3363138fb060 for instance with task_state deleting. {{(pid=95467) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 08:30:27 user nova-compute[95467]: DEBUG nova.compute.manager [req-728b6992-ad7c-45e4-a8e1-e78db18c0325 req-5f20c761-9925-47ed-858d-866e138d8945 service nova] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Received event network-vif-plugged-62cba8e1-074b-41db-bb58-3363138fb060 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:30:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-728b6992-ad7c-45e4-a8e1-e78db18c0325 req-5f20c761-9925-47ed-858d-866e138d8945 service nova] Acquiring lock "d22eb02b-7e8d-4755-9f1e-3eee56ddec0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:30:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-728b6992-ad7c-45e4-a8e1-e78db18c0325 req-5f20c761-9925-47ed-858d-866e138d8945 service nova] Lock "d22eb02b-7e8d-4755-9f1e-3eee56ddec0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:30:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-728b6992-ad7c-45e4-a8e1-e78db18c0325 req-5f20c761-9925-47ed-858d-866e138d8945 service nova] Lock "d22eb02b-7e8d-4755-9f1e-3eee56ddec0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:30:27 user nova-compute[95467]: DEBUG nova.compute.manager [req-728b6992-ad7c-45e4-a8e1-e78db18c0325 req-5f20c761-9925-47ed-858d-866e138d8945 service nova] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] No waiting events found dispatching network-vif-plugged-62cba8e1-074b-41db-bb58-3363138fb060 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:30:27 user nova-compute[95467]: WARNING nova.compute.manager [req-728b6992-ad7c-45e4-a8e1-e78db18c0325 req-5f20c761-9925-47ed-858d-866e138d8945 service nova] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Received unexpected event network-vif-plugged-62cba8e1-074b-41db-bb58-3363138fb060 for instance with vm_state active and task_state deleting.
Nov 15 08:30:27 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:30:27 user nova-compute[95467]: INFO nova.compute.manager [-] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Took 1.18 seconds to deallocate network for instance.
Nov 15 08:30:28 user nova-compute[95467]: INFO nova.compute.manager [None req-def23ab9-26b2-47c5-9031-8c0e6cd47ef7 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Took 1.47 seconds to detach 1 volumes for instance.
Nov 15 08:30:28 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-def23ab9-26b2-47c5-9031-8c0e6cd47ef7 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:30:28 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-def23ab9-26b2-47c5-9031-8c0e6cd47ef7 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:30:29 user nova-compute[95467]: DEBUG nova.compute.manager [req-40bd0f4a-efc1-4e7a-b76b-4235c7eea5b3 req-f1679c5e-9c17-4887-8eae-023ef76fe68d service nova] [instance: d22eb02b-7e8d-4755-9f1e-3eee56ddec0c] Received event network-vif-deleted-62cba8e1-074b-41db-bb58-3363138fb060 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:30:29 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-def23ab9-26b2-47c5-9031-8c0e6cd47ef7 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:30:29 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-def23ab9-26b2-47c5-9031-8c0e6cd47ef7 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:30:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-def23ab9-26b2-47c5-9031-8c0e6cd47ef7 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.375s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:30:29 user nova-compute[95467]: INFO nova.scheduler.client.report [None req-def23ab9-26b2-47c5-9031-8c0e6cd47ef7 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Deleted allocations for instance d22eb02b-7e8d-4755-9f1e-3eee56ddec0c
Nov 15 08:30:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-def23ab9-26b2-47c5-9031-8c0e6cd47ef7 tempest-ServerActionsTestOtherB-220421987 tempest-ServerActionsTestOtherB-220421987-project-member] Lock "d22eb02b-7e8d-4755-9f1e-3eee56ddec0c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.402s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:30:30 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:30:35 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:30:35 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:30:35 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=95467) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 08:30:35 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:30:35 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:30:35 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:30:38 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:30:39 user nova-compute[95467]: DEBUG nova.compute.manager [req-28773617-d767-4158-bbff-9557fd111286 req-29f0d9c0-ef42-4d98-a798-dd34f1be107c service nova] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Received event network-changed-6130058a-f78c-4f81-b4a8-233863e6ae8c {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:30:39 user nova-compute[95467]: DEBUG nova.compute.manager [req-28773617-d767-4158-bbff-9557fd111286 req-29f0d9c0-ef42-4d98-a798-dd34f1be107c service nova] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Refreshing instance network info cache due to event network-changed-6130058a-f78c-4f81-b4a8-233863e6ae8c. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:30:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-28773617-d767-4158-bbff-9557fd111286 req-29f0d9c0-ef42-4d98-a798-dd34f1be107c service nova] Acquiring lock "refresh_cache-aaa2d1c7-dbda-4bf2-8706-3e941b44b076" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:30:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-28773617-d767-4158-bbff-9557fd111286 req-29f0d9c0-ef42-4d98-a798-dd34f1be107c service nova] Acquired lock "refresh_cache-aaa2d1c7-dbda-4bf2-8706-3e941b44b076" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:30:39 user nova-compute[95467]: DEBUG nova.network.neutron [req-28773617-d767-4158-bbff-9557fd111286 req-29f0d9c0-ef42-4d98-a798-dd34f1be107c service nova] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Refreshing network info cache for port 6130058a-f78c-4f81-b4a8-233863e6ae8c {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:30:40 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e214a1f8-0154-4b29-9c9d-4e1d66473840 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Acquiring lock "aaa2d1c7-dbda-4bf2-8706-3e941b44b076" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:30:40 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e214a1f8-0154-4b29-9c9d-4e1d66473840 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Lock "aaa2d1c7-dbda-4bf2-8706-3e941b44b076" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:30:40 user nova-compute[95467]: DEBUG nova.objects.instance [None req-e214a1f8-0154-4b29-9c9d-4e1d66473840 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Lazy-loading 'flavor' on Instance uuid aaa2d1c7-dbda-4bf2-8706-3e941b44b076 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:30:40 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e214a1f8-0154-4b29-9c9d-4e1d66473840 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Lock "aaa2d1c7-dbda-4bf2-8706-3e941b44b076" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:30:40 user nova-compute[95467]: DEBUG nova.network.neutron [req-28773617-d767-4158-bbff-9557fd111286 req-29f0d9c0-ef42-4d98-a798-dd34f1be107c service nova] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Updated VIF entry in instance network info cache for port 6130058a-f78c-4f81-b4a8-233863e6ae8c. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:30:40 user nova-compute[95467]: DEBUG nova.network.neutron [req-28773617-d767-4158-bbff-9557fd111286 req-29f0d9c0-ef42-4d98-a798-dd34f1be107c service nova] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Updating instance_info_cache with network_info: [{"id": "6130058a-f78c-4f81-b4a8-233863e6ae8c", "address": "fa:16:3e:15:19:18", "network": {"id": "a0f0cb10-26c8-4299-8a7e-4d34cfd26c82", "bridge": "br-int", "label": "tempest-TestStampPattern-737883783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b4ba53c039b4d699865e97ea1105843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6130058a-f7", "ovs_interfaceid": "6130058a-f78c-4f81-b4a8-233863e6ae8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:30:40 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-28773617-d767-4158-bbff-9557fd111286 req-29f0d9c0-ef42-4d98-a798-dd34f1be107c service nova] Releasing lock "refresh_cache-aaa2d1c7-dbda-4bf2-8706-3e941b44b076" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:30:40 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e214a1f8-0154-4b29-9c9d-4e1d66473840 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Acquiring lock "aaa2d1c7-dbda-4bf2-8706-3e941b44b076" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:30:40 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e214a1f8-0154-4b29-9c9d-4e1d66473840 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Lock "aaa2d1c7-dbda-4bf2-8706-3e941b44b076" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:30:40 user nova-compute[95467]: INFO nova.compute.manager [None req-e214a1f8-0154-4b29-9c9d-4e1d66473840 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Attaching volume be5769ee-f9e8-4f2b-bf37-b8a4bb618605 to /dev/vdb
Nov 15 08:30:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:30:40 user nova-compute[95467]: DEBUG os_brick.utils [None req-e214a1f8-0154-4b29-9c9d-4e1d66473840 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:30:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:30:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:30:40 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[083a2ae0-0e31-488b-a068-d4d5f347ebbc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:882ae90641f\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:30:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:30:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:30:40 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[46cf0ca6-1101-470f-8f81-c0c657be7f3d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:30:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:30:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:30:40 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd50c6e4-fd4a-43ad-9c78-62cf4acab965]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:30:40 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39360f1-99a9-4070-bd07-68515a7f2fed]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:30:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-e214a1f8-0154-4b29-9c9d-4e1d66473840 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Running cmd (subprocess): nvme version {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:30:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-e214a1f8-0154-4b29-9c9d-4e1d66473840 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] 'nvme version' failed. Not Retrying. {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:30:40 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e214a1f8-0154-4b29-9c9d-4e1d66473840 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] nvme not present on system {{(pid=95467) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 08:30:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:30:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:30:40 user nova-compute[95467]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 08:30:40 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[126b41f0-c4ba-4613-99f6-3de9fe8b4e33]: (4, '') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:30:40 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-e214a1f8-0154-4b29-9c9d-4e1d66473840 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=95467) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 08:30:40 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-e214a1f8-0154-4b29-9c9d-4e1d66473840 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 08:30:40 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-e214a1f8-0154-4b29-9c9d-4e1d66473840 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] LIGHTOS: no hostnqn found. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 08:30:40 user nova-compute[95467]: DEBUG os_brick.utils [None req-e214a1f8-0154-4b29-9c9d-4e1d66473840 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:882ae90641f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:30:40 user nova-compute[95467]: DEBUG nova.virt.block_device [None req-e214a1f8-0154-4b29-9c9d-4e1d66473840 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Updating existing volume attachment record: cc10807b-8cec-4a32-a2a8-0eb5595ce532 {{(pid=95467) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 08:30:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:30:45 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:30:47 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e214a1f8-0154-4b29-9c9d-4e1d66473840 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Calling os-brick to attach iSCSI Volume {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 08:30:47 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e214a1f8-0154-4b29-9c9d-4e1d66473840 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:be5769ee-f9e8-4f2b-bf37-b8a4bb618605', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nTezSsDo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:30:47 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-e214a1f8-0154-4b29-9c9d-4e1d66473840 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:30:47 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-e214a1f8-0154-4b29-9c9d-4e1d66473840 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:30:47 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-e214a1f8-0154-4b29-9c9d-4e1d66473840 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:30:47 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-e214a1f8-0154-4b29-9c9d-4e1d66473840 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:30:47 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-e214a1f8-0154-4b29-9c9d-4e1d66473840 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be5769ee-f9e8-4f2b-bf37-b8a4bb618605" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:30:47 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-e214a1f8-0154-4b29-9c9d-4e1d66473840 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be5769ee-f9e8-4f2b-bf37-b8a4bb618605" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:30:47 user nova-compute[95467]: INFO os_brick.initiator.connectors.iscsi [None req-e214a1f8-0154-4b29-9c9d-4e1d66473840 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 08:30:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be5769ee-f9e8-4f2b-bf37-b8a4bb618605 -p 172.16.0.220:3260 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:30:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be5769ee-f9e8-4f2b-bf37-b8a4bb618605 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:30:47 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af2a59e-479d-42d3-a412-3a7ce5e002b9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:30:47 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e214a1f8-0154-4b29-9c9d-4e1d66473840 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 08:30:47 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:30:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be5769ee-f9e8-4f2b-bf37-b8a4bb618605 -p 172.16.0.220:3260 --interface default --op new {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:30:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be5769ee-f9e8-4f2b-bf37-b8a4bb618605 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:30:47 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c6a99a-2899-481b-be58-6bc264acdc59]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be5769ee-f9e8-4f2b-bf37-b8a4bb618605] added\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:30:47 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e214a1f8-0154-4b29-9c9d-4e1d66473840 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be5769ee-f9e8-4f2b-bf37-b8a4bb618605] added
Nov 15 08:30:47 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:30:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be5769ee-f9e8-4f2b-bf37-b8a4bb618605 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:30:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be5769ee-f9e8-4f2b-bf37-b8a4bb618605 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:30:47 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[327dda0b-9804-483b-8783-7bf398b83070]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:30:47 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e214a1f8-0154-4b29-9c9d-4e1d66473840 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:30:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be5769ee-f9e8-4f2b-bf37-b8a4bb618605 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:30:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be5769ee-f9e8-4f2b-bf37-b8a4bb618605 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:30:47 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5dad400-27a3-4a4c-8543-3cb6aab1eb12]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:30:47 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e214a1f8-0154-4b29-9c9d-4e1d66473840 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:30:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be5769ee-f9e8-4f2b-bf37-b8a4bb618605 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nTezSsDo {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:30:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be5769ee-f9e8-4f2b-bf37-b8a4bb618605 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nTezSsDo" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:30:47 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16f6946-1b6a-4d49-b514-32e485391e49]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:30:47 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e214a1f8-0154-4b29-9c9d-4e1d66473840 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nTezSsDo'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:30:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be5769ee-f9e8-4f2b-bf37-b8a4bb618605 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:30:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be5769ee-f9e8-4f2b-bf37-b8a4bb618605 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:30:47 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41a4f64-d91b-421a-a919-899b8d9f8fca]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:30:47 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e214a1f8-0154-4b29-9c9d-4e1d66473840 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:30:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:30:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:30:47 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d790a42f-d744-4ba7-b413-7816b188eac4]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:30:47 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e214a1f8-0154-4b29-9c9d-4e1d66473840 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:30:47 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:30:47 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e214a1f8-0154-4b29-9c9d-4e1d66473840 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:30:47 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:30:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be5769ee-f9e8-4f2b-bf37-b8a4bb618605 -p 172.16.0.220:3260 --login {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:30:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be5769ee-f9e8-4f2b-bf37-b8a4bb618605 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:30:47 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[9436403e-20fb-43ff-a185-95946ab36538]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:be5769ee-f9e8-4f2b-bf37-b8a4bb618605, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:be5769ee-f9e8-4f2b-bf37-b8a4bb618605, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:30:47 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e214a1f8-0154-4b29-9c9d-4e1d66473840 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:be5769ee-f9e8-4f2b-bf37-b8a4bb618605, portal: 172.16.0.220,3260]
Nov 15 08:30:47 user nova-compute[95467]: Login to [iface: default, target: iqn.2010-10.org.openstack:be5769ee-f9e8-4f2b-bf37-b8a4bb618605, portal: 172.16.0.220,3260] successful.
Nov 15 08:30:47 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:30:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be5769ee-f9e8-4f2b-bf37-b8a4bb618605 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:30:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be5769ee-f9e8-4f2b-bf37-b8a4bb618605 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:30:47 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51e6037-f3f6-4c77-a6af-7f8c6c59c8ef]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:30:47 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e214a1f8-0154-4b29-9c9d-4e1d66473840 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:30:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:30:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:30:47 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a3bf91-267d-4cee-adc4-5d350dca3f03]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5769ee-f9e8-4f2b-bf37-b8a4bb618605 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:30:47 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e214a1f8-0154-4b29-9c9d-4e1d66473840 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:30:47 user nova-compute[95467]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5769ee-f9e8-4f2b-bf37-b8a4bb618605 (non-flash)
Nov 15 08:30:47 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:30:47 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e214a1f8-0154-4b29-9c9d-4e1d66473840 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:30:47 user nova-compute[95467]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5769ee-f9e8-4f2b-bf37-b8a4bb618605 (non-flash)
Nov 15 08:30:47 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:30:47 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-e214a1f8-0154-4b29-9c9d-4e1d66473840 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be5769ee-f9e8-4f2b-bf37-b8a4bb618605" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:30:47 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e214a1f8-0154-4b29-9c9d-4e1d66473840 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Connected to 172.16.0.220:3260 {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 08:30:47 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-e214a1f8-0154-4b29-9c9d-4e1d66473840 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=95467) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 08:30:47 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-e214a1f8-0154-4b29-9c9d-4e1d66473840 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=95467) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 08:30:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:30:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:30:47 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5f1082-e58f-4b61-a6e7-ffe5860e8037]: (4, ('- - 0', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:30:47 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-e214a1f8-0154-4b29-9c9d-4e1d66473840 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:30:47 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e214a1f8-0154-4b29-9c9d-4e1d66473840 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:be5769ee-f9e8-4f2b-bf37-b8a4bb618605', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nTezSsDo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 08:30:47 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:30:47 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Cleaning up deleted instances with incomplete migration  {{(pid=95467) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 08:30:48 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:30:48 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-e214a1f8-0154-4b29-9c9d-4e1d66473840 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:30:48 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-e214a1f8-0154-4b29-9c9d-4e1d66473840 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '23935623735623238', 'path': '/dev/sdc'} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:30:48 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e214a1f8-0154-4b29-9c9d-4e1d66473840 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935623735623238', 'path': '/dev/sdc'} {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 08:30:48 user nova-compute[95467]: DEBUG nova.objects.instance [None req-e214a1f8-0154-4b29-9c9d-4e1d66473840 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Lazy-loading 'flavor' on Instance uuid aaa2d1c7-dbda-4bf2-8706-3e941b44b076 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:30:48 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-e214a1f8-0154-4b29-9c9d-4e1d66473840 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 08:30:48 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:30:48 user nova-compute[95467]:   <source dev="/dev/sdc"/>
Nov 15 08:30:48 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:30:48 user nova-compute[95467]:   <serial>be5769ee-f9e8-4f2b-bf37-b8a4bb618605</serial>
Nov 15 08:30:48 user nova-compute[95467]: </disk>
Nov 15 08:30:48 user nova-compute[95467]:  {{(pid=95467) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 08:30:48 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-e214a1f8-0154-4b29-9c9d-4e1d66473840 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:30:48 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-e214a1f8-0154-4b29-9c9d-4e1d66473840 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] No BDM found with device name vdb, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:30:48 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-e214a1f8-0154-4b29-9c9d-4e1d66473840 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] No VIF found with MAC fa:16:3e:15:19:18, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:30:49 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e214a1f8-0154-4b29-9c9d-4e1d66473840 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Lock "aaa2d1c7-dbda-4bf2-8706-3e941b44b076" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.577s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:30:50 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:30:51 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:30:51 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:30:51 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=95467) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 08:30:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-17245807-bcaa-49ed-8483-266066670f53 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Acquiring lock "aaa2d1c7-dbda-4bf2-8706-3e941b44b076" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:30:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-17245807-bcaa-49ed-8483-266066670f53 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Lock "aaa2d1c7-dbda-4bf2-8706-3e941b44b076" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:30:51 user nova-compute[95467]: INFO nova.compute.manager [None req-17245807-bcaa-49ed-8483-266066670f53 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Detaching volume be5769ee-f9e8-4f2b-bf37-b8a4bb618605
Nov 15 08:30:51 user nova-compute[95467]: INFO nova.virt.block_device [None req-17245807-bcaa-49ed-8483-266066670f53 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Attempting to driver detach volume be5769ee-f9e8-4f2b-bf37-b8a4bb618605 from mountpoint /dev/vdb
Nov 15 08:30:51 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-17245807-bcaa-49ed-8483-266066670f53 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Attempting to detach device vdb from instance aaa2d1c7-dbda-4bf2-8706-3e941b44b076 from the persistent domain config. {{(pid=95467) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 08:30:51 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-17245807-bcaa-49ed-8483-266066670f53 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 08:30:51 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:30:51 user nova-compute[95467]:   <source dev="/dev/sdc"/>
Nov 15 08:30:51 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:30:51 user nova-compute[95467]:   <serial>be5769ee-f9e8-4f2b-bf37-b8a4bb618605</serial>
Nov 15 08:30:51 user nova-compute[95467]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 08:30:51 user nova-compute[95467]: </disk>
Nov 15 08:30:51 user nova-compute[95467]:  {{(pid=95467) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 08:30:52 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-17245807-bcaa-49ed-8483-266066670f53 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Successfully detached device vdb from instance aaa2d1c7-dbda-4bf2-8706-3e941b44b076 from the persistent domain config.
Nov 15 08:30:52 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-17245807-bcaa-49ed-8483-266066670f53 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance aaa2d1c7-dbda-4bf2-8706-3e941b44b076 from the live domain config. {{(pid=95467) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 08:30:52 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-17245807-bcaa-49ed-8483-266066670f53 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 08:30:52 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:30:52 user nova-compute[95467]:   <source dev="/dev/sdc"/>
Nov 15 08:30:52 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:30:52 user nova-compute[95467]:   <serial>be5769ee-f9e8-4f2b-bf37-b8a4bb618605</serial>
Nov 15 08:30:52 user nova-compute[95467]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 08:30:52 user nova-compute[95467]: </disk>
Nov 15 08:30:52 user nova-compute[95467]:  {{(pid=95467) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 08:30:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-645a293c-d1ca-4013-97d1-fb3b6b63898b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Acquiring lock "091612cf-b737-480b-984e-a05b522676b6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:30:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-645a293c-d1ca-4013-97d1-fb3b6b63898b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "091612cf-b737-480b-984e-a05b522676b6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:30:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-645a293c-d1ca-4013-97d1-fb3b6b63898b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Acquiring lock "091612cf-b737-480b-984e-a05b522676b6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:30:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-645a293c-d1ca-4013-97d1-fb3b6b63898b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "091612cf-b737-480b-984e-a05b522676b6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:30:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-645a293c-d1ca-4013-97d1-fb3b6b63898b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "091612cf-b737-480b-984e-a05b522676b6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:30:52 user nova-compute[95467]: INFO nova.compute.manager [None req-645a293c-d1ca-4013-97d1-fb3b6b63898b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 091612cf-b737-480b-984e-a05b522676b6] Terminating instance
Nov 15 08:30:52 user nova-compute[95467]: DEBUG nova.compute.manager [None req-645a293c-d1ca-4013-97d1-fb3b6b63898b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 091612cf-b737-480b-984e-a05b522676b6] Start destroying the instance on the hypervisor. {{(pid=95467) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 08:30:52 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:30:52 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:30:52 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-17245807-bcaa-49ed-8483-266066670f53 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance aaa2d1c7-dbda-4bf2-8706-3e941b44b076 {{(pid=95467) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 08:30:52 user nova-compute[95467]: DEBUG nova.compute.manager [req-cf933544-07d6-4ff6-957f-d0c8fc062903 req-cc993a1d-357a-4d2b-a652-37340f5b59f8 service nova] [instance: 091612cf-b737-480b-984e-a05b522676b6] Received event network-vif-unplugged-4880d737-2c51-4a14-bba5-f9ec720a3f18 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:30:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-cf933544-07d6-4ff6-957f-d0c8fc062903 req-cc993a1d-357a-4d2b-a652-37340f5b59f8 service nova] Acquiring lock "091612cf-b737-480b-984e-a05b522676b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:30:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-cf933544-07d6-4ff6-957f-d0c8fc062903 req-cc993a1d-357a-4d2b-a652-37340f5b59f8 service nova] Lock "091612cf-b737-480b-984e-a05b522676b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:30:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-cf933544-07d6-4ff6-957f-d0c8fc062903 req-cc993a1d-357a-4d2b-a652-37340f5b59f8 service nova] Lock "091612cf-b737-480b-984e-a05b522676b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:30:52 user nova-compute[95467]: DEBUG nova.compute.manager [req-cf933544-07d6-4ff6-957f-d0c8fc062903 req-cc993a1d-357a-4d2b-a652-37340f5b59f8 service nova] [instance: 091612cf-b737-480b-984e-a05b522676b6] No waiting events found dispatching network-vif-unplugged-4880d737-2c51-4a14-bba5-f9ec720a3f18 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:30:52 user nova-compute[95467]: DEBUG nova.compute.manager [req-cf933544-07d6-4ff6-957f-d0c8fc062903 req-cc993a1d-357a-4d2b-a652-37340f5b59f8 service nova] [instance: 091612cf-b737-480b-984e-a05b522676b6] Received event network-vif-unplugged-4880d737-2c51-4a14-bba5-f9ec720a3f18 for instance with task_state deleting. {{(pid=95467) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 08:30:52 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager.update_available_resource {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:30:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:30:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:30:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:30:52 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Auditing locally available compute resources for user (node: user) {{(pid=95467) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 08:30:52 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:30:52 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:30:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:30:53 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 091612cf-b737-480b-984e-a05b522676b6] Instance destroyed successfully.
Nov 15 08:30:53 user nova-compute[95467]: DEBUG nova.objects.instance [None req-645a293c-d1ca-4013-97d1-fb3b6b63898b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lazy-loading 'resources' on Instance uuid 091612cf-b737-480b-984e-a05b522676b6 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:30:53 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-645a293c-d1ca-4013-97d1-fb3b6b63898b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:21:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-205049505',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-205049505',id=36,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:21:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c34d65a8000347feb2b3966b7ce0d785',ramdisk_id='',reservation_id='r-sz004h8p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1903830225',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:23:27Z,user_data=None,user_id='6971581ab2604353aeb0c45c5252b4fb',uuid=091612cf-b737-480b-984e-a05b522676b6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4880d737-2c51-4a14-bba5-f9ec720a3f18", "address": "fa:16:3e:21:da:50", "network": {"id": "ac9a381d-25fe-4419-b151-f03333413813", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1183680999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34d65a8000347feb2b3966b7ce0d785", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4880d737-2c", "ovs_interfaceid": "4880d737-2c51-4a14-bba5-f9ec720a3f18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:30:53 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-645a293c-d1ca-4013-97d1-fb3b6b63898b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Converting VIF {"id": "4880d737-2c51-4a14-bba5-f9ec720a3f18", "address": "fa:16:3e:21:da:50", "network": {"id": "ac9a381d-25fe-4419-b151-f03333413813", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1183680999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34d65a8000347feb2b3966b7ce0d785", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4880d737-2c", "ovs_interfaceid": "4880d737-2c51-4a14-bba5-f9ec720a3f18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:30:53 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-645a293c-d1ca-4013-97d1-fb3b6b63898b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:da:50,bridge_name='br-int',has_traffic_filtering=True,id=4880d737-2c51-4a14-bba5-f9ec720a3f18,network=Network(ac9a381d-25fe-4419-b151-f03333413813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4880d737-2c') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:30:53 user nova-compute[95467]: DEBUG os_vif [None req-645a293c-d1ca-4013-97d1-fb3b6b63898b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:da:50,bridge_name='br-int',has_traffic_filtering=True,id=4880d737-2c51-4a14-bba5-f9ec720a3f18,network=Network(ac9a381d-25fe-4419-b151-f03333413813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4880d737-2c') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:30:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:30:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4880d737-2c, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:30:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:30:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:30:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:30:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3a4038da-8ff0-4ce3-afa4-f3b804edb4c7) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:30:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:30:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:30:53 user nova-compute[95467]: INFO os_vif [None req-645a293c-d1ca-4013-97d1-fb3b6b63898b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:da:50,bridge_name='br-int',has_traffic_filtering=True,id=4880d737-2c51-4a14-bba5-f9ec720a3f18,network=Network(ac9a381d-25fe-4419-b151-f03333413813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4880d737-2c')
Nov 15 08:30:53 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-645a293c-d1ca-4013-97d1-fb3b6b63898b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 091612cf-b737-480b-984e-a05b522676b6] Deleting instance files /opt/stack/data/nova/instances/091612cf-b737-480b-984e-a05b522676b6_del
Nov 15 08:30:53 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-645a293c-d1ca-4013-97d1-fb3b6b63898b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 091612cf-b737-480b-984e-a05b522676b6] Deletion of /opt/stack/data/nova/instances/091612cf-b737-480b-984e-a05b522676b6_del complete
Nov 15 08:30:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:30:53 user nova-compute[95467]: INFO nova.compute.manager [None req-645a293c-d1ca-4013-97d1-fb3b6b63898b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 091612cf-b737-480b-984e-a05b522676b6] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 15 08:30:53 user nova-compute[95467]: DEBUG oslo.service.loopingcall [None req-645a293c-d1ca-4013-97d1-fb3b6b63898b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=95467) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 08:30:53 user nova-compute[95467]: DEBUG nova.compute.manager [-] [instance: 091612cf-b737-480b-984e-a05b522676b6] Deallocating network for instance {{(pid=95467) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 08:30:53 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: 091612cf-b737-480b-984e-a05b522676b6] deallocate_for_instance() {{(pid=95467) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 08:30:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:30:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:30:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:30:53 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:30:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:30:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:30:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:30:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:30:54 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Error from libvirt while getting description of instance-00000024: [Error Code 42] Domain not found: no domain with matching uuid '091612cf-b737-480b-984e-a05b522676b6' (instance-00000024): libvirt.libvirtError: Domain not found: no domain with matching uuid '091612cf-b737-480b-984e-a05b522676b6' (instance-00000024)
Nov 15 08:30:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaa2d1c7-dbda-4bf2-8706-3e941b44b076/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:30:54 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: 091612cf-b737-480b-984e-a05b522676b6] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:30:54 user nova-compute[95467]: INFO nova.compute.manager [-] [instance: 091612cf-b737-480b-984e-a05b522676b6] Took 0.87 seconds to deallocate network for instance.
Nov 15 08:30:54 user nova-compute[95467]: DEBUG nova.compute.manager [req-1190ea43-15bd-4655-84fe-cd6ab04c5ae7 req-636d1bbf-f3ad-403a-b395-c775324464f9 service nova] [instance: 091612cf-b737-480b-984e-a05b522676b6] Received event network-vif-deleted-4880d737-2c51-4a14-bba5-f9ec720a3f18 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:30:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaa2d1c7-dbda-4bf2-8706-3e941b44b076/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:30:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaa2d1c7-dbda-4bf2-8706-3e941b44b076/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:30:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-645a293c-d1ca-4013-97d1-fb3b6b63898b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:30:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-645a293c-d1ca-4013-97d1-fb3b6b63898b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:30:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaa2d1c7-dbda-4bf2-8706-3e941b44b076/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:30:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk.rescue --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:30:54 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-645a293c-d1ca-4013-97d1-fb3b6b63898b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Refreshing inventories for resource provider f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 08:30:54 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-645a293c-d1ca-4013-97d1-fb3b6b63898b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Updating ProviderTree inventory for provider f56c3524-ed11-494e-82e4-b1a23920d1ae from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 08:30:54 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-645a293c-d1ca-4013-97d1-fb3b6b63898b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Updating inventory in ProviderTree for provider f56c3524-ed11-494e-82e4-b1a23920d1ae with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 08:30:54 user nova-compute[95467]: DEBUG nova.compute.manager [req-3e4618e6-8164-4c4f-aebb-b66b44fe26a4 req-74e39473-470c-42d1-a2fc-2769e33bce76 service nova] [instance: 091612cf-b737-480b-984e-a05b522676b6] Received event network-vif-plugged-4880d737-2c51-4a14-bba5-f9ec720a3f18 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:30:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-3e4618e6-8164-4c4f-aebb-b66b44fe26a4 req-74e39473-470c-42d1-a2fc-2769e33bce76 service nova] Acquiring lock "091612cf-b737-480b-984e-a05b522676b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:30:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-3e4618e6-8164-4c4f-aebb-b66b44fe26a4 req-74e39473-470c-42d1-a2fc-2769e33bce76 service nova] Lock "091612cf-b737-480b-984e-a05b522676b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:30:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-3e4618e6-8164-4c4f-aebb-b66b44fe26a4 req-74e39473-470c-42d1-a2fc-2769e33bce76 service nova] Lock "091612cf-b737-480b-984e-a05b522676b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:30:54 user nova-compute[95467]: DEBUG nova.compute.manager [req-3e4618e6-8164-4c4f-aebb-b66b44fe26a4 req-74e39473-470c-42d1-a2fc-2769e33bce76 service nova] [instance: 091612cf-b737-480b-984e-a05b522676b6] No waiting events found dispatching network-vif-plugged-4880d737-2c51-4a14-bba5-f9ec720a3f18 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:30:54 user nova-compute[95467]: WARNING nova.compute.manager [req-3e4618e6-8164-4c4f-aebb-b66b44fe26a4 req-74e39473-470c-42d1-a2fc-2769e33bce76 service nova] [instance: 091612cf-b737-480b-984e-a05b522676b6] Received unexpected event network-vif-plugged-4880d737-2c51-4a14-bba5-f9ec720a3f18 for instance with vm_state deleted and task_state None.
Nov 15 08:30:54 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-645a293c-d1ca-4013-97d1-fb3b6b63898b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Refreshing aggregate associations for resource provider f56c3524-ed11-494e-82e4-b1a23920d1ae, aggregates: None {{(pid=95467) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 08:30:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:30:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk.rescue --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:30:54 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-645a293c-d1ca-4013-97d1-fb3b6b63898b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Refreshing trait associations for resource provider f56c3524-ed11-494e-82e4-b1a23920d1ae, traits: COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSSE3,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI {{(pid=95467) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 08:30:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:30:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:30:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:30:55 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-645a293c-d1ca-4013-97d1-fb3b6b63898b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:30:55 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-645a293c-d1ca-4013-97d1-fb3b6b63898b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:30:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:30:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:30:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-645a293c-d1ca-4013-97d1-fb3b6b63898b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.760s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:30:55 user nova-compute[95467]: INFO nova.scheduler.client.report [None req-645a293c-d1ca-4013-97d1-fb3b6b63898b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Deleted allocations for instance 091612cf-b737-480b-984e-a05b522676b6
Nov 15 08:30:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:30:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-645a293c-d1ca-4013-97d1-fb3b6b63898b tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "091612cf-b737-480b-984e-a05b522676b6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.914s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:30:55 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:30:55 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:30:55 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Hypervisor/Node resource view: name=user free_ram=8408MB free_disk=25.02651596069336GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=95467) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 08:30:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:30:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:30:55 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 21cf2ada-b15c-490d-ac37-96e9c87e9056 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:30:55 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:30:55 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 10d73b73-ca65-4192-8954-288dc1df9f24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:30:55 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 3825a691-ac5c-4c06-b4a4-2a0b40c638c4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:30:55 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance aaa2d1c7-dbda-4bf2-8706-3e941b44b076 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:30:55 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 08:30:55 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 08:30:55 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:30:55 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:30:56 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Compute_service record updated for user:user {{(pid=95467) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 08:30:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.349s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:30:56 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:30:57 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:30:57 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:30:57 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:30:57 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:30:57 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:30:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:30:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:30:59 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:30:59 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Starting heal instance info cache {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 08:30:59 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Didn't find any instances for network info cache update. {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 08:31:01 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:31:02 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:31:02 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Cleaning up deleted instances {{(pid=95467) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 08:31:02 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] There are 0 instances to clean {{(pid=95467) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 08:31:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:31:05 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8fef3b14-f38b-4102-9446-64562ab71d13 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Acquiring lock "10d73b73-ca65-4192-8954-288dc1df9f24" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:31:05 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8fef3b14-f38b-4102-9446-64562ab71d13 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "10d73b73-ca65-4192-8954-288dc1df9f24" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:31:05 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8fef3b14-f38b-4102-9446-64562ab71d13 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Acquiring lock "10d73b73-ca65-4192-8954-288dc1df9f24-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:31:05 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8fef3b14-f38b-4102-9446-64562ab71d13 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "10d73b73-ca65-4192-8954-288dc1df9f24-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:31:05 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8fef3b14-f38b-4102-9446-64562ab71d13 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "10d73b73-ca65-4192-8954-288dc1df9f24-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:31:05 user nova-compute[95467]: INFO nova.compute.manager [None req-8fef3b14-f38b-4102-9446-64562ab71d13 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Terminating instance
Nov 15 08:31:05 user nova-compute[95467]: DEBUG nova.compute.manager [None req-8fef3b14-f38b-4102-9446-64562ab71d13 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Start destroying the instance on the hypervisor. {{(pid=95467) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 08:31:05 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:31:05 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:31:06 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:31:06 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:31:06 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:31:06 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:31:06 user nova-compute[95467]: DEBUG nova.compute.manager [req-52809640-12eb-46df-b0f6-4ae66110830d req-3f0699a1-5b73-4aba-9452-aeee98a280f7 service nova] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Received event network-vif-unplugged-b88ee27b-7174-45f5-a5a5-45db71caac08 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:31:06 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-52809640-12eb-46df-b0f6-4ae66110830d req-3f0699a1-5b73-4aba-9452-aeee98a280f7 service nova] Acquiring lock "10d73b73-ca65-4192-8954-288dc1df9f24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:31:06 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-52809640-12eb-46df-b0f6-4ae66110830d req-3f0699a1-5b73-4aba-9452-aeee98a280f7 service nova] Lock "10d73b73-ca65-4192-8954-288dc1df9f24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:31:06 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-52809640-12eb-46df-b0f6-4ae66110830d req-3f0699a1-5b73-4aba-9452-aeee98a280f7 service nova] Lock "10d73b73-ca65-4192-8954-288dc1df9f24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:31:06 user nova-compute[95467]: DEBUG nova.compute.manager [req-52809640-12eb-46df-b0f6-4ae66110830d req-3f0699a1-5b73-4aba-9452-aeee98a280f7 service nova] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] No waiting events found dispatching network-vif-unplugged-b88ee27b-7174-45f5-a5a5-45db71caac08 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:31:06 user nova-compute[95467]: DEBUG nova.compute.manager [req-52809640-12eb-46df-b0f6-4ae66110830d req-3f0699a1-5b73-4aba-9452-aeee98a280f7 service nova] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Received event network-vif-unplugged-b88ee27b-7174-45f5-a5a5-45db71caac08 for instance with task_state deleting. {{(pid=95467) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 08:31:06 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:31:06 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Instance destroyed successfully.
Nov 15 08:31:06 user nova-compute[95467]: DEBUG nova.objects.instance [None req-8fef3b14-f38b-4102-9446-64562ab71d13 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lazy-loading 'resources' on Instance uuid 10d73b73-ca65-4192-8954-288dc1df9f24 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:31:06 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-8fef3b14-f38b-4102-9446-64562ab71d13 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:15:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1288293325',display_name='tempest-ServerRescueNegativeTestJSON-server-1288293325',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1288293325',id=22,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:16:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bd281be4e94a4d31a47a13267d51d9b6',ramdisk_id='',reservation_id='r-egtjqjbc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1148442534',owner_user_name='tempest-ServerRescueNegativeTestJSON-1148442534-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:16:59Z,user_data=None,user_id='c07f8dbc38004ecd973f61bba63606d4',uuid=10d73b73-ca65-4192-8954-288dc1df9f24,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "b88ee27b-7174-45f5-a5a5-45db71caac08", "address": "fa:16:3e:a0:3b:16", "network": {"id": "369d2a6f-60b7-4c92-8b2d-1f3828f6698b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1491709218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd281be4e94a4d31a47a13267d51d9b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb88ee27b-71", "ovs_interfaceid": "b88ee27b-7174-45f5-a5a5-45db71caac08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:31:06 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-8fef3b14-f38b-4102-9446-64562ab71d13 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Converting VIF {"id": "b88ee27b-7174-45f5-a5a5-45db71caac08", "address": "fa:16:3e:a0:3b:16", "network": {"id": "369d2a6f-60b7-4c92-8b2d-1f3828f6698b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1491709218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd281be4e94a4d31a47a13267d51d9b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb88ee27b-71", "ovs_interfaceid": "b88ee27b-7174-45f5-a5a5-45db71caac08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:31:06 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-8fef3b14-f38b-4102-9446-64562ab71d13 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a0:3b:16,bridge_name='br-int',has_traffic_filtering=True,id=b88ee27b-7174-45f5-a5a5-45db71caac08,network=Network(369d2a6f-60b7-4c92-8b2d-1f3828f6698b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb88ee27b-71') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:31:06 user nova-compute[95467]: DEBUG os_vif [None req-8fef3b14-f38b-4102-9446-64562ab71d13 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:3b:16,bridge_name='br-int',has_traffic_filtering=True,id=b88ee27b-7174-45f5-a5a5-45db71caac08,network=Network(369d2a6f-60b7-4c92-8b2d-1f3828f6698b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb88ee27b-71') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:31:06 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:31:06 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb88ee27b-71, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:31:06 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:31:06 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:31:06 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:31:06 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7a8cec7c-747e-4c45-9db2-c0ca233009b1) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:31:06 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:31:06 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:31:06 user nova-compute[95467]: INFO os_vif [None req-8fef3b14-f38b-4102-9446-64562ab71d13 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:3b:16,bridge_name='br-int',has_traffic_filtering=True,id=b88ee27b-7174-45f5-a5a5-45db71caac08,network=Network(369d2a6f-60b7-4c92-8b2d-1f3828f6698b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb88ee27b-71')
Nov 15 08:31:06 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-8fef3b14-f38b-4102-9446-64562ab71d13 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Deleting instance files /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24_del
Nov 15 08:31:06 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-8fef3b14-f38b-4102-9446-64562ab71d13 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Deletion of /opt/stack/data/nova/instances/10d73b73-ca65-4192-8954-288dc1df9f24_del complete
Nov 15 08:31:06 user nova-compute[95467]: INFO nova.compute.manager [None req-8fef3b14-f38b-4102-9446-64562ab71d13 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 15 08:31:06 user nova-compute[95467]: DEBUG oslo.service.loopingcall [None req-8fef3b14-f38b-4102-9446-64562ab71d13 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=95467) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 08:31:06 user nova-compute[95467]: DEBUG nova.compute.manager [-] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Deallocating network for instance {{(pid=95467) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 08:31:06 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] deallocate_for_instance() {{(pid=95467) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 08:31:06 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:31:07 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:31:07 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:31:07 user nova-compute[95467]: INFO nova.compute.manager [-] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Took 0.71 seconds to deallocate network for instance.
Nov 15 08:31:07 user nova-compute[95467]: DEBUG nova.compute.manager [req-d7cd21f4-4e71-44af-aa4c-62827b63b7ed req-6e5755dc-88ec-4757-bba0-f857eef9c0a5 service nova] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Received event network-vif-deleted-b88ee27b-7174-45f5-a5a5-45db71caac08 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:31:07 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8fef3b14-f38b-4102-9446-64562ab71d13 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:31:07 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8fef3b14-f38b-4102-9446-64562ab71d13 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:31:07 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-8fef3b14-f38b-4102-9446-64562ab71d13 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:31:07 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-8fef3b14-f38b-4102-9446-64562ab71d13 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:31:07 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8fef3b14-f38b-4102-9446-64562ab71d13 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.281s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:31:07 user nova-compute[95467]: INFO nova.scheduler.client.report [None req-8fef3b14-f38b-4102-9446-64562ab71d13 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Deleted allocations for instance 10d73b73-ca65-4192-8954-288dc1df9f24
Nov 15 08:31:07 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8fef3b14-f38b-4102-9446-64562ab71d13 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "10d73b73-ca65-4192-8954-288dc1df9f24" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.171s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:31:08 user nova-compute[95467]: DEBUG nova.compute.manager [req-00f0c4e3-b70d-41b7-95c4-a2f1dedbe4b1 req-49aeaec8-ed6f-474d-848f-e82fae0b93fa service nova] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Received event network-vif-plugged-b88ee27b-7174-45f5-a5a5-45db71caac08 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:31:08 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-00f0c4e3-b70d-41b7-95c4-a2f1dedbe4b1 req-49aeaec8-ed6f-474d-848f-e82fae0b93fa service nova] Acquiring lock "10d73b73-ca65-4192-8954-288dc1df9f24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:31:08 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-00f0c4e3-b70d-41b7-95c4-a2f1dedbe4b1 req-49aeaec8-ed6f-474d-848f-e82fae0b93fa service nova] Lock "10d73b73-ca65-4192-8954-288dc1df9f24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:31:08 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-00f0c4e3-b70d-41b7-95c4-a2f1dedbe4b1 req-49aeaec8-ed6f-474d-848f-e82fae0b93fa service nova] Lock "10d73b73-ca65-4192-8954-288dc1df9f24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:31:08 user nova-compute[95467]: DEBUG nova.compute.manager [req-00f0c4e3-b70d-41b7-95c4-a2f1dedbe4b1 req-49aeaec8-ed6f-474d-848f-e82fae0b93fa service nova] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] No waiting events found dispatching network-vif-plugged-b88ee27b-7174-45f5-a5a5-45db71caac08 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:31:08 user nova-compute[95467]: WARNING nova.compute.manager [req-00f0c4e3-b70d-41b7-95c4-a2f1dedbe4b1 req-49aeaec8-ed6f-474d-848f-e82fae0b93fa service nova] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Received unexpected event network-vif-plugged-b88ee27b-7174-45f5-a5a5-45db71caac08 for instance with vm_state deleted and task_state None.
Nov 15 08:31:08 user nova-compute[95467]: DEBUG nova.compute.manager [req-00f0c4e3-b70d-41b7-95c4-a2f1dedbe4b1 req-49aeaec8-ed6f-474d-848f-e82fae0b93fa service nova] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Received event network-vif-plugged-b88ee27b-7174-45f5-a5a5-45db71caac08 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:31:08 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-00f0c4e3-b70d-41b7-95c4-a2f1dedbe4b1 req-49aeaec8-ed6f-474d-848f-e82fae0b93fa service nova] Acquiring lock "10d73b73-ca65-4192-8954-288dc1df9f24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:31:08 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-00f0c4e3-b70d-41b7-95c4-a2f1dedbe4b1 req-49aeaec8-ed6f-474d-848f-e82fae0b93fa service nova] Lock "10d73b73-ca65-4192-8954-288dc1df9f24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:31:08 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-00f0c4e3-b70d-41b7-95c4-a2f1dedbe4b1 req-49aeaec8-ed6f-474d-848f-e82fae0b93fa service nova] Lock "10d73b73-ca65-4192-8954-288dc1df9f24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:31:08 user nova-compute[95467]: DEBUG nova.compute.manager [req-00f0c4e3-b70d-41b7-95c4-a2f1dedbe4b1 req-49aeaec8-ed6f-474d-848f-e82fae0b93fa service nova] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] No waiting events found dispatching network-vif-plugged-b88ee27b-7174-45f5-a5a5-45db71caac08 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:31:08 user nova-compute[95467]: WARNING nova.compute.manager [req-00f0c4e3-b70d-41b7-95c4-a2f1dedbe4b1 req-49aeaec8-ed6f-474d-848f-e82fae0b93fa service nova] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Received unexpected event network-vif-plugged-b88ee27b-7174-45f5-a5a5-45db71caac08 for instance with vm_state deleted and task_state None.
Nov 15 08:31:08 user nova-compute[95467]: DEBUG nova.compute.manager [req-00f0c4e3-b70d-41b7-95c4-a2f1dedbe4b1 req-49aeaec8-ed6f-474d-848f-e82fae0b93fa service nova] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Received event network-vif-plugged-b88ee27b-7174-45f5-a5a5-45db71caac08 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:31:08 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-00f0c4e3-b70d-41b7-95c4-a2f1dedbe4b1 req-49aeaec8-ed6f-474d-848f-e82fae0b93fa service nova] Acquiring lock "10d73b73-ca65-4192-8954-288dc1df9f24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:31:08 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-00f0c4e3-b70d-41b7-95c4-a2f1dedbe4b1 req-49aeaec8-ed6f-474d-848f-e82fae0b93fa service nova] Lock "10d73b73-ca65-4192-8954-288dc1df9f24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:31:08 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-00f0c4e3-b70d-41b7-95c4-a2f1dedbe4b1 req-49aeaec8-ed6f-474d-848f-e82fae0b93fa service nova] Lock "10d73b73-ca65-4192-8954-288dc1df9f24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:31:08 user nova-compute[95467]: DEBUG nova.compute.manager [req-00f0c4e3-b70d-41b7-95c4-a2f1dedbe4b1 req-49aeaec8-ed6f-474d-848f-e82fae0b93fa service nova] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] No waiting events found dispatching network-vif-plugged-b88ee27b-7174-45f5-a5a5-45db71caac08 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:31:08 user nova-compute[95467]: WARNING nova.compute.manager [req-00f0c4e3-b70d-41b7-95c4-a2f1dedbe4b1 req-49aeaec8-ed6f-474d-848f-e82fae0b93fa service nova] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Received unexpected event network-vif-plugged-b88ee27b-7174-45f5-a5a5-45db71caac08 for instance with vm_state deleted and task_state None.
Nov 15 08:31:08 user nova-compute[95467]: DEBUG nova.compute.manager [req-00f0c4e3-b70d-41b7-95c4-a2f1dedbe4b1 req-49aeaec8-ed6f-474d-848f-e82fae0b93fa service nova] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Received event network-vif-unplugged-b88ee27b-7174-45f5-a5a5-45db71caac08 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:31:08 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-00f0c4e3-b70d-41b7-95c4-a2f1dedbe4b1 req-49aeaec8-ed6f-474d-848f-e82fae0b93fa service nova] Acquiring lock "10d73b73-ca65-4192-8954-288dc1df9f24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:31:08 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-00f0c4e3-b70d-41b7-95c4-a2f1dedbe4b1 req-49aeaec8-ed6f-474d-848f-e82fae0b93fa service nova] Lock "10d73b73-ca65-4192-8954-288dc1df9f24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:31:08 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-00f0c4e3-b70d-41b7-95c4-a2f1dedbe4b1 req-49aeaec8-ed6f-474d-848f-e82fae0b93fa service nova] Lock "10d73b73-ca65-4192-8954-288dc1df9f24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:31:08 user nova-compute[95467]: DEBUG nova.compute.manager [req-00f0c4e3-b70d-41b7-95c4-a2f1dedbe4b1 req-49aeaec8-ed6f-474d-848f-e82fae0b93fa service nova] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] No waiting events found dispatching network-vif-unplugged-b88ee27b-7174-45f5-a5a5-45db71caac08 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:31:08 user nova-compute[95467]: WARNING nova.compute.manager [req-00f0c4e3-b70d-41b7-95c4-a2f1dedbe4b1 req-49aeaec8-ed6f-474d-848f-e82fae0b93fa service nova] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Received unexpected event network-vif-unplugged-b88ee27b-7174-45f5-a5a5-45db71caac08 for instance with vm_state deleted and task_state None.
Nov 15 08:31:08 user nova-compute[95467]: DEBUG nova.compute.manager [req-00f0c4e3-b70d-41b7-95c4-a2f1dedbe4b1 req-49aeaec8-ed6f-474d-848f-e82fae0b93fa service nova] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Received event network-vif-plugged-b88ee27b-7174-45f5-a5a5-45db71caac08 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:31:08 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-00f0c4e3-b70d-41b7-95c4-a2f1dedbe4b1 req-49aeaec8-ed6f-474d-848f-e82fae0b93fa service nova] Acquiring lock "10d73b73-ca65-4192-8954-288dc1df9f24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:31:08 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-00f0c4e3-b70d-41b7-95c4-a2f1dedbe4b1 req-49aeaec8-ed6f-474d-848f-e82fae0b93fa service nova] Lock "10d73b73-ca65-4192-8954-288dc1df9f24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:31:08 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-00f0c4e3-b70d-41b7-95c4-a2f1dedbe4b1 req-49aeaec8-ed6f-474d-848f-e82fae0b93fa service nova] Lock "10d73b73-ca65-4192-8954-288dc1df9f24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:31:08 user nova-compute[95467]: DEBUG nova.compute.manager [req-00f0c4e3-b70d-41b7-95c4-a2f1dedbe4b1 req-49aeaec8-ed6f-474d-848f-e82fae0b93fa service nova] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] No waiting events found dispatching network-vif-plugged-b88ee27b-7174-45f5-a5a5-45db71caac08 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:31:08 user nova-compute[95467]: WARNING nova.compute.manager [req-00f0c4e3-b70d-41b7-95c4-a2f1dedbe4b1 req-49aeaec8-ed6f-474d-848f-e82fae0b93fa service nova] [instance: 10d73b73-ca65-4192-8954-288dc1df9f24] Received unexpected event network-vif-plugged-b88ee27b-7174-45f5-a5a5-45db71caac08 for instance with vm_state deleted and task_state None.
Nov 15 08:31:11 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:31:12 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-17245807-bcaa-49ed-8483-266066670f53 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance aaa2d1c7-dbda-4bf2-8706-3e941b44b076 is timed out.
Nov 15 08:31:12 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-17245807-bcaa-49ed-8483-266066670f53 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Successfully detached device vdb from instance aaa2d1c7-dbda-4bf2-8706-3e941b44b076 from the live domain config.
Nov 15 08:31:12 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17245807-bcaa-49ed-8483-266066670f53 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] calling os-brick to detach iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 08:31:12 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-17245807-bcaa-49ed-8483-266066670f53 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, {'target_iqn': 'iqn.2010-10.org.openstack:be5769ee-f9e8-4f2b-bf37-b8a4bb618605', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nTezSsDo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:31:12 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-17245807-bcaa-49ed-8483-266066670f53 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:31:12 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-17245807-bcaa-49ed-8483-266066670f53 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:31:12 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-17245807-bcaa-49ed-8483-266066670f53 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.005s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:31:12 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:31:12 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:31:12 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9e7dad-0080-45e4-a2bf-c494ef09d24f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6b158da6-a9ec-4bcc-b515-5578c6b55523\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:be5769ee-f9e8-4f2b-bf37-b8a4bb618605\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c381414d-a749-4256-95d5-011070a64fb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:31:12 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-17245807-bcaa-49ed-8483-266066670f53 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 08:31:12 user nova-compute[95467]: No targets found.
Nov 15 08:31:12 user nova-compute[95467]: iSNS:
Nov 15 08:31:12 user nova-compute[95467]: No targets found.
Nov 15 08:31:12 user nova-compute[95467]: STATIC:
Nov 15 08:31:12 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:6b158da6-a9ec-4bcc-b515-5578c6b55523
Nov 15 08:31:12 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:31:12 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:31:12 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e
Nov 15 08:31:12 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:31:12 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:31:12 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:be5769ee-f9e8-4f2b-bf37-b8a4bb618605
Nov 15 08:31:12 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:31:12 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:31:12 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:c381414d-a749-4256-95d5-011070a64fb8
Nov 15 08:31:12 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:31:12 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:31:12 user nova-compute[95467]: FIRMWARE:
Nov 15 08:31:12 user nova-compute[95467]: No targets found.
Nov 15 08:31:12 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:31:12 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-17245807-bcaa-49ed-8483-266066670f53 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 08:31:12 user nova-compute[95467]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 08:31:12 user nova-compute[95467]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=95467) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 08:31:12 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-17245807-bcaa-49ed-8483-266066670f53 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be5769ee-f9e8-4f2b-bf37-b8a4bb618605', 0)] {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 08:31:12 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:31:12 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:31:12 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8caa6426-8109-4639-a4c0-10507bd7ff80]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b158da6-a9ec-4bcc-b515-5578c6b55523\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be5769ee-f9e8-4f2b-bf37-b8a4bb618605\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c381414d-a749-4256-95d5-011070a64fb8\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:31:12 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:31:12 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:31:12 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54582e4-f95a-471c-9526-ec30d4159e20]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5769ee-f9e8-4f2b-bf37-b8a4bb618605 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c381414d-a749-4256-95d5-011070a64fb8 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b158da6-a9ec-4bcc-b515-5578c6b55523 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:31:12 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-17245807-bcaa-49ed-8483-266066670f53 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:31:12 user nova-compute[95467]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5769ee-f9e8-4f2b-bf37-b8a4bb618605 (non-flash)
Nov 15 08:31:12 user nova-compute[95467]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c381414d-a749-4256-95d5-011070a64fb8 (non-flash)
Nov 15 08:31:12 user nova-compute[95467]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b158da6-a9ec-4bcc-b515-5578c6b55523 (non-flash)
Nov 15 08:31:12 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:31:12 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-17245807-bcaa-49ed-8483-266066670f53 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:31:12 user nova-compute[95467]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5769ee-f9e8-4f2b-bf37-b8a4bb618605 (non-flash)
Nov 15 08:31:12 user nova-compute[95467]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c381414d-a749-4256-95d5-011070a64fb8 (non-flash)
Nov 15 08:31:12 user nova-compute[95467]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b158da6-a9ec-4bcc-b515-5578c6b55523 (non-flash)
Nov 15 08:31:12 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:31:12 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-17245807-bcaa-49ed-8483-266066670f53 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efec8443490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be5769ee-f9e8-4f2b-bf37-b8a4bb618605'): ({'sdc'}, set())}) {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 08:31:12 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-17245807-bcaa-49ed-8483-266066670f53 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Removing single pathed devices sdc {{(pid=95467) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 08:31:12 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:31:12 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:31:12 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f770b0-b2da-4799-87ad-703097690396]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:31:12 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:31:12 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.033s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:31:12 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6641f1a-1194-40f2-8004-20fd961c2cfc]: (4, ('ok\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:31:12 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-17245807-bcaa-49ed-8483-266066670f53 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Flushing IO for device /dev/sdc {{(pid=95467) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 08:31:12 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:31:12 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:31:12 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1737d5-d8ee-4d9e-9c08-7060294811a6]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:31:12 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-17245807-bcaa-49ed-8483-266066670f53 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=95467) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 08:31:12 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:31:12 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:31:12 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e5d79d-3c2a-4376-ad54-3125ce09bdfa]: (4, ('1', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:31:12 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-17245807-bcaa-49ed-8483-266066670f53 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 08:31:12 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-17245807-bcaa-49ed-8483-266066670f53 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] SCSI volumes sdc have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 08:31:12 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-17245807-bcaa-49ed-8483-266066670f53 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be5769ee-f9e8-4f2b-bf37-b8a4bb618605')] {{(pid=95467) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 08:31:12 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be5769ee-f9e8-4f2b-bf37-b8a4bb618605 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:31:12 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be5769ee-f9e8-4f2b-bf37-b8a4bb618605 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:31:12 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa51089-5d89-4da1-95fb-21cfe1f10392]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:31:12 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-17245807-bcaa-49ed-8483-266066670f53 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:31:12 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be5769ee-f9e8-4f2b-bf37-b8a4bb618605 -p 172.16.0.220:3260 --logout {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:31:12 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be5769ee-f9e8-4f2b-bf37-b8a4bb618605 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:31:12 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[658edf96-b868-4aca-a81d-a37a86ac88fe]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:be5769ee-f9e8-4f2b-bf37-b8a4bb618605, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:be5769ee-f9e8-4f2b-bf37-b8a4bb618605, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:31:12 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-17245807-bcaa-49ed-8483-266066670f53 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:be5769ee-f9e8-4f2b-bf37-b8a4bb618605, portal: 172.16.0.220,3260]
Nov 15 08:31:12 user nova-compute[95467]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:be5769ee-f9e8-4f2b-bf37-b8a4bb618605, portal: 172.16.0.220,3260] successful.
Nov 15 08:31:12 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:31:12 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be5769ee-f9e8-4f2b-bf37-b8a4bb618605 -p 172.16.0.220:3260 --op delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:31:12 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be5769ee-f9e8-4f2b-bf37-b8a4bb618605 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:31:12 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e487895-63b7-4b1d-b288-aebb6c56af95]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:31:12 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-17245807-bcaa-49ed-8483-266066670f53 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:31:12 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-17245807-bcaa-49ed-8483-266066670f53 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:31:12 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-17245807-bcaa-49ed-8483-266066670f53 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] <== disconnect_volume: return (364ms) None {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:31:12 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17245807-bcaa-49ed-8483-266066670f53 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Disconnected iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 08:31:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:31:13 user nova-compute[95467]: DEBUG nova.objects.instance [None req-17245807-bcaa-49ed-8483-266066670f53 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Lazy-loading 'flavor' on Instance uuid aaa2d1c7-dbda-4bf2-8706-3e941b44b076 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:31:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-17245807-bcaa-49ed-8483-266066670f53 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Lock "aaa2d1c7-dbda-4bf2-8706-3e941b44b076" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.105s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:31:16 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:31:20 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:31:21 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:31:21 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:31:26 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:31:31 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:31:36 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:31:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:31:42 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-05c4bfd5-69e9-4860-ba92-04a6186c53f2 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Acquiring lock "3825a691-ac5c-4c06-b4a4-2a0b40c638c4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:31:42 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-05c4bfd5-69e9-4860-ba92-04a6186c53f2 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "3825a691-ac5c-4c06-b4a4-2a0b40c638c4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:31:42 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-05c4bfd5-69e9-4860-ba92-04a6186c53f2 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Acquiring lock "3825a691-ac5c-4c06-b4a4-2a0b40c638c4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:31:42 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-05c4bfd5-69e9-4860-ba92-04a6186c53f2 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "3825a691-ac5c-4c06-b4a4-2a0b40c638c4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:31:42 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-05c4bfd5-69e9-4860-ba92-04a6186c53f2 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "3825a691-ac5c-4c06-b4a4-2a0b40c638c4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:31:42 user nova-compute[95467]: INFO nova.compute.manager [None req-05c4bfd5-69e9-4860-ba92-04a6186c53f2 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Terminating instance
Nov 15 08:31:42 user nova-compute[95467]: DEBUG nova.compute.manager [None req-05c4bfd5-69e9-4860-ba92-04a6186c53f2 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Start destroying the instance on the hypervisor. {{(pid=95467) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 08:31:42 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:31:42 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG nova.compute.manager [req-2b3d6ceb-133b-4a3c-8050-e111d7abece8 req-086d59b9-3372-47bb-8f1c-119668fbb0f7 service nova] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Received event network-vif-unplugged-3fddc7dd-48af-4964-bc1a-a54623453f62 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-2b3d6ceb-133b-4a3c-8050-e111d7abece8 req-086d59b9-3372-47bb-8f1c-119668fbb0f7 service nova] Acquiring lock "3825a691-ac5c-4c06-b4a4-2a0b40c638c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-2b3d6ceb-133b-4a3c-8050-e111d7abece8 req-086d59b9-3372-47bb-8f1c-119668fbb0f7 service nova] Lock "3825a691-ac5c-4c06-b4a4-2a0b40c638c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-2b3d6ceb-133b-4a3c-8050-e111d7abece8 req-086d59b9-3372-47bb-8f1c-119668fbb0f7 service nova] Lock "3825a691-ac5c-4c06-b4a4-2a0b40c638c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG nova.compute.manager [req-2b3d6ceb-133b-4a3c-8050-e111d7abece8 req-086d59b9-3372-47bb-8f1c-119668fbb0f7 service nova] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] No waiting events found dispatching network-vif-unplugged-3fddc7dd-48af-4964-bc1a-a54623453f62 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG nova.compute.manager [req-2b3d6ceb-133b-4a3c-8050-e111d7abece8 req-086d59b9-3372-47bb-8f1c-119668fbb0f7 service nova] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Received event network-vif-unplugged-3fddc7dd-48af-4964-bc1a-a54623453f62 for instance with task_state deleting. {{(pid=95467) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:31:43 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Instance destroyed successfully.
Nov 15 08:31:43 user nova-compute[95467]: DEBUG nova.objects.instance [None req-05c4bfd5-69e9-4860-ba92-04a6186c53f2 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lazy-loading 'resources' on Instance uuid 3825a691-ac5c-4c06-b4a4-2a0b40c638c4 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-05c4bfd5-69e9-4860-ba92-04a6186c53f2 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:15:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-483246753',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-483246753',id=24,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:17:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c34d65a8000347feb2b3966b7ce0d785',ramdisk_id='',reservation_id='r-qiiyu7bw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1903830225',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:19:42Z,user_data=None,user_id='6971581ab2604353aeb0c45c5252b4fb',uuid=3825a691-ac5c-4c06-b4a4-2a0b40c638c4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3fddc7dd-48af-4964-bc1a-a54623453f62", "address": "fa:16:3e:c6:49:ac", "network": {"id": "ac9a381d-25fe-4419-b151-f03333413813", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1183680999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34d65a8000347feb2b3966b7ce0d785", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fddc7dd-48", "ovs_interfaceid": "3fddc7dd-48af-4964-bc1a-a54623453f62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-05c4bfd5-69e9-4860-ba92-04a6186c53f2 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Converting VIF {"id": "3fddc7dd-48af-4964-bc1a-a54623453f62", "address": "fa:16:3e:c6:49:ac", "network": {"id": "ac9a381d-25fe-4419-b151-f03333413813", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1183680999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34d65a8000347feb2b3966b7ce0d785", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fddc7dd-48", "ovs_interfaceid": "3fddc7dd-48af-4964-bc1a-a54623453f62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-05c4bfd5-69e9-4860-ba92-04a6186c53f2 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:49:ac,bridge_name='br-int',has_traffic_filtering=True,id=3fddc7dd-48af-4964-bc1a-a54623453f62,network=Network(ac9a381d-25fe-4419-b151-f03333413813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fddc7dd-48') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG os_vif [None req-05c4bfd5-69e9-4860-ba92-04a6186c53f2 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:49:ac,bridge_name='br-int',has_traffic_filtering=True,id=3fddc7dd-48af-4964-bc1a-a54623453f62,network=Network(ac9a381d-25fe-4419-b151-f03333413813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fddc7dd-48') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3fddc7dd-48, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5038da26-ca5d-4c32-93f8-3246791547cf) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:31:43 user nova-compute[95467]: INFO os_vif [None req-05c4bfd5-69e9-4860-ba92-04a6186c53f2 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:49:ac,bridge_name='br-int',has_traffic_filtering=True,id=3fddc7dd-48af-4964-bc1a-a54623453f62,network=Network(ac9a381d-25fe-4419-b151-f03333413813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fddc7dd-48')
Nov 15 08:31:43 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05c4bfd5-69e9-4860-ba92-04a6186c53f2 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] calling os-brick to detach iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-05c4bfd5-69e9-4860-ba92-04a6186c53f2 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, {'target_iqn': 'iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HFkTLjDm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:31:43 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-05c4bfd5-69e9-4860-ba92-04a6186c53f2 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:31:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-05c4bfd5-69e9-4860-ba92-04a6186c53f2 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-05c4bfd5-69e9-4860-ba92-04a6186c53f2 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[49df2296-c2f7-4799-9c79-34f44b6838a4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-05c4bfd5-69e9-4860-ba92-04a6186c53f2 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 08:31:43 user nova-compute[95467]: No targets found.
Nov 15 08:31:43 user nova-compute[95467]: iSNS:
Nov 15 08:31:43 user nova-compute[95467]: No targets found.
Nov 15 08:31:43 user nova-compute[95467]: STATIC:
Nov 15 08:31:43 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e
Nov 15 08:31:43 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:31:43 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:31:43 user nova-compute[95467]: FIRMWARE:
Nov 15 08:31:43 user nova-compute[95467]: No targets found.
Nov 15 08:31:43 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-05c4bfd5-69e9-4860-ba92-04a6186c53f2 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 08:31:43 user nova-compute[95467]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 08:31:43 user nova-compute[95467]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=95467) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-05c4bfd5-69e9-4860-ba92-04a6186c53f2 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e', 0)] {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e538ef-8120-41b0-81c2-b4e432bcd1ea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2447c6b-3428-4193-817f-8779cd6f285f]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-05c4bfd5-69e9-4860-ba92-04a6186c53f2 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:31:43 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-05c4bfd5-69e9-4860-ba92-04a6186c53f2 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e (non-flash)
Nov 15 08:31:43 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-05c4bfd5-69e9-4860-ba92-04a6186c53f2 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efed9fe88b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e'): ({'sdb'}, set())}) {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-05c4bfd5-69e9-4860-ba92-04a6186c53f2 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Removing single pathed devices sdb {{(pid=95467) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed5aaec-e426-45ac-8989-e9c838dd4fc0]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8121762-68ef-4721-b644-c0ff1dbedee0]: (4, ('ok\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-05c4bfd5-69e9-4860-ba92-04a6186c53f2 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Flushing IO for device /dev/sdb {{(pid=95467) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac8fb05-86fb-497c-9eb3-37a09bc52703]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-05c4bfd5-69e9-4860-ba92-04a6186c53f2 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=95467) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[604c9c5a-4887-4dfc-858e-8e8b36a86fd0]: (4, ('1', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-05c4bfd5-69e9-4860-ba92-04a6186c53f2 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-05c4bfd5-69e9-4860-ba92-04a6186c53f2 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] SCSI volumes sdb have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-05c4bfd5-69e9-4860-ba92-04a6186c53f2 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e')] {{(pid=95467) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[4575fab0-f9d5-49c9-94f1-d1c8b01f3e47]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-05c4bfd5-69e9-4860-ba92-04a6186c53f2 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e -p 172.16.0.220:3260 --logout {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[afef5201-d083-40ba-8d37-9e58fb3d6ac0]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-05c4bfd5-69e9-4860-ba92-04a6186c53f2 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e, portal: 172.16.0.220,3260]
Nov 15 08:31:43 user nova-compute[95467]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e, portal: 172.16.0.220,3260] successful.
Nov 15 08:31:43 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e -p 172.16.0.220:3260 --op delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3089133-4789-4c57-b24a-05d2c0ac013e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4a5311-d0cb-4c57-bbaf-aff084953cdf]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-05c4bfd5-69e9-4860-ba92-04a6186c53f2 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-05c4bfd5-69e9-4860-ba92-04a6186c53f2 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-05c4bfd5-69e9-4860-ba92-04a6186c53f2 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] <== disconnect_volume: return (285ms) None {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05c4bfd5-69e9-4860-ba92-04a6186c53f2 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Disconnected iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 08:31:43 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-05c4bfd5-69e9-4860-ba92-04a6186c53f2 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Deleting instance files /opt/stack/data/nova/instances/3825a691-ac5c-4c06-b4a4-2a0b40c638c4_del
Nov 15 08:31:43 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-05c4bfd5-69e9-4860-ba92-04a6186c53f2 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Deletion of /opt/stack/data/nova/instances/3825a691-ac5c-4c06-b4a4-2a0b40c638c4_del complete
Nov 15 08:31:43 user nova-compute[95467]: INFO nova.compute.manager [None req-05c4bfd5-69e9-4860-ba92-04a6186c53f2 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 15 08:31:43 user nova-compute[95467]: DEBUG oslo.service.loopingcall [None req-05c4bfd5-69e9-4860-ba92-04a6186c53f2 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=95467) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG nova.compute.manager [-] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Deallocating network for instance {{(pid=95467) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 08:31:43 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] deallocate_for_instance() {{(pid=95467) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 08:31:44 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:31:44 user nova-compute[95467]: INFO nova.compute.manager [-] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Took 0.44 seconds to deallocate network for instance.
Nov 15 08:31:44 user nova-compute[95467]: DEBUG nova.compute.manager [None req-4f9dfcc1-e2ee-45d3-9092-e52cd619348f tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:31:44 user nova-compute[95467]: INFO nova.compute.manager [None req-4f9dfcc1-e2ee-45d3-9092-e52cd619348f tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] instance snapshotting
Nov 15 08:31:44 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-4f9dfcc1-e2ee-45d3-9092-e52cd619348f tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Beginning live snapshot process
Nov 15 08:31:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-4f9dfcc1-e2ee-45d3-9092-e52cd619348f tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaa2d1c7-dbda-4bf2-8706-3e941b44b076/disk --force-share --output=json -f qcow2 {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:31:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-4f9dfcc1-e2ee-45d3-9092-e52cd619348f tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaa2d1c7-dbda-4bf2-8706-3e941b44b076/disk --force-share --output=json -f qcow2" returned: 0 in 0.182s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:31:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-4f9dfcc1-e2ee-45d3-9092-e52cd619348f tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaa2d1c7-dbda-4bf2-8706-3e941b44b076/disk --force-share --output=json -f qcow2 {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:31:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-4f9dfcc1-e2ee-45d3-9092-e52cd619348f tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaa2d1c7-dbda-4bf2-8706-3e941b44b076/disk --force-share --output=json -f qcow2" returned: 0 in 0.185s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:31:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-4f9dfcc1-e2ee-45d3-9092-e52cd619348f tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:31:45 user nova-compute[95467]: INFO nova.compute.manager [None req-05c4bfd5-69e9-4860-ba92-04a6186c53f2 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Took 0.83 seconds to detach 1 volumes for instance.
Nov 15 08:31:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-05c4bfd5-69e9-4860-ba92-04a6186c53f2 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:31:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-05c4bfd5-69e9-4860-ba92-04a6186c53f2 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:31:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-4f9dfcc1-e2ee-45d3-9092-e52cd619348f tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.186s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:31:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-4f9dfcc1-e2ee-45d3-9092-e52cd619348f tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpcmp8utgf/71497a1b1f29481a917047a160c5d8ef.delta 1073741824 {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:31:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-4f9dfcc1-e2ee-45d3-9092-e52cd619348f tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpcmp8utgf/71497a1b1f29481a917047a160c5d8ef.delta 1073741824" returned: 0 in 0.050s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:31:45 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-4f9dfcc1-e2ee-45d3-9092-e52cd619348f tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 15 08:31:45 user nova-compute[95467]: DEBUG nova.compute.manager [req-b4a490a7-b9ea-4470-8963-2acff22db757 req-8bb5a37e-a4f0-4873-b7a4-8d31e90a3f2b service nova] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Received event network-vif-plugged-3fddc7dd-48af-4964-bc1a-a54623453f62 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:31:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b4a490a7-b9ea-4470-8963-2acff22db757 req-8bb5a37e-a4f0-4873-b7a4-8d31e90a3f2b service nova] Acquiring lock "3825a691-ac5c-4c06-b4a4-2a0b40c638c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:31:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b4a490a7-b9ea-4470-8963-2acff22db757 req-8bb5a37e-a4f0-4873-b7a4-8d31e90a3f2b service nova] Lock "3825a691-ac5c-4c06-b4a4-2a0b40c638c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:31:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b4a490a7-b9ea-4470-8963-2acff22db757 req-8bb5a37e-a4f0-4873-b7a4-8d31e90a3f2b service nova] Lock "3825a691-ac5c-4c06-b4a4-2a0b40c638c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:31:45 user nova-compute[95467]: DEBUG nova.compute.manager [req-b4a490a7-b9ea-4470-8963-2acff22db757 req-8bb5a37e-a4f0-4873-b7a4-8d31e90a3f2b service nova] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] No waiting events found dispatching network-vif-plugged-3fddc7dd-48af-4964-bc1a-a54623453f62 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:31:45 user nova-compute[95467]: WARNING nova.compute.manager [req-b4a490a7-b9ea-4470-8963-2acff22db757 req-8bb5a37e-a4f0-4873-b7a4-8d31e90a3f2b service nova] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Received unexpected event network-vif-plugged-3fddc7dd-48af-4964-bc1a-a54623453f62 for instance with vm_state deleted and task_state None.
Nov 15 08:31:45 user nova-compute[95467]: DEBUG nova.compute.manager [req-b4a490a7-b9ea-4470-8963-2acff22db757 req-8bb5a37e-a4f0-4873-b7a4-8d31e90a3f2b service nova] [instance: 3825a691-ac5c-4c06-b4a4-2a0b40c638c4] Received event network-vif-deleted-3fddc7dd-48af-4964-bc1a-a54623453f62 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:31:45 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-05c4bfd5-69e9-4860-ba92-04a6186c53f2 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:31:45 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-05c4bfd5-69e9-4860-ba92-04a6186c53f2 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:31:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-05c4bfd5-69e9-4860-ba92-04a6186c53f2 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.249s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:31:45 user nova-compute[95467]: INFO nova.scheduler.client.report [None req-05c4bfd5-69e9-4860-ba92-04a6186c53f2 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Deleted allocations for instance 3825a691-ac5c-4c06-b4a4-2a0b40c638c4
Nov 15 08:31:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-05c4bfd5-69e9-4860-ba92-04a6186c53f2 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "3825a691-ac5c-4c06-b4a4-2a0b40c638c4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.697s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:31:45 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-4f9dfcc1-e2ee-45d3-9092-e52cd619348f tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=95467) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 08:31:46 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-4f9dfcc1-e2ee-45d3-9092-e52cd619348f tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] COPY block job progress, current cursor: 32636928 final cursor: 75563008 {{(pid=95467) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 08:31:46 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-4f9dfcc1-e2ee-45d3-9092-e52cd619348f tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=95467) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 08:31:46 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-4f9dfcc1-e2ee-45d3-9092-e52cd619348f tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 15 08:31:47 user nova-compute[95467]: DEBUG nova.privsep.utils [None req-4f9dfcc1-e2ee-45d3-9092-e52cd619348f tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=95467) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 08:31:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-4f9dfcc1-e2ee-45d3-9092-e52cd619348f tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpcmp8utgf/71497a1b1f29481a917047a160c5d8ef.delta /opt/stack/data/nova/instances/snapshots/tmpcmp8utgf/71497a1b1f29481a917047a160c5d8ef {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:31:47 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-4f9dfcc1-e2ee-45d3-9092-e52cd619348f tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpcmp8utgf/71497a1b1f29481a917047a160c5d8ef.delta /opt/stack/data/nova/instances/snapshots/tmpcmp8utgf/71497a1b1f29481a917047a160c5d8ef" returned: 0 in 0.630s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:31:47 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-4f9dfcc1-e2ee-45d3-9092-e52cd619348f tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Snapshot extracted, beginning image upload
Nov 15 08:31:48 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:31:50 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-4f9dfcc1-e2ee-45d3-9092-e52cd619348f tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Snapshot image upload complete
Nov 15 08:31:50 user nova-compute[95467]: INFO nova.compute.manager [None req-4f9dfcc1-e2ee-45d3-9092-e52cd619348f tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Took 5.86 seconds to snapshot the instance on the hypervisor.
Nov 15 08:31:51 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:31:51 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=95467) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 08:31:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Acquiring lock "e378dc0e-8898-4895-884f-6c3e3f328bee" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:31:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Lock "e378dc0e-8898-4895-884f-6c3e3f328bee" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:31:52 user nova-compute[95467]: DEBUG nova.compute.manager [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] Starting instance... {{(pid=95467) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 08:31:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:31:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:31:52 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=95467) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 08:31:52 user nova-compute[95467]: INFO nova.compute.claims [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] Claim successful on node user
Nov 15 08:31:52 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:31:52 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:31:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.284s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:31:52 user nova-compute[95467]: DEBUG nova.compute.manager [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] Start building networks asynchronously for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 08:31:52 user nova-compute[95467]: DEBUG nova.compute.manager [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] Allocating IP information in the background. {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 08:31:52 user nova-compute[95467]: DEBUG nova.network.neutron [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] allocate_for_instance() {{(pid=95467) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 08:31:52 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 08:31:52 user nova-compute[95467]: DEBUG nova.compute.manager [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] Start building block device mappings for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 08:31:52 user nova-compute[95467]: DEBUG nova.policy [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0b1403873af04f78a6c2cbadcec38867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4ba53c039b4d699865e97ea1105843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95467) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 08:31:52 user nova-compute[95467]: DEBUG nova.compute.manager [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] Start spawning the instance on the hypervisor. {{(pid=95467) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 08:31:52 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] Creating instance directory {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 08:31:52 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] Creating image(s)
Nov 15 08:31:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Acquiring lock "/opt/stack/data/nova/instances/e378dc0e-8898-4895-884f-6c3e3f328bee/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:31:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Lock "/opt/stack/data/nova/instances/e378dc0e-8898-4895-884f-6c3e3f328bee/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:31:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Lock "/opt/stack/data/nova/instances/e378dc0e-8898-4895-884f-6c3e3f328bee/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:31:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Acquiring lock "e61da72c1043f46379d0876d858d609597343e00" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:31:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Lock "e61da72c1043f46379d0876d858d609597343e00" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:31:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e61da72c1043f46379d0876d858d609597343e00.part --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:31:54 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager.update_available_resource {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:31:54 user nova-compute[95467]: DEBUG nova.network.neutron [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] Successfully created port: cac0d932-a57e-4170-9779-4f574a7a88e0 {{(pid=95467) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 08:31:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:31:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:31:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:31:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:31:54 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Auditing locally available compute resources for user (node: user) {{(pid=95467) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 08:31:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e61da72c1043f46379d0876d858d609597343e00.part --force-share --output=json" returned: 0 in 0.199s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:31:54 user nova-compute[95467]: DEBUG nova.virt.images [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] 02991598-b01c-4ef4-8aed-7327cf0d7be3 was qcow2, converting to raw {{(pid=95467) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 08:31:54 user nova-compute[95467]: DEBUG nova.privsep.utils [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=95467) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 08:31:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e61da72c1043f46379d0876d858d609597343e00.part /opt/stack/data/nova/instances/_base/e61da72c1043f46379d0876d858d609597343e00.converted {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:31:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:31:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:31:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:31:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:31:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:31:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:31:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:31:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e61da72c1043f46379d0876d858d609597343e00.part /opt/stack/data/nova/instances/_base/e61da72c1043f46379d0876d858d609597343e00.converted" returned: 0 in 0.817s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:31:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e61da72c1043f46379d0876d858d609597343e00.converted --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:31:55 user nova-compute[95467]: DEBUG nova.network.neutron [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] Successfully updated port: cac0d932-a57e-4170-9779-4f574a7a88e0 {{(pid=95467) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 08:31:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Acquiring lock "refresh_cache-e378dc0e-8898-4895-884f-6c3e3f328bee" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:31:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Acquired lock "refresh_cache-e378dc0e-8898-4895-884f-6c3e3f328bee" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:31:55 user nova-compute[95467]: DEBUG nova.network.neutron [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:31:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:31:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaa2d1c7-dbda-4bf2-8706-3e941b44b076/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:31:55 user nova-compute[95467]: DEBUG nova.compute.manager [req-e1c04072-0bdc-45ae-867e-52690d54e157 req-a06ec174-464b-4949-8afa-5824fd747935 service nova] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] Received event network-changed-cac0d932-a57e-4170-9779-4f574a7a88e0 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:31:55 user nova-compute[95467]: DEBUG nova.compute.manager [req-e1c04072-0bdc-45ae-867e-52690d54e157 req-a06ec174-464b-4949-8afa-5824fd747935 service nova] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] Refreshing instance network info cache due to event network-changed-cac0d932-a57e-4170-9779-4f574a7a88e0. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:31:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-e1c04072-0bdc-45ae-867e-52690d54e157 req-a06ec174-464b-4949-8afa-5824fd747935 service nova] Acquiring lock "refresh_cache-e378dc0e-8898-4895-884f-6c3e3f328bee" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:31:55 user nova-compute[95467]: DEBUG nova.network.neutron [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] Instance cache missing network info. {{(pid=95467) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 08:31:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e61da72c1043f46379d0876d858d609597343e00.converted --force-share --output=json" returned: 0 in 0.250s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:31:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Lock "e61da72c1043f46379d0876d858d609597343e00" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.474s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:31:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e61da72c1043f46379d0876d858d609597343e00 --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:31:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaa2d1c7-dbda-4bf2-8706-3e941b44b076/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:31:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaa2d1c7-dbda-4bf2-8706-3e941b44b076/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:31:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e61da72c1043f46379d0876d858d609597343e00 --force-share --output=json" returned: 0 in 0.173s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:31:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Acquiring lock "e61da72c1043f46379d0876d858d609597343e00" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:31:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Lock "e61da72c1043f46379d0876d858d609597343e00" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:31:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e61da72c1043f46379d0876d858d609597343e00 --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:31:55 user nova-compute[95467]: DEBUG nova.network.neutron [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] Updating instance_info_cache with network_info: [{"id": "cac0d932-a57e-4170-9779-4f574a7a88e0", "address": "fa:16:3e:d1:56:fd", "network": {"id": "a0f0cb10-26c8-4299-8a7e-4d34cfd26c82", "bridge": "br-int", "label": "tempest-TestStampPattern-737883783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b4ba53c039b4d699865e97ea1105843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcac0d932-a5", "ovs_interfaceid": "cac0d932-a57e-4170-9779-4f574a7a88e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:31:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaa2d1c7-dbda-4bf2-8706-3e941b44b076/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:31:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Releasing lock "refresh_cache-e378dc0e-8898-4895-884f-6c3e3f328bee" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:31:55 user nova-compute[95467]: DEBUG nova.compute.manager [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] Instance network_info: |[{"id": "cac0d932-a57e-4170-9779-4f574a7a88e0", "address": "fa:16:3e:d1:56:fd", "network": {"id": "a0f0cb10-26c8-4299-8a7e-4d34cfd26c82", "bridge": "br-int", "label": "tempest-TestStampPattern-737883783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b4ba53c039b4d699865e97ea1105843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcac0d932-a5", "ovs_interfaceid": "cac0d932-a57e-4170-9779-4f574a7a88e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 08:31:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-e1c04072-0bdc-45ae-867e-52690d54e157 req-a06ec174-464b-4949-8afa-5824fd747935 service nova] Acquired lock "refresh_cache-e378dc0e-8898-4895-884f-6c3e3f328bee" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:31:55 user nova-compute[95467]: DEBUG nova.network.neutron [req-e1c04072-0bdc-45ae-867e-52690d54e157 req-a06ec174-464b-4949-8afa-5824fd747935 service nova] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] Refreshing network info cache for port cac0d932-a57e-4170-9779-4f574a7a88e0 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e61da72c1043f46379d0876d858d609597343e00 --force-share --output=json" returned: 0 in 0.542s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e61da72c1043f46379d0876d858d609597343e00,backing_fmt=raw /opt/stack/data/nova/instances/e378dc0e-8898-4895-884f-6c3e3f328bee/disk 1073741824 {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:31:56 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:31:56 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:31:56 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Hypervisor/Node resource view: name=user free_ram=8657MB free_disk=24.91402816772461GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=95467) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e61da72c1043f46379d0876d858d609597343e00,backing_fmt=raw /opt/stack/data/nova/instances/e378dc0e-8898-4895-884f-6c3e3f328bee/disk 1073741824" returned: 0 in 0.074s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Lock "e61da72c1043f46379d0876d858d609597343e00" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.621s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e61da72c1043f46379d0876d858d609597343e00 --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 21cf2ada-b15c-490d-ac37-96e9c87e9056 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance aaa2d1c7-dbda-4bf2-8706-3e941b44b076 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance e378dc0e-8898-4895-884f-6c3e3f328bee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e61da72c1043f46379d0876d858d609597343e00 --force-share --output=json" returned: 0 in 0.219s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] Created local disks {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] Ensure instance console log exists: /opt/stack/data/nova/instances/e378dc0e-8898-4895-884f-6c3e3f328bee/console.log {{(pid=95467) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] Start _get_guest_xml network_info=[{"id": "cac0d932-a57e-4170-9779-4f574a7a88e0", "address": "fa:16:3e:d1:56:fd", "network": {"id": "a0f0cb10-26c8-4299-8a7e-4d34cfd26c82", "bridge": "br-int", "label": "tempest-TestStampPattern-737883783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b4ba53c039b4d699865e97ea1105843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcac0d932-a5", "ovs_interfaceid": "cac0d932-a57e-4170-9779-4f574a7a88e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='35f8791a9f15a45f4fb7dc412ec1593a',container_format='bare',created_at=2023-11-15T08:31:44Z,direct_url=<?>,disk_format='qcow2',id=02991598-b01c-4ef4-8aed-7327cf0d7be3,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-885001448',owner='0b4ba53c039b4d699865e97ea1105843',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-15T08:31:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '02991598-b01c-4ef4-8aed-7327cf0d7be3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:31:56 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:31:56 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:31:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='35f8791a9f15a45f4fb7dc412ec1593a',container_format='bare',created_at=2023-11-15T08:31:44Z,direct_url=<?>,disk_format='qcow2',id=02991598-b01c-4ef4-8aed-7327cf0d7be3,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-885001448',owner='0b4ba53c039b4d699865e97ea1105843',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-15T08:31:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:31:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1292692666',display_name='tempest-TestStampPattern-server-1292692666',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1292692666',id=48,image_ref='02991598-b01c-4ef4-8aed-7327cf0d7be3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGn0oxsNrNpRwH5qXJYkx21obo8Lj9sdybiQDlMglXKMhHyYV0IVC0OwmijdhcVEz8KfHXfjwjg/GO8OGaIkn6LxI/No3ftDsuwo7JsF5I0wAs7c8mGozFfZJ8NKgWtVJA==',key_name='tempest-TestStampPattern-1164290551',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b4ba53c039b4d699865e97ea1105843',ramdisk_id='',reservation_id='r-0ostgia2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='aaa2d1c7-dbda-4bf2-8706-3e941b44b076',image_min_disk='1',image_min_ram='0',image_owner_id='0b4ba53c039b4d699865e97ea1105843',image_owner_project_name='tempest-TestStampPattern-89436842',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-89436842-project-member',image_user_id='0b1403873af04f78a6c2cbadcec38867',network_allocated='True',owner_project_name='tempest-TestStampPattern-89436842',owner_user_name='tempest-TestStampPattern-89436842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:31:53Z,user_data=None,user_id='0b1403873af04f78a6c2cbadcec38867',uuid=e378dc0e-8898-4895-884f-6c3e3f328bee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cac0d932-a57e-4170-9779-4f574a7a88e0", "address": "fa:16:3e:d1:56:fd", "network": {"id": "a0f0cb10-26c8-4299-8a7e-4d34cfd26c82", "bridge": "br-int", "label": "tempest-TestStampPattern-737883783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b4ba53c039b4d699865e97ea1105843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcac0d932-a5", "ovs_interfaceid": "cac0d932-a57e-4170-9779-4f574a7a88e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Converting VIF {"id": "cac0d932-a57e-4170-9779-4f574a7a88e0", "address": "fa:16:3e:d1:56:fd", "network": {"id": "a0f0cb10-26c8-4299-8a7e-4d34cfd26c82", "bridge": "br-int", "label": "tempest-TestStampPattern-737883783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b4ba53c039b4d699865e97ea1105843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcac0d932-a5", "ovs_interfaceid": "cac0d932-a57e-4170-9779-4f574a7a88e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:56:fd,bridge_name='br-int',has_traffic_filtering=True,id=cac0d932-a57e-4170-9779-4f574a7a88e0,network=Network(a0f0cb10-26c8-4299-8a7e-4d34cfd26c82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcac0d932-a5') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG nova.objects.instance [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Lazy-loading 'pci_devices' on Instance uuid e378dc0e-8898-4895-884f-6c3e3f328bee {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:31:56 user nova-compute[95467]:   <uuid>e378dc0e-8898-4895-884f-6c3e3f328bee</uuid>
Nov 15 08:31:56 user nova-compute[95467]:   <name>instance-00000030</name>
Nov 15 08:31:56 user nova-compute[95467]:   <memory>524288</memory>
Nov 15 08:31:56 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:31:56 user nova-compute[95467]:   <metadata>
Nov 15 08:31:56 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:31:56 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:31:56 user nova-compute[95467]:       <nova:name>tempest-TestStampPattern-server-1292692666</nova:name>
Nov 15 08:31:56 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:31:56</nova:creationTime>
Nov 15 08:31:56 user nova-compute[95467]:       <nova:flavor name="m1.tiny">
Nov 15 08:31:56 user nova-compute[95467]:         <nova:memory>512</nova:memory>
Nov 15 08:31:56 user nova-compute[95467]:         <nova:disk>1</nova:disk>
Nov 15 08:31:56 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:31:56 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:31:56 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:31:56 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:31:56 user nova-compute[95467]:       <nova:owner>
Nov 15 08:31:56 user nova-compute[95467]:         <nova:user uuid="0b1403873af04f78a6c2cbadcec38867">tempest-TestStampPattern-89436842-project-member</nova:user>
Nov 15 08:31:56 user nova-compute[95467]:         <nova:project uuid="0b4ba53c039b4d699865e97ea1105843">tempest-TestStampPattern-89436842</nova:project>
Nov 15 08:31:56 user nova-compute[95467]:       </nova:owner>
Nov 15 08:31:56 user nova-compute[95467]:       <nova:root type="image" uuid="02991598-b01c-4ef4-8aed-7327cf0d7be3"/>
Nov 15 08:31:56 user nova-compute[95467]:       <nova:ports>
Nov 15 08:31:56 user nova-compute[95467]:         <nova:port uuid="cac0d932-a57e-4170-9779-4f574a7a88e0">
Nov 15 08:31:56 user nova-compute[95467]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 08:31:56 user nova-compute[95467]:         </nova:port>
Nov 15 08:31:56 user nova-compute[95467]:       </nova:ports>
Nov 15 08:31:56 user nova-compute[95467]:     </nova:instance>
Nov 15 08:31:56 user nova-compute[95467]:   </metadata>
Nov 15 08:31:56 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:31:56 user nova-compute[95467]:     <system>
Nov 15 08:31:56 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:31:56 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:31:56 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:31:56 user nova-compute[95467]:       <entry name="serial">e378dc0e-8898-4895-884f-6c3e3f328bee</entry>
Nov 15 08:31:56 user nova-compute[95467]:       <entry name="uuid">e378dc0e-8898-4895-884f-6c3e3f328bee</entry>
Nov 15 08:31:56 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:31:56 user nova-compute[95467]:     </system>
Nov 15 08:31:56 user nova-compute[95467]:   </sysinfo>
Nov 15 08:31:56 user nova-compute[95467]:   <os>
Nov 15 08:31:56 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:31:56 user nova-compute[95467]:     <boot dev="hd"/>
Nov 15 08:31:56 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:31:56 user nova-compute[95467]:   </os>
Nov 15 08:31:56 user nova-compute[95467]:   <features>
Nov 15 08:31:56 user nova-compute[95467]:     <acpi/>
Nov 15 08:31:56 user nova-compute[95467]:     <apic/>
Nov 15 08:31:56 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:31:56 user nova-compute[95467]:   </features>
Nov 15 08:31:56 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:31:56 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:31:56 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:31:56 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:31:56 user nova-compute[95467]:   </clock>
Nov 15 08:31:56 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:31:56 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:31:56 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:31:56 user nova-compute[95467]:   </cpu>
Nov 15 08:31:56 user nova-compute[95467]:   <devices>
Nov 15 08:31:56 user nova-compute[95467]:     <disk type="file" device="disk">
Nov 15 08:31:56 user nova-compute[95467]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 08:31:56 user nova-compute[95467]:       <source file="/opt/stack/data/nova/instances/e378dc0e-8898-4895-884f-6c3e3f328bee/disk"/>
Nov 15 08:31:56 user nova-compute[95467]:       <target dev="vda" bus="virtio"/>
Nov 15 08:31:56 user nova-compute[95467]:     </disk>
Nov 15 08:31:56 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:31:56 user nova-compute[95467]:       <mac address="fa:16:3e:d1:56:fd"/>
Nov 15 08:31:56 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:31:56 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:31:56 user nova-compute[95467]:       <target dev="tapcac0d932-a5"/>
Nov 15 08:31:56 user nova-compute[95467]:     </interface>
Nov 15 08:31:56 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:31:56 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/e378dc0e-8898-4895-884f-6c3e3f328bee/console.log" append="off"/>
Nov 15 08:31:56 user nova-compute[95467]:     </serial>
Nov 15 08:31:56 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:31:56 user nova-compute[95467]:     <video>
Nov 15 08:31:56 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:31:56 user nova-compute[95467]:     </video>
Nov 15 08:31:56 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:31:56 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:31:56 user nova-compute[95467]:     </rng>
Nov 15 08:31:56 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:31:56 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:31:56 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:31:56 user nova-compute[95467]:     </memballoon>
Nov 15 08:31:56 user nova-compute[95467]:   </devices>
Nov 15 08:31:56 user nova-compute[95467]: </domain>
Nov 15 08:31:56 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:31:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1292692666',display_name='tempest-TestStampPattern-server-1292692666',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1292692666',id=48,image_ref='02991598-b01c-4ef4-8aed-7327cf0d7be3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGn0oxsNrNpRwH5qXJYkx21obo8Lj9sdybiQDlMglXKMhHyYV0IVC0OwmijdhcVEz8KfHXfjwjg/GO8OGaIkn6LxI/No3ftDsuwo7JsF5I0wAs7c8mGozFfZJ8NKgWtVJA==',key_name='tempest-TestStampPattern-1164290551',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b4ba53c039b4d699865e97ea1105843',ramdisk_id='',reservation_id='r-0ostgia2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='aaa2d1c7-dbda-4bf2-8706-3e941b44b076',image_min_disk='1',image_min_ram='0',image_owner_id='0b4ba53c039b4d699865e97ea1105843',image_owner_project_name='tempest-TestStampPattern-89436842',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-89436842-project-member',image_user_id='0b1403873af04f78a6c2cbadcec38867',network_allocated='True',owner_project_name='tempest-TestStampPattern-89436842',owner_user_name='tempest-TestStampPattern-89436842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:31:53Z,user_data=None,user_id='0b1403873af04f78a6c2cbadcec38867',uuid=e378dc0e-8898-4895-884f-6c3e3f328bee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cac0d932-a57e-4170-9779-4f574a7a88e0", "address": "fa:16:3e:d1:56:fd", "network": {"id": "a0f0cb10-26c8-4299-8a7e-4d34cfd26c82", "bridge": "br-int", "label": "tempest-TestStampPattern-737883783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b4ba53c039b4d699865e97ea1105843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcac0d932-a5", "ovs_interfaceid": "cac0d932-a57e-4170-9779-4f574a7a88e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Converting VIF {"id": "cac0d932-a57e-4170-9779-4f574a7a88e0", "address": "fa:16:3e:d1:56:fd", "network": {"id": "a0f0cb10-26c8-4299-8a7e-4d34cfd26c82", "bridge": "br-int", "label": "tempest-TestStampPattern-737883783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b4ba53c039b4d699865e97ea1105843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcac0d932-a5", "ovs_interfaceid": "cac0d932-a57e-4170-9779-4f574a7a88e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:56:fd,bridge_name='br-int',has_traffic_filtering=True,id=cac0d932-a57e-4170-9779-4f574a7a88e0,network=Network(a0f0cb10-26c8-4299-8a7e-4d34cfd26c82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcac0d932-a5') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG os_vif [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:56:fd,bridge_name='br-int',has_traffic_filtering=True,id=cac0d932-a57e-4170-9779-4f574a7a88e0,network=Network(a0f0cb10-26c8-4299-8a7e-4d34cfd26c82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcac0d932-a5') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '312f461d-0841-508f-bd7b-9af484aa4d7f', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e2539743-a0d7-4919-a227-e7b84fa1f141 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Acquiring lock "b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e2539743-a0d7-4919-a227-e7b84fa1f141 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e2539743-a0d7-4919-a227-e7b84fa1f141 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Acquiring lock "b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e2539743-a0d7-4919-a227-e7b84fa1f141 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e2539743-a0d7-4919-a227-e7b84fa1f141 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:31:56 user nova-compute[95467]: INFO nova.compute.manager [None req-e2539743-a0d7-4919-a227-e7b84fa1f141 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Terminating instance
Nov 15 08:31:56 user nova-compute[95467]: DEBUG nova.compute.manager [None req-e2539743-a0d7-4919-a227-e7b84fa1f141 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Start destroying the instance on the hypervisor. {{(pid=95467) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG nova.network.neutron [req-e1c04072-0bdc-45ae-867e-52690d54e157 req-a06ec174-464b-4949-8afa-5824fd747935 service nova] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] Updated VIF entry in instance network info cache for port cac0d932-a57e-4170-9779-4f574a7a88e0. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG nova.network.neutron [req-e1c04072-0bdc-45ae-867e-52690d54e157 req-a06ec174-464b-4949-8afa-5824fd747935 service nova] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] Updating instance_info_cache with network_info: [{"id": "cac0d932-a57e-4170-9779-4f574a7a88e0", "address": "fa:16:3e:d1:56:fd", "network": {"id": "a0f0cb10-26c8-4299-8a7e-4d34cfd26c82", "bridge": "br-int", "label": "tempest-TestStampPattern-737883783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b4ba53c039b4d699865e97ea1105843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcac0d932-a5", "ovs_interfaceid": "cac0d932-a57e-4170-9779-4f574a7a88e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcac0d932-a5, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcac0d932-a5, col_values=(('qos', UUID('8ae4b7a2-4d07-462a-a898-1cb5ae0d8cf5')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcac0d932-a5, col_values=(('external_ids', {'iface-id': 'cac0d932-a57e-4170-9779-4f574a7a88e0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:56:fd', 'vm-uuid': 'e378dc0e-8898-4895-884f-6c3e3f328bee'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-e1c04072-0bdc-45ae-867e-52690d54e157 req-a06ec174-464b-4949-8afa-5824fd747935 service nova] Releasing lock "refresh_cache-e378dc0e-8898-4895-884f-6c3e3f328bee" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:31:56 user nova-compute[95467]: INFO os_vif [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:56:fd,bridge_name='br-int',has_traffic_filtering=True,id=cac0d932-a57e-4170-9779-4f574a7a88e0,network=Network(a0f0cb10-26c8-4299-8a7e-4d34cfd26c82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcac0d932-a5')
Nov 15 08:31:56 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] No VIF found with MAC fa:16:3e:d1:56:fd, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Compute_service record updated for user:user {{(pid=95467) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.540s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:31:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:31:57 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:31:57 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:31:57 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:31:57 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:31:57 user nova-compute[95467]: DEBUG nova.compute.manager [req-a6a197a1-fce8-4e18-a0f6-003a780dadae req-f95fa554-c5dd-4eac-b203-9da6f1ca621d service nova] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Received event network-vif-unplugged-1436eae1-0899-4fc5-8bbe-575fa2c70d42 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:31:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-a6a197a1-fce8-4e18-a0f6-003a780dadae req-f95fa554-c5dd-4eac-b203-9da6f1ca621d service nova] Acquiring lock "b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:31:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-a6a197a1-fce8-4e18-a0f6-003a780dadae req-f95fa554-c5dd-4eac-b203-9da6f1ca621d service nova] Lock "b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:31:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-a6a197a1-fce8-4e18-a0f6-003a780dadae req-f95fa554-c5dd-4eac-b203-9da6f1ca621d service nova] Lock "b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:31:57 user nova-compute[95467]: DEBUG nova.compute.manager [req-a6a197a1-fce8-4e18-a0f6-003a780dadae req-f95fa554-c5dd-4eac-b203-9da6f1ca621d service nova] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] No waiting events found dispatching network-vif-unplugged-1436eae1-0899-4fc5-8bbe-575fa2c70d42 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:31:57 user nova-compute[95467]: DEBUG nova.compute.manager [req-a6a197a1-fce8-4e18-a0f6-003a780dadae req-f95fa554-c5dd-4eac-b203-9da6f1ca621d service nova] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Received event network-vif-unplugged-1436eae1-0899-4fc5-8bbe-575fa2c70d42 for instance with task_state deleting. {{(pid=95467) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 08:31:57 user nova-compute[95467]: DEBUG nova.compute.manager [req-a6a197a1-fce8-4e18-a0f6-003a780dadae req-f95fa554-c5dd-4eac-b203-9da6f1ca621d service nova] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Received event network-vif-plugged-1436eae1-0899-4fc5-8bbe-575fa2c70d42 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:31:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-a6a197a1-fce8-4e18-a0f6-003a780dadae req-f95fa554-c5dd-4eac-b203-9da6f1ca621d service nova] Acquiring lock "b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:31:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-a6a197a1-fce8-4e18-a0f6-003a780dadae req-f95fa554-c5dd-4eac-b203-9da6f1ca621d service nova] Lock "b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:31:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-a6a197a1-fce8-4e18-a0f6-003a780dadae req-f95fa554-c5dd-4eac-b203-9da6f1ca621d service nova] Lock "b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:31:57 user nova-compute[95467]: DEBUG nova.compute.manager [req-a6a197a1-fce8-4e18-a0f6-003a780dadae req-f95fa554-c5dd-4eac-b203-9da6f1ca621d service nova] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] No waiting events found dispatching network-vif-plugged-1436eae1-0899-4fc5-8bbe-575fa2c70d42 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:31:57 user nova-compute[95467]: WARNING nova.compute.manager [req-a6a197a1-fce8-4e18-a0f6-003a780dadae req-f95fa554-c5dd-4eac-b203-9da6f1ca621d service nova] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Received unexpected event network-vif-plugged-1436eae1-0899-4fc5-8bbe-575fa2c70d42 for instance with vm_state active and task_state deleting.
Nov 15 08:31:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:31:57 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Instance destroyed successfully.
Nov 15 08:31:57 user nova-compute[95467]: DEBUG nova.objects.instance [None req-e2539743-a0d7-4919-a227-e7b84fa1f141 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lazy-loading 'resources' on Instance uuid b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:31:57 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-e2539743-a0d7-4919-a227-e7b84fa1f141 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:15:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-438049731',display_name='tempest-ServerRescueNegativeTestJSON-server-438049731',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-438049731',id=21,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:19:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bd281be4e94a4d31a47a13267d51d9b6',ramdisk_id='',reservation_id='r-x5tle0vp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1148442534',owner_user_name='tempest-ServerRescueNegativeTestJSON-1148442534-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:21:44Z,user_data=None,user_id='c07f8dbc38004ecd973f61bba63606d4',uuid=b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1436eae1-0899-4fc5-8bbe-575fa2c70d42", "address": "fa:16:3e:08:e7:36", "network": {"id": "369d2a6f-60b7-4c92-8b2d-1f3828f6698b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1491709218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd281be4e94a4d31a47a13267d51d9b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1436eae1-08", "ovs_interfaceid": "1436eae1-0899-4fc5-8bbe-575fa2c70d42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:31:57 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-e2539743-a0d7-4919-a227-e7b84fa1f141 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Converting VIF {"id": "1436eae1-0899-4fc5-8bbe-575fa2c70d42", "address": "fa:16:3e:08:e7:36", "network": {"id": "369d2a6f-60b7-4c92-8b2d-1f3828f6698b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1491709218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd281be4e94a4d31a47a13267d51d9b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1436eae1-08", "ovs_interfaceid": "1436eae1-0899-4fc5-8bbe-575fa2c70d42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:31:57 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-e2539743-a0d7-4919-a227-e7b84fa1f141 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:e7:36,bridge_name='br-int',has_traffic_filtering=True,id=1436eae1-0899-4fc5-8bbe-575fa2c70d42,network=Network(369d2a6f-60b7-4c92-8b2d-1f3828f6698b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1436eae1-08') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:31:57 user nova-compute[95467]: DEBUG os_vif [None req-e2539743-a0d7-4919-a227-e7b84fa1f141 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:e7:36,bridge_name='br-int',has_traffic_filtering=True,id=1436eae1-0899-4fc5-8bbe-575fa2c70d42,network=Network(369d2a6f-60b7-4c92-8b2d-1f3828f6698b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1436eae1-08') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:31:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:31:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1436eae1-08, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:31:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:31:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:31:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:31:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:31:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1b74b1d3-2374-42c0-a181-12cb9ce35fb2) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:31:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:31:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:31:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:31:57 user nova-compute[95467]: INFO os_vif [None req-e2539743-a0d7-4919-a227-e7b84fa1f141 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:e7:36,bridge_name='br-int',has_traffic_filtering=True,id=1436eae1-0899-4fc5-8bbe-575fa2c70d42,network=Network(369d2a6f-60b7-4c92-8b2d-1f3828f6698b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1436eae1-08')
Nov 15 08:31:57 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-e2539743-a0d7-4919-a227-e7b84fa1f141 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Deleting instance files /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67_del
Nov 15 08:31:57 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-e2539743-a0d7-4919-a227-e7b84fa1f141 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Deletion of /opt/stack/data/nova/instances/b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67_del complete
Nov 15 08:31:57 user nova-compute[95467]: INFO nova.compute.manager [None req-e2539743-a0d7-4919-a227-e7b84fa1f141 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Took 1.26 seconds to destroy the instance on the hypervisor.
Nov 15 08:31:57 user nova-compute[95467]: DEBUG oslo.service.loopingcall [None req-e2539743-a0d7-4919-a227-e7b84fa1f141 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=95467) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 08:31:57 user nova-compute[95467]: DEBUG nova.compute.manager [-] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Deallocating network for instance {{(pid=95467) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 08:31:57 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] deallocate_for_instance() {{(pid=95467) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 08:31:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:31:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:31:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:31:58 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:31:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:31:58 user nova-compute[95467]: INFO nova.compute.manager [-] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Took 0.69 seconds to deallocate network for instance.
Nov 15 08:31:58 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:31:58 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e2539743-a0d7-4919-a227-e7b84fa1f141 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:31:58 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e2539743-a0d7-4919-a227-e7b84fa1f141 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:31:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:31:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:31:58 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-e2539743-a0d7-4919-a227-e7b84fa1f141 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:31:58 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-e2539743-a0d7-4919-a227-e7b84fa1f141 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:31:58 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e2539743-a0d7-4919-a227-e7b84fa1f141 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.246s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:31:58 user nova-compute[95467]: INFO nova.scheduler.client.report [None req-e2539743-a0d7-4919-a227-e7b84fa1f141 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Deleted allocations for instance b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67
Nov 15 08:31:59 user nova-compute[95467]: DEBUG nova.compute.manager [req-43b0686e-7775-4212-87ff-7c4fe81b415d req-f05251a6-f1bb-4126-b20a-57354967cfdf service nova] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] Received event network-vif-plugged-cac0d932-a57e-4170-9779-4f574a7a88e0 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:31:59 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-43b0686e-7775-4212-87ff-7c4fe81b415d req-f05251a6-f1bb-4126-b20a-57354967cfdf service nova] Acquiring lock "e378dc0e-8898-4895-884f-6c3e3f328bee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:31:59 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-43b0686e-7775-4212-87ff-7c4fe81b415d req-f05251a6-f1bb-4126-b20a-57354967cfdf service nova] Lock "e378dc0e-8898-4895-884f-6c3e3f328bee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:31:59 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-43b0686e-7775-4212-87ff-7c4fe81b415d req-f05251a6-f1bb-4126-b20a-57354967cfdf service nova] Lock "e378dc0e-8898-4895-884f-6c3e3f328bee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:31:59 user nova-compute[95467]: DEBUG nova.compute.manager [req-43b0686e-7775-4212-87ff-7c4fe81b415d req-f05251a6-f1bb-4126-b20a-57354967cfdf service nova] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] No waiting events found dispatching network-vif-plugged-cac0d932-a57e-4170-9779-4f574a7a88e0 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:31:59 user nova-compute[95467]: WARNING nova.compute.manager [req-43b0686e-7775-4212-87ff-7c4fe81b415d req-f05251a6-f1bb-4126-b20a-57354967cfdf service nova] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] Received unexpected event network-vif-plugged-cac0d932-a57e-4170-9779-4f574a7a88e0 for instance with vm_state building and task_state spawning.
Nov 15 08:31:59 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e2539743-a0d7-4919-a227-e7b84fa1f141 tempest-ServerRescueNegativeTestJSON-1148442534 tempest-ServerRescueNegativeTestJSON-1148442534-project-member] Lock "b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.471s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:31:59 user nova-compute[95467]: DEBUG nova.compute.manager [req-17a760d5-fb4c-4606-862b-86f7cc05a2f9 req-db2f688c-309f-4158-ad17-0e8053c69072 service nova] [instance: b534dd0b-7dc9-4fa6-9fdb-bc68fce61b67] Received event network-vif-deleted-1436eae1-0899-4fc5-8bbe-575fa2c70d42 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:32:00 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:32:00 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Starting heal instance info cache {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 08:32:00 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Rebuilding the list of instances to heal {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 08:32:00 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] Skipping network cache update for instance because it is Building. {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 15 08:32:00 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "refresh_cache-21cf2ada-b15c-490d-ac37-96e9c87e9056" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:32:00 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquired lock "refresh_cache-21cf2ada-b15c-490d-ac37-96e9c87e9056" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:32:00 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Forcefully refreshing network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 08:32:00 user nova-compute[95467]: DEBUG nova.objects.instance [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lazy-loading 'info_cache' on Instance uuid 21cf2ada-b15c-490d-ac37-96e9c87e9056 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:32:00 user nova-compute[95467]: DEBUG nova.compute.manager [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] Instance event wait completed in 0 seconds for  {{(pid=95467) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 08:32:00 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] Guest created on hypervisor {{(pid=95467) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 08:32:00 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] Instance spawned successfully.
Nov 15 08:32:00 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 08:32:00 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] Found default for hw_input_bus of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:32:00 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] Found default for hw_pointer_model of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:32:01 user nova-compute[95467]: DEBUG nova.compute.manager [req-accdb27b-f8f3-4d98-a0b1-2579bedf08ff req-2978a583-0db2-48c0-a1e7-6b6472eead05 service nova] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] Received event network-vif-plugged-cac0d932-a57e-4170-9779-4f574a7a88e0 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:32:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-accdb27b-f8f3-4d98-a0b1-2579bedf08ff req-2978a583-0db2-48c0-a1e7-6b6472eead05 service nova] Acquiring lock "e378dc0e-8898-4895-884f-6c3e3f328bee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:32:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-accdb27b-f8f3-4d98-a0b1-2579bedf08ff req-2978a583-0db2-48c0-a1e7-6b6472eead05 service nova] Lock "e378dc0e-8898-4895-884f-6c3e3f328bee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:32:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-accdb27b-f8f3-4d98-a0b1-2579bedf08ff req-2978a583-0db2-48c0-a1e7-6b6472eead05 service nova] Lock "e378dc0e-8898-4895-884f-6c3e3f328bee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:32:01 user nova-compute[95467]: DEBUG nova.compute.manager [req-accdb27b-f8f3-4d98-a0b1-2579bedf08ff req-2978a583-0db2-48c0-a1e7-6b6472eead05 service nova] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] No waiting events found dispatching network-vif-plugged-cac0d932-a57e-4170-9779-4f574a7a88e0 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:32:01 user nova-compute[95467]: WARNING nova.compute.manager [req-accdb27b-f8f3-4d98-a0b1-2579bedf08ff req-2978a583-0db2-48c0-a1e7-6b6472eead05 service nova] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] Received unexpected event network-vif-plugged-cac0d932-a57e-4170-9779-4f574a7a88e0 for instance with vm_state building and task_state spawning.
Nov 15 08:32:01 user nova-compute[95467]: INFO nova.compute.manager [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] Took 8.15 seconds to spawn the instance on the hypervisor.
Nov 15 08:32:01 user nova-compute[95467]: DEBUG nova.compute.manager [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:32:01 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Updating instance_info_cache with network_info: [{"id": "1e52d31b-a56a-41e1-8a39-b79dacfe70b9", "address": "fa:16:3e:7f:8e:61", "network": {"id": "ac9a381d-25fe-4419-b151-f03333413813", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1183680999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34d65a8000347feb2b3966b7ce0d785", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e52d31b-a5", "ovs_interfaceid": "1e52d31b-a56a-41e1-8a39-b79dacfe70b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:32:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Releasing lock "refresh_cache-21cf2ada-b15c-490d-ac37-96e9c87e9056" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:32:01 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Updated the network info_cache for instance {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 08:32:01 user nova-compute[95467]: INFO nova.compute.manager [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] Took 8.81 seconds to build instance.
Nov 15 08:32:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-6d1ce1b1-c410-40ac-8304-fe8dde79498a tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Lock "e378dc0e-8898-4895-884f-6c3e3f328bee" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.959s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:32:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:32:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:32:03 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:32:03 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:32:07 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:32:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:32:17 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:32:18 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:32:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:32:23 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:32:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:32:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:32:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:32:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:32:33 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-45976326-224a-4608-847e-97cad82be374 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Acquiring lock "21cf2ada-b15c-490d-ac37-96e9c87e9056" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:32:33 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-45976326-224a-4608-847e-97cad82be374 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "21cf2ada-b15c-490d-ac37-96e9c87e9056" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:32:33 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-45976326-224a-4608-847e-97cad82be374 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Acquiring lock "21cf2ada-b15c-490d-ac37-96e9c87e9056-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:32:33 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-45976326-224a-4608-847e-97cad82be374 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "21cf2ada-b15c-490d-ac37-96e9c87e9056-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:32:33 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-45976326-224a-4608-847e-97cad82be374 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "21cf2ada-b15c-490d-ac37-96e9c87e9056-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:32:33 user nova-compute[95467]: INFO nova.compute.manager [None req-45976326-224a-4608-847e-97cad82be374 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Terminating instance
Nov 15 08:32:33 user nova-compute[95467]: DEBUG nova.compute.manager [None req-45976326-224a-4608-847e-97cad82be374 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Start destroying the instance on the hypervisor. {{(pid=95467) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 08:32:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:32:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:32:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:32:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:32:34 user nova-compute[95467]: DEBUG nova.compute.manager [req-6cbcf14d-10ca-4c7d-91b7-4c9d2f6b12b9 req-16ec762c-70bf-4018-b42c-51c1191a5e7b service nova] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Received event network-vif-unplugged-1e52d31b-a56a-41e1-8a39-b79dacfe70b9 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:32:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-6cbcf14d-10ca-4c7d-91b7-4c9d2f6b12b9 req-16ec762c-70bf-4018-b42c-51c1191a5e7b service nova] Acquiring lock "21cf2ada-b15c-490d-ac37-96e9c87e9056-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:32:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-6cbcf14d-10ca-4c7d-91b7-4c9d2f6b12b9 req-16ec762c-70bf-4018-b42c-51c1191a5e7b service nova] Lock "21cf2ada-b15c-490d-ac37-96e9c87e9056-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:32:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-6cbcf14d-10ca-4c7d-91b7-4c9d2f6b12b9 req-16ec762c-70bf-4018-b42c-51c1191a5e7b service nova] Lock "21cf2ada-b15c-490d-ac37-96e9c87e9056-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:32:34 user nova-compute[95467]: DEBUG nova.compute.manager [req-6cbcf14d-10ca-4c7d-91b7-4c9d2f6b12b9 req-16ec762c-70bf-4018-b42c-51c1191a5e7b service nova] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] No waiting events found dispatching network-vif-unplugged-1e52d31b-a56a-41e1-8a39-b79dacfe70b9 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:32:34 user nova-compute[95467]: DEBUG nova.compute.manager [req-6cbcf14d-10ca-4c7d-91b7-4c9d2f6b12b9 req-16ec762c-70bf-4018-b42c-51c1191a5e7b service nova] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Received event network-vif-unplugged-1e52d31b-a56a-41e1-8a39-b79dacfe70b9 for instance with task_state deleting. {{(pid=95467) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 08:32:34 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:32:34 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:32:34 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:32:34 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:32:34 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Instance destroyed successfully.
Nov 15 08:32:34 user nova-compute[95467]: DEBUG nova.objects.instance [None req-45976326-224a-4608-847e-97cad82be374 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lazy-loading 'resources' on Instance uuid 21cf2ada-b15c-490d-ac37-96e9c87e9056 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:32:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-45976326-224a-4608-847e-97cad82be374 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:12:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1521441653',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1521441653',id=15,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:13:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c34d65a8000347feb2b3966b7ce0d785',ramdisk_id='',reservation_id='r-mu80gu5r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1903830225',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:14:53Z,user_data=None,user_id='6971581ab2604353aeb0c45c5252b4fb',uuid=21cf2ada-b15c-490d-ac37-96e9c87e9056,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1e52d31b-a56a-41e1-8a39-b79dacfe70b9", "address": "fa:16:3e:7f:8e:61", "network": {"id": "ac9a381d-25fe-4419-b151-f03333413813", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1183680999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34d65a8000347feb2b3966b7ce0d785", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e52d31b-a5", "ovs_interfaceid": "1e52d31b-a56a-41e1-8a39-b79dacfe70b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:32:34 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-45976326-224a-4608-847e-97cad82be374 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Converting VIF {"id": "1e52d31b-a56a-41e1-8a39-b79dacfe70b9", "address": "fa:16:3e:7f:8e:61", "network": {"id": "ac9a381d-25fe-4419-b151-f03333413813", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1183680999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34d65a8000347feb2b3966b7ce0d785", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e52d31b-a5", "ovs_interfaceid": "1e52d31b-a56a-41e1-8a39-b79dacfe70b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:32:34 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-45976326-224a-4608-847e-97cad82be374 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:8e:61,bridge_name='br-int',has_traffic_filtering=True,id=1e52d31b-a56a-41e1-8a39-b79dacfe70b9,network=Network(ac9a381d-25fe-4419-b151-f03333413813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e52d31b-a5') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:32:34 user nova-compute[95467]: DEBUG os_vif [None req-45976326-224a-4608-847e-97cad82be374 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:8e:61,bridge_name='br-int',has_traffic_filtering=True,id=1e52d31b-a56a-41e1-8a39-b79dacfe70b9,network=Network(ac9a381d-25fe-4419-b151-f03333413813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e52d31b-a5') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:32:34 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:32:34 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:32:34 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1e52d31b-a5, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:32:34 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:32:34 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:32:34 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=23e60d41-5986-4068-a585-b19b59fa70e2) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:32:34 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:32:34 user nova-compute[95467]: INFO os_vif [None req-45976326-224a-4608-847e-97cad82be374 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:8e:61,bridge_name='br-int',has_traffic_filtering=True,id=1e52d31b-a56a-41e1-8a39-b79dacfe70b9,network=Network(ac9a381d-25fe-4419-b151-f03333413813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e52d31b-a5')
Nov 15 08:32:34 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-45976326-224a-4608-847e-97cad82be374 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Deleting instance files /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056_del
Nov 15 08:32:34 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-45976326-224a-4608-847e-97cad82be374 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Deletion of /opt/stack/data/nova/instances/21cf2ada-b15c-490d-ac37-96e9c87e9056_del complete
Nov 15 08:32:34 user nova-compute[95467]: INFO nova.compute.manager [None req-45976326-224a-4608-847e-97cad82be374 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 15 08:32:34 user nova-compute[95467]: DEBUG oslo.service.loopingcall [None req-45976326-224a-4608-847e-97cad82be374 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=95467) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 08:32:34 user nova-compute[95467]: DEBUG nova.compute.manager [-] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Deallocating network for instance {{(pid=95467) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 08:32:34 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] deallocate_for_instance() {{(pid=95467) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 08:32:34 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:32:35 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:32:35 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:32:35 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:32:35 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:32:35 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:32:35 user nova-compute[95467]: INFO nova.compute.manager [-] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Took 1.17 seconds to deallocate network for instance.
Nov 15 08:32:35 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-45976326-224a-4608-847e-97cad82be374 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:32:35 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-45976326-224a-4608-847e-97cad82be374 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:32:35 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-45976326-224a-4608-847e-97cad82be374 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:32:35 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-45976326-224a-4608-847e-97cad82be374 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:32:35 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-45976326-224a-4608-847e-97cad82be374 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.159s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:32:36 user nova-compute[95467]: INFO nova.scheduler.client.report [None req-45976326-224a-4608-847e-97cad82be374 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Deleted allocations for instance 21cf2ada-b15c-490d-ac37-96e9c87e9056
Nov 15 08:32:36 user nova-compute[95467]: DEBUG nova.compute.manager [req-b876817f-8517-48a9-b089-46ea2e901c56 req-6584dfdd-bf72-4cb9-9487-0db5a262149d service nova] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Received event network-vif-plugged-1e52d31b-a56a-41e1-8a39-b79dacfe70b9 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:32:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b876817f-8517-48a9-b089-46ea2e901c56 req-6584dfdd-bf72-4cb9-9487-0db5a262149d service nova] Acquiring lock "21cf2ada-b15c-490d-ac37-96e9c87e9056-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:32:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b876817f-8517-48a9-b089-46ea2e901c56 req-6584dfdd-bf72-4cb9-9487-0db5a262149d service nova] Lock "21cf2ada-b15c-490d-ac37-96e9c87e9056-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:32:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b876817f-8517-48a9-b089-46ea2e901c56 req-6584dfdd-bf72-4cb9-9487-0db5a262149d service nova] Lock "21cf2ada-b15c-490d-ac37-96e9c87e9056-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:32:36 user nova-compute[95467]: DEBUG nova.compute.manager [req-b876817f-8517-48a9-b089-46ea2e901c56 req-6584dfdd-bf72-4cb9-9487-0db5a262149d service nova] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] No waiting events found dispatching network-vif-plugged-1e52d31b-a56a-41e1-8a39-b79dacfe70b9 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:32:36 user nova-compute[95467]: WARNING nova.compute.manager [req-b876817f-8517-48a9-b089-46ea2e901c56 req-6584dfdd-bf72-4cb9-9487-0db5a262149d service nova] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Received unexpected event network-vif-plugged-1e52d31b-a56a-41e1-8a39-b79dacfe70b9 for instance with vm_state deleted and task_state None.
Nov 15 08:32:36 user nova-compute[95467]: DEBUG nova.compute.manager [req-b876817f-8517-48a9-b089-46ea2e901c56 req-6584dfdd-bf72-4cb9-9487-0db5a262149d service nova] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Received event network-vif-plugged-1e52d31b-a56a-41e1-8a39-b79dacfe70b9 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:32:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b876817f-8517-48a9-b089-46ea2e901c56 req-6584dfdd-bf72-4cb9-9487-0db5a262149d service nova] Acquiring lock "21cf2ada-b15c-490d-ac37-96e9c87e9056-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:32:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b876817f-8517-48a9-b089-46ea2e901c56 req-6584dfdd-bf72-4cb9-9487-0db5a262149d service nova] Lock "21cf2ada-b15c-490d-ac37-96e9c87e9056-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:32:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b876817f-8517-48a9-b089-46ea2e901c56 req-6584dfdd-bf72-4cb9-9487-0db5a262149d service nova] Lock "21cf2ada-b15c-490d-ac37-96e9c87e9056-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:32:36 user nova-compute[95467]: DEBUG nova.compute.manager [req-b876817f-8517-48a9-b089-46ea2e901c56 req-6584dfdd-bf72-4cb9-9487-0db5a262149d service nova] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] No waiting events found dispatching network-vif-plugged-1e52d31b-a56a-41e1-8a39-b79dacfe70b9 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:32:36 user nova-compute[95467]: WARNING nova.compute.manager [req-b876817f-8517-48a9-b089-46ea2e901c56 req-6584dfdd-bf72-4cb9-9487-0db5a262149d service nova] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Received unexpected event network-vif-plugged-1e52d31b-a56a-41e1-8a39-b79dacfe70b9 for instance with vm_state deleted and task_state None.
Nov 15 08:32:36 user nova-compute[95467]: DEBUG nova.compute.manager [req-b876817f-8517-48a9-b089-46ea2e901c56 req-6584dfdd-bf72-4cb9-9487-0db5a262149d service nova] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Received event network-vif-plugged-1e52d31b-a56a-41e1-8a39-b79dacfe70b9 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:32:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b876817f-8517-48a9-b089-46ea2e901c56 req-6584dfdd-bf72-4cb9-9487-0db5a262149d service nova] Acquiring lock "21cf2ada-b15c-490d-ac37-96e9c87e9056-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:32:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b876817f-8517-48a9-b089-46ea2e901c56 req-6584dfdd-bf72-4cb9-9487-0db5a262149d service nova] Lock "21cf2ada-b15c-490d-ac37-96e9c87e9056-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:32:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b876817f-8517-48a9-b089-46ea2e901c56 req-6584dfdd-bf72-4cb9-9487-0db5a262149d service nova] Lock "21cf2ada-b15c-490d-ac37-96e9c87e9056-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:32:36 user nova-compute[95467]: DEBUG nova.compute.manager [req-b876817f-8517-48a9-b089-46ea2e901c56 req-6584dfdd-bf72-4cb9-9487-0db5a262149d service nova] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] No waiting events found dispatching network-vif-plugged-1e52d31b-a56a-41e1-8a39-b79dacfe70b9 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:32:36 user nova-compute[95467]: WARNING nova.compute.manager [req-b876817f-8517-48a9-b089-46ea2e901c56 req-6584dfdd-bf72-4cb9-9487-0db5a262149d service nova] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Received unexpected event network-vif-plugged-1e52d31b-a56a-41e1-8a39-b79dacfe70b9 for instance with vm_state deleted and task_state None.
Nov 15 08:32:36 user nova-compute[95467]: DEBUG nova.compute.manager [req-b876817f-8517-48a9-b089-46ea2e901c56 req-6584dfdd-bf72-4cb9-9487-0db5a262149d service nova] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Received event network-vif-unplugged-1e52d31b-a56a-41e1-8a39-b79dacfe70b9 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:32:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b876817f-8517-48a9-b089-46ea2e901c56 req-6584dfdd-bf72-4cb9-9487-0db5a262149d service nova] Acquiring lock "21cf2ada-b15c-490d-ac37-96e9c87e9056-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:32:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b876817f-8517-48a9-b089-46ea2e901c56 req-6584dfdd-bf72-4cb9-9487-0db5a262149d service nova] Lock "21cf2ada-b15c-490d-ac37-96e9c87e9056-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:32:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b876817f-8517-48a9-b089-46ea2e901c56 req-6584dfdd-bf72-4cb9-9487-0db5a262149d service nova] Lock "21cf2ada-b15c-490d-ac37-96e9c87e9056-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:32:36 user nova-compute[95467]: DEBUG nova.compute.manager [req-b876817f-8517-48a9-b089-46ea2e901c56 req-6584dfdd-bf72-4cb9-9487-0db5a262149d service nova] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] No waiting events found dispatching network-vif-unplugged-1e52d31b-a56a-41e1-8a39-b79dacfe70b9 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:32:36 user nova-compute[95467]: WARNING nova.compute.manager [req-b876817f-8517-48a9-b089-46ea2e901c56 req-6584dfdd-bf72-4cb9-9487-0db5a262149d service nova] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Received unexpected event network-vif-unplugged-1e52d31b-a56a-41e1-8a39-b79dacfe70b9 for instance with vm_state deleted and task_state None.
Nov 15 08:32:36 user nova-compute[95467]: DEBUG nova.compute.manager [req-b876817f-8517-48a9-b089-46ea2e901c56 req-6584dfdd-bf72-4cb9-9487-0db5a262149d service nova] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Received event network-vif-plugged-1e52d31b-a56a-41e1-8a39-b79dacfe70b9 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:32:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b876817f-8517-48a9-b089-46ea2e901c56 req-6584dfdd-bf72-4cb9-9487-0db5a262149d service nova] Acquiring lock "21cf2ada-b15c-490d-ac37-96e9c87e9056-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:32:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b876817f-8517-48a9-b089-46ea2e901c56 req-6584dfdd-bf72-4cb9-9487-0db5a262149d service nova] Lock "21cf2ada-b15c-490d-ac37-96e9c87e9056-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:32:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b876817f-8517-48a9-b089-46ea2e901c56 req-6584dfdd-bf72-4cb9-9487-0db5a262149d service nova] Lock "21cf2ada-b15c-490d-ac37-96e9c87e9056-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:32:36 user nova-compute[95467]: DEBUG nova.compute.manager [req-b876817f-8517-48a9-b089-46ea2e901c56 req-6584dfdd-bf72-4cb9-9487-0db5a262149d service nova] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] No waiting events found dispatching network-vif-plugged-1e52d31b-a56a-41e1-8a39-b79dacfe70b9 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:32:36 user nova-compute[95467]: WARNING nova.compute.manager [req-b876817f-8517-48a9-b089-46ea2e901c56 req-6584dfdd-bf72-4cb9-9487-0db5a262149d service nova] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Received unexpected event network-vif-plugged-1e52d31b-a56a-41e1-8a39-b79dacfe70b9 for instance with vm_state deleted and task_state None.
Nov 15 08:32:36 user nova-compute[95467]: DEBUG nova.compute.manager [req-b876817f-8517-48a9-b089-46ea2e901c56 req-6584dfdd-bf72-4cb9-9487-0db5a262149d service nova] [instance: 21cf2ada-b15c-490d-ac37-96e9c87e9056] Received event network-vif-deleted-1e52d31b-a56a-41e1-8a39-b79dacfe70b9 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:32:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-45976326-224a-4608-847e-97cad82be374 tempest-ServerBootFromVolumeStableRescueTest-1903830225 tempest-ServerBootFromVolumeStableRescueTest-1903830225-project-member] Lock "21cf2ada-b15c-490d-ac37-96e9c87e9056" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.407s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:32:39 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:32:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:32:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:32:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:32:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:32:51 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:32:51 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=95467) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 08:32:53 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager.update_available_resource {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:32:53 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:32:53 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:32:53 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:32:53 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Auditing locally available compute resources for user (node: user) {{(pid=95467) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 08:32:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaa2d1c7-dbda-4bf2-8706-3e941b44b076/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:32:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaa2d1c7-dbda-4bf2-8706-3e941b44b076/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:32:53 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaa2d1c7-dbda-4bf2-8706-3e941b44b076/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:32:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaa2d1c7-dbda-4bf2-8706-3e941b44b076/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:32:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e378dc0e-8898-4895-884f-6c3e3f328bee/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:32:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e378dc0e-8898-4895-884f-6c3e3f328bee/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:32:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e378dc0e-8898-4895-884f-6c3e3f328bee/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:32:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e378dc0e-8898-4895-884f-6c3e3f328bee/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:32:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:32:54 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:32:54 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:32:54 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Hypervisor/Node resource view: name=user free_ram=8814MB free_disk=25.06719970703125GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=95467) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 08:32:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:32:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:32:54 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance aaa2d1c7-dbda-4bf2-8706-3e941b44b076 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:32:54 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance e378dc0e-8898-4895-884f-6c3e3f328bee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:32:54 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 08:32:54 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 08:32:55 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:32:55 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:32:55 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Compute_service record updated for user:user {{(pid=95467) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 08:32:55 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.267s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:32:57 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:32:57 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:32:58 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:32:58 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:32:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:33:00 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:33:00 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Starting heal instance info cache {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 08:33:00 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "refresh_cache-aaa2d1c7-dbda-4bf2-8706-3e941b44b076" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:33:00 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquired lock "refresh_cache-aaa2d1c7-dbda-4bf2-8706-3e941b44b076" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:33:00 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Forcefully refreshing network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 08:33:01 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Updating instance_info_cache with network_info: [{"id": "6130058a-f78c-4f81-b4a8-233863e6ae8c", "address": "fa:16:3e:15:19:18", "network": {"id": "a0f0cb10-26c8-4299-8a7e-4d34cfd26c82", "bridge": "br-int", "label": "tempest-TestStampPattern-737883783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b4ba53c039b4d699865e97ea1105843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6130058a-f7", "ovs_interfaceid": "6130058a-f78c-4f81-b4a8-233863e6ae8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:33:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Releasing lock "refresh_cache-aaa2d1c7-dbda-4bf2-8706-3e941b44b076" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:33:01 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Updated the network info_cache for instance {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 08:33:01 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:33:04 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:33:05 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:33:09 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:33:09 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:33:09 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=95467) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 08:33:09 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:33:09 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:33:09 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:33:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:33:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:33:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=95467) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 08:33:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:33:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:33:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:33:19 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:33:19 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:33:19 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=95467) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 08:33:19 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:33:19 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:33:19 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:33:24 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:33:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:33:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:33:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:33:34 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:33:34 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:33:34 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:33:36 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:33:37 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Acquiring lock "2945f42b-62a1-44c5-be3b-f1dbe6826c0f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:33:37 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "2945f42b-62a1-44c5-be3b-f1dbe6826c0f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:33:37 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Starting instance... {{(pid=95467) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 08:33:37 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:33:37 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:33:37 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=95467) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 08:33:37 user nova-compute[95467]: INFO nova.compute.claims [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Claim successful on node user
Nov 15 08:33:38 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:33:38 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:33:38 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:33:38 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:33:38 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.243s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:33:38 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Start building networks asynchronously for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 08:33:38 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Allocating IP information in the background. {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 08:33:38 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] allocate_for_instance() {{(pid=95467) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 08:33:38 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 08:33:38 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Start building block device mappings for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 08:33:38 user nova-compute[95467]: DEBUG nova.policy [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e31df8ed5a914b2395b548606b65e580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a636c8b7074bd19eeee608156f8568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95467) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 08:33:38 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Start spawning the instance on the hypervisor. {{(pid=95467) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 08:33:38 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Creating instance directory {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 08:33:38 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Creating image(s)
Nov 15 08:33:38 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Acquiring lock "/opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:33:38 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "/opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:33:38 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "/opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:33:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:33:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.171s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:33:38 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Acquiring lock "a3fcf60225fcefd310404971cd18ab9851c548dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:33:38 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:33:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:33:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.176s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:33:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/disk 1073741824 {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:33:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/disk 1073741824" returned: 0 in 0.062s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:33:38 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:33:38 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:33:38 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Successfully created port: 27b8a52f-50f2-42e6-9c9f-9b74f9778096 {{(pid=95467) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 08:33:39 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.174s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:33:39 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/disk. size=1073741824 {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 08:33:39 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:33:39 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:33:39 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Cannot resize image /opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/disk to a smaller size. {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 08:33:39 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Created local disks {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 08:33:39 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Ensure instance console log exists: /opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/console.log {{(pid=95467) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 08:33:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:33:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.006s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:33:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:33:39 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:33:39 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Successfully updated port: 27b8a52f-50f2-42e6-9c9f-9b74f9778096 {{(pid=95467) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 08:33:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Acquiring lock "refresh_cache-2945f42b-62a1-44c5-be3b-f1dbe6826c0f" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:33:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Acquired lock "refresh_cache-2945f42b-62a1-44c5-be3b-f1dbe6826c0f" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:33:39 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:33:39 user nova-compute[95467]: DEBUG nova.compute.manager [req-76ebafe7-a993-48cc-803a-119015ab7f0a req-393c7df1-69fb-4619-b95e-1208caa59573 service nova] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Received event network-changed-27b8a52f-50f2-42e6-9c9f-9b74f9778096 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:33:39 user nova-compute[95467]: DEBUG nova.compute.manager [req-76ebafe7-a993-48cc-803a-119015ab7f0a req-393c7df1-69fb-4619-b95e-1208caa59573 service nova] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Refreshing instance network info cache due to event network-changed-27b8a52f-50f2-42e6-9c9f-9b74f9778096. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:33:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-76ebafe7-a993-48cc-803a-119015ab7f0a req-393c7df1-69fb-4619-b95e-1208caa59573 service nova] Acquiring lock "refresh_cache-2945f42b-62a1-44c5-be3b-f1dbe6826c0f" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:33:39 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Instance cache missing network info. {{(pid=95467) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 08:33:39 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Updating instance_info_cache with network_info: [{"id": "27b8a52f-50f2-42e6-9c9f-9b74f9778096", "address": "fa:16:3e:81:ba:80", "network": {"id": "26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1542679712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9a636c8b7074bd19eeee608156f8568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b8a52f-50", "ovs_interfaceid": "27b8a52f-50f2-42e6-9c9f-9b74f9778096", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:33:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Releasing lock "refresh_cache-2945f42b-62a1-44c5-be3b-f1dbe6826c0f" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:33:39 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Instance network_info: |[{"id": "27b8a52f-50f2-42e6-9c9f-9b74f9778096", "address": "fa:16:3e:81:ba:80", "network": {"id": "26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1542679712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9a636c8b7074bd19eeee608156f8568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b8a52f-50", "ovs_interfaceid": "27b8a52f-50f2-42e6-9c9f-9b74f9778096", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 08:33:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-76ebafe7-a993-48cc-803a-119015ab7f0a req-393c7df1-69fb-4619-b95e-1208caa59573 service nova] Acquired lock "refresh_cache-2945f42b-62a1-44c5-be3b-f1dbe6826c0f" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:33:39 user nova-compute[95467]: DEBUG nova.network.neutron [req-76ebafe7-a993-48cc-803a-119015ab7f0a req-393c7df1-69fb-4619-b95e-1208caa59573 service nova] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Refreshing network info cache for port 27b8a52f-50f2-42e6-9c9f-9b74f9778096 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:33:39 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Start _get_guest_xml network_info=[{"id": "27b8a52f-50f2-42e6-9c9f-9b74f9778096", "address": "fa:16:3e:81:ba:80", "network": {"id": "26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1542679712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9a636c8b7074bd19eeee608156f8568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b8a52f-50", "ovs_interfaceid": "27b8a52f-50f2-42e6-9c9f-9b74f9778096", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'ed9c48aa-ce73-4b3b-9db1-235898be671b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:33:39 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:33:39 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:33:39 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:33:39 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:33:39 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:33:39 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:33:39 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:33:39 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:33:39 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:33:39 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:33:39 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:33:39 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:33:39 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:33:39 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:33:39 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:33:39 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:33:39 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:33:39 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:33:40 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:33:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1665521832',display_name='tempest-AttachVolumeTestJSON-server-1665521832',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1665521832',id=49,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHEZ4L2W1PqDn37Zx7UIz0j2KcbPq+rly9Qd/KJO59g5c8MCgjoXP3xcb3EyLIk0CvVsb/gd4fXybCigHKczFCKQxo4IJMRUgO0RY0jH5aIgYmljg+NxxHHdbnLulJeSuQ==',key_name='tempest-keypair-1324520091',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9a636c8b7074bd19eeee608156f8568',ramdisk_id='',reservation_id='r-fsabz05b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1507968277',owner_user_name='tempest-AttachVolumeTestJSON-1507968277-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:33:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e31df8ed5a914b2395b548606b65e580',uuid=2945f42b-62a1-44c5-be3b-f1dbe6826c0f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27b8a52f-50f2-42e6-9c9f-9b74f9778096", "address": "fa:16:3e:81:ba:80", "network": {"id": "26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1542679712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9a636c8b7074bd19eeee608156f8568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b8a52f-50", "ovs_interfaceid": "27b8a52f-50f2-42e6-9c9f-9b74f9778096", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:33:40 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Converting VIF {"id": "27b8a52f-50f2-42e6-9c9f-9b74f9778096", "address": "fa:16:3e:81:ba:80", "network": {"id": "26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1542679712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9a636c8b7074bd19eeee608156f8568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b8a52f-50", "ovs_interfaceid": "27b8a52f-50f2-42e6-9c9f-9b74f9778096", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:33:40 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:ba:80,bridge_name='br-int',has_traffic_filtering=True,id=27b8a52f-50f2-42e6-9c9f-9b74f9778096,network=Network(26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27b8a52f-50') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:33:40 user nova-compute[95467]: DEBUG nova.objects.instance [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lazy-loading 'pci_devices' on Instance uuid 2945f42b-62a1-44c5-be3b-f1dbe6826c0f {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:33:40 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:33:40 user nova-compute[95467]:   <uuid>2945f42b-62a1-44c5-be3b-f1dbe6826c0f</uuid>
Nov 15 08:33:40 user nova-compute[95467]:   <name>instance-00000031</name>
Nov 15 08:33:40 user nova-compute[95467]:   <memory>524288</memory>
Nov 15 08:33:40 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:33:40 user nova-compute[95467]:   <metadata>
Nov 15 08:33:40 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:33:40 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:33:40 user nova-compute[95467]:       <nova:name>tempest-AttachVolumeTestJSON-server-1665521832</nova:name>
Nov 15 08:33:40 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:33:39</nova:creationTime>
Nov 15 08:33:40 user nova-compute[95467]:       <nova:flavor name="m1.tiny">
Nov 15 08:33:40 user nova-compute[95467]:         <nova:memory>512</nova:memory>
Nov 15 08:33:40 user nova-compute[95467]:         <nova:disk>1</nova:disk>
Nov 15 08:33:40 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:33:40 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:33:40 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:33:40 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:33:40 user nova-compute[95467]:       <nova:owner>
Nov 15 08:33:40 user nova-compute[95467]:         <nova:user uuid="e31df8ed5a914b2395b548606b65e580">tempest-AttachVolumeTestJSON-1507968277-project-member</nova:user>
Nov 15 08:33:40 user nova-compute[95467]:         <nova:project uuid="a9a636c8b7074bd19eeee608156f8568">tempest-AttachVolumeTestJSON-1507968277</nova:project>
Nov 15 08:33:40 user nova-compute[95467]:       </nova:owner>
Nov 15 08:33:40 user nova-compute[95467]:       <nova:root type="image" uuid="ed9c48aa-ce73-4b3b-9db1-235898be671b"/>
Nov 15 08:33:40 user nova-compute[95467]:       <nova:ports>
Nov 15 08:33:40 user nova-compute[95467]:         <nova:port uuid="27b8a52f-50f2-42e6-9c9f-9b74f9778096">
Nov 15 08:33:40 user nova-compute[95467]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 08:33:40 user nova-compute[95467]:         </nova:port>
Nov 15 08:33:40 user nova-compute[95467]:       </nova:ports>
Nov 15 08:33:40 user nova-compute[95467]:     </nova:instance>
Nov 15 08:33:40 user nova-compute[95467]:   </metadata>
Nov 15 08:33:40 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:33:40 user nova-compute[95467]:     <system>
Nov 15 08:33:40 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:33:40 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:33:40 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:33:40 user nova-compute[95467]:       <entry name="serial">2945f42b-62a1-44c5-be3b-f1dbe6826c0f</entry>
Nov 15 08:33:40 user nova-compute[95467]:       <entry name="uuid">2945f42b-62a1-44c5-be3b-f1dbe6826c0f</entry>
Nov 15 08:33:40 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:33:40 user nova-compute[95467]:     </system>
Nov 15 08:33:40 user nova-compute[95467]:   </sysinfo>
Nov 15 08:33:40 user nova-compute[95467]:   <os>
Nov 15 08:33:40 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:33:40 user nova-compute[95467]:     <boot dev="hd"/>
Nov 15 08:33:40 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:33:40 user nova-compute[95467]:   </os>
Nov 15 08:33:40 user nova-compute[95467]:   <features>
Nov 15 08:33:40 user nova-compute[95467]:     <acpi/>
Nov 15 08:33:40 user nova-compute[95467]:     <apic/>
Nov 15 08:33:40 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:33:40 user nova-compute[95467]:   </features>
Nov 15 08:33:40 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:33:40 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:33:40 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:33:40 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:33:40 user nova-compute[95467]:   </clock>
Nov 15 08:33:40 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:33:40 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:33:40 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:33:40 user nova-compute[95467]:   </cpu>
Nov 15 08:33:40 user nova-compute[95467]:   <devices>
Nov 15 08:33:40 user nova-compute[95467]:     <disk type="file" device="disk">
Nov 15 08:33:40 user nova-compute[95467]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 08:33:40 user nova-compute[95467]:       <source file="/opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/disk"/>
Nov 15 08:33:40 user nova-compute[95467]:       <target dev="vda" bus="virtio"/>
Nov 15 08:33:40 user nova-compute[95467]:     </disk>
Nov 15 08:33:40 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:33:40 user nova-compute[95467]:       <mac address="fa:16:3e:81:ba:80"/>
Nov 15 08:33:40 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:33:40 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:33:40 user nova-compute[95467]:       <target dev="tap27b8a52f-50"/>
Nov 15 08:33:40 user nova-compute[95467]:     </interface>
Nov 15 08:33:40 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:33:40 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/console.log" append="off"/>
Nov 15 08:33:40 user nova-compute[95467]:     </serial>
Nov 15 08:33:40 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:33:40 user nova-compute[95467]:     <video>
Nov 15 08:33:40 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:33:40 user nova-compute[95467]:     </video>
Nov 15 08:33:40 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:33:40 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:33:40 user nova-compute[95467]:     </rng>
Nov 15 08:33:40 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:33:40 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:33:40 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:33:40 user nova-compute[95467]:     </memballoon>
Nov 15 08:33:40 user nova-compute[95467]:   </devices>
Nov 15 08:33:40 user nova-compute[95467]: </domain>
Nov 15 08:33:40 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:33:40 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:33:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1665521832',display_name='tempest-AttachVolumeTestJSON-server-1665521832',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1665521832',id=49,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHEZ4L2W1PqDn37Zx7UIz0j2KcbPq+rly9Qd/KJO59g5c8MCgjoXP3xcb3EyLIk0CvVsb/gd4fXybCigHKczFCKQxo4IJMRUgO0RY0jH5aIgYmljg+NxxHHdbnLulJeSuQ==',key_name='tempest-keypair-1324520091',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9a636c8b7074bd19eeee608156f8568',ramdisk_id='',reservation_id='r-fsabz05b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1507968277',owner_user_name='tempest-AttachVolumeTestJSON-1507968277-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:33:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e31df8ed5a914b2395b548606b65e580',uuid=2945f42b-62a1-44c5-be3b-f1dbe6826c0f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27b8a52f-50f2-42e6-9c9f-9b74f9778096", "address": "fa:16:3e:81:ba:80", "network": {"id": "26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1542679712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9a636c8b7074bd19eeee608156f8568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b8a52f-50", "ovs_interfaceid": "27b8a52f-50f2-42e6-9c9f-9b74f9778096", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:33:40 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Converting VIF {"id": "27b8a52f-50f2-42e6-9c9f-9b74f9778096", "address": "fa:16:3e:81:ba:80", "network": {"id": "26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1542679712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9a636c8b7074bd19eeee608156f8568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b8a52f-50", "ovs_interfaceid": "27b8a52f-50f2-42e6-9c9f-9b74f9778096", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:33:40 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:ba:80,bridge_name='br-int',has_traffic_filtering=True,id=27b8a52f-50f2-42e6-9c9f-9b74f9778096,network=Network(26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27b8a52f-50') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:33:40 user nova-compute[95467]: DEBUG os_vif [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:ba:80,bridge_name='br-int',has_traffic_filtering=True,id=27b8a52f-50f2-42e6-9c9f-9b74f9778096,network=Network(26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27b8a52f-50') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:33:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:33:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:33:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:33:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:33:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '285d7eca-fd49-53a1-880b-efb515c32d78', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:33:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:33:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:33:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:33:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap27b8a52f-50, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:33:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap27b8a52f-50, col_values=(('qos', UUID('b2379271-1a76-42b6-bd4b-66e8d86d433b')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:33:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap27b8a52f-50, col_values=(('external_ids', {'iface-id': '27b8a52f-50f2-42e6-9c9f-9b74f9778096', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:ba:80', 'vm-uuid': '2945f42b-62a1-44c5-be3b-f1dbe6826c0f'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:33:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:33:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:33:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:33:40 user nova-compute[95467]: INFO os_vif [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:ba:80,bridge_name='br-int',has_traffic_filtering=True,id=27b8a52f-50f2-42e6-9c9f-9b74f9778096,network=Network(26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27b8a52f-50')
Nov 15 08:33:40 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:33:40 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] No VIF found with MAC fa:16:3e:81:ba:80, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:33:40 user nova-compute[95467]: DEBUG nova.network.neutron [req-76ebafe7-a993-48cc-803a-119015ab7f0a req-393c7df1-69fb-4619-b95e-1208caa59573 service nova] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Updated VIF entry in instance network info cache for port 27b8a52f-50f2-42e6-9c9f-9b74f9778096. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:33:40 user nova-compute[95467]: DEBUG nova.network.neutron [req-76ebafe7-a993-48cc-803a-119015ab7f0a req-393c7df1-69fb-4619-b95e-1208caa59573 service nova] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Updating instance_info_cache with network_info: [{"id": "27b8a52f-50f2-42e6-9c9f-9b74f9778096", "address": "fa:16:3e:81:ba:80", "network": {"id": "26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1542679712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9a636c8b7074bd19eeee608156f8568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b8a52f-50", "ovs_interfaceid": "27b8a52f-50f2-42e6-9c9f-9b74f9778096", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:33:40 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-76ebafe7-a993-48cc-803a-119015ab7f0a req-393c7df1-69fb-4619-b95e-1208caa59573 service nova] Releasing lock "refresh_cache-2945f42b-62a1-44c5-be3b-f1dbe6826c0f" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:33:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:33:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:33:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:33:41 user nova-compute[95467]: DEBUG nova.compute.manager [req-58a17adc-b77d-4f83-9463-22e1afe26641 req-b66070f4-5d7f-4ec3-8e67-d3dd2c56a29e service nova] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Received event network-vif-plugged-27b8a52f-50f2-42e6-9c9f-9b74f9778096 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:33:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-58a17adc-b77d-4f83-9463-22e1afe26641 req-b66070f4-5d7f-4ec3-8e67-d3dd2c56a29e service nova] Acquiring lock "2945f42b-62a1-44c5-be3b-f1dbe6826c0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:33:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-58a17adc-b77d-4f83-9463-22e1afe26641 req-b66070f4-5d7f-4ec3-8e67-d3dd2c56a29e service nova] Lock "2945f42b-62a1-44c5-be3b-f1dbe6826c0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:33:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-58a17adc-b77d-4f83-9463-22e1afe26641 req-b66070f4-5d7f-4ec3-8e67-d3dd2c56a29e service nova] Lock "2945f42b-62a1-44c5-be3b-f1dbe6826c0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:33:41 user nova-compute[95467]: DEBUG nova.compute.manager [req-58a17adc-b77d-4f83-9463-22e1afe26641 req-b66070f4-5d7f-4ec3-8e67-d3dd2c56a29e service nova] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] No waiting events found dispatching network-vif-plugged-27b8a52f-50f2-42e6-9c9f-9b74f9778096 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:33:41 user nova-compute[95467]: WARNING nova.compute.manager [req-58a17adc-b77d-4f83-9463-22e1afe26641 req-b66070f4-5d7f-4ec3-8e67-d3dd2c56a29e service nova] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Received unexpected event network-vif-plugged-27b8a52f-50f2-42e6-9c9f-9b74f9778096 for instance with vm_state building and task_state spawning.
Nov 15 08:33:42 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:33:42 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:33:42 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:33:42 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:33:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:33:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:33:43 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Instance event wait completed in 0 seconds for  {{(pid=95467) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 08:33:43 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Guest created on hypervisor {{(pid=95467) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 08:33:43 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Instance spawned successfully.
Nov 15 08:33:43 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 08:33:43 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Found default for hw_cdrom_bus of ide {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:33:43 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Found default for hw_disk_bus of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:33:43 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Found default for hw_input_bus of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:33:43 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Found default for hw_pointer_model of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:33:43 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Found default for hw_video_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:33:43 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Found default for hw_vif_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:33:43 user nova-compute[95467]: INFO nova.compute.manager [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Took 5.26 seconds to spawn the instance on the hypervisor.
Nov 15 08:33:43 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:33:43 user nova-compute[95467]: INFO nova.compute.manager [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Took 5.83 seconds to build instance.
Nov 15 08:33:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3e8badd0-5b68-4652-999c-709042730923 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "2945f42b-62a1-44c5-be3b-f1dbe6826c0f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.954s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:33:43 user nova-compute[95467]: DEBUG nova.compute.manager [req-0380a2e0-5c4c-4081-9bfd-1744ea8374eb req-da8c20a7-74b1-43fe-9b8a-58f6e9df424d service nova] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Received event network-vif-plugged-27b8a52f-50f2-42e6-9c9f-9b74f9778096 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:33:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-0380a2e0-5c4c-4081-9bfd-1744ea8374eb req-da8c20a7-74b1-43fe-9b8a-58f6e9df424d service nova] Acquiring lock "2945f42b-62a1-44c5-be3b-f1dbe6826c0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:33:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-0380a2e0-5c4c-4081-9bfd-1744ea8374eb req-da8c20a7-74b1-43fe-9b8a-58f6e9df424d service nova] Lock "2945f42b-62a1-44c5-be3b-f1dbe6826c0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:33:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-0380a2e0-5c4c-4081-9bfd-1744ea8374eb req-da8c20a7-74b1-43fe-9b8a-58f6e9df424d service nova] Lock "2945f42b-62a1-44c5-be3b-f1dbe6826c0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:33:43 user nova-compute[95467]: DEBUG nova.compute.manager [req-0380a2e0-5c4c-4081-9bfd-1744ea8374eb req-da8c20a7-74b1-43fe-9b8a-58f6e9df424d service nova] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] No waiting events found dispatching network-vif-plugged-27b8a52f-50f2-42e6-9c9f-9b74f9778096 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:33:43 user nova-compute[95467]: WARNING nova.compute.manager [req-0380a2e0-5c4c-4081-9bfd-1744ea8374eb req-da8c20a7-74b1-43fe-9b8a-58f6e9df424d service nova] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Received unexpected event network-vif-plugged-27b8a52f-50f2-42e6-9c9f-9b74f9778096 for instance with vm_state active and task_state None.
Nov 15 08:33:44 user nova-compute[95467]: DEBUG nova.compute.manager [req-d174891c-5390-40a5-bb46-9d97cf239f0b req-b5a7c4f9-c473-44ef-8d6e-c080971a698d service nova] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] Received event network-changed-cac0d932-a57e-4170-9779-4f574a7a88e0 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:33:44 user nova-compute[95467]: DEBUG nova.compute.manager [req-d174891c-5390-40a5-bb46-9d97cf239f0b req-b5a7c4f9-c473-44ef-8d6e-c080971a698d service nova] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] Refreshing instance network info cache due to event network-changed-cac0d932-a57e-4170-9779-4f574a7a88e0. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:33:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-d174891c-5390-40a5-bb46-9d97cf239f0b req-b5a7c4f9-c473-44ef-8d6e-c080971a698d service nova] Acquiring lock "refresh_cache-e378dc0e-8898-4895-884f-6c3e3f328bee" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:33:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-d174891c-5390-40a5-bb46-9d97cf239f0b req-b5a7c4f9-c473-44ef-8d6e-c080971a698d service nova] Acquired lock "refresh_cache-e378dc0e-8898-4895-884f-6c3e3f328bee" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:33:44 user nova-compute[95467]: DEBUG nova.network.neutron [req-d174891c-5390-40a5-bb46-9d97cf239f0b req-b5a7c4f9-c473-44ef-8d6e-c080971a698d service nova] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] Refreshing network info cache for port cac0d932-a57e-4170-9779-4f574a7a88e0 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:33:44 user nova-compute[95467]: DEBUG nova.network.neutron [req-d174891c-5390-40a5-bb46-9d97cf239f0b req-b5a7c4f9-c473-44ef-8d6e-c080971a698d service nova] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] Updated VIF entry in instance network info cache for port cac0d932-a57e-4170-9779-4f574a7a88e0. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:33:44 user nova-compute[95467]: DEBUG nova.network.neutron [req-d174891c-5390-40a5-bb46-9d97cf239f0b req-b5a7c4f9-c473-44ef-8d6e-c080971a698d service nova] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] Updating instance_info_cache with network_info: [{"id": "cac0d932-a57e-4170-9779-4f574a7a88e0", "address": "fa:16:3e:d1:56:fd", "network": {"id": "a0f0cb10-26c8-4299-8a7e-4d34cfd26c82", "bridge": "br-int", "label": "tempest-TestStampPattern-737883783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b4ba53c039b4d699865e97ea1105843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcac0d932-a5", "ovs_interfaceid": "cac0d932-a57e-4170-9779-4f574a7a88e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:33:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-d174891c-5390-40a5-bb46-9d97cf239f0b req-b5a7c4f9-c473-44ef-8d6e-c080971a698d service nova] Releasing lock "refresh_cache-e378dc0e-8898-4895-884f-6c3e3f328bee" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:33:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1a48a2e4-cc15-4ff8-b36a-6f5a6ddbacfc tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Acquiring lock "e378dc0e-8898-4895-884f-6c3e3f328bee" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:33:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1a48a2e4-cc15-4ff8-b36a-6f5a6ddbacfc tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Lock "e378dc0e-8898-4895-884f-6c3e3f328bee" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:33:44 user nova-compute[95467]: DEBUG nova.objects.instance [None req-1a48a2e4-cc15-4ff8-b36a-6f5a6ddbacfc tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Lazy-loading 'flavor' on Instance uuid e378dc0e-8898-4895-884f-6c3e3f328bee {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:33:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1a48a2e4-cc15-4ff8-b36a-6f5a6ddbacfc tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Lock "e378dc0e-8898-4895-884f-6c3e3f328bee" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:33:45 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:33:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1a48a2e4-cc15-4ff8-b36a-6f5a6ddbacfc tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Acquiring lock "e378dc0e-8898-4895-884f-6c3e3f328bee" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:33:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1a48a2e4-cc15-4ff8-b36a-6f5a6ddbacfc tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Lock "e378dc0e-8898-4895-884f-6c3e3f328bee" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:33:45 user nova-compute[95467]: INFO nova.compute.manager [None req-1a48a2e4-cc15-4ff8-b36a-6f5a6ddbacfc tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] Attaching volume 99ef1578-524a-4477-bdaa-1439e94893c3 to /dev/vdb
Nov 15 08:33:45 user nova-compute[95467]: DEBUG os_brick.utils [None req-1a48a2e4-cc15-4ff8-b36a-6f5a6ddbacfc tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:33:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:33:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:33:45 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f073b46d-211c-4ed7-82db-5fbcc617214d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:882ae90641f\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:33:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:33:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:33:45 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[843c73b4-0abd-43da-9b71-468d23a88521]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:33:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:33:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:33:45 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af8cac7-22ff-432f-97d2-684650965d5b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:33:45 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[de57b89c-cd9d-43a6-b3bf-2260370c78b3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:33:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-1a48a2e4-cc15-4ff8-b36a-6f5a6ddbacfc tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Running cmd (subprocess): nvme version {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:33:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-1a48a2e4-cc15-4ff8-b36a-6f5a6ddbacfc tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] 'nvme version' failed. Not Retrying. {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:33:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1a48a2e4-cc15-4ff8-b36a-6f5a6ddbacfc tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] nvme not present on system {{(pid=95467) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 08:33:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:33:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:33:45 user nova-compute[95467]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 08:33:45 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7a3018-22f5-47d5-b2cd-7f17cb03061c]: (4, '') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:33:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-1a48a2e4-cc15-4ff8-b36a-6f5a6ddbacfc tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=95467) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 08:33:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-1a48a2e4-cc15-4ff8-b36a-6f5a6ddbacfc tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 08:33:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-1a48a2e4-cc15-4ff8-b36a-6f5a6ddbacfc tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] LIGHTOS: no hostnqn found. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 08:33:45 user nova-compute[95467]: DEBUG os_brick.utils [None req-1a48a2e4-cc15-4ff8-b36a-6f5a6ddbacfc tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:882ae90641f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:33:45 user nova-compute[95467]: DEBUG nova.virt.block_device [None req-1a48a2e4-cc15-4ff8-b36a-6f5a6ddbacfc tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] Updating existing volume attachment record: 4b408474-72f5-4033-9e4c-f6fe1e5ef129 {{(pid=95467) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 08:33:47 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Acquiring lock "c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:33:47 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:33:47 user nova-compute[95467]: DEBUG nova.compute.manager [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Starting instance... {{(pid=95467) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 08:33:47 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:33:47 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:33:47 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=95467) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 08:33:47 user nova-compute[95467]: INFO nova.compute.claims [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Claim successful on node user
Nov 15 08:33:47 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:33:47 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:33:47 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.274s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:33:47 user nova-compute[95467]: DEBUG nova.compute.manager [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Start building networks asynchronously for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 08:33:47 user nova-compute[95467]: DEBUG nova.compute.manager [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Allocating IP information in the background. {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 08:33:47 user nova-compute[95467]: DEBUG nova.network.neutron [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] allocate_for_instance() {{(pid=95467) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 08:33:47 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 08:33:47 user nova-compute[95467]: DEBUG nova.compute.manager [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Start building block device mappings for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 08:33:47 user nova-compute[95467]: DEBUG nova.policy [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7b095b34b1b74a28a9f0b96cb6f033aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7355ea3588ae4c2f9242e63084008710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95467) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 08:33:47 user nova-compute[95467]: DEBUG nova.compute.manager [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Start spawning the instance on the hypervisor. {{(pid=95467) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 08:33:47 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Creating instance directory {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 08:33:47 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Creating image(s)
Nov 15 08:33:47 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Acquiring lock "/opt/stack/data/nova/instances/c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:33:47 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "/opt/stack/data/nova/instances/c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:33:47 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "/opt/stack/data/nova/instances/c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:33:47 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Acquiring lock "166bd0c92028594abd6b0ce8dbcfc5710b6f9fc7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:33:47 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "166bd0c92028594abd6b0ce8dbcfc5710b6f9fc7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:33:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/166bd0c92028594abd6b0ce8dbcfc5710b6f9fc7.part --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:33:48 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:33:48 user nova-compute[95467]: DEBUG nova.network.neutron [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Successfully created port: 469317c8-e304-434f-aa57-d791c555d494 {{(pid=95467) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 08:33:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/166bd0c92028594abd6b0ce8dbcfc5710b6f9fc7.part --force-share --output=json" returned: 0 in 0.265s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:33:48 user nova-compute[95467]: DEBUG nova.virt.images [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] 5287dd1e-2bf5-4503-98db-e03e6d3d044f was qcow2, converting to raw {{(pid=95467) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 08:33:48 user nova-compute[95467]: DEBUG nova.privsep.utils [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=95467) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 08:33:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/166bd0c92028594abd6b0ce8dbcfc5710b6f9fc7.part /opt/stack/data/nova/instances/_base/166bd0c92028594abd6b0ce8dbcfc5710b6f9fc7.converted {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:33:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/166bd0c92028594abd6b0ce8dbcfc5710b6f9fc7.part /opt/stack/data/nova/instances/_base/166bd0c92028594abd6b0ce8dbcfc5710b6f9fc7.converted" returned: 0 in 0.241s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:33:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/166bd0c92028594abd6b0ce8dbcfc5710b6f9fc7.converted --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:33:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/166bd0c92028594abd6b0ce8dbcfc5710b6f9fc7.converted --force-share --output=json" returned: 0 in 0.203s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:33:49 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "166bd0c92028594abd6b0ce8dbcfc5710b6f9fc7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.240s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:33:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/166bd0c92028594abd6b0ce8dbcfc5710b6f9fc7 --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:33:49 user nova-compute[95467]: DEBUG nova.network.neutron [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Successfully updated port: 469317c8-e304-434f-aa57-d791c555d494 {{(pid=95467) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 08:33:49 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Acquiring lock "refresh_cache-c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:33:49 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Acquired lock "refresh_cache-c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:33:49 user nova-compute[95467]: DEBUG nova.network.neutron [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:33:49 user nova-compute[95467]: DEBUG nova.compute.manager [req-686f45ff-3cf9-437f-85e3-94200058f2c3 req-2f79147d-d4a4-4bdf-b736-5d2a7bf8c637 service nova] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Received event network-changed-469317c8-e304-434f-aa57-d791c555d494 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:33:49 user nova-compute[95467]: DEBUG nova.compute.manager [req-686f45ff-3cf9-437f-85e3-94200058f2c3 req-2f79147d-d4a4-4bdf-b736-5d2a7bf8c637 service nova] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Refreshing instance network info cache due to event network-changed-469317c8-e304-434f-aa57-d791c555d494. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:33:49 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-686f45ff-3cf9-437f-85e3-94200058f2c3 req-2f79147d-d4a4-4bdf-b736-5d2a7bf8c637 service nova] Acquiring lock "refresh_cache-c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:33:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/166bd0c92028594abd6b0ce8dbcfc5710b6f9fc7 --force-share --output=json" returned: 0 in 0.188s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:33:49 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Acquiring lock "166bd0c92028594abd6b0ce8dbcfc5710b6f9fc7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:33:49 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "166bd0c92028594abd6b0ce8dbcfc5710b6f9fc7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:33:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/166bd0c92028594abd6b0ce8dbcfc5710b6f9fc7 --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:33:49 user nova-compute[95467]: DEBUG nova.network.neutron [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Instance cache missing network info. {{(pid=95467) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 08:33:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/166bd0c92028594abd6b0ce8dbcfc5710b6f9fc7 --force-share --output=json" returned: 0 in 0.185s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:33:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/166bd0c92028594abd6b0ce8dbcfc5710b6f9fc7,backing_fmt=raw /opt/stack/data/nova/instances/c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c/disk 1073741824 {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:33:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/166bd0c92028594abd6b0ce8dbcfc5710b6f9fc7,backing_fmt=raw /opt/stack/data/nova/instances/c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c/disk 1073741824" returned: 0 in 0.049s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:33:49 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "166bd0c92028594abd6b0ce8dbcfc5710b6f9fc7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:33:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/166bd0c92028594abd6b0ce8dbcfc5710b6f9fc7 --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:33:49 user nova-compute[95467]: DEBUG nova.network.neutron [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Updating instance_info_cache with network_info: [{"id": "469317c8-e304-434f-aa57-d791c555d494", "address": "fa:16:3e:4f:39:f3", "network": {"id": "d67049b6-2e91-4d1e-8e42-5388ef75521a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984085217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7355ea3588ae4c2f9242e63084008710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469317c8-e3", "ovs_interfaceid": "469317c8-e304-434f-aa57-d791c555d494", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:33:49 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Releasing lock "refresh_cache-c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:33:49 user nova-compute[95467]: DEBUG nova.compute.manager [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Instance network_info: |[{"id": "469317c8-e304-434f-aa57-d791c555d494", "address": "fa:16:3e:4f:39:f3", "network": {"id": "d67049b6-2e91-4d1e-8e42-5388ef75521a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984085217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7355ea3588ae4c2f9242e63084008710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469317c8-e3", "ovs_interfaceid": "469317c8-e304-434f-aa57-d791c555d494", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 08:33:49 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-686f45ff-3cf9-437f-85e3-94200058f2c3 req-2f79147d-d4a4-4bdf-b736-5d2a7bf8c637 service nova] Acquired lock "refresh_cache-c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:33:49 user nova-compute[95467]: DEBUG nova.network.neutron [req-686f45ff-3cf9-437f-85e3-94200058f2c3 req-2f79147d-d4a4-4bdf-b736-5d2a7bf8c637 service nova] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Refreshing network info cache for port 469317c8-e304-434f-aa57-d791c555d494 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:33:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/166bd0c92028594abd6b0ce8dbcfc5710b6f9fc7 --force-share --output=json" returned: 0 in 0.187s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:33:49 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c/disk. size=1073741824 {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 08:33:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Cannot resize image /opt/stack/data/nova/instances/c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c/disk to a smaller size. {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Created local disks {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Ensure instance console log exists: /opt/stack/data/nova/instances/c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c/console.log {{(pid=95467) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Start _get_guest_xml network_info=[{"id": "469317c8-e304-434f-aa57-d791c555d494", "address": "fa:16:3e:4f:39:f3", "network": {"id": "d67049b6-2e91-4d1e-8e42-5388ef75521a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984085217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7355ea3588ae4c2f9242e63084008710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469317c8-e3", "ovs_interfaceid": "469317c8-e304-434f-aa57-d791c555d494", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:33:45Z,direct_url=<?>,disk_format='qcow2',id=5287dd1e-2bf5-4503-98db-e03e6d3d044f,min_disk=0,min_ram=0,name='tempest-scenario-img--1817728146',owner='7355ea3588ae4c2f9242e63084008710',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:33:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '5287dd1e-2bf5-4503-98db-e03e6d3d044f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:33:50 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:33:50 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:33:50 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:33:45Z,direct_url=<?>,disk_format='qcow2',id=5287dd1e-2bf5-4503-98db-e03e6d3d044f,min_disk=0,min_ram=0,name='tempest-scenario-img--1817728146',owner='7355ea3588ae4c2f9242e63084008710',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:33:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:33:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1078493853',display_name='tempest-TestMinimumBasicScenario-server-1078493853',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1078493853',id=50,image_ref='5287dd1e-2bf5-4503-98db-e03e6d3d044f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFuo49k9cvv7YNAlDfgSDtSKD5rkKjZXUDBHBnwxYNRe8PhjZ3K4zmMBSfZv32JlPsh+fr3qErhJmjvAamhoAh2VTCuxfWFiDo8zp3ZYgGDbY08lk14VdY8/gEVybaHTzA==',key_name='tempest-TestMinimumBasicScenario-1958468488',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7355ea3588ae4c2f9242e63084008710',ramdisk_id='',reservation_id='r-zru7ldf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5287dd1e-2bf5-4503-98db-e03e6d3d044f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-721378270',owner_user_name='tempest-TestMinimumBasicScenario-721378270-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:33:48Z,user_data=None,user_id='7b095b34b1b74a28a9f0b96cb6f033aa',uuid=c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "469317c8-e304-434f-aa57-d791c555d494", "address": "fa:16:3e:4f:39:f3", "network": {"id": "d67049b6-2e91-4d1e-8e42-5388ef75521a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984085217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7355ea3588ae4c2f9242e63084008710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469317c8-e3", "ovs_interfaceid": "469317c8-e304-434f-aa57-d791c555d494", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Converting VIF {"id": "469317c8-e304-434f-aa57-d791c555d494", "address": "fa:16:3e:4f:39:f3", "network": {"id": "d67049b6-2e91-4d1e-8e42-5388ef75521a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984085217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7355ea3588ae4c2f9242e63084008710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469317c8-e3", "ovs_interfaceid": "469317c8-e304-434f-aa57-d791c555d494", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:39:f3,bridge_name='br-int',has_traffic_filtering=True,id=469317c8-e304-434f-aa57-d791c555d494,network=Network(d67049b6-2e91-4d1e-8e42-5388ef75521a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469317c8-e3') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG nova.objects.instance [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lazy-loading 'pci_devices' on Instance uuid c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:33:50 user nova-compute[95467]:   <uuid>c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c</uuid>
Nov 15 08:33:50 user nova-compute[95467]:   <name>instance-00000032</name>
Nov 15 08:33:50 user nova-compute[95467]:   <memory>524288</memory>
Nov 15 08:33:50 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:33:50 user nova-compute[95467]:   <metadata>
Nov 15 08:33:50 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:33:50 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:33:50 user nova-compute[95467]:       <nova:name>tempest-TestMinimumBasicScenario-server-1078493853</nova:name>
Nov 15 08:33:50 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:33:50</nova:creationTime>
Nov 15 08:33:50 user nova-compute[95467]:       <nova:flavor name="m1.tiny">
Nov 15 08:33:50 user nova-compute[95467]:         <nova:memory>512</nova:memory>
Nov 15 08:33:50 user nova-compute[95467]:         <nova:disk>1</nova:disk>
Nov 15 08:33:50 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:33:50 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:33:50 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:33:50 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:33:50 user nova-compute[95467]:       <nova:owner>
Nov 15 08:33:50 user nova-compute[95467]:         <nova:user uuid="7b095b34b1b74a28a9f0b96cb6f033aa">tempest-TestMinimumBasicScenario-721378270-project-member</nova:user>
Nov 15 08:33:50 user nova-compute[95467]:         <nova:project uuid="7355ea3588ae4c2f9242e63084008710">tempest-TestMinimumBasicScenario-721378270</nova:project>
Nov 15 08:33:50 user nova-compute[95467]:       </nova:owner>
Nov 15 08:33:50 user nova-compute[95467]:       <nova:root type="image" uuid="5287dd1e-2bf5-4503-98db-e03e6d3d044f"/>
Nov 15 08:33:50 user nova-compute[95467]:       <nova:ports>
Nov 15 08:33:50 user nova-compute[95467]:         <nova:port uuid="469317c8-e304-434f-aa57-d791c555d494">
Nov 15 08:33:50 user nova-compute[95467]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 08:33:50 user nova-compute[95467]:         </nova:port>
Nov 15 08:33:50 user nova-compute[95467]:       </nova:ports>
Nov 15 08:33:50 user nova-compute[95467]:     </nova:instance>
Nov 15 08:33:50 user nova-compute[95467]:   </metadata>
Nov 15 08:33:50 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:33:50 user nova-compute[95467]:     <system>
Nov 15 08:33:50 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:33:50 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:33:50 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:33:50 user nova-compute[95467]:       <entry name="serial">c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c</entry>
Nov 15 08:33:50 user nova-compute[95467]:       <entry name="uuid">c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c</entry>
Nov 15 08:33:50 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:33:50 user nova-compute[95467]:     </system>
Nov 15 08:33:50 user nova-compute[95467]:   </sysinfo>
Nov 15 08:33:50 user nova-compute[95467]:   <os>
Nov 15 08:33:50 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:33:50 user nova-compute[95467]:     <boot dev="hd"/>
Nov 15 08:33:50 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:33:50 user nova-compute[95467]:   </os>
Nov 15 08:33:50 user nova-compute[95467]:   <features>
Nov 15 08:33:50 user nova-compute[95467]:     <acpi/>
Nov 15 08:33:50 user nova-compute[95467]:     <apic/>
Nov 15 08:33:50 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:33:50 user nova-compute[95467]:   </features>
Nov 15 08:33:50 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:33:50 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:33:50 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:33:50 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:33:50 user nova-compute[95467]:   </clock>
Nov 15 08:33:50 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:33:50 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:33:50 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:33:50 user nova-compute[95467]:   </cpu>
Nov 15 08:33:50 user nova-compute[95467]:   <devices>
Nov 15 08:33:50 user nova-compute[95467]:     <disk type="file" device="disk">
Nov 15 08:33:50 user nova-compute[95467]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 08:33:50 user nova-compute[95467]:       <source file="/opt/stack/data/nova/instances/c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c/disk"/>
Nov 15 08:33:50 user nova-compute[95467]:       <target dev="vda" bus="virtio"/>
Nov 15 08:33:50 user nova-compute[95467]:     </disk>
Nov 15 08:33:50 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:33:50 user nova-compute[95467]:       <mac address="fa:16:3e:4f:39:f3"/>
Nov 15 08:33:50 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:33:50 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:33:50 user nova-compute[95467]:       <target dev="tap469317c8-e3"/>
Nov 15 08:33:50 user nova-compute[95467]:     </interface>
Nov 15 08:33:50 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:33:50 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c/console.log" append="off"/>
Nov 15 08:33:50 user nova-compute[95467]:     </serial>
Nov 15 08:33:50 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:33:50 user nova-compute[95467]:     <video>
Nov 15 08:33:50 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:33:50 user nova-compute[95467]:     </video>
Nov 15 08:33:50 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:33:50 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:33:50 user nova-compute[95467]:     </rng>
Nov 15 08:33:50 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:33:50 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:33:50 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:33:50 user nova-compute[95467]:     </memballoon>
Nov 15 08:33:50 user nova-compute[95467]:   </devices>
Nov 15 08:33:50 user nova-compute[95467]: </domain>
Nov 15 08:33:50 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:33:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1078493853',display_name='tempest-TestMinimumBasicScenario-server-1078493853',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1078493853',id=50,image_ref='5287dd1e-2bf5-4503-98db-e03e6d3d044f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFuo49k9cvv7YNAlDfgSDtSKD5rkKjZXUDBHBnwxYNRe8PhjZ3K4zmMBSfZv32JlPsh+fr3qErhJmjvAamhoAh2VTCuxfWFiDo8zp3ZYgGDbY08lk14VdY8/gEVybaHTzA==',key_name='tempest-TestMinimumBasicScenario-1958468488',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7355ea3588ae4c2f9242e63084008710',ramdisk_id='',reservation_id='r-zru7ldf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5287dd1e-2bf5-4503-98db-e03e6d3d044f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-721378270',owner_user_name='tempest-TestMinimumBasicScenario-721378270-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:33:48Z,user_data=None,user_id='7b095b34b1b74a28a9f0b96cb6f033aa',uuid=c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "469317c8-e304-434f-aa57-d791c555d494", "address": "fa:16:3e:4f:39:f3", "network": {"id": "d67049b6-2e91-4d1e-8e42-5388ef75521a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984085217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7355ea3588ae4c2f9242e63084008710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469317c8-e3", "ovs_interfaceid": "469317c8-e304-434f-aa57-d791c555d494", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Converting VIF {"id": "469317c8-e304-434f-aa57-d791c555d494", "address": "fa:16:3e:4f:39:f3", "network": {"id": "d67049b6-2e91-4d1e-8e42-5388ef75521a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984085217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7355ea3588ae4c2f9242e63084008710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469317c8-e3", "ovs_interfaceid": "469317c8-e304-434f-aa57-d791c555d494", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:39:f3,bridge_name='br-int',has_traffic_filtering=True,id=469317c8-e304-434f-aa57-d791c555d494,network=Network(d67049b6-2e91-4d1e-8e42-5388ef75521a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469317c8-e3') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG os_vif [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:39:f3,bridge_name='br-int',has_traffic_filtering=True,id=469317c8-e304-434f-aa57-d791c555d494,network=Network(d67049b6-2e91-4d1e-8e42-5388ef75521a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469317c8-e3') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG nova.network.neutron [req-686f45ff-3cf9-437f-85e3-94200058f2c3 req-2f79147d-d4a4-4bdf-b736-5d2a7bf8c637 service nova] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Updated VIF entry in instance network info cache for port 469317c8-e304-434f-aa57-d791c555d494. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG nova.network.neutron [req-686f45ff-3cf9-437f-85e3-94200058f2c3 req-2f79147d-d4a4-4bdf-b736-5d2a7bf8c637 service nova] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Updating instance_info_cache with network_info: [{"id": "469317c8-e304-434f-aa57-d791c555d494", "address": "fa:16:3e:4f:39:f3", "network": {"id": "d67049b6-2e91-4d1e-8e42-5388ef75521a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984085217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7355ea3588ae4c2f9242e63084008710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469317c8-e3", "ovs_interfaceid": "469317c8-e304-434f-aa57-d791c555d494", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7122c16f-3716-5e20-89a3-6dbc1affe673', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a48a2e4-cc15-4ff8-b36a-6f5a6ddbacfc tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] Calling os-brick to attach iSCSI Volume {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a48a2e4-cc15-4ff8-b36a-6f5a6ddbacfc tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:99ef1578-524a-4477-bdaa-1439e94893c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XPHlZRIY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:33:50 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-1a48a2e4-cc15-4ff8-b36a-6f5a6ddbacfc tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:33:50 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-1a48a2e4-cc15-4ff8-b36a-6f5a6ddbacfc tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-1a48a2e4-cc15-4ff8-b36a-6f5a6ddbacfc tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:33:50 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-1a48a2e4-cc15-4ff8-b36a-6f5a6ddbacfc tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:33:50 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-1a48a2e4-cc15-4ff8-b36a-6f5a6ddbacfc tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99ef1578-524a-4477-bdaa-1439e94893c3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-1a48a2e4-cc15-4ff8-b36a-6f5a6ddbacfc tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99ef1578-524a-4477-bdaa-1439e94893c3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:33:50 user nova-compute[95467]: INFO os_brick.initiator.connectors.iscsi [None req-1a48a2e4-cc15-4ff8-b36a-6f5a6ddbacfc tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 08:33:50 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-686f45ff-3cf9-437f-85e3-94200058f2c3 req-2f79147d-d4a4-4bdf-b736-5d2a7bf8c637 service nova] Releasing lock "refresh_cache-c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99ef1578-524a-4477-bdaa-1439e94893c3 -p 172.16.0.220:3260 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap469317c8-e3, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap469317c8-e3, col_values=(('qos', UUID('2b28dd77-3839-43e4-846c-253d7b30c47c')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap469317c8-e3, col_values=(('external_ids', {'iface-id': '469317c8-e304-434f-aa57-d791c555d494', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:39:f3', 'vm-uuid': 'c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:33:50 user nova-compute[95467]: INFO os_vif [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:39:f3,bridge_name='br-int',has_traffic_filtering=True,id=469317c8-e304-434f-aa57-d791c555d494,network=Network(d67049b6-2e91-4d1e-8e42-5388ef75521a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469317c8-e3')
Nov 15 08:33:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99ef1578-524a-4477-bdaa-1439e94893c3 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c5146d-17be-4f9b-807b-471271c96bb2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a48a2e4-cc15-4ff8-b36a-6f5a6ddbacfc tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 08:33:50 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99ef1578-524a-4477-bdaa-1439e94893c3 -p 172.16.0.220:3260 --interface default --op new {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99ef1578-524a-4477-bdaa-1439e94893c3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[2567de55-6020-4654-95f6-3cc3a5adf565]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99ef1578-524a-4477-bdaa-1439e94893c3] added\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a48a2e4-cc15-4ff8-b36a-6f5a6ddbacfc tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99ef1578-524a-4477-bdaa-1439e94893c3] added
Nov 15 08:33:50 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99ef1578-524a-4477-bdaa-1439e94893c3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99ef1578-524a-4477-bdaa-1439e94893c3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[7724a14f-5630-469c-9656-b226b84b6e6f]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a48a2e4-cc15-4ff8-b36a-6f5a6ddbacfc tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99ef1578-524a-4477-bdaa-1439e94893c3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] No VIF found with MAC fa:16:3e:4f:39:f3, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99ef1578-524a-4477-bdaa-1439e94893c3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55e6f37-5de3-40fb-9d95-55593efb621e]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a48a2e4-cc15-4ff8-b36a-6f5a6ddbacfc tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99ef1578-524a-4477-bdaa-1439e94893c3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XPHlZRIY {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99ef1578-524a-4477-bdaa-1439e94893c3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XPHlZRIY" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b17cf849-ec87-4505-b433-75b21f1180a6]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a48a2e4-cc15-4ff8-b36a-6f5a6ddbacfc tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XPHlZRIY'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99ef1578-524a-4477-bdaa-1439e94893c3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99ef1578-524a-4477-bdaa-1439e94893c3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[12921b5a-0248-4df8-9e8a-45e049d080d3]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a48a2e4-cc15-4ff8-b36a-6f5a6ddbacfc tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf4e7aa-9446-4409-b23a-38f288707275]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a48a2e4-cc15-4ff8-b36a-6f5a6ddbacfc tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 08:33:50 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a48a2e4-cc15-4ff8-b36a-6f5a6ddbacfc tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 08:33:50 user nova-compute[95467]:  {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:33:50 user nova-compute[95467]: WARNING os_brick.initiator.connectors.iscsi [None req-1a48a2e4-cc15-4ff8-b36a-6f5a6ddbacfc tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 08:33:50 user nova-compute[95467]: 
Nov 15 08:33:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99ef1578-524a-4477-bdaa-1439e94893c3 -p 172.16.0.220:3260 --login {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99ef1578-524a-4477-bdaa-1439e94893c3 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc30c844-ce4c-4c96-80d1-18414d0167ff]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:99ef1578-524a-4477-bdaa-1439e94893c3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:99ef1578-524a-4477-bdaa-1439e94893c3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a48a2e4-cc15-4ff8-b36a-6f5a6ddbacfc tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:99ef1578-524a-4477-bdaa-1439e94893c3, portal: 172.16.0.220,3260]
Nov 15 08:33:50 user nova-compute[95467]: Login to [iface: default, target: iqn.2010-10.org.openstack:99ef1578-524a-4477-bdaa-1439e94893c3, portal: 172.16.0.220,3260] successful.
Nov 15 08:33:50 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99ef1578-524a-4477-bdaa-1439e94893c3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99ef1578-524a-4477-bdaa-1439e94893c3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ece539-b2c9-43b2-b74e-7ac278ae5be8]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a48a2e4-cc15-4ff8-b36a-6f5a6ddbacfc tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a27d771-d223-4c36-a5d8-316cefffff36]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99ef1578-524a-4477-bdaa-1439e94893c3 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a48a2e4-cc15-4ff8-b36a-6f5a6ddbacfc tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99ef1578-524a-4477-bdaa-1439e94893c3 (non-flash)
Nov 15 08:33:50 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a48a2e4-cc15-4ff8-b36a-6f5a6ddbacfc tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99ef1578-524a-4477-bdaa-1439e94893c3 (non-flash)
Nov 15 08:33:50 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-1a48a2e4-cc15-4ff8-b36a-6f5a6ddbacfc tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99ef1578-524a-4477-bdaa-1439e94893c3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a48a2e4-cc15-4ff8-b36a-6f5a6ddbacfc tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Connected to 172.16.0.220:3260 {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-1a48a2e4-cc15-4ff8-b36a-6f5a6ddbacfc tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=95467) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-1a48a2e4-cc15-4ff8-b36a-6f5a6ddbacfc tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=95467) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[709721d5-27f4-4fb9-9d01-4a945a985f31]: (4, ('- - 0', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-1a48a2e4-cc15-4ff8-b36a-6f5a6ddbacfc tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:33:50 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a48a2e4-cc15-4ff8-b36a-6f5a6ddbacfc tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:99ef1578-524a-4477-bdaa-1439e94893c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XPHlZRIY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 08:33:51 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-1a48a2e4-cc15-4ff8-b36a-6f5a6ddbacfc tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:33:51 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a48a2e4-cc15-4ff8-b36a-6f5a6ddbacfc tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '26266643931323833', 'path': '/dev/sdb'} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:33:51 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a48a2e4-cc15-4ff8-b36a-6f5a6ddbacfc tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266643931323833', 'path': '/dev/sdb'} {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 08:33:51 user nova-compute[95467]: DEBUG nova.objects.instance [None req-1a48a2e4-cc15-4ff8-b36a-6f5a6ddbacfc tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Lazy-loading 'flavor' on Instance uuid e378dc0e-8898-4895-884f-6c3e3f328bee {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:33:51 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:33:51 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-1a48a2e4-cc15-4ff8-b36a-6f5a6ddbacfc tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 08:33:51 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:33:51 user nova-compute[95467]:   <source dev="/dev/sdb"/>
Nov 15 08:33:51 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:33:51 user nova-compute[95467]:   <serial>99ef1578-524a-4477-bdaa-1439e94893c3</serial>
Nov 15 08:33:51 user nova-compute[95467]: </disk>
Nov 15 08:33:51 user nova-compute[95467]:  {{(pid=95467) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 08:33:51 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:33:51 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:33:51 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:33:51 user nova-compute[95467]: DEBUG nova.compute.manager [req-c2c0f114-882e-4f45-a9a1-7e8faca5ff9d req-62f64124-158f-4902-99dc-fd87ad7fb5e4 service nova] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Received event network-vif-plugged-469317c8-e304-434f-aa57-d791c555d494 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:33:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-c2c0f114-882e-4f45-a9a1-7e8faca5ff9d req-62f64124-158f-4902-99dc-fd87ad7fb5e4 service nova] Acquiring lock "c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:33:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-c2c0f114-882e-4f45-a9a1-7e8faca5ff9d req-62f64124-158f-4902-99dc-fd87ad7fb5e4 service nova] Lock "c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:33:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-c2c0f114-882e-4f45-a9a1-7e8faca5ff9d req-62f64124-158f-4902-99dc-fd87ad7fb5e4 service nova] Lock "c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:33:51 user nova-compute[95467]: DEBUG nova.compute.manager [req-c2c0f114-882e-4f45-a9a1-7e8faca5ff9d req-62f64124-158f-4902-99dc-fd87ad7fb5e4 service nova] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] No waiting events found dispatching network-vif-plugged-469317c8-e304-434f-aa57-d791c555d494 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:33:51 user nova-compute[95467]: WARNING nova.compute.manager [req-c2c0f114-882e-4f45-a9a1-7e8faca5ff9d req-62f64124-158f-4902-99dc-fd87ad7fb5e4 service nova] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Received unexpected event network-vif-plugged-469317c8-e304-434f-aa57-d791c555d494 for instance with vm_state building and task_state spawning.
Nov 15 08:33:52 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:33:52 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:33:52 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-1a48a2e4-cc15-4ff8-b36a-6f5a6ddbacfc tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:33:52 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-1a48a2e4-cc15-4ff8-b36a-6f5a6ddbacfc tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] No BDM found with device name vdb, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:33:52 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-1a48a2e4-cc15-4ff8-b36a-6f5a6ddbacfc tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] No VIF found with MAC fa:16:3e:d1:56:fd, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:33:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-1a48a2e4-cc15-4ff8-b36a-6f5a6ddbacfc tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Lock "e378dc0e-8898-4895-884f-6c3e3f328bee" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.264s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:33:52 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:33:52 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=95467) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 08:33:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:33:53 user nova-compute[95467]: DEBUG nova.compute.manager [req-31c5ef75-0708-473f-b5a4-78560918190f req-f076ff14-fd84-48e3-a8c1-bd33c4203161 service nova] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Received event network-vif-plugged-469317c8-e304-434f-aa57-d791c555d494 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:33:53 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-31c5ef75-0708-473f-b5a4-78560918190f req-f076ff14-fd84-48e3-a8c1-bd33c4203161 service nova] Acquiring lock "c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:33:53 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-31c5ef75-0708-473f-b5a4-78560918190f req-f076ff14-fd84-48e3-a8c1-bd33c4203161 service nova] Lock "c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:33:53 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-31c5ef75-0708-473f-b5a4-78560918190f req-f076ff14-fd84-48e3-a8c1-bd33c4203161 service nova] Lock "c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:33:53 user nova-compute[95467]: DEBUG nova.compute.manager [req-31c5ef75-0708-473f-b5a4-78560918190f req-f076ff14-fd84-48e3-a8c1-bd33c4203161 service nova] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] No waiting events found dispatching network-vif-plugged-469317c8-e304-434f-aa57-d791c555d494 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:33:53 user nova-compute[95467]: WARNING nova.compute.manager [req-31c5ef75-0708-473f-b5a4-78560918190f req-f076ff14-fd84-48e3-a8c1-bd33c4203161 service nova] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Received unexpected event network-vif-plugged-469317c8-e304-434f-aa57-d791c555d494 for instance with vm_state building and task_state spawning.
Nov 15 08:33:53 user nova-compute[95467]: DEBUG nova.compute.manager [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Instance event wait completed in 0 seconds for  {{(pid=95467) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 08:33:53 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Guest created on hypervisor {{(pid=95467) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 08:33:53 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Instance spawned successfully.
Nov 15 08:33:53 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 08:33:53 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Found default for hw_cdrom_bus of ide {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:33:53 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Found default for hw_disk_bus of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:33:53 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Found default for hw_input_bus of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:33:53 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Found default for hw_pointer_model of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:33:53 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Found default for hw_video_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:33:53 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Found default for hw_vif_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:33:53 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-ca05a15c-a334-411f-8ad9-b1ca04afd212 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Acquiring lock "e378dc0e-8898-4895-884f-6c3e3f328bee" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:33:53 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-ca05a15c-a334-411f-8ad9-b1ca04afd212 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Lock "e378dc0e-8898-4895-884f-6c3e3f328bee" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:33:54 user nova-compute[95467]: INFO nova.compute.manager [None req-ca05a15c-a334-411f-8ad9-b1ca04afd212 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] Detaching volume 99ef1578-524a-4477-bdaa-1439e94893c3
Nov 15 08:33:54 user nova-compute[95467]: INFO nova.compute.manager [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Took 6.09 seconds to spawn the instance on the hypervisor.
Nov 15 08:33:54 user nova-compute[95467]: DEBUG nova.compute.manager [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:33:54 user nova-compute[95467]: INFO nova.virt.block_device [None req-ca05a15c-a334-411f-8ad9-b1ca04afd212 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] Attempting to driver detach volume 99ef1578-524a-4477-bdaa-1439e94893c3 from mountpoint /dev/vdb
Nov 15 08:33:54 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-ca05a15c-a334-411f-8ad9-b1ca04afd212 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Attempting to detach device vdb from instance e378dc0e-8898-4895-884f-6c3e3f328bee from the persistent domain config. {{(pid=95467) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 08:33:54 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-ca05a15c-a334-411f-8ad9-b1ca04afd212 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 08:33:54 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:33:54 user nova-compute[95467]:   <source dev="/dev/sdb"/>
Nov 15 08:33:54 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:33:54 user nova-compute[95467]:   <serial>99ef1578-524a-4477-bdaa-1439e94893c3</serial>
Nov 15 08:33:54 user nova-compute[95467]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 08:33:54 user nova-compute[95467]: </disk>
Nov 15 08:33:54 user nova-compute[95467]:  {{(pid=95467) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 08:33:54 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-ca05a15c-a334-411f-8ad9-b1ca04afd212 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Successfully detached device vdb from instance e378dc0e-8898-4895-884f-6c3e3f328bee from the persistent domain config.
Nov 15 08:33:54 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-ca05a15c-a334-411f-8ad9-b1ca04afd212 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e378dc0e-8898-4895-884f-6c3e3f328bee from the live domain config. {{(pid=95467) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 08:33:54 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-ca05a15c-a334-411f-8ad9-b1ca04afd212 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 08:33:54 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:33:54 user nova-compute[95467]:   <source dev="/dev/sdb"/>
Nov 15 08:33:54 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:33:54 user nova-compute[95467]:   <serial>99ef1578-524a-4477-bdaa-1439e94893c3</serial>
Nov 15 08:33:54 user nova-compute[95467]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 08:33:54 user nova-compute[95467]: </disk>
Nov 15 08:33:54 user nova-compute[95467]:  {{(pid=95467) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 08:33:54 user nova-compute[95467]: INFO nova.compute.manager [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Took 6.73 seconds to build instance.
Nov 15 08:33:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-68d79d71-d688-4a91-ab5e-06bee7f0b132 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.847s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:33:54 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-ca05a15c-a334-411f-8ad9-b1ca04afd212 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e378dc0e-8898-4895-884f-6c3e3f328bee {{(pid=95467) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 08:33:54 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager.update_available_resource {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:33:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:33:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:33:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:33:54 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Auditing locally available compute resources for user (node: user) {{(pid=95467) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 08:33:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:33:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:33:54 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:33:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:33:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaa2d1c7-dbda-4bf2-8706-3e941b44b076/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:33:55 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:33:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaa2d1c7-dbda-4bf2-8706-3e941b44b076/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:33:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaa2d1c7-dbda-4bf2-8706-3e941b44b076/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:33:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaa2d1c7-dbda-4bf2-8706-3e941b44b076/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:33:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:33:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:33:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:33:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:33:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e378dc0e-8898-4895-884f-6c3e3f328bee/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:33:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e378dc0e-8898-4895-884f-6c3e3f328bee/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:33:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e378dc0e-8898-4895-884f-6c3e3f328bee/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:33:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e378dc0e-8898-4895-884f-6c3e3f328bee/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:33:56 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:33:56 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:33:56 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Hypervisor/Node resource view: name=user free_ram=8592MB free_disk=24.991897583007812GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=95467) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 08:33:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:33:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:33:56 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance aaa2d1c7-dbda-4bf2-8706-3e941b44b076 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:33:56 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance e378dc0e-8898-4895-884f-6c3e3f328bee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:33:56 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 2945f42b-62a1-44c5-be3b-f1dbe6826c0f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:33:56 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:33:56 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 08:33:56 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 08:33:56 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:33:56 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:33:57 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Compute_service record updated for user:user {{(pid=95467) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 08:33:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.287s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:33:58 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:33:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:33:59 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:33:59 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:34:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:34:00 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:34:00 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:34:00 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Starting heal instance info cache {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 08:34:00 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Rebuilding the list of instances to heal {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 08:34:00 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "refresh_cache-aaa2d1c7-dbda-4bf2-8706-3e941b44b076" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:34:00 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquired lock "refresh_cache-aaa2d1c7-dbda-4bf2-8706-3e941b44b076" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:34:00 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Forcefully refreshing network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 08:34:00 user nova-compute[95467]: DEBUG nova.objects.instance [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lazy-loading 'info_cache' on Instance uuid aaa2d1c7-dbda-4bf2-8706-3e941b44b076 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:34:01 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Updating instance_info_cache with network_info: [{"id": "6130058a-f78c-4f81-b4a8-233863e6ae8c", "address": "fa:16:3e:15:19:18", "network": {"id": "a0f0cb10-26c8-4299-8a7e-4d34cfd26c82", "bridge": "br-int", "label": "tempest-TestStampPattern-737883783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b4ba53c039b4d699865e97ea1105843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6130058a-f7", "ovs_interfaceid": "6130058a-f78c-4f81-b4a8-233863e6ae8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:34:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Releasing lock "refresh_cache-aaa2d1c7-dbda-4bf2-8706-3e941b44b076" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:34:01 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Updated the network info_cache for instance {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 08:34:01 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:34:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:34:05 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:34:06 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:34:07 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:34:08 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:34:10 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:34:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:34:14 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-ca05a15c-a334-411f-8ad9-b1ca04afd212 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e378dc0e-8898-4895-884f-6c3e3f328bee is timed out.
Nov 15 08:34:14 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-ca05a15c-a334-411f-8ad9-b1ca04afd212 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Successfully detached device vdb from instance e378dc0e-8898-4895-884f-6c3e3f328bee from the live domain config.
Nov 15 08:34:14 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca05a15c-a334-411f-8ad9-b1ca04afd212 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] calling os-brick to detach iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 08:34:14 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca05a15c-a334-411f-8ad9-b1ca04afd212 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, {'target_iqn': 'iqn.2010-10.org.openstack:99ef1578-524a-4477-bdaa-1439e94893c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XPHlZRIY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:34:14 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-ca05a15c-a334-411f-8ad9-b1ca04afd212 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:34:14 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-ca05a15c-a334-411f-8ad9-b1ca04afd212 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:34:14 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-ca05a15c-a334-411f-8ad9-b1ca04afd212 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:34:14 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:34:14 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:34:14 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[25cef80f-b6bb-4c11-be71-3868664bf19f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:99ef1578-524a-4477-bdaa-1439e94893c3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:34:14 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca05a15c-a334-411f-8ad9-b1ca04afd212 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 08:34:14 user nova-compute[95467]: No targets found.
Nov 15 08:34:14 user nova-compute[95467]: iSNS:
Nov 15 08:34:14 user nova-compute[95467]: No targets found.
Nov 15 08:34:14 user nova-compute[95467]: STATIC:
Nov 15 08:34:14 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:99ef1578-524a-4477-bdaa-1439e94893c3
Nov 15 08:34:14 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:34:14 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:34:14 user nova-compute[95467]: FIRMWARE:
Nov 15 08:34:14 user nova-compute[95467]: No targets found.
Nov 15 08:34:14 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:34:14 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca05a15c-a334-411f-8ad9-b1ca04afd212 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 08:34:14 user nova-compute[95467]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 08:34:14 user nova-compute[95467]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=95467) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 08:34:14 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca05a15c-a334-411f-8ad9-b1ca04afd212 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99ef1578-524a-4477-bdaa-1439e94893c3', 0)] {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 08:34:14 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:34:14 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:34:14 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d03529-2732-4ac1-8e68-b23580b25b7b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99ef1578-524a-4477-bdaa-1439e94893c3\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:34:14 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:34:14 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:34:14 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25b21e9-9a52-472e-8e88-61402024f480]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99ef1578-524a-4477-bdaa-1439e94893c3 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:34:14 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca05a15c-a334-411f-8ad9-b1ca04afd212 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99ef1578-524a-4477-bdaa-1439e94893c3 (non-flash)
Nov 15 08:34:14 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:34:14 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca05a15c-a334-411f-8ad9-b1ca04afd212 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99ef1578-524a-4477-bdaa-1439e94893c3 (non-flash)
Nov 15 08:34:14 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:34:14 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca05a15c-a334-411f-8ad9-b1ca04afd212 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efee2a8f880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99ef1578-524a-4477-bdaa-1439e94893c3'): ({'sdb'}, set())}) {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 08:34:14 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-ca05a15c-a334-411f-8ad9-b1ca04afd212 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Removing single pathed devices sdb {{(pid=95467) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 08:34:14 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:34:14 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:34:14 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[35722cac-f1c3-4103-8c7f-c3a5d3c13bfa]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:34:14 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:34:14 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:34:14 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[defed042-a094-42a6-9042-535eb7dfcb7f]: (4, ('ok\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:34:14 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-ca05a15c-a334-411f-8ad9-b1ca04afd212 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Flushing IO for device /dev/sdb {{(pid=95467) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 08:34:14 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:34:14 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:34:14 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d07208-4dfe-4182-9b3a-99664fc868ea]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:34:14 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-ca05a15c-a334-411f-8ad9-b1ca04afd212 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=95467) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 08:34:14 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:34:14 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:34:14 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b16091-588a-4b11-9027-5d43ab2b611b]: (4, ('1', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:34:14 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-ca05a15c-a334-411f-8ad9-b1ca04afd212 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 08:34:14 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-ca05a15c-a334-411f-8ad9-b1ca04afd212 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] SCSI volumes sdb have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 08:34:14 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca05a15c-a334-411f-8ad9-b1ca04afd212 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99ef1578-524a-4477-bdaa-1439e94893c3')] {{(pid=95467) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 08:34:14 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99ef1578-524a-4477-bdaa-1439e94893c3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:34:14 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99ef1578-524a-4477-bdaa-1439e94893c3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:34:14 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c985651-5651-43b9-abb8-08ca7e69ce70]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:34:14 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca05a15c-a334-411f-8ad9-b1ca04afd212 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:34:14 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99ef1578-524a-4477-bdaa-1439e94893c3 -p 172.16.0.220:3260 --logout {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:34:14 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99ef1578-524a-4477-bdaa-1439e94893c3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:34:14 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ef3434-2839-4885-a862-8a867242a66d]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:99ef1578-524a-4477-bdaa-1439e94893c3, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:99ef1578-524a-4477-bdaa-1439e94893c3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:34:14 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca05a15c-a334-411f-8ad9-b1ca04afd212 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:99ef1578-524a-4477-bdaa-1439e94893c3, portal: 172.16.0.220,3260]
Nov 15 08:34:14 user nova-compute[95467]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:99ef1578-524a-4477-bdaa-1439e94893c3, portal: 172.16.0.220,3260] successful.
Nov 15 08:34:14 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:34:14 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99ef1578-524a-4477-bdaa-1439e94893c3 -p 172.16.0.220:3260 --op delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:34:14 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99ef1578-524a-4477-bdaa-1439e94893c3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:34:14 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b285173d-992d-4497-b004-ac7c26525e6b]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:34:14 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca05a15c-a334-411f-8ad9-b1ca04afd212 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:34:14 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-ca05a15c-a334-411f-8ad9-b1ca04afd212 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:34:14 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca05a15c-a334-411f-8ad9-b1ca04afd212 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] <== disconnect_volume: return (289ms) None {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:34:14 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca05a15c-a334-411f-8ad9-b1ca04afd212 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] Disconnected iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 08:34:15 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:34:15 user nova-compute[95467]: DEBUG nova.objects.instance [None req-ca05a15c-a334-411f-8ad9-b1ca04afd212 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Lazy-loading 'flavor' on Instance uuid e378dc0e-8898-4895-884f-6c3e3f328bee {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:34:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-ca05a15c-a334-411f-8ad9-b1ca04afd212 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Lock "e378dc0e-8898-4895-884f-6c3e3f328bee" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.660s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:34:18 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:34:20 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:34:23 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:34:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:34:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:34:30 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:34:35 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:34:35 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:34:35 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=95467) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 08:34:35 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:34:35 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:34:35 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:34:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:34:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:34:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=95467) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 08:34:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:34:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:34:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:34:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:34:44 user nova-compute[95467]: DEBUG nova.compute.manager [req-e07c340a-8542-43a8-9e5b-4082aab34c31 req-6b095bb8-2671-4a70-9a57-e431ef82c0b8 service nova] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] Received event network-changed-cac0d932-a57e-4170-9779-4f574a7a88e0 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:34:44 user nova-compute[95467]: DEBUG nova.compute.manager [req-e07c340a-8542-43a8-9e5b-4082aab34c31 req-6b095bb8-2671-4a70-9a57-e431ef82c0b8 service nova] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] Refreshing instance network info cache due to event network-changed-cac0d932-a57e-4170-9779-4f574a7a88e0. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:34:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-e07c340a-8542-43a8-9e5b-4082aab34c31 req-6b095bb8-2671-4a70-9a57-e431ef82c0b8 service nova] Acquiring lock "refresh_cache-e378dc0e-8898-4895-884f-6c3e3f328bee" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:34:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-e07c340a-8542-43a8-9e5b-4082aab34c31 req-6b095bb8-2671-4a70-9a57-e431ef82c0b8 service nova] Acquired lock "refresh_cache-e378dc0e-8898-4895-884f-6c3e3f328bee" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:34:44 user nova-compute[95467]: DEBUG nova.network.neutron [req-e07c340a-8542-43a8-9e5b-4082aab34c31 req-6b095bb8-2671-4a70-9a57-e431ef82c0b8 service nova] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] Refreshing network info cache for port cac0d932-a57e-4170-9779-4f574a7a88e0 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:34:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-92e2de06-ff01-457f-b84d-05a17125702b tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Acquiring lock "e378dc0e-8898-4895-884f-6c3e3f328bee" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:34:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-92e2de06-ff01-457f-b84d-05a17125702b tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Lock "e378dc0e-8898-4895-884f-6c3e3f328bee" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:34:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-92e2de06-ff01-457f-b84d-05a17125702b tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Acquiring lock "e378dc0e-8898-4895-884f-6c3e3f328bee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:34:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-92e2de06-ff01-457f-b84d-05a17125702b tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Lock "e378dc0e-8898-4895-884f-6c3e3f328bee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:34:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-92e2de06-ff01-457f-b84d-05a17125702b tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Lock "e378dc0e-8898-4895-884f-6c3e3f328bee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:34:44 user nova-compute[95467]: INFO nova.compute.manager [None req-92e2de06-ff01-457f-b84d-05a17125702b tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] Terminating instance
Nov 15 08:34:44 user nova-compute[95467]: DEBUG nova.compute.manager [None req-92e2de06-ff01-457f-b84d-05a17125702b tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] Start destroying the instance on the hypervisor. {{(pid=95467) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 08:34:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:34:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:34:45 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:34:45 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:34:45 user nova-compute[95467]: DEBUG nova.network.neutron [req-e07c340a-8542-43a8-9e5b-4082aab34c31 req-6b095bb8-2671-4a70-9a57-e431ef82c0b8 service nova] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] Updated VIF entry in instance network info cache for port cac0d932-a57e-4170-9779-4f574a7a88e0. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:34:45 user nova-compute[95467]: DEBUG nova.network.neutron [req-e07c340a-8542-43a8-9e5b-4082aab34c31 req-6b095bb8-2671-4a70-9a57-e431ef82c0b8 service nova] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] Updating instance_info_cache with network_info: [{"id": "cac0d932-a57e-4170-9779-4f574a7a88e0", "address": "fa:16:3e:d1:56:fd", "network": {"id": "a0f0cb10-26c8-4299-8a7e-4d34cfd26c82", "bridge": "br-int", "label": "tempest-TestStampPattern-737883783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b4ba53c039b4d699865e97ea1105843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcac0d932-a5", "ovs_interfaceid": "cac0d932-a57e-4170-9779-4f574a7a88e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:34:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-e07c340a-8542-43a8-9e5b-4082aab34c31 req-6b095bb8-2671-4a70-9a57-e431ef82c0b8 service nova] Releasing lock "refresh_cache-e378dc0e-8898-4895-884f-6c3e3f328bee" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:34:45 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:34:45 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:34:45 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:34:45 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] Instance destroyed successfully.
Nov 15 08:34:45 user nova-compute[95467]: DEBUG nova.objects.instance [None req-92e2de06-ff01-457f-b84d-05a17125702b tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Lazy-loading 'resources' on Instance uuid e378dc0e-8898-4895-884f-6c3e3f328bee {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:34:45 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-92e2de06-ff01-457f-b84d-05a17125702b tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:31:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1292692666',display_name='tempest-TestStampPattern-server-1292692666',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1292692666',id=48,image_ref='02991598-b01c-4ef4-8aed-7327cf0d7be3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGn0oxsNrNpRwH5qXJYkx21obo8Lj9sdybiQDlMglXKMhHyYV0IVC0OwmijdhcVEz8KfHXfjwjg/GO8OGaIkn6LxI/No3ftDsuwo7JsF5I0wAs7c8mGozFfZJ8NKgWtVJA==',key_name='tempest-TestStampPattern-1164290551',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:32:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b4ba53c039b4d699865e97ea1105843',ramdisk_id='',reservation_id='r-0ostgia2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='aaa2d1c7-dbda-4bf2-8706-3e941b44b076',image_min_disk='1',image_min_ram='0',image_owner_id='0b4ba53c039b4d699865e97ea1105843',image_owner_project_name='tempest-TestStampPattern-89436842',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-89436842-project-member',image_user_id='0b1403873af04f78a6c2cbadcec38867',owner_project_name='tempest-TestStampPattern-89436842',owner_user_name='tempest-TestStampPattern-89436842-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:32:01Z,user_data=None,user_id='0b1403873af04f78a6c2cbadcec38867',uuid=e378dc0e-8898-4895-884f-6c3e3f328bee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cac0d932-a57e-4170-9779-4f574a7a88e0", "address": "fa:16:3e:d1:56:fd", "network": {"id": "a0f0cb10-26c8-4299-8a7e-4d34cfd26c82", "bridge": "br-int", "label": "tempest-TestStampPattern-737883783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b4ba53c039b4d699865e97ea1105843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcac0d932-a5", "ovs_interfaceid": "cac0d932-a57e-4170-9779-4f574a7a88e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:34:45 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-92e2de06-ff01-457f-b84d-05a17125702b tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Converting VIF {"id": "cac0d932-a57e-4170-9779-4f574a7a88e0", "address": "fa:16:3e:d1:56:fd", "network": {"id": "a0f0cb10-26c8-4299-8a7e-4d34cfd26c82", "bridge": "br-int", "label": "tempest-TestStampPattern-737883783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b4ba53c039b4d699865e97ea1105843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcac0d932-a5", "ovs_interfaceid": "cac0d932-a57e-4170-9779-4f574a7a88e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:34:45 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-92e2de06-ff01-457f-b84d-05a17125702b tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:56:fd,bridge_name='br-int',has_traffic_filtering=True,id=cac0d932-a57e-4170-9779-4f574a7a88e0,network=Network(a0f0cb10-26c8-4299-8a7e-4d34cfd26c82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcac0d932-a5') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:34:45 user nova-compute[95467]: DEBUG os_vif [None req-92e2de06-ff01-457f-b84d-05a17125702b tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:56:fd,bridge_name='br-int',has_traffic_filtering=True,id=cac0d932-a57e-4170-9779-4f574a7a88e0,network=Network(a0f0cb10-26c8-4299-8a7e-4d34cfd26c82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcac0d932-a5') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:34:45 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:34:45 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcac0d932-a5, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:34:45 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:34:45 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:34:45 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:34:45 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8ae4b7a2-4d07-462a-a898-1cb5ae0d8cf5) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:34:45 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:34:45 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:34:45 user nova-compute[95467]: INFO os_vif [None req-92e2de06-ff01-457f-b84d-05a17125702b tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:56:fd,bridge_name='br-int',has_traffic_filtering=True,id=cac0d932-a57e-4170-9779-4f574a7a88e0,network=Network(a0f0cb10-26c8-4299-8a7e-4d34cfd26c82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcac0d932-a5')
Nov 15 08:34:45 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-92e2de06-ff01-457f-b84d-05a17125702b tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] Deleting instance files /opt/stack/data/nova/instances/e378dc0e-8898-4895-884f-6c3e3f328bee_del
Nov 15 08:34:45 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-92e2de06-ff01-457f-b84d-05a17125702b tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] Deletion of /opt/stack/data/nova/instances/e378dc0e-8898-4895-884f-6c3e3f328bee_del complete
Nov 15 08:34:45 user nova-compute[95467]: INFO nova.compute.manager [None req-92e2de06-ff01-457f-b84d-05a17125702b tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 15 08:34:45 user nova-compute[95467]: DEBUG oslo.service.loopingcall [None req-92e2de06-ff01-457f-b84d-05a17125702b tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=95467) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 08:34:45 user nova-compute[95467]: DEBUG nova.compute.manager [-] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] Deallocating network for instance {{(pid=95467) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 08:34:45 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] deallocate_for_instance() {{(pid=95467) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 08:34:46 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:34:46 user nova-compute[95467]: INFO nova.compute.manager [-] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] Took 0.44 seconds to deallocate network for instance.
Nov 15 08:34:46 user nova-compute[95467]: DEBUG nova.compute.manager [req-c52ca7ed-2c10-4d47-94bf-63418dd53877 req-ab49b179-a0aa-4bbf-bbc5-a3fbb3a3d6c9 service nova] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] Received event network-vif-deleted-cac0d932-a57e-4170-9779-4f574a7a88e0 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:34:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-92e2de06-ff01-457f-b84d-05a17125702b tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:34:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-92e2de06-ff01-457f-b84d-05a17125702b tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:34:46 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-92e2de06-ff01-457f-b84d-05a17125702b tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:34:46 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-92e2de06-ff01-457f-b84d-05a17125702b tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:34:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-92e2de06-ff01-457f-b84d-05a17125702b tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.175s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:34:46 user nova-compute[95467]: INFO nova.scheduler.client.report [None req-92e2de06-ff01-457f-b84d-05a17125702b tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Deleted allocations for instance e378dc0e-8898-4895-884f-6c3e3f328bee
Nov 15 08:34:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-92e2de06-ff01-457f-b84d-05a17125702b tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Lock "e378dc0e-8898-4895-884f-6c3e3f328bee" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.696s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:34:46 user nova-compute[95467]: DEBUG nova.compute.manager [req-e0a39f14-0ba6-4308-9312-65180a83a5e5 req-c6e3e25d-de7f-4039-9449-3e3721e4ad49 service nova] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] Received event network-vif-unplugged-cac0d932-a57e-4170-9779-4f574a7a88e0 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:34:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-e0a39f14-0ba6-4308-9312-65180a83a5e5 req-c6e3e25d-de7f-4039-9449-3e3721e4ad49 service nova] Acquiring lock "e378dc0e-8898-4895-884f-6c3e3f328bee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:34:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-e0a39f14-0ba6-4308-9312-65180a83a5e5 req-c6e3e25d-de7f-4039-9449-3e3721e4ad49 service nova] Lock "e378dc0e-8898-4895-884f-6c3e3f328bee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:34:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-e0a39f14-0ba6-4308-9312-65180a83a5e5 req-c6e3e25d-de7f-4039-9449-3e3721e4ad49 service nova] Lock "e378dc0e-8898-4895-884f-6c3e3f328bee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:34:46 user nova-compute[95467]: DEBUG nova.compute.manager [req-e0a39f14-0ba6-4308-9312-65180a83a5e5 req-c6e3e25d-de7f-4039-9449-3e3721e4ad49 service nova] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] No waiting events found dispatching network-vif-unplugged-cac0d932-a57e-4170-9779-4f574a7a88e0 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:34:46 user nova-compute[95467]: WARNING nova.compute.manager [req-e0a39f14-0ba6-4308-9312-65180a83a5e5 req-c6e3e25d-de7f-4039-9449-3e3721e4ad49 service nova] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] Received unexpected event network-vif-unplugged-cac0d932-a57e-4170-9779-4f574a7a88e0 for instance with vm_state deleted and task_state None.
Nov 15 08:34:46 user nova-compute[95467]: DEBUG nova.compute.manager [req-e0a39f14-0ba6-4308-9312-65180a83a5e5 req-c6e3e25d-de7f-4039-9449-3e3721e4ad49 service nova] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] Received event network-vif-plugged-cac0d932-a57e-4170-9779-4f574a7a88e0 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:34:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-e0a39f14-0ba6-4308-9312-65180a83a5e5 req-c6e3e25d-de7f-4039-9449-3e3721e4ad49 service nova] Acquiring lock "e378dc0e-8898-4895-884f-6c3e3f328bee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:34:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-e0a39f14-0ba6-4308-9312-65180a83a5e5 req-c6e3e25d-de7f-4039-9449-3e3721e4ad49 service nova] Lock "e378dc0e-8898-4895-884f-6c3e3f328bee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:34:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-e0a39f14-0ba6-4308-9312-65180a83a5e5 req-c6e3e25d-de7f-4039-9449-3e3721e4ad49 service nova] Lock "e378dc0e-8898-4895-884f-6c3e3f328bee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:34:46 user nova-compute[95467]: DEBUG nova.compute.manager [req-e0a39f14-0ba6-4308-9312-65180a83a5e5 req-c6e3e25d-de7f-4039-9449-3e3721e4ad49 service nova] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] No waiting events found dispatching network-vif-plugged-cac0d932-a57e-4170-9779-4f574a7a88e0 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:34:46 user nova-compute[95467]: WARNING nova.compute.manager [req-e0a39f14-0ba6-4308-9312-65180a83a5e5 req-c6e3e25d-de7f-4039-9449-3e3721e4ad49 service nova] [instance: e378dc0e-8898-4895-884f-6c3e3f328bee] Received unexpected event network-vif-plugged-cac0d932-a57e-4170-9779-4f574a7a88e0 for instance with vm_state deleted and task_state None.
Nov 15 08:34:50 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:34:52 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:34:52 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=95467) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 08:34:55 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:34:55 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:34:56 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager.update_available_resource {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:34:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:34:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:34:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:34:56 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Auditing locally available compute resources for user (node: user) {{(pid=95467) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 08:34:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:34:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:34:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:34:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:34:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaa2d1c7-dbda-4bf2-8706-3e941b44b076/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:34:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaa2d1c7-dbda-4bf2-8706-3e941b44b076/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:34:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaa2d1c7-dbda-4bf2-8706-3e941b44b076/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:34:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaa2d1c7-dbda-4bf2-8706-3e941b44b076/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:34:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:34:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:34:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:34:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:34:58 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:34:58 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:34:58 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Hypervisor/Node resource view: name=user free_ram=8714MB free_disk=24.93665313720703GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=95467) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 08:34:58 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:34:58 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:34:58 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance aaa2d1c7-dbda-4bf2-8706-3e941b44b076 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:34:58 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 2945f42b-62a1-44c5-be3b-f1dbe6826c0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:34:58 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:34:58 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 08:34:58 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 08:34:58 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:34:58 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:34:58 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Compute_service record updated for user:user {{(pid=95467) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 08:34:58 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.262s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:35:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:35:02 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:35:02 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Starting heal instance info cache {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 08:35:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "refresh_cache-2945f42b-62a1-44c5-be3b-f1dbe6826c0f" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:35:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquired lock "refresh_cache-2945f42b-62a1-44c5-be3b-f1dbe6826c0f" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:35:02 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Forcefully refreshing network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 08:35:03 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Updating instance_info_cache with network_info: [{"id": "27b8a52f-50f2-42e6-9c9f-9b74f9778096", "address": "fa:16:3e:81:ba:80", "network": {"id": "26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1542679712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9a636c8b7074bd19eeee608156f8568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b8a52f-50", "ovs_interfaceid": "27b8a52f-50f2-42e6-9c9f-9b74f9778096", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:35:03 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Releasing lock "refresh_cache-2945f42b-62a1-44c5-be3b-f1dbe6826c0f" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:35:03 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Updated the network info_cache for instance {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 08:35:03 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:35:03 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:35:03 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:35:03 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:35:05 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:35:07 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:35:10 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:35:15 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:35:20 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:35:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:35:28 user nova-compute[95467]: DEBUG nova.compute.manager [req-7a3c7883-5640-4524-b503-85f87b6dc5f5 req-ffad8d65-7181-4568-bfcf-94820aaabea7 service nova] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Received event network-changed-27b8a52f-50f2-42e6-9c9f-9b74f9778096 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:35:28 user nova-compute[95467]: DEBUG nova.compute.manager [req-7a3c7883-5640-4524-b503-85f87b6dc5f5 req-ffad8d65-7181-4568-bfcf-94820aaabea7 service nova] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Refreshing instance network info cache due to event network-changed-27b8a52f-50f2-42e6-9c9f-9b74f9778096. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:35:28 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-7a3c7883-5640-4524-b503-85f87b6dc5f5 req-ffad8d65-7181-4568-bfcf-94820aaabea7 service nova] Acquiring lock "refresh_cache-2945f42b-62a1-44c5-be3b-f1dbe6826c0f" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:35:28 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-7a3c7883-5640-4524-b503-85f87b6dc5f5 req-ffad8d65-7181-4568-bfcf-94820aaabea7 service nova] Acquired lock "refresh_cache-2945f42b-62a1-44c5-be3b-f1dbe6826c0f" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:35:28 user nova-compute[95467]: DEBUG nova.network.neutron [req-7a3c7883-5640-4524-b503-85f87b6dc5f5 req-ffad8d65-7181-4568-bfcf-94820aaabea7 service nova] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Refreshing network info cache for port 27b8a52f-50f2-42e6-9c9f-9b74f9778096 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:35:29 user nova-compute[95467]: DEBUG nova.network.neutron [req-7a3c7883-5640-4524-b503-85f87b6dc5f5 req-ffad8d65-7181-4568-bfcf-94820aaabea7 service nova] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Updated VIF entry in instance network info cache for port 27b8a52f-50f2-42e6-9c9f-9b74f9778096. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:35:29 user nova-compute[95467]: DEBUG nova.network.neutron [req-7a3c7883-5640-4524-b503-85f87b6dc5f5 req-ffad8d65-7181-4568-bfcf-94820aaabea7 service nova] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Updating instance_info_cache with network_info: [{"id": "27b8a52f-50f2-42e6-9c9f-9b74f9778096", "address": "fa:16:3e:81:ba:80", "network": {"id": "26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1542679712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9a636c8b7074bd19eeee608156f8568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b8a52f-50", "ovs_interfaceid": "27b8a52f-50f2-42e6-9c9f-9b74f9778096", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:35:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-7a3c7883-5640-4524-b503-85f87b6dc5f5 req-ffad8d65-7181-4568-bfcf-94820aaabea7 service nova] Releasing lock "refresh_cache-2945f42b-62a1-44c5-be3b-f1dbe6826c0f" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:35:30 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:35:30 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-940bdddc-230e-44dd-b2cd-630bd381f789 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Acquiring lock "2945f42b-62a1-44c5-be3b-f1dbe6826c0f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:35:30 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-940bdddc-230e-44dd-b2cd-630bd381f789 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "2945f42b-62a1-44c5-be3b-f1dbe6826c0f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:35:30 user nova-compute[95467]: DEBUG nova.objects.instance [None req-940bdddc-230e-44dd-b2cd-630bd381f789 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lazy-loading 'flavor' on Instance uuid 2945f42b-62a1-44c5-be3b-f1dbe6826c0f {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:35:30 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-940bdddc-230e-44dd-b2cd-630bd381f789 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "2945f42b-62a1-44c5-be3b-f1dbe6826c0f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:35:31 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-940bdddc-230e-44dd-b2cd-630bd381f789 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Acquiring lock "2945f42b-62a1-44c5-be3b-f1dbe6826c0f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:35:31 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-940bdddc-230e-44dd-b2cd-630bd381f789 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "2945f42b-62a1-44c5-be3b-f1dbe6826c0f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:35:31 user nova-compute[95467]: INFO nova.compute.manager [None req-940bdddc-230e-44dd-b2cd-630bd381f789 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Attaching volume 5e85d95d-936c-4e74-b53a-9e1b77c68fb1 to /dev/vdb
Nov 15 08:35:31 user nova-compute[95467]: DEBUG os_brick.utils [None req-940bdddc-230e-44dd-b2cd-630bd381f789 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:35:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:35:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:35:31 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d99df67-7777-4334-8954-4c1e408c93c2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:882ae90641f\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:35:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:35:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:35:31 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c71fc3-37a6-4186-a6e9-e0039d1601a9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:35:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:35:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:35:31 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[975ba9cd-5f26-45a1-925c-2a9b4cdda3d4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:35:31 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd9d133-5f2b-461b-8411-76d79d8465bb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:35:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-940bdddc-230e-44dd-b2cd-630bd381f789 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Running cmd (subprocess): nvme version {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:35:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-940bdddc-230e-44dd-b2cd-630bd381f789 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] 'nvme version' failed. Not Retrying. {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:35:31 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.nvmeof [None req-940bdddc-230e-44dd-b2cd-630bd381f789 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] nvme not present on system {{(pid=95467) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 08:35:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:35:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:35:31 user nova-compute[95467]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 08:35:31 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee8f9f4-7282-4224-b6e8-7f943feafe97]: (4, '') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:35:31 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-940bdddc-230e-44dd-b2cd-630bd381f789 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=95467) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 08:35:31 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-940bdddc-230e-44dd-b2cd-630bd381f789 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 08:35:31 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-940bdddc-230e-44dd-b2cd-630bd381f789 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] LIGHTOS: no hostnqn found. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 08:35:31 user nova-compute[95467]: DEBUG os_brick.utils [None req-940bdddc-230e-44dd-b2cd-630bd381f789 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:882ae90641f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:35:31 user nova-compute[95467]: DEBUG nova.virt.block_device [None req-940bdddc-230e-44dd-b2cd-630bd381f789 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Updating existing volume attachment record: b126497b-f91e-46f1-a0b6-43d6a7f7a53e {{(pid=95467) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 08:35:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:35:35 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:35:35 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-940bdddc-230e-44dd-b2cd-630bd381f789 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Calling os-brick to attach iSCSI Volume {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 08:35:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-940bdddc-230e-44dd-b2cd-630bd381f789 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aXoYUDZA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:35:35 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-940bdddc-230e-44dd-b2cd-630bd381f789 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:35:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-940bdddc-230e-44dd-b2cd-630bd381f789 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:35:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-940bdddc-230e-44dd-b2cd-630bd381f789 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:35:35 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-940bdddc-230e-44dd-b2cd-630bd381f789 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:35:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-940bdddc-230e-44dd-b2cd-630bd381f789 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:35:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-940bdddc-230e-44dd-b2cd-630bd381f789 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:35:35 user nova-compute[95467]: INFO os_brick.initiator.connectors.iscsi [None req-940bdddc-230e-44dd-b2cd-630bd381f789 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 08:35:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 -p 172.16.0.220:3260 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:35:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:35:35 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[52bf1b83-dd68-4aa3-83c1-d1984a642eaa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:35:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-940bdddc-230e-44dd-b2cd-630bd381f789 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 08:35:35 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:35:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 -p 172.16.0.220:3260 --interface default --op new {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:35:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:35:35 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ae6a5d-1bf9-4eda-a0de-b97e87415a40]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1] added\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:35:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-940bdddc-230e-44dd-b2cd-630bd381f789 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1] added
Nov 15 08:35:35 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:35:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:35:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:35:35 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79c9f3b-edae-4632-8374-34710e755ee0]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:35:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-940bdddc-230e-44dd-b2cd-630bd381f789 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:35:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:35:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:35:35 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[38cd975f-afaf-4cd4-9b68-67d1222649b7]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:35:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-940bdddc-230e-44dd-b2cd-630bd381f789 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:35:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aXoYUDZA {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:35:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aXoYUDZA" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:35:35 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e02bd9-d7a4-418e-8a8a-2675970cfd79]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:35:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-940bdddc-230e-44dd-b2cd-630bd381f789 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aXoYUDZA'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:35:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:35:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:35:35 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cab6333-5b3b-46d5-b4c1-a86bb66c5c7f]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:35:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-940bdddc-230e-44dd-b2cd-630bd381f789 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:35:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:35:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:35:35 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[43586214-15b7-4643-b88b-4b04d83f6421]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:35:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-940bdddc-230e-44dd-b2cd-630bd381f789 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 08:35:35 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:35:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-940bdddc-230e-44dd-b2cd-630bd381f789 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 08:35:35 user nova-compute[95467]:  {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:35:35 user nova-compute[95467]: WARNING os_brick.initiator.connectors.iscsi [None req-940bdddc-230e-44dd-b2cd-630bd381f789 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 08:35:35 user nova-compute[95467]: 
Nov 15 08:35:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 -p 172.16.0.220:3260 --login {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:35:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:35:35 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f58d90-a02c-4360-ac88-f181d3bcc580]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:35:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-940bdddc-230e-44dd-b2cd-630bd381f789 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1, portal: 172.16.0.220,3260]
Nov 15 08:35:35 user nova-compute[95467]: Login to [iface: default, target: iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1, portal: 172.16.0.220,3260] successful.
Nov 15 08:35:35 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:35:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:35:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:35:35 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[1949395e-70fb-4ff5-920d-141fc9307489]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:35:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-940bdddc-230e-44dd-b2cd-630bd381f789 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:35:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:35:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:35:35 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae17476-d18a-48ba-9cd3-900d2772aecb]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:35:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-940bdddc-230e-44dd-b2cd-630bd381f789 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 (non-flash)
Nov 15 08:35:35 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:35:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-940bdddc-230e-44dd-b2cd-630bd381f789 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 (non-flash)
Nov 15 08:35:35 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:35:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-940bdddc-230e-44dd-b2cd-630bd381f789 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:35:35 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-940bdddc-230e-44dd-b2cd-630bd381f789 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Connected to 172.16.0.220:3260 {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 08:35:35 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-940bdddc-230e-44dd-b2cd-630bd381f789 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=95467) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 08:35:35 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-940bdddc-230e-44dd-b2cd-630bd381f789 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=95467) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 08:35:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:35:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:35:35 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb8d0ba-60f7-49fd-92c6-cfb87e6ac699]: (4, ('- - 0', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:35:35 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-940bdddc-230e-44dd-b2cd-630bd381f789 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: None {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:35:36 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-940bdddc-230e-44dd-b2cd-630bd381f789 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:35:36 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-940bdddc-230e-44dd-b2cd-630bd381f789 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aXoYUDZA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 08:35:36 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-940bdddc-230e-44dd-b2cd-630bd381f789 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:35:36 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-940bdddc-230e-44dd-b2cd-630bd381f789 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '26363643135346535', 'path': '/dev/sdb'} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:35:36 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-940bdddc-230e-44dd-b2cd-630bd381f789 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26363643135346535', 'path': '/dev/sdb'} {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 08:35:36 user nova-compute[95467]: DEBUG nova.objects.instance [None req-940bdddc-230e-44dd-b2cd-630bd381f789 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lazy-loading 'flavor' on Instance uuid 2945f42b-62a1-44c5-be3b-f1dbe6826c0f {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:35:36 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-940bdddc-230e-44dd-b2cd-630bd381f789 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 08:35:36 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:35:36 user nova-compute[95467]:   <source dev="/dev/sdb"/>
Nov 15 08:35:36 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:35:36 user nova-compute[95467]:   <serial>5e85d95d-936c-4e74-b53a-9e1b77c68fb1</serial>
Nov 15 08:35:36 user nova-compute[95467]: </disk>
Nov 15 08:35:36 user nova-compute[95467]:  {{(pid=95467) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 08:35:37 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-940bdddc-230e-44dd-b2cd-630bd381f789 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:35:37 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-940bdddc-230e-44dd-b2cd-630bd381f789 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] No BDM found with device name vdb, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:35:37 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-940bdddc-230e-44dd-b2cd-630bd381f789 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] No VIF found with MAC fa:16:3e:81:ba:80, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:35:37 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-940bdddc-230e-44dd-b2cd-630bd381f789 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "2945f42b-62a1-44c5-be3b-f1dbe6826c0f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.469s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:35:38 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:35:38 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0f4506f0-bdd5-4d48-b260-61c0d2ab846c tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Acquiring lock "2945f42b-62a1-44c5-be3b-f1dbe6826c0f" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:35:38 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0f4506f0-bdd5-4d48-b260-61c0d2ab846c tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "2945f42b-62a1-44c5-be3b-f1dbe6826c0f" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:35:38 user nova-compute[95467]: DEBUG nova.compute.manager [None req-0f4506f0-bdd5-4d48-b260-61c0d2ab846c tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:35:38 user nova-compute[95467]: DEBUG nova.compute.manager [None req-0f4506f0-bdd5-4d48-b260-61c0d2ab846c tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=95467) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 15 08:35:38 user nova-compute[95467]: DEBUG nova.objects.instance [None req-0f4506f0-bdd5-4d48-b260-61c0d2ab846c tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lazy-loading 'flavor' on Instance uuid 2945f42b-62a1-44c5-be3b-f1dbe6826c0f {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:35:38 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:35:38 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:35:38 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:35:38 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:35:39 user nova-compute[95467]: DEBUG nova.compute.manager [req-6ade4db9-245a-474d-bb0c-f7bb57b6ea40 req-97888c0e-32d2-466a-a11f-11a9407dcfc6 service nova] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Received event network-vif-unplugged-27b8a52f-50f2-42e6-9c9f-9b74f9778096 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:35:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-6ade4db9-245a-474d-bb0c-f7bb57b6ea40 req-97888c0e-32d2-466a-a11f-11a9407dcfc6 service nova] Acquiring lock "2945f42b-62a1-44c5-be3b-f1dbe6826c0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:35:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-6ade4db9-245a-474d-bb0c-f7bb57b6ea40 req-97888c0e-32d2-466a-a11f-11a9407dcfc6 service nova] Lock "2945f42b-62a1-44c5-be3b-f1dbe6826c0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:35:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-6ade4db9-245a-474d-bb0c-f7bb57b6ea40 req-97888c0e-32d2-466a-a11f-11a9407dcfc6 service nova] Lock "2945f42b-62a1-44c5-be3b-f1dbe6826c0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:35:39 user nova-compute[95467]: DEBUG nova.compute.manager [req-6ade4db9-245a-474d-bb0c-f7bb57b6ea40 req-97888c0e-32d2-466a-a11f-11a9407dcfc6 service nova] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] No waiting events found dispatching network-vif-unplugged-27b8a52f-50f2-42e6-9c9f-9b74f9778096 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:35:39 user nova-compute[95467]: WARNING nova.compute.manager [req-6ade4db9-245a-474d-bb0c-f7bb57b6ea40 req-97888c0e-32d2-466a-a11f-11a9407dcfc6 service nova] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Received unexpected event network-vif-unplugged-27b8a52f-50f2-42e6-9c9f-9b74f9778096 for instance with vm_state active and task_state powering-off.
Nov 15 08:35:39 user nova-compute[95467]: DEBUG nova.compute.manager [req-52a34485-70a8-406a-86cb-c8c5d395d62e req-36c4a03d-3546-45bd-93c6-733943e6ee55 service nova] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Received event network-changed-6130058a-f78c-4f81-b4a8-233863e6ae8c {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:35:39 user nova-compute[95467]: DEBUG nova.compute.manager [req-52a34485-70a8-406a-86cb-c8c5d395d62e req-36c4a03d-3546-45bd-93c6-733943e6ee55 service nova] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Refreshing instance network info cache due to event network-changed-6130058a-f78c-4f81-b4a8-233863e6ae8c. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:35:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-52a34485-70a8-406a-86cb-c8c5d395d62e req-36c4a03d-3546-45bd-93c6-733943e6ee55 service nova] Acquiring lock "refresh_cache-aaa2d1c7-dbda-4bf2-8706-3e941b44b076" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:35:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-52a34485-70a8-406a-86cb-c8c5d395d62e req-36c4a03d-3546-45bd-93c6-733943e6ee55 service nova] Acquired lock "refresh_cache-aaa2d1c7-dbda-4bf2-8706-3e941b44b076" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:35:39 user nova-compute[95467]: DEBUG nova.network.neutron [req-52a34485-70a8-406a-86cb-c8c5d395d62e req-36c4a03d-3546-45bd-93c6-733943e6ee55 service nova] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Refreshing network info cache for port 6130058a-f78c-4f81-b4a8-233863e6ae8c {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:35:39 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:35:39 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:35:39 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:35:39 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Instance destroyed successfully.
Nov 15 08:35:39 user nova-compute[95467]: DEBUG nova.compute.manager [None req-0f4506f0-bdd5-4d48-b260-61c0d2ab846c tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:35:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-ca7283fc-1ec6-4c22-9661-7418bf6c45c1 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Acquiring lock "aaa2d1c7-dbda-4bf2-8706-3e941b44b076" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:35:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-ca7283fc-1ec6-4c22-9661-7418bf6c45c1 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Lock "aaa2d1c7-dbda-4bf2-8706-3e941b44b076" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:35:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-ca7283fc-1ec6-4c22-9661-7418bf6c45c1 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Acquiring lock "aaa2d1c7-dbda-4bf2-8706-3e941b44b076-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:35:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-ca7283fc-1ec6-4c22-9661-7418bf6c45c1 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Lock "aaa2d1c7-dbda-4bf2-8706-3e941b44b076-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:35:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-ca7283fc-1ec6-4c22-9661-7418bf6c45c1 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Lock "aaa2d1c7-dbda-4bf2-8706-3e941b44b076-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:35:39 user nova-compute[95467]: INFO nova.compute.manager [None req-ca7283fc-1ec6-4c22-9661-7418bf6c45c1 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Terminating instance
Nov 15 08:35:39 user nova-compute[95467]: DEBUG nova.compute.manager [None req-ca7283fc-1ec6-4c22-9661-7418bf6c45c1 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Start destroying the instance on the hypervisor. {{(pid=95467) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 08:35:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-0f4506f0-bdd5-4d48-b260-61c0d2ab846c tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "2945f42b-62a1-44c5-be3b-f1dbe6826c0f" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.860s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:35:39 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:35:39 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:35:39 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:35:39 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:35:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f9ad9ef1-b20a-4683-a511-3ed3d9866747 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Acquiring lock "c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:35:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f9ad9ef1-b20a-4683-a511-3ed3d9866747 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:35:39 user nova-compute[95467]: DEBUG nova.objects.instance [None req-f9ad9ef1-b20a-4683-a511-3ed3d9866747 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lazy-loading 'flavor' on Instance uuid c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:35:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f9ad9ef1-b20a-4683-a511-3ed3d9866747 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:35:39 user nova-compute[95467]: DEBUG nova.network.neutron [req-52a34485-70a8-406a-86cb-c8c5d395d62e req-36c4a03d-3546-45bd-93c6-733943e6ee55 service nova] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Updated VIF entry in instance network info cache for port 6130058a-f78c-4f81-b4a8-233863e6ae8c. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:35:39 user nova-compute[95467]: DEBUG nova.network.neutron [req-52a34485-70a8-406a-86cb-c8c5d395d62e req-36c4a03d-3546-45bd-93c6-733943e6ee55 service nova] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Updating instance_info_cache with network_info: [{"id": "6130058a-f78c-4f81-b4a8-233863e6ae8c", "address": "fa:16:3e:15:19:18", "network": {"id": "a0f0cb10-26c8-4299-8a7e-4d34cfd26c82", "bridge": "br-int", "label": "tempest-TestStampPattern-737883783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b4ba53c039b4d699865e97ea1105843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6130058a-f7", "ovs_interfaceid": "6130058a-f78c-4f81-b4a8-233863e6ae8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:35:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-52a34485-70a8-406a-86cb-c8c5d395d62e req-36c4a03d-3546-45bd-93c6-733943e6ee55 service nova] Releasing lock "refresh_cache-aaa2d1c7-dbda-4bf2-8706-3e941b44b076" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:35:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f9ad9ef1-b20a-4683-a511-3ed3d9866747 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Acquiring lock "c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:35:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f9ad9ef1-b20a-4683-a511-3ed3d9866747 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:35:39 user nova-compute[95467]: INFO nova.compute.manager [None req-f9ad9ef1-b20a-4683-a511-3ed3d9866747 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Attaching volume df597122-35e7-4d3a-8ea0-b3c6073617d3 to /dev/vdb
Nov 15 08:35:40 user nova-compute[95467]: DEBUG os_brick.utils [None req-f9ad9ef1-b20a-4683-a511-3ed3d9866747 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:35:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:35:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:35:40 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed8154f-e9e8-417b-98bf-8a7f0e36a015]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:882ae90641f\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:35:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:35:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:35:40 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d314e86-533c-4928-9ac3-f978a4b7a602]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:35:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:35:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:35:40 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e7627c-382c-44c2-974e-3db980c04411]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:35:40 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75532d3-6bf1-4d21-b674-3ab8811c329d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:35:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-f9ad9ef1-b20a-4683-a511-3ed3d9866747 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Running cmd (subprocess): nvme version {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:35:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-f9ad9ef1-b20a-4683-a511-3ed3d9866747 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] 'nvme version' failed. Not Retrying. {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:35:40 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f9ad9ef1-b20a-4683-a511-3ed3d9866747 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] nvme not present on system {{(pid=95467) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 08:35:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:35:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:35:40 user nova-compute[95467]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 08:35:40 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[574eb9e2-92b1-4c05-a7af-aace3365aa40]: (4, '') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:35:40 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-f9ad9ef1-b20a-4683-a511-3ed3d9866747 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=95467) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 08:35:40 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-f9ad9ef1-b20a-4683-a511-3ed3d9866747 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 08:35:40 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-f9ad9ef1-b20a-4683-a511-3ed3d9866747 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] LIGHTOS: no hostnqn found. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 08:35:40 user nova-compute[95467]: DEBUG os_brick.utils [None req-f9ad9ef1-b20a-4683-a511-3ed3d9866747 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:882ae90641f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:35:40 user nova-compute[95467]: DEBUG nova.virt.block_device [None req-f9ad9ef1-b20a-4683-a511-3ed3d9866747 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Updating existing volume attachment record: 1dbc2c7b-1c8a-4b6c-9644-d3b705be20e8 {{(pid=95467) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 08:35:40 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Instance destroyed successfully.
Nov 15 08:35:40 user nova-compute[95467]: DEBUG nova.objects.instance [None req-ca7283fc-1ec6-4c22-9661-7418bf6c45c1 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Lazy-loading 'resources' on Instance uuid aaa2d1c7-dbda-4bf2-8706-3e941b44b076 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:35:40 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-ca7283fc-1ec6-4c22-9661-7418bf6c45c1 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:28:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-190117512',display_name='tempest-TestStampPattern-server-190117512',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-190117512',id=47,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGn0oxsNrNpRwH5qXJYkx21obo8Lj9sdybiQDlMglXKMhHyYV0IVC0OwmijdhcVEz8KfHXfjwjg/GO8OGaIkn6LxI/No3ftDsuwo7JsF5I0wAs7c8mGozFfZJ8NKgWtVJA==',key_name='tempest-TestStampPattern-1164290551',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:28:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b4ba53c039b4d699865e97ea1105843',ramdisk_id='',reservation_id='r-qb22x3mj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-89436842',owner_user_name='tempest-TestStampPattern-89436842-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:31:50Z,user_data=None,user_id='0b1403873af04f78a6c2cbadcec38867',uuid=aaa2d1c7-dbda-4bf2-8706-3e941b44b076,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6130058a-f78c-4f81-b4a8-233863e6ae8c", "address": "fa:16:3e:15:19:18", "network": {"id": "a0f0cb10-26c8-4299-8a7e-4d34cfd26c82", "bridge": "br-int", "label": "tempest-TestStampPattern-737883783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b4ba53c039b4d699865e97ea1105843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6130058a-f7", "ovs_interfaceid": "6130058a-f78c-4f81-b4a8-233863e6ae8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:35:40 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-ca7283fc-1ec6-4c22-9661-7418bf6c45c1 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Converting VIF {"id": "6130058a-f78c-4f81-b4a8-233863e6ae8c", "address": "fa:16:3e:15:19:18", "network": {"id": "a0f0cb10-26c8-4299-8a7e-4d34cfd26c82", "bridge": "br-int", "label": "tempest-TestStampPattern-737883783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b4ba53c039b4d699865e97ea1105843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6130058a-f7", "ovs_interfaceid": "6130058a-f78c-4f81-b4a8-233863e6ae8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:35:40 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-ca7283fc-1ec6-4c22-9661-7418bf6c45c1 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:19:18,bridge_name='br-int',has_traffic_filtering=True,id=6130058a-f78c-4f81-b4a8-233863e6ae8c,network=Network(a0f0cb10-26c8-4299-8a7e-4d34cfd26c82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6130058a-f7') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:35:40 user nova-compute[95467]: DEBUG os_vif [None req-ca7283fc-1ec6-4c22-9661-7418bf6c45c1 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:19:18,bridge_name='br-int',has_traffic_filtering=True,id=6130058a-f78c-4f81-b4a8-233863e6ae8c,network=Network(a0f0cb10-26c8-4299-8a7e-4d34cfd26c82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6130058a-f7') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:35:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:35:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6130058a-f7, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:35:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:35:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:35:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:35:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:35:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=05db1819-986f-4c8e-8a9b-7b61618fe96d) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:35:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:35:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:35:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:35:40 user nova-compute[95467]: INFO os_vif [None req-ca7283fc-1ec6-4c22-9661-7418bf6c45c1 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:19:18,bridge_name='br-int',has_traffic_filtering=True,id=6130058a-f78c-4f81-b4a8-233863e6ae8c,network=Network(a0f0cb10-26c8-4299-8a7e-4d34cfd26c82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6130058a-f7')
Nov 15 08:35:40 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-ca7283fc-1ec6-4c22-9661-7418bf6c45c1 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Deleting instance files /opt/stack/data/nova/instances/aaa2d1c7-dbda-4bf2-8706-3e941b44b076_del
Nov 15 08:35:40 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-ca7283fc-1ec6-4c22-9661-7418bf6c45c1 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Deletion of /opt/stack/data/nova/instances/aaa2d1c7-dbda-4bf2-8706-3e941b44b076_del complete
Nov 15 08:35:40 user nova-compute[95467]: INFO nova.compute.manager [None req-ca7283fc-1ec6-4c22-9661-7418bf6c45c1 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 15 08:35:40 user nova-compute[95467]: DEBUG oslo.service.loopingcall [None req-ca7283fc-1ec6-4c22-9661-7418bf6c45c1 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=95467) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 08:35:40 user nova-compute[95467]: DEBUG nova.compute.manager [-] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Deallocating network for instance {{(pid=95467) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 08:35:40 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] deallocate_for_instance() {{(pid=95467) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 08:35:41 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:35:41 user nova-compute[95467]: INFO nova.compute.manager [-] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Took 0.65 seconds to deallocate network for instance.
Nov 15 08:35:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-ca7283fc-1ec6-4c22-9661-7418bf6c45c1 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:35:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-ca7283fc-1ec6-4c22-9661-7418bf6c45c1 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:35:41 user nova-compute[95467]: DEBUG nova.compute.manager [req-725cd491-2e9e-4a87-ad95-148c47620cf3 req-802cbf42-8a19-4386-83d8-5de2b05b0a0a service nova] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Received event network-vif-deleted-6130058a-f78c-4f81-b4a8-233863e6ae8c {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:35:41 user nova-compute[95467]: DEBUG nova.compute.manager [req-5cfeb29e-32bb-4a6c-a1ae-ef57d48a2ce8 req-bde0c853-e69f-46b5-bf96-ebb2daf6eea6 service nova] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Received event network-vif-plugged-27b8a52f-50f2-42e6-9c9f-9b74f9778096 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:35:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-5cfeb29e-32bb-4a6c-a1ae-ef57d48a2ce8 req-bde0c853-e69f-46b5-bf96-ebb2daf6eea6 service nova] Acquiring lock "2945f42b-62a1-44c5-be3b-f1dbe6826c0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:35:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-5cfeb29e-32bb-4a6c-a1ae-ef57d48a2ce8 req-bde0c853-e69f-46b5-bf96-ebb2daf6eea6 service nova] Lock "2945f42b-62a1-44c5-be3b-f1dbe6826c0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:35:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-5cfeb29e-32bb-4a6c-a1ae-ef57d48a2ce8 req-bde0c853-e69f-46b5-bf96-ebb2daf6eea6 service nova] Lock "2945f42b-62a1-44c5-be3b-f1dbe6826c0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:35:41 user nova-compute[95467]: DEBUG nova.compute.manager [req-5cfeb29e-32bb-4a6c-a1ae-ef57d48a2ce8 req-bde0c853-e69f-46b5-bf96-ebb2daf6eea6 service nova] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] No waiting events found dispatching network-vif-plugged-27b8a52f-50f2-42e6-9c9f-9b74f9778096 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:35:41 user nova-compute[95467]: WARNING nova.compute.manager [req-5cfeb29e-32bb-4a6c-a1ae-ef57d48a2ce8 req-bde0c853-e69f-46b5-bf96-ebb2daf6eea6 service nova] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Received unexpected event network-vif-plugged-27b8a52f-50f2-42e6-9c9f-9b74f9778096 for instance with vm_state stopped and task_state None.
Nov 15 08:35:41 user nova-compute[95467]: DEBUG nova.compute.manager [req-5cfeb29e-32bb-4a6c-a1ae-ef57d48a2ce8 req-bde0c853-e69f-46b5-bf96-ebb2daf6eea6 service nova] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Received event network-vif-unplugged-6130058a-f78c-4f81-b4a8-233863e6ae8c {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:35:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-5cfeb29e-32bb-4a6c-a1ae-ef57d48a2ce8 req-bde0c853-e69f-46b5-bf96-ebb2daf6eea6 service nova] Acquiring lock "aaa2d1c7-dbda-4bf2-8706-3e941b44b076-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:35:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-5cfeb29e-32bb-4a6c-a1ae-ef57d48a2ce8 req-bde0c853-e69f-46b5-bf96-ebb2daf6eea6 service nova] Lock "aaa2d1c7-dbda-4bf2-8706-3e941b44b076-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:35:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-5cfeb29e-32bb-4a6c-a1ae-ef57d48a2ce8 req-bde0c853-e69f-46b5-bf96-ebb2daf6eea6 service nova] Lock "aaa2d1c7-dbda-4bf2-8706-3e941b44b076-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:35:41 user nova-compute[95467]: DEBUG nova.compute.manager [req-5cfeb29e-32bb-4a6c-a1ae-ef57d48a2ce8 req-bde0c853-e69f-46b5-bf96-ebb2daf6eea6 service nova] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] No waiting events found dispatching network-vif-unplugged-6130058a-f78c-4f81-b4a8-233863e6ae8c {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:35:41 user nova-compute[95467]: WARNING nova.compute.manager [req-5cfeb29e-32bb-4a6c-a1ae-ef57d48a2ce8 req-bde0c853-e69f-46b5-bf96-ebb2daf6eea6 service nova] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Received unexpected event network-vif-unplugged-6130058a-f78c-4f81-b4a8-233863e6ae8c for instance with vm_state deleted and task_state None.
Nov 15 08:35:41 user nova-compute[95467]: DEBUG nova.compute.manager [req-5cfeb29e-32bb-4a6c-a1ae-ef57d48a2ce8 req-bde0c853-e69f-46b5-bf96-ebb2daf6eea6 service nova] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Received event network-vif-plugged-6130058a-f78c-4f81-b4a8-233863e6ae8c {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:35:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-5cfeb29e-32bb-4a6c-a1ae-ef57d48a2ce8 req-bde0c853-e69f-46b5-bf96-ebb2daf6eea6 service nova] Acquiring lock "aaa2d1c7-dbda-4bf2-8706-3e941b44b076-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:35:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-5cfeb29e-32bb-4a6c-a1ae-ef57d48a2ce8 req-bde0c853-e69f-46b5-bf96-ebb2daf6eea6 service nova] Lock "aaa2d1c7-dbda-4bf2-8706-3e941b44b076-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:35:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-5cfeb29e-32bb-4a6c-a1ae-ef57d48a2ce8 req-bde0c853-e69f-46b5-bf96-ebb2daf6eea6 service nova] Lock "aaa2d1c7-dbda-4bf2-8706-3e941b44b076-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:35:41 user nova-compute[95467]: DEBUG nova.compute.manager [req-5cfeb29e-32bb-4a6c-a1ae-ef57d48a2ce8 req-bde0c853-e69f-46b5-bf96-ebb2daf6eea6 service nova] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] No waiting events found dispatching network-vif-plugged-6130058a-f78c-4f81-b4a8-233863e6ae8c {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:35:41 user nova-compute[95467]: WARNING nova.compute.manager [req-5cfeb29e-32bb-4a6c-a1ae-ef57d48a2ce8 req-bde0c853-e69f-46b5-bf96-ebb2daf6eea6 service nova] [instance: aaa2d1c7-dbda-4bf2-8706-3e941b44b076] Received unexpected event network-vif-plugged-6130058a-f78c-4f81-b4a8-233863e6ae8c for instance with vm_state deleted and task_state None.
Nov 15 08:35:41 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-ca7283fc-1ec6-4c22-9661-7418bf6c45c1 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:35:41 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-ca7283fc-1ec6-4c22-9661-7418bf6c45c1 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:35:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-ca7283fc-1ec6-4c22-9661-7418bf6c45c1 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.176s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:35:41 user nova-compute[95467]: INFO nova.scheduler.client.report [None req-ca7283fc-1ec6-4c22-9661-7418bf6c45c1 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Deleted allocations for instance aaa2d1c7-dbda-4bf2-8706-3e941b44b076
Nov 15 08:35:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-ca7283fc-1ec6-4c22-9661-7418bf6c45c1 tempest-TestStampPattern-89436842 tempest-TestStampPattern-89436842-project-member] Lock "aaa2d1c7-dbda-4bf2-8706-3e941b44b076" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.916s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:35:44 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9ad9ef1-b20a-4683-a511-3ed3d9866747 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Calling os-brick to attach iSCSI Volume {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 08:35:44 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ad9ef1-b20a-4683-a511-3ed3d9866747 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vloNywIR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:35:44 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-f9ad9ef1-b20a-4683-a511-3ed3d9866747 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:35:44 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-f9ad9ef1-b20a-4683-a511-3ed3d9866747 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:35:44 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-f9ad9ef1-b20a-4683-a511-3ed3d9866747 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:35:44 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-f9ad9ef1-b20a-4683-a511-3ed3d9866747 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:35:44 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-f9ad9ef1-b20a-4683-a511-3ed3d9866747 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:35:44 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-f9ad9ef1-b20a-4683-a511-3ed3d9866747 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:35:44 user nova-compute[95467]: INFO os_brick.initiator.connectors.iscsi [None req-f9ad9ef1-b20a-4683-a511-3ed3d9866747 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 08:35:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3 -p 172.16.0.220:3260 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:35:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:35:44 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d615f6c-8f0b-4cb8-abd1-5076e8d907ac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:35:44 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ad9ef1-b20a-4683-a511-3ed3d9866747 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 08:35:44 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:35:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3 -p 172.16.0.220:3260 --interface default --op new {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:35:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:35:44 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[06725ff0-c605-4177-a2bb-be1c5cfb8c02]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3] added\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:35:44 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ad9ef1-b20a-4683-a511-3ed3d9866747 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3] added
Nov 15 08:35:44 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:35:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:35:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:35:44 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb7f7e6-36e5-49f8-8b53-20b4f7be474f]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:35:44 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ad9ef1-b20a-4683-a511-3ed3d9866747 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:35:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:35:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:35:44 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c2788f-9f52-445b-9486-3e5ae8fd6c8c]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:35:44 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ad9ef1-b20a-4683-a511-3ed3d9866747 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:35:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vloNywIR {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:35:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vloNywIR" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:35:44 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[092c55c0-151c-4de9-a5ec-da584ce8cf56]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:35:44 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ad9ef1-b20a-4683-a511-3ed3d9866747 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vloNywIR'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:35:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:35:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:35:44 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5153e08-2267-42a4-95e1-4a9e8c609437]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:35:44 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ad9ef1-b20a-4683-a511-3ed3d9866747 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:35:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:35:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:35:44 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6139d59-33b5-49d5-bd64-f7ac3ce68a95]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:35:44 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ad9ef1-b20a-4683-a511-3ed3d9866747 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 (non-flash)
Nov 15 08:35:44 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:35:44 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ad9ef1-b20a-4683-a511-3ed3d9866747 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 (non-flash)
Nov 15 08:35:44 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:35:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3 -p 172.16.0.220:3260 --login {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:35:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:35:44 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb229ca-b410-41e4-bd9d-d62fb01ef987]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:35:44 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ad9ef1-b20a-4683-a511-3ed3d9866747 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3, portal: 172.16.0.220,3260]
Nov 15 08:35:44 user nova-compute[95467]: Login to [iface: default, target: iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3, portal: 172.16.0.220,3260] successful.
Nov 15 08:35:44 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:35:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:35:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:35:44 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a922b5-a7a9-4cad-b870-7664422e2626]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:35:44 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ad9ef1-b20a-4683-a511-3ed3d9866747 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:35:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:35:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:35:44 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[802c987b-2ff2-42f5-94f3-b2cd049f7d1c]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:35:44 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ad9ef1-b20a-4683-a511-3ed3d9866747 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 (non-flash)
Nov 15 08:35:44 user nova-compute[95467]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3 (non-flash)
Nov 15 08:35:44 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:35:44 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ad9ef1-b20a-4683-a511-3ed3d9866747 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 (non-flash)
Nov 15 08:35:44 user nova-compute[95467]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3 (non-flash)
Nov 15 08:35:44 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:35:44 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-f9ad9ef1-b20a-4683-a511-3ed3d9866747 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:35:44 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ad9ef1-b20a-4683-a511-3ed3d9866747 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Connected to 172.16.0.220:3260 {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 08:35:44 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-f9ad9ef1-b20a-4683-a511-3ed3d9866747 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] HCTL ('34', '-', '-', 0) found on session 58 with lun 0 {{(pid=95467) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 08:35:44 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-f9ad9ef1-b20a-4683-a511-3ed3d9866747 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=95467) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 08:35:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:35:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:35:44 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d3a310-3e1d-4728-81c3-6c5716a9618d]: (4, ('- - 0', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:35:44 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-f9ad9ef1-b20a-4683-a511-3ed3d9866747 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:35:44 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ad9ef1-b20a-4683-a511-3ed3d9866747 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vloNywIR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 08:35:45 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:35:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-f9ad9ef1-b20a-4683-a511-3ed3d9866747 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:35:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ad9ef1-b20a-4683-a511-3ed3d9866747 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23232616563343433', 'path': '/dev/sdc'} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:35:45 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9ad9ef1-b20a-4683-a511-3ed3d9866747 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23232616563343433', 'path': '/dev/sdc'} {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 08:35:45 user nova-compute[95467]: DEBUG nova.objects.instance [None req-f9ad9ef1-b20a-4683-a511-3ed3d9866747 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lazy-loading 'flavor' on Instance uuid c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:35:45 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-f9ad9ef1-b20a-4683-a511-3ed3d9866747 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 08:35:45 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:35:45 user nova-compute[95467]:   <source dev="/dev/sdc"/>
Nov 15 08:35:45 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:35:45 user nova-compute[95467]:   <serial>df597122-35e7-4d3a-8ea0-b3c6073617d3</serial>
Nov 15 08:35:45 user nova-compute[95467]: </disk>
Nov 15 08:35:45 user nova-compute[95467]:  {{(pid=95467) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 08:35:46 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-f9ad9ef1-b20a-4683-a511-3ed3d9866747 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:35:46 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-f9ad9ef1-b20a-4683-a511-3ed3d9866747 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] No BDM found with device name vdb, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:35:46 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-f9ad9ef1-b20a-4683-a511-3ed3d9866747 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] No VIF found with MAC fa:16:3e:4f:39:f3, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:35:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f9ad9ef1-b20a-4683-a511-3ed3d9866747 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.385s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:35:48 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:35:49 user nova-compute[95467]: DEBUG nova.compute.manager [req-c6f770ba-2170-4e47-a76e-0a399096831c req-0a2c5f9e-3fe7-4577-8661-ef5a30750ec4 service nova] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Received event network-changed-469317c8-e304-434f-aa57-d791c555d494 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:35:49 user nova-compute[95467]: DEBUG nova.compute.manager [req-c6f770ba-2170-4e47-a76e-0a399096831c req-0a2c5f9e-3fe7-4577-8661-ef5a30750ec4 service nova] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Refreshing instance network info cache due to event network-changed-469317c8-e304-434f-aa57-d791c555d494. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:35:49 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-c6f770ba-2170-4e47-a76e-0a399096831c req-0a2c5f9e-3fe7-4577-8661-ef5a30750ec4 service nova] Acquiring lock "refresh_cache-c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:35:49 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-c6f770ba-2170-4e47-a76e-0a399096831c req-0a2c5f9e-3fe7-4577-8661-ef5a30750ec4 service nova] Acquired lock "refresh_cache-c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:35:49 user nova-compute[95467]: DEBUG nova.network.neutron [req-c6f770ba-2170-4e47-a76e-0a399096831c req-0a2c5f9e-3fe7-4577-8661-ef5a30750ec4 service nova] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Refreshing network info cache for port 469317c8-e304-434f-aa57-d791c555d494 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:35:50 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:35:50 user nova-compute[95467]: DEBUG nova.network.neutron [req-c6f770ba-2170-4e47-a76e-0a399096831c req-0a2c5f9e-3fe7-4577-8661-ef5a30750ec4 service nova] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Updated VIF entry in instance network info cache for port 469317c8-e304-434f-aa57-d791c555d494. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:35:50 user nova-compute[95467]: DEBUG nova.network.neutron [req-c6f770ba-2170-4e47-a76e-0a399096831c req-0a2c5f9e-3fe7-4577-8661-ef5a30750ec4 service nova] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Updating instance_info_cache with network_info: [{"id": "469317c8-e304-434f-aa57-d791c555d494", "address": "fa:16:3e:4f:39:f3", "network": {"id": "d67049b6-2e91-4d1e-8e42-5388ef75521a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984085217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7355ea3588ae4c2f9242e63084008710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469317c8-e3", "ovs_interfaceid": "469317c8-e304-434f-aa57-d791c555d494", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:35:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-c6f770ba-2170-4e47-a76e-0a399096831c req-0a2c5f9e-3fe7-4577-8661-ef5a30750ec4 service nova] Releasing lock "refresh_cache-c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:35:51 user nova-compute[95467]: DEBUG nova.compute.manager [req-5e10abaf-2aa6-4e35-b75b-2e6126d07ee9 req-2f00c2cd-6b49-4649-b6fc-82f77626efc9 service nova] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Received event network-changed-469317c8-e304-434f-aa57-d791c555d494 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:35:51 user nova-compute[95467]: DEBUG nova.compute.manager [req-5e10abaf-2aa6-4e35-b75b-2e6126d07ee9 req-2f00c2cd-6b49-4649-b6fc-82f77626efc9 service nova] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Refreshing instance network info cache due to event network-changed-469317c8-e304-434f-aa57-d791c555d494. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:35:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-5e10abaf-2aa6-4e35-b75b-2e6126d07ee9 req-2f00c2cd-6b49-4649-b6fc-82f77626efc9 service nova] Acquiring lock "refresh_cache-c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:35:51 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-5e10abaf-2aa6-4e35-b75b-2e6126d07ee9 req-2f00c2cd-6b49-4649-b6fc-82f77626efc9 service nova] Acquired lock "refresh_cache-c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:35:51 user nova-compute[95467]: DEBUG nova.network.neutron [req-5e10abaf-2aa6-4e35-b75b-2e6126d07ee9 req-2f00c2cd-6b49-4649-b6fc-82f77626efc9 service nova] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Refreshing network info cache for port 469317c8-e304-434f-aa57-d791c555d494 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:35:52 user nova-compute[95467]: DEBUG nova.network.neutron [req-5e10abaf-2aa6-4e35-b75b-2e6126d07ee9 req-2f00c2cd-6b49-4649-b6fc-82f77626efc9 service nova] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Updated VIF entry in instance network info cache for port 469317c8-e304-434f-aa57-d791c555d494. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:35:52 user nova-compute[95467]: DEBUG nova.network.neutron [req-5e10abaf-2aa6-4e35-b75b-2e6126d07ee9 req-2f00c2cd-6b49-4649-b6fc-82f77626efc9 service nova] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Updating instance_info_cache with network_info: [{"id": "469317c8-e304-434f-aa57-d791c555d494", "address": "fa:16:3e:4f:39:f3", "network": {"id": "d67049b6-2e91-4d1e-8e42-5388ef75521a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984085217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7355ea3588ae4c2f9242e63084008710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469317c8-e3", "ovs_interfaceid": "469317c8-e304-434f-aa57-d791c555d494", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:35:52 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-5e10abaf-2aa6-4e35-b75b-2e6126d07ee9 req-2f00c2cd-6b49-4649-b6fc-82f77626efc9 service nova] Releasing lock "refresh_cache-c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:35:52 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:35:52 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=95467) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 08:35:52 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:35:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:35:53 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:35:53 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Cleaning up deleted instances with incomplete migration  {{(pid=95467) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 08:35:53 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Acquiring lock "c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:35:53 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:35:53 user nova-compute[95467]: INFO nova.compute.manager [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Rebooting instance
Nov 15 08:35:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Acquiring lock "refresh_cache-c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:35:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Acquired lock "refresh_cache-c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:35:54 user nova-compute[95467]: DEBUG nova.network.neutron [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:35:54 user nova-compute[95467]: DEBUG nova.network.neutron [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Updating instance_info_cache with network_info: [{"id": "469317c8-e304-434f-aa57-d791c555d494", "address": "fa:16:3e:4f:39:f3", "network": {"id": "d67049b6-2e91-4d1e-8e42-5388ef75521a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984085217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7355ea3588ae4c2f9242e63084008710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469317c8-e3", "ovs_interfaceid": "469317c8-e304-434f-aa57-d791c555d494", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:35:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Releasing lock "refresh_cache-c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:35:54 user nova-compute[95467]: DEBUG nova.compute.manager [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:35:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:35:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:35:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:35:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:35:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:35:54 user nova-compute[95467]: DEBUG nova.compute.manager [req-2202bfb9-38fa-4a64-98b6-15a145d5342f req-a17ba4e3-b204-4b28-a976-d8b1e2086c11 service nova] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Received event network-vif-unplugged-469317c8-e304-434f-aa57-d791c555d494 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:35:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-2202bfb9-38fa-4a64-98b6-15a145d5342f req-a17ba4e3-b204-4b28-a976-d8b1e2086c11 service nova] Acquiring lock "c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:35:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-2202bfb9-38fa-4a64-98b6-15a145d5342f req-a17ba4e3-b204-4b28-a976-d8b1e2086c11 service nova] Lock "c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:35:54 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-2202bfb9-38fa-4a64-98b6-15a145d5342f req-a17ba4e3-b204-4b28-a976-d8b1e2086c11 service nova] Lock "c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:35:54 user nova-compute[95467]: DEBUG nova.compute.manager [req-2202bfb9-38fa-4a64-98b6-15a145d5342f req-a17ba4e3-b204-4b28-a976-d8b1e2086c11 service nova] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] No waiting events found dispatching network-vif-unplugged-469317c8-e304-434f-aa57-d791c555d494 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:35:54 user nova-compute[95467]: WARNING nova.compute.manager [req-2202bfb9-38fa-4a64-98b6-15a145d5342f req-a17ba4e3-b204-4b28-a976-d8b1e2086c11 service nova] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Received unexpected event network-vif-unplugged-469317c8-e304-434f-aa57-d791c555d494 for instance with vm_state active and task_state reboot_started_hard.
Nov 15 08:35:55 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:35:55 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Instance destroyed successfully.
Nov 15 08:35:55 user nova-compute[95467]: DEBUG nova.objects.instance [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lazy-loading 'resources' on Instance uuid c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:33:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1078493853',display_name='tempest-TestMinimumBasicScenario-server-1078493853',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1078493853',id=50,image_ref='5287dd1e-2bf5-4503-98db-e03e6d3d044f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFuo49k9cvv7YNAlDfgSDtSKD5rkKjZXUDBHBnwxYNRe8PhjZ3K4zmMBSfZv32JlPsh+fr3qErhJmjvAamhoAh2VTCuxfWFiDo8zp3ZYgGDbY08lk14VdY8/gEVybaHTzA==',key_name='tempest-TestMinimumBasicScenario-1958468488',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:33:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7355ea3588ae4c2f9242e63084008710',ramdisk_id='',reservation_id='r-zru7ldf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5287dd1e-2bf5-4503-98db-e03e6d3d044f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-721378270',owner_user_name='tempest-TestMinimumBasicScenario-721378270-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:35:55Z,user_data=None,user_id='7b095b34b1b74a28a9f0b96cb6f033aa',uuid=c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "469317c8-e304-434f-aa57-d791c555d494", "address": "fa:16:3e:4f:39:f3", "network": {"id": "d67049b6-2e91-4d1e-8e42-5388ef75521a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984085217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7355ea3588ae4c2f9242e63084008710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469317c8-e3", "ovs_interfaceid": "469317c8-e304-434f-aa57-d791c555d494", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Converting VIF {"id": "469317c8-e304-434f-aa57-d791c555d494", "address": "fa:16:3e:4f:39:f3", "network": {"id": "d67049b6-2e91-4d1e-8e42-5388ef75521a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984085217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7355ea3588ae4c2f9242e63084008710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469317c8-e3", "ovs_interfaceid": "469317c8-e304-434f-aa57-d791c555d494", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:39:f3,bridge_name='br-int',has_traffic_filtering=True,id=469317c8-e304-434f-aa57-d791c555d494,network=Network(d67049b6-2e91-4d1e-8e42-5388ef75521a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469317c8-e3') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG os_vif [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:39:f3,bridge_name='br-int',has_traffic_filtering=True,id=469317c8-e304-434f-aa57-d791c555d494,network=Network(d67049b6-2e91-4d1e-8e42-5388ef75521a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469317c8-e3') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap469317c8-e3, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2b28dd77-3839-43e4-846c-253d7b30c47c) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:35:55 user nova-compute[95467]: INFO os_vif [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:39:f3,bridge_name='br-int',has_traffic_filtering=True,id=469317c8-e304-434f-aa57-d791c555d494,network=Network(d67049b6-2e91-4d1e-8e42-5388ef75521a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469317c8-e3')
Nov 15 08:35:55 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] calling os-brick to detach iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, {'target_iqn': 'iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vloNywIR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:35:55 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:35:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0d6a1e-6d4b-49df-897f-23feecc618a5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 08:35:55 user nova-compute[95467]: No targets found.
Nov 15 08:35:55 user nova-compute[95467]: iSNS:
Nov 15 08:35:55 user nova-compute[95467]: No targets found.
Nov 15 08:35:55 user nova-compute[95467]: STATIC:
Nov 15 08:35:55 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3
Nov 15 08:35:55 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:35:55 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:35:55 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1
Nov 15 08:35:55 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:35:55 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:35:55 user nova-compute[95467]: FIRMWARE:
Nov 15 08:35:55 user nova-compute[95467]: No targets found.
Nov 15 08:35:55 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 08:35:55 user nova-compute[95467]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 08:35:55 user nova-compute[95467]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=95467) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3', 0)] {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ce963b-4ea4-4ce4-b429-73314a1f1bd8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6592cc-5f4f-44a4-b344-196d05b26211]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 (non-flash)
Nov 15 08:35:55 user nova-compute[95467]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3 (non-flash)
Nov 15 08:35:55 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 (non-flash)
Nov 15 08:35:55 user nova-compute[95467]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3 (non-flash)
Nov 15 08:35:55 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efed8244af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3'): ({'sdc'}, set())}) {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Removing single pathed devices sdc {{(pid=95467) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[4adf70b7-7157-4822-b58e-636ae74ef24e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86d5190-dcdd-4d6c-8bea-d984a9ae81f9]: (4, ('ok\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Flushing IO for device /dev/sdc {{(pid=95467) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3bf64ba-4501-4af2-bb1a-3d45c2bc6166]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=95467) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef75d3a-930c-496b-b5e2-e1ba1c0f2b53]: (4, ('1', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] SCSI volumes sdc have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3')] {{(pid=95467) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7be21c-5745-413c-abc6-e40e542b4d0b]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3 -p 172.16.0.220:3260 --logout {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d130ca1-81d1-43c8-a843-af28bfa54bd8]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3, portal: 172.16.0.220,3260]
Nov 15 08:35:55 user nova-compute[95467]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3, portal: 172.16.0.220,3260] successful.
Nov 15 08:35:55 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3 -p 172.16.0.220:3260 --op delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e2cd62-9dad-4cf0-9048-44ceb626aa2c]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] <== disconnect_volume: return (320ms) None {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Disconnected iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Start _get_guest_xml network_info=[{"id": "469317c8-e304-434f-aa57-d791c555d494", "address": "fa:16:3e:4f:39:f3", "network": {"id": "d67049b6-2e91-4d1e-8e42-5388ef75521a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984085217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7355ea3588ae4c2f9242e63084008710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469317c8-e3", "ovs_interfaceid": "469317c8-e304-434f-aa57-d791c555d494", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5287dd1e-2bf5-4503-98db-e03e6d3d044f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '5287dd1e-2bf5-4503-98db-e03e6d3d044f'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '1dbc2c7b-1c8a-4b6c-9644-d3b705be20e8', 'delete_on_termination': False, 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vloNywIR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c', 'attached_at': '', 'detached_at': '', 'volume_id': 'df597122-35e7-4d3a-8ea0-b3c6073617d3', 'serial': 'df597122-35e7-4d3a-8ea0-b3c6073617d3'}, 'volume_type': None} {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:35:55 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:35:55 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:35:55 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5287dd1e-2bf5-4503-98db-e03e6d3d044f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG nova.objects.instance [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lazy-loading 'vcpu_model' on Instance uuid c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG nova.objects.base [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Object Instance<c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c> lazy-loaded attributes: resources,vcpu_model {{(pid=95467) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Calling os-brick to attach iSCSI Volume {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vloNywIR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:35:55 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:35:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:35:55 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:35:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:35:55 user nova-compute[95467]: INFO os_brick.initiator.connectors.iscsi [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 08:35:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3 -p 172.16.0.220:3260 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c4a87a-a7f7-4053-b88d-b9ed83e53844]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 08:35:55 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3 -p 172.16.0.220:3260 --interface default --op new {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c94144c-8c3d-4138-a2c7-a6095c63d8b0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3] added\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3] added
Nov 15 08:35:55 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b83be6-e967-4594-a19e-aa1028482dae]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ed46b6-6cf9-47e3-872c-6afd7a0d9b7b]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vloNywIR {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vloNywIR" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b5c731-8df9-4386-b8eb-d44db362ae06]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vloNywIR'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:35:55 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:35:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:35:56 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8986abb8-4512-4857-9351-960e5d425467]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:35:56 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:35:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:35:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:35:56 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8669f769-6765-45c6-9020-d09bf27caa82]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:35:56 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 (non-flash)
Nov 15 08:35:56 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:35:56 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 (non-flash)
Nov 15 08:35:56 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:35:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3 -p 172.16.0.220:3260 --login {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:35:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:35:56 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e20f7f-643f-4719-8a1f-174637e032b4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:35:56 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3, portal: 172.16.0.220,3260]
Nov 15 08:35:56 user nova-compute[95467]: Login to [iface: default, target: iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3, portal: 172.16.0.220,3260] successful.
Nov 15 08:35:56 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:35:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:35:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:35:56 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d540e19e-f7d7-4639-980d-13dca5c9be49]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:35:56 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:35:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:35:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:35:56 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8951b7a4-091b-4e36-8e94-87842a64ec04]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:35:56 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 (non-flash)
Nov 15 08:35:56 user nova-compute[95467]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3 (non-flash)
Nov 15 08:35:56 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:35:56 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 (non-flash)
Nov 15 08:35:56 user nova-compute[95467]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3 (non-flash)
Nov 15 08:35:56 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:35:56 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:35:56 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Connected to 172.16.0.220:3260 {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 08:35:56 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] HCTL ('34', '-', '-', 0) found on session 59 with lun 0 {{(pid=95467) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 08:35:56 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=95467) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 08:35:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:35:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:35:56 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[89cb5e82-4c56-4ee1-95b8-b1ef9db528a8]: (4, ('- - 0', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:35:56 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Searching for a device in session 59 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:35:56 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vloNywIR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 08:35:56 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager.update_available_resource {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:35:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:35:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:35:56 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:35:56 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Auditing locally available compute resources for user (node: user) {{(pid=95467) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 08:35:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:35:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:35:56 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:35:57 user nova-compute[95467]: DEBUG nova.compute.manager [req-b79a3165-e237-43ec-b21a-bd42ea1bd2ab req-372760a9-b64e-47ae-8b27-2ca4a8dd92e9 service nova] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Received event network-vif-plugged-469317c8-e304-434f-aa57-d791c555d494 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:35:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b79a3165-e237-43ec-b21a-bd42ea1bd2ab req-372760a9-b64e-47ae-8b27-2ca4a8dd92e9 service nova] Acquiring lock "c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:35:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b79a3165-e237-43ec-b21a-bd42ea1bd2ab req-372760a9-b64e-47ae-8b27-2ca4a8dd92e9 service nova] Lock "c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:35:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b79a3165-e237-43ec-b21a-bd42ea1bd2ab req-372760a9-b64e-47ae-8b27-2ca4a8dd92e9 service nova] Lock "c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:35:57 user nova-compute[95467]: DEBUG nova.compute.manager [req-b79a3165-e237-43ec-b21a-bd42ea1bd2ab req-372760a9-b64e-47ae-8b27-2ca4a8dd92e9 service nova] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] No waiting events found dispatching network-vif-plugged-469317c8-e304-434f-aa57-d791c555d494 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:35:57 user nova-compute[95467]: WARNING nova.compute.manager [req-b79a3165-e237-43ec-b21a-bd42ea1bd2ab req-372760a9-b64e-47ae-8b27-2ca4a8dd92e9 service nova] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Received unexpected event network-vif-plugged-469317c8-e304-434f-aa57-d791c555d494 for instance with vm_state active and task_state reboot_started_hard.
Nov 15 08:35:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:35:57 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:35:57 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.608s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:35:57 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] <== connect_volume: return (1610ms) {'type': 'block', 'scsi_wwn': '23232616563343433', 'path': '/dev/sdc'} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:35:57 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23232616563343433', 'path': '/dev/sdc'} {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 08:35:57 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:35:57 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:35:57 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Hypervisor/Node resource view: name=user free_ram=9051MB free_disk=25.059967041015625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=95467) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 08:35:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:35:57 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:35:57 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:33:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1078493853',display_name='tempest-TestMinimumBasicScenario-server-1078493853',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1078493853',id=50,image_ref='5287dd1e-2bf5-4503-98db-e03e6d3d044f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFuo49k9cvv7YNAlDfgSDtSKD5rkKjZXUDBHBnwxYNRe8PhjZ3K4zmMBSfZv32JlPsh+fr3qErhJmjvAamhoAh2VTCuxfWFiDo8zp3ZYgGDbY08lk14VdY8/gEVybaHTzA==',key_name='tempest-TestMinimumBasicScenario-1958468488',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:33:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7355ea3588ae4c2f9242e63084008710',ramdisk_id='',reservation_id='r-zru7ldf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5287dd1e-2bf5-4503-98db-e03e6d3d044f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-721378270',owner_user_name='tempest-TestMinimumBasicScenario-721378270-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:35:55Z,user_data=None,user_id='7b095b34b1b74a28a9f0b96cb6f033aa',uuid=c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "469317c8-e304-434f-aa57-d791c555d494", "address": "fa:16:3e:4f:39:f3", "network": {"id": "d67049b6-2e91-4d1e-8e42-5388ef75521a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984085217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7355ea3588ae4c2f9242e63084008710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469317c8-e3", "ovs_interfaceid": "469317c8-e304-434f-aa57-d791c555d494", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:35:57 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Converting VIF {"id": "469317c8-e304-434f-aa57-d791c555d494", "address": "fa:16:3e:4f:39:f3", "network": {"id": "d67049b6-2e91-4d1e-8e42-5388ef75521a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984085217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7355ea3588ae4c2f9242e63084008710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469317c8-e3", "ovs_interfaceid": "469317c8-e304-434f-aa57-d791c555d494", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:35:57 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:39:f3,bridge_name='br-int',has_traffic_filtering=True,id=469317c8-e304-434f-aa57-d791c555d494,network=Network(d67049b6-2e91-4d1e-8e42-5388ef75521a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469317c8-e3') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:35:57 user nova-compute[95467]: DEBUG nova.objects.instance [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lazy-loading 'pci_devices' on Instance uuid c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:35:57 user nova-compute[95467]: DEBUG nova.objects.base [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Object Instance<c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=95467) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 08:35:57 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:35:57 user nova-compute[95467]:   <uuid>c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c</uuid>
Nov 15 08:35:57 user nova-compute[95467]:   <name>instance-00000032</name>
Nov 15 08:35:57 user nova-compute[95467]:   <memory>524288</memory>
Nov 15 08:35:57 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:35:57 user nova-compute[95467]:   <metadata>
Nov 15 08:35:57 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:35:57 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:35:57 user nova-compute[95467]:       <nova:name>tempest-TestMinimumBasicScenario-server-1078493853</nova:name>
Nov 15 08:35:57 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:35:55</nova:creationTime>
Nov 15 08:35:57 user nova-compute[95467]:       <nova:flavor name="m1.tiny">
Nov 15 08:35:57 user nova-compute[95467]:         <nova:memory>512</nova:memory>
Nov 15 08:35:57 user nova-compute[95467]:         <nova:disk>1</nova:disk>
Nov 15 08:35:57 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:35:57 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:35:57 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:35:57 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:35:57 user nova-compute[95467]:       <nova:owner>
Nov 15 08:35:57 user nova-compute[95467]:         <nova:user uuid="7b095b34b1b74a28a9f0b96cb6f033aa">tempest-TestMinimumBasicScenario-721378270-project-member</nova:user>
Nov 15 08:35:57 user nova-compute[95467]:         <nova:project uuid="7355ea3588ae4c2f9242e63084008710">tempest-TestMinimumBasicScenario-721378270</nova:project>
Nov 15 08:35:57 user nova-compute[95467]:       </nova:owner>
Nov 15 08:35:57 user nova-compute[95467]:       <nova:root type="image" uuid="5287dd1e-2bf5-4503-98db-e03e6d3d044f"/>
Nov 15 08:35:57 user nova-compute[95467]:       <nova:ports>
Nov 15 08:35:57 user nova-compute[95467]:         <nova:port uuid="469317c8-e304-434f-aa57-d791c555d494">
Nov 15 08:35:57 user nova-compute[95467]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 08:35:57 user nova-compute[95467]:         </nova:port>
Nov 15 08:35:57 user nova-compute[95467]:       </nova:ports>
Nov 15 08:35:57 user nova-compute[95467]:     </nova:instance>
Nov 15 08:35:57 user nova-compute[95467]:   </metadata>
Nov 15 08:35:57 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:35:57 user nova-compute[95467]:     <system>
Nov 15 08:35:57 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:35:57 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:35:57 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:35:57 user nova-compute[95467]:       <entry name="serial">c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c</entry>
Nov 15 08:35:57 user nova-compute[95467]:       <entry name="uuid">c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c</entry>
Nov 15 08:35:57 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:35:57 user nova-compute[95467]:     </system>
Nov 15 08:35:57 user nova-compute[95467]:   </sysinfo>
Nov 15 08:35:57 user nova-compute[95467]:   <os>
Nov 15 08:35:57 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:35:57 user nova-compute[95467]:     <boot dev="hd"/>
Nov 15 08:35:57 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:35:57 user nova-compute[95467]:   </os>
Nov 15 08:35:57 user nova-compute[95467]:   <features>
Nov 15 08:35:57 user nova-compute[95467]:     <acpi/>
Nov 15 08:35:57 user nova-compute[95467]:     <apic/>
Nov 15 08:35:57 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:35:57 user nova-compute[95467]:   </features>
Nov 15 08:35:57 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:35:57 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:35:57 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:35:57 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:35:57 user nova-compute[95467]:   </clock>
Nov 15 08:35:57 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:35:57 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:35:57 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:35:57 user nova-compute[95467]:   </cpu>
Nov 15 08:35:57 user nova-compute[95467]:   <devices>
Nov 15 08:35:57 user nova-compute[95467]:     <disk type="file" device="disk">
Nov 15 08:35:57 user nova-compute[95467]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 08:35:57 user nova-compute[95467]:       <source file="/opt/stack/data/nova/instances/c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c/disk"/>
Nov 15 08:35:57 user nova-compute[95467]:       <target dev="vda" bus="virtio"/>
Nov 15 08:35:57 user nova-compute[95467]:     </disk>
Nov 15 08:35:57 user nova-compute[95467]:     <disk type="block" device="disk">
Nov 15 08:35:57 user nova-compute[95467]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:35:57 user nova-compute[95467]:       <source dev="/dev/sdc"/>
Nov 15 08:35:57 user nova-compute[95467]:       <target dev="vdb" bus="virtio"/>
Nov 15 08:35:57 user nova-compute[95467]:       <serial>df597122-35e7-4d3a-8ea0-b3c6073617d3</serial>
Nov 15 08:35:57 user nova-compute[95467]:     </disk>
Nov 15 08:35:57 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:35:57 user nova-compute[95467]:       <mac address="fa:16:3e:4f:39:f3"/>
Nov 15 08:35:57 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:35:57 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:35:57 user nova-compute[95467]:       <target dev="tap469317c8-e3"/>
Nov 15 08:35:57 user nova-compute[95467]:     </interface>
Nov 15 08:35:57 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:35:57 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c/console.log" append="off"/>
Nov 15 08:35:57 user nova-compute[95467]:     </serial>
Nov 15 08:35:57 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:35:57 user nova-compute[95467]:     <video>
Nov 15 08:35:57 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:35:57 user nova-compute[95467]:     </video>
Nov 15 08:35:57 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:35:57 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:35:57 user nova-compute[95467]:     </rng>
Nov 15 08:35:57 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:35:57 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:35:57 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:35:57 user nova-compute[95467]:     </memballoon>
Nov 15 08:35:57 user nova-compute[95467]:   </devices>
Nov 15 08:35:57 user nova-compute[95467]: </domain>
Nov 15 08:35:57 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:35:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:35:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:35:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:35:57 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 2945f42b-62a1-44c5-be3b-f1dbe6826c0f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:35:57 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:35:57 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 08:35:57 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 08:35:57 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Refreshing inventories for resource provider f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 08:35:57 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Updating ProviderTree inventory for provider f56c3524-ed11-494e-82e4-b1a23920d1ae from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 08:35:57 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Updating inventory in ProviderTree for provider f56c3524-ed11-494e-82e4-b1a23920d1ae with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 08:35:57 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Refreshing aggregate associations for resource provider f56c3524-ed11-494e-82e4-b1a23920d1ae, aggregates: None {{(pid=95467) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 08:35:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:35:57 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:35:57 user nova-compute[95467]: DEBUG nova.objects.instance [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lazy-loading 'trusted_certs' on Instance uuid c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:35:57 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Refreshing trait associations for resource provider f56c3524-ed11-494e-82e4-b1a23920d1ae, traits: COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSSE3,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI {{(pid=95467) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 08:35:57 user nova-compute[95467]: DEBUG nova.objects.base [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Object Instance<c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=95467) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 08:35:57 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/166bd0c92028594abd6b0ce8dbcfc5710b6f9fc7 --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:35:58 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:35:58 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:35:58 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Compute_service record updated for user:user {{(pid=95467) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 08:35:58 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.605s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:35:58 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/166bd0c92028594abd6b0ce8dbcfc5710b6f9fc7 --force-share --output=json" returned: 0 in 0.184s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:35:58 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c/disk. size=1073741824 {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 08:35:58 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:35:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:35:58 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:35:58 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Cannot resize image /opt/stack/data/nova/instances/c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c/disk to a smaller size. {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 08:35:58 user nova-compute[95467]: DEBUG nova.objects.instance [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lazy-loading 'migration_context' on Instance uuid c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:35:58 user nova-compute[95467]: DEBUG nova.objects.base [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Object Instance<c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=95467) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 08:35:58 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:33:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1078493853',display_name='tempest-TestMinimumBasicScenario-server-1078493853',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1078493853',id=50,image_ref='5287dd1e-2bf5-4503-98db-e03e6d3d044f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFuo49k9cvv7YNAlDfgSDtSKD5rkKjZXUDBHBnwxYNRe8PhjZ3K4zmMBSfZv32JlPsh+fr3qErhJmjvAamhoAh2VTCuxfWFiDo8zp3ZYgGDbY08lk14VdY8/gEVybaHTzA==',key_name='tempest-TestMinimumBasicScenario-1958468488',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:33:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='7355ea3588ae4c2f9242e63084008710',ramdisk_id='',reservation_id='r-zru7ldf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5287dd1e-2bf5-4503-98db-e03e6d3d044f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-721378270',owner_user_name='tempest-TestMinimumBasicScenario-721378270-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:35:55Z,user_data=None,user_id='7b095b34b1b74a28a9f0b96cb6f033aa',uuid=c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "469317c8-e304-434f-aa57-d791c555d494", "address": "fa:16:3e:4f:39:f3", "network": {"id": "d67049b6-2e91-4d1e-8e42-5388ef75521a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984085217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7355ea3588ae4c2f9242e63084008710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469317c8-e3", "ovs_interfaceid": "469317c8-e304-434f-aa57-d791c555d494", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:35:58 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Converting VIF {"id": "469317c8-e304-434f-aa57-d791c555d494", "address": "fa:16:3e:4f:39:f3", "network": {"id": "d67049b6-2e91-4d1e-8e42-5388ef75521a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984085217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7355ea3588ae4c2f9242e63084008710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469317c8-e3", "ovs_interfaceid": "469317c8-e304-434f-aa57-d791c555d494", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:35:58 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:39:f3,bridge_name='br-int',has_traffic_filtering=True,id=469317c8-e304-434f-aa57-d791c555d494,network=Network(d67049b6-2e91-4d1e-8e42-5388ef75521a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469317c8-e3') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:35:58 user nova-compute[95467]: DEBUG os_vif [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:39:f3,bridge_name='br-int',has_traffic_filtering=True,id=469317c8-e304-434f-aa57-d791c555d494,network=Network(d67049b6-2e91-4d1e-8e42-5388ef75521a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469317c8-e3') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:35:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:35:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:35:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:35:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:35:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7122c16f-3716-5e20-89a3-6dbc1affe673', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:35:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:35:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:35:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:35:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:35:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap469317c8-e3, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:35:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap469317c8-e3, col_values=(('qos', UUID('aa2a936f-aa54-4d93-a37f-d6d20b40ad5e')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:35:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap469317c8-e3, col_values=(('external_ids', {'iface-id': '469317c8-e304-434f-aa57-d791c555d494', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:39:f3', 'vm-uuid': 'c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:35:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:35:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:35:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:35:58 user nova-compute[95467]: INFO os_vif [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:39:f3,bridge_name='br-int',has_traffic_filtering=True,id=469317c8-e304-434f-aa57-d791c555d494,network=Network(d67049b6-2e91-4d1e-8e42-5388ef75521a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469317c8-e3')
Nov 15 08:35:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:35:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:35:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:35:59 user nova-compute[95467]: DEBUG nova.compute.manager [req-d277641e-2744-4f89-aecf-3f160801ae12 req-687038a9-fd2c-4704-b4f2-bf013431ffe6 service nova] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Received event network-vif-plugged-469317c8-e304-434f-aa57-d791c555d494 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:35:59 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-d277641e-2744-4f89-aecf-3f160801ae12 req-687038a9-fd2c-4704-b4f2-bf013431ffe6 service nova] Acquiring lock "c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:35:59 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-d277641e-2744-4f89-aecf-3f160801ae12 req-687038a9-fd2c-4704-b4f2-bf013431ffe6 service nova] Lock "c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:35:59 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-d277641e-2744-4f89-aecf-3f160801ae12 req-687038a9-fd2c-4704-b4f2-bf013431ffe6 service nova] Lock "c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:35:59 user nova-compute[95467]: DEBUG nova.compute.manager [req-d277641e-2744-4f89-aecf-3f160801ae12 req-687038a9-fd2c-4704-b4f2-bf013431ffe6 service nova] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] No waiting events found dispatching network-vif-plugged-469317c8-e304-434f-aa57-d791c555d494 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:35:59 user nova-compute[95467]: WARNING nova.compute.manager [req-d277641e-2744-4f89-aecf-3f160801ae12 req-687038a9-fd2c-4704-b4f2-bf013431ffe6 service nova] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Received unexpected event network-vif-plugged-469317c8-e304-434f-aa57-d791c555d494 for instance with vm_state active and task_state reboot_started_hard.
Nov 15 08:36:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:36:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:36:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:36:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:36:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:36:01 user nova-compute[95467]: DEBUG nova.compute.manager [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Instance event wait completed in 0 seconds for  {{(pid=95467) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 08:36:01 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Instance rebooted successfully.
Nov 15 08:36:01 user nova-compute[95467]: DEBUG nova.compute.manager [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:36:01 user nova-compute[95467]: DEBUG nova.compute.manager [req-3f9e32e3-6286-41e0-a99e-d2e8b983b95e req-c8c4ed6c-8474-4f7c-875b-805695ee6493 service nova] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Received event network-vif-plugged-469317c8-e304-434f-aa57-d791c555d494 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:36:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-3f9e32e3-6286-41e0-a99e-d2e8b983b95e req-c8c4ed6c-8474-4f7c-875b-805695ee6493 service nova] Acquiring lock "c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:36:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-3f9e32e3-6286-41e0-a99e-d2e8b983b95e req-c8c4ed6c-8474-4f7c-875b-805695ee6493 service nova] Lock "c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:36:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-3f9e32e3-6286-41e0-a99e-d2e8b983b95e req-c8c4ed6c-8474-4f7c-875b-805695ee6493 service nova] Lock "c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:36:01 user nova-compute[95467]: DEBUG nova.compute.manager [req-3f9e32e3-6286-41e0-a99e-d2e8b983b95e req-c8c4ed6c-8474-4f7c-875b-805695ee6493 service nova] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] No waiting events found dispatching network-vif-plugged-469317c8-e304-434f-aa57-d791c555d494 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:36:01 user nova-compute[95467]: WARNING nova.compute.manager [req-3f9e32e3-6286-41e0-a99e-d2e8b983b95e req-c8c4ed6c-8474-4f7c-875b-805695ee6493 service nova] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Received unexpected event network-vif-plugged-469317c8-e304-434f-aa57-d791c555d494 for instance with vm_state active and task_state reboot_started_hard.
Nov 15 08:36:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-ef728f26-3ad3-4068-ac40-e6efb580f821 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.960s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:36:02 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:36:02 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:36:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:36:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:36:03 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:36:03 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Starting heal instance info cache {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 08:36:03 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "refresh_cache-c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:36:03 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquired lock "refresh_cache-c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:36:03 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Forcefully refreshing network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 08:36:04 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Updating instance_info_cache with network_info: [{"id": "469317c8-e304-434f-aa57-d791c555d494", "address": "fa:16:3e:4f:39:f3", "network": {"id": "d67049b6-2e91-4d1e-8e42-5388ef75521a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984085217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7355ea3588ae4c2f9242e63084008710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469317c8-e3", "ovs_interfaceid": "469317c8-e304-434f-aa57-d791c555d494", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:36:04 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Releasing lock "refresh_cache-c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:36:04 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Updated the network info_cache for instance {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 08:36:04 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:36:04 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:36:07 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:36:08 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:36:08 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:36:09 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:36:09 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Cleaning up deleted instances {{(pid=95467) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 08:36:09 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] There are 0 instances to clean {{(pid=95467) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 08:36:11 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:36:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:36:15 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:36:18 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:36:18 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:36:23 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:36:23 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:36:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:36:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:36:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:36:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:36:35 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:36:38 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:36:38 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:36:39 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:36:43 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._sync_power_states {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:36:43 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Triggering sync for uuid 2945f42b-62a1-44c5-be3b-f1dbe6826c0f {{(pid=95467) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 08:36:43 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Triggering sync for uuid c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c {{(pid=95467) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 08:36:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "2945f42b-62a1-44c5-be3b-f1dbe6826c0f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:36:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "2945f42b-62a1-44c5-be3b-f1dbe6826c0f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:36:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:36:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:36:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "2945f42b-62a1-44c5-be3b-f1dbe6826c0f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:36:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:36:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:36:48 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:36:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:36:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:36:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=95467) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 08:36:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:36:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:36:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:36:53 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:36:53 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=95467) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 08:36:56 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:36:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:36:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:36:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=95467) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 08:36:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:36:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:36:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:36:58 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager.update_available_resource {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:36:58 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:36:58 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:36:58 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:36:58 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Auditing locally available compute resources for user (node: user) {{(pid=95467) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 08:36:58 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:36:58 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:36:58 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:36:59 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:36:59 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:36:59 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:36:59 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:36:59 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:36:59 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:36:59 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:36:59 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:36:59 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:36:59 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Hypervisor/Node resource view: name=user free_ram=8975MB free_disk=25.050128936767578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=95467) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 08:36:59 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:36:59 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:37:00 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 2945f42b-62a1-44c5-be3b-f1dbe6826c0f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:37:00 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:37:00 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 08:37:00 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 08:37:00 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:37:00 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:37:00 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Compute_service record updated for user:user {{(pid=95467) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 08:37:00 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.244s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:37:02 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:37:02 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:37:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:37:04 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:37:05 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:37:05 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Starting heal instance info cache {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 08:37:05 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Rebuilding the list of instances to heal {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 08:37:05 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "refresh_cache-2945f42b-62a1-44c5-be3b-f1dbe6826c0f" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:37:05 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquired lock "refresh_cache-2945f42b-62a1-44c5-be3b-f1dbe6826c0f" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:37:05 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Forcefully refreshing network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 08:37:05 user nova-compute[95467]: DEBUG nova.objects.instance [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lazy-loading 'info_cache' on Instance uuid 2945f42b-62a1-44c5-be3b-f1dbe6826c0f {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:37:06 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Updating instance_info_cache with network_info: [{"id": "27b8a52f-50f2-42e6-9c9f-9b74f9778096", "address": "fa:16:3e:81:ba:80", "network": {"id": "26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1542679712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9a636c8b7074bd19eeee608156f8568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b8a52f-50", "ovs_interfaceid": "27b8a52f-50f2-42e6-9c9f-9b74f9778096", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:37:06 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Releasing lock "refresh_cache-2945f42b-62a1-44c5-be3b-f1dbe6826c0f" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:37:06 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Updated the network info_cache for instance {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 08:37:06 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:37:07 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:37:08 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:37:08 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:37:08 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=95467) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 08:37:08 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:37:08 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:37:08 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:37:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:37:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:37:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=95467) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 08:37:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:37:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:37:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:37:18 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:37:23 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:37:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:37:29 user nova-compute[95467]: DEBUG nova.objects.instance [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lazy-loading 'flavor' on Instance uuid 2945f42b-62a1-44c5-be3b-f1dbe6826c0f {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:37:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Acquiring lock "refresh_cache-2945f42b-62a1-44c5-be3b-f1dbe6826c0f" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:37:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Acquired lock "refresh_cache-2945f42b-62a1-44c5-be3b-f1dbe6826c0f" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:37:29 user nova-compute[95467]: DEBUG nova.network.neutron [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:37:29 user nova-compute[95467]: DEBUG nova.objects.instance [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lazy-loading 'info_cache' on Instance uuid 2945f42b-62a1-44c5-be3b-f1dbe6826c0f {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:37:29 user nova-compute[95467]: DEBUG nova.objects.base [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Object Instance<2945f42b-62a1-44c5-be3b-f1dbe6826c0f> lazy-loaded attributes: flavor,info_cache {{(pid=95467) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG nova.network.neutron [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Updating instance_info_cache with network_info: [{"id": "27b8a52f-50f2-42e6-9c9f-9b74f9778096", "address": "fa:16:3e:81:ba:80", "network": {"id": "26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1542679712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9a636c8b7074bd19eeee608156f8568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b8a52f-50", "ovs_interfaceid": "27b8a52f-50f2-42e6-9c9f-9b74f9778096", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Releasing lock "refresh_cache-2945f42b-62a1-44c5-be3b-f1dbe6826c0f" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:37:30 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Instance destroyed successfully.
Nov 15 08:37:30 user nova-compute[95467]: DEBUG nova.objects.instance [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lazy-loading 'resources' on Instance uuid 2945f42b-62a1-44c5-be3b-f1dbe6826c0f {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG nova.objects.base [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Object Instance<2945f42b-62a1-44c5-be3b-f1dbe6826c0f> lazy-loaded attributes: flavor,info_cache,resources {{(pid=95467) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:33:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1665521832',display_name='tempest-AttachVolumeTestJSON-server-1665521832',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1665521832',id=49,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHEZ4L2W1PqDn37Zx7UIz0j2KcbPq+rly9Qd/KJO59g5c8MCgjoXP3xcb3EyLIk0CvVsb/gd4fXybCigHKczFCKQxo4IJMRUgO0RY0jH5aIgYmljg+NxxHHdbnLulJeSuQ==',key_name='tempest-keypair-1324520091',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:33:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a9a636c8b7074bd19eeee608156f8568',ramdisk_id='',reservation_id='r-fsabz05b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1507968277',owner_user_name='tempest-AttachVolumeTestJSON-1507968277-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:35:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e31df8ed5a914b2395b548606b65e580',uuid=2945f42b-62a1-44c5-be3b-f1dbe6826c0f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "27b8a52f-50f2-42e6-9c9f-9b74f9778096", "address": "fa:16:3e:81:ba:80", "network": {"id": "26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1542679712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9a636c8b7074bd19eeee608156f8568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b8a52f-50", "ovs_interfaceid": "27b8a52f-50f2-42e6-9c9f-9b74f9778096", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Converting VIF {"id": "27b8a52f-50f2-42e6-9c9f-9b74f9778096", "address": "fa:16:3e:81:ba:80", "network": {"id": "26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1542679712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9a636c8b7074bd19eeee608156f8568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b8a52f-50", "ovs_interfaceid": "27b8a52f-50f2-42e6-9c9f-9b74f9778096", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:ba:80,bridge_name='br-int',has_traffic_filtering=True,id=27b8a52f-50f2-42e6-9c9f-9b74f9778096,network=Network(26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27b8a52f-50') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG os_vif [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:ba:80,bridge_name='br-int',has_traffic_filtering=True,id=27b8a52f-50f2-42e6-9c9f-9b74f9778096,network=Network(26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27b8a52f-50') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap27b8a52f-50, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b2379271-1a76-42b6-bd4b-66e8d86d433b) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:37:30 user nova-compute[95467]: INFO os_vif [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:ba:80,bridge_name='br-int',has_traffic_filtering=True,id=27b8a52f-50f2-42e6-9c9f-9b74f9778096,network=Network(26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27b8a52f-50')
Nov 15 08:37:30 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] calling os-brick to detach iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, {'target_iqn': 'iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aXoYUDZA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:37:30 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:37:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[2438d836-4db8-4759-9899-612c0541bd4a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 08:37:30 user nova-compute[95467]: No targets found.
Nov 15 08:37:30 user nova-compute[95467]: iSNS:
Nov 15 08:37:30 user nova-compute[95467]: No targets found.
Nov 15 08:37:30 user nova-compute[95467]: STATIC:
Nov 15 08:37:30 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3
Nov 15 08:37:30 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:37:30 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:37:30 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1
Nov 15 08:37:30 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:37:30 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:37:30 user nova-compute[95467]: FIRMWARE:
Nov 15 08:37:30 user nova-compute[95467]: No targets found.
Nov 15 08:37:30 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 08:37:30 user nova-compute[95467]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 08:37:30 user nova-compute[95467]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=95467) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1', 0)] {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20d7b64-cc80-4a0a-b367-13029b13ea7b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2f7ddd-8caf-4715-bfed-2d00922dd5a4]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 (non-flash)
Nov 15 08:37:30 user nova-compute[95467]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3 (non-flash)
Nov 15 08:37:30 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 (non-flash)
Nov 15 08:37:30 user nova-compute[95467]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3 (non-flash)
Nov 15 08:37:30 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efed857b7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1'): ({'sdb'}, set())}) {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Removing single pathed devices sdb {{(pid=95467) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0f50dc-9182-40fa-bb1d-c81e6e288291]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc238bad-9535-4b28-a9d5-e77fb83b25cc]: (4, ('ok\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Flushing IO for device /dev/sdb {{(pid=95467) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be00e51-6ea8-4c72-98fc-b411c329cb3b]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=95467) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd70cec6-2175-4be8-912f-29e8489867d0]: (4, ('1', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] SCSI volumes sdb have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1')] {{(pid=95467) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af1cd48-3950-4be8-8583-92436d632b18]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 -p 172.16.0.220:3260 --logout {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa544f5d-5953-41b2-9959-8b88572f195f]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1, portal: 172.16.0.220,3260]
Nov 15 08:37:30 user nova-compute[95467]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1, portal: 172.16.0.220,3260] successful.
Nov 15 08:37:30 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 -p 172.16.0.220:3260 --op delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a479f05-9eaa-4a49-a868-550db8a9042d]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] <== disconnect_volume: return (296ms) None {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Disconnected iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Start _get_guest_xml network_info=[{"id": "27b8a52f-50f2-42e6-9c9f-9b74f9778096", "address": "fa:16:3e:81:ba:80", "network": {"id": "26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1542679712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9a636c8b7074bd19eeee608156f8568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b8a52f-50", "ovs_interfaceid": "27b8a52f-50f2-42e6-9c9f-9b74f9778096", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'ed9c48aa-ce73-4b3b-9db1-235898be671b'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'b126497b-f91e-46f1-a0b6-43d6a7f7a53e', 'delete_on_termination': False, 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aXoYUDZA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '2945f42b-62a1-44c5-be3b-f1dbe6826c0f', 'attached_at': '', 'detached_at': '', 'volume_id': '5e85d95d-936c-4e74-b53a-9e1b77c68fb1', 'serial': '5e85d95d-936c-4e74-b53a-9e1b77c68fb1'}, 'volume_type': None} {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG nova.objects.instance [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lazy-loading 'numa_topology' on Instance uuid 2945f42b-62a1-44c5-be3b-f1dbe6826c0f {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG nova.objects.base [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Object Instance<2945f42b-62a1-44c5-be3b-f1dbe6826c0f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=95467) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 08:37:30 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:37:30 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:37:30 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG nova.objects.instance [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2945f42b-62a1-44c5-be3b-f1dbe6826c0f {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG nova.objects.base [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Object Instance<2945f42b-62a1-44c5-be3b-f1dbe6826c0f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=95467) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Calling os-brick to attach iSCSI Volume {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aXoYUDZA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:37:30 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:37:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:37:30 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:37:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:37:30 user nova-compute[95467]: INFO os_brick.initiator.connectors.iscsi [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 08:37:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 -p 172.16.0.220:3260 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d247d0-5224-4fe7-9592-53109f2812c3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 08:37:30 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 -p 172.16.0.220:3260 --interface default --op new {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e2e71b-2cff-4b7c-bae4-b74638116538]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1] added\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1] added
Nov 15 08:37:30 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5f634e-486d-4e68-b744-0939a03ff14f]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c71306-88b1-4bfa-9a11-8768a67a8e21]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aXoYUDZA {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aXoYUDZA" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc68212-a6fd-4899-bc24-06a76037c392]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aXoYUDZA'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[118dbb5a-eb86-407e-b792-104d8351450c]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ed6a8f-8356-47ef-8c0f-2cb76889acc1]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3 (non-flash)
Nov 15 08:37:30 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3 (non-flash)
Nov 15 08:37:30 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 -p 172.16.0.220:3260 --login {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[191d0524-f194-4d25-a888-5bfe70e4969c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1, portal: 172.16.0.220,3260]
Nov 15 08:37:30 user nova-compute[95467]: Login to [iface: default, target: iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1, portal: 172.16.0.220,3260] successful.
Nov 15 08:37:30 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8d2758-8129-49ea-a946-2836754112e0]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5f1da9-b051-4d95-8c2e-c887670da12f]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3 (non-flash)
Nov 15 08:37:30 user nova-compute[95467]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 (non-flash)
Nov 15 08:37:30 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3 (non-flash)
Nov 15 08:37:30 user nova-compute[95467]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 (non-flash)
Nov 15 08:37:30 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Connected to 172.16.0.220:3260 {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=95467) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=95467) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[16edd683-35d8-4d02-b132-e1ce01d56f98]: (4, ('- - 0', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:37:30 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aXoYUDZA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 08:37:31 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:37:31 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '26363643135346535', 'path': '/dev/sdb'} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:37:31 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26363643135346535', 'path': '/dev/sdb'} {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 08:37:31 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:33:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1665521832',display_name='tempest-AttachVolumeTestJSON-server-1665521832',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1665521832',id=49,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHEZ4L2W1PqDn37Zx7UIz0j2KcbPq+rly9Qd/KJO59g5c8MCgjoXP3xcb3EyLIk0CvVsb/gd4fXybCigHKczFCKQxo4IJMRUgO0RY0jH5aIgYmljg+NxxHHdbnLulJeSuQ==',key_name='tempest-keypair-1324520091',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:33:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a9a636c8b7074bd19eeee608156f8568',ramdisk_id='',reservation_id='r-fsabz05b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1507968277',owner_user_name='tempest-AttachVolumeTestJSON-1507968277-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:35:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e31df8ed5a914b2395b548606b65e580',uuid=2945f42b-62a1-44c5-be3b-f1dbe6826c0f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "27b8a52f-50f2-42e6-9c9f-9b74f9778096", "address": "fa:16:3e:81:ba:80", "network": {"id": "26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1542679712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9a636c8b7074bd19eeee608156f8568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b8a52f-50", "ovs_interfaceid": "27b8a52f-50f2-42e6-9c9f-9b74f9778096", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:37:31 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Converting VIF {"id": "27b8a52f-50f2-42e6-9c9f-9b74f9778096", "address": "fa:16:3e:81:ba:80", "network": {"id": "26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1542679712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9a636c8b7074bd19eeee608156f8568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b8a52f-50", "ovs_interfaceid": "27b8a52f-50f2-42e6-9c9f-9b74f9778096", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:37:31 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:ba:80,bridge_name='br-int',has_traffic_filtering=True,id=27b8a52f-50f2-42e6-9c9f-9b74f9778096,network=Network(26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27b8a52f-50') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:37:31 user nova-compute[95467]: DEBUG nova.objects.instance [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lazy-loading 'pci_devices' on Instance uuid 2945f42b-62a1-44c5-be3b-f1dbe6826c0f {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:37:31 user nova-compute[95467]: DEBUG nova.objects.base [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Object Instance<2945f42b-62a1-44c5-be3b-f1dbe6826c0f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=95467) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 08:37:31 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:37:31 user nova-compute[95467]:   <uuid>2945f42b-62a1-44c5-be3b-f1dbe6826c0f</uuid>
Nov 15 08:37:31 user nova-compute[95467]:   <name>instance-00000031</name>
Nov 15 08:37:31 user nova-compute[95467]:   <memory>524288</memory>
Nov 15 08:37:31 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:37:31 user nova-compute[95467]:   <metadata>
Nov 15 08:37:31 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:37:31 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:37:31 user nova-compute[95467]:       <nova:name>tempest-AttachVolumeTestJSON-server-1665521832</nova:name>
Nov 15 08:37:31 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:37:30</nova:creationTime>
Nov 15 08:37:31 user nova-compute[95467]:       <nova:flavor name="m1.tiny">
Nov 15 08:37:31 user nova-compute[95467]:         <nova:memory>512</nova:memory>
Nov 15 08:37:31 user nova-compute[95467]:         <nova:disk>1</nova:disk>
Nov 15 08:37:31 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:37:31 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:37:31 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:37:31 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:37:31 user nova-compute[95467]:       <nova:owner>
Nov 15 08:37:31 user nova-compute[95467]:         <nova:user uuid="e31df8ed5a914b2395b548606b65e580">tempest-AttachVolumeTestJSON-1507968277-project-member</nova:user>
Nov 15 08:37:31 user nova-compute[95467]:         <nova:project uuid="a9a636c8b7074bd19eeee608156f8568">tempest-AttachVolumeTestJSON-1507968277</nova:project>
Nov 15 08:37:31 user nova-compute[95467]:       </nova:owner>
Nov 15 08:37:31 user nova-compute[95467]:       <nova:root type="image" uuid="ed9c48aa-ce73-4b3b-9db1-235898be671b"/>
Nov 15 08:37:31 user nova-compute[95467]:       <nova:ports>
Nov 15 08:37:31 user nova-compute[95467]:         <nova:port uuid="27b8a52f-50f2-42e6-9c9f-9b74f9778096">
Nov 15 08:37:31 user nova-compute[95467]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 08:37:31 user nova-compute[95467]:         </nova:port>
Nov 15 08:37:31 user nova-compute[95467]:       </nova:ports>
Nov 15 08:37:31 user nova-compute[95467]:     </nova:instance>
Nov 15 08:37:31 user nova-compute[95467]:   </metadata>
Nov 15 08:37:31 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:37:31 user nova-compute[95467]:     <system>
Nov 15 08:37:31 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:37:31 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:37:31 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:37:31 user nova-compute[95467]:       <entry name="serial">2945f42b-62a1-44c5-be3b-f1dbe6826c0f</entry>
Nov 15 08:37:31 user nova-compute[95467]:       <entry name="uuid">2945f42b-62a1-44c5-be3b-f1dbe6826c0f</entry>
Nov 15 08:37:31 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:37:31 user nova-compute[95467]:     </system>
Nov 15 08:37:31 user nova-compute[95467]:   </sysinfo>
Nov 15 08:37:31 user nova-compute[95467]:   <os>
Nov 15 08:37:31 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:37:31 user nova-compute[95467]:     <boot dev="hd"/>
Nov 15 08:37:31 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:37:31 user nova-compute[95467]:   </os>
Nov 15 08:37:31 user nova-compute[95467]:   <features>
Nov 15 08:37:31 user nova-compute[95467]:     <acpi/>
Nov 15 08:37:31 user nova-compute[95467]:     <apic/>
Nov 15 08:37:31 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:37:31 user nova-compute[95467]:   </features>
Nov 15 08:37:31 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:37:31 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:37:31 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:37:31 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:37:31 user nova-compute[95467]:   </clock>
Nov 15 08:37:31 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:37:31 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:37:31 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:37:31 user nova-compute[95467]:   </cpu>
Nov 15 08:37:31 user nova-compute[95467]:   <devices>
Nov 15 08:37:31 user nova-compute[95467]:     <disk type="file" device="disk">
Nov 15 08:37:31 user nova-compute[95467]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 08:37:31 user nova-compute[95467]:       <source file="/opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/disk"/>
Nov 15 08:37:31 user nova-compute[95467]:       <target dev="vda" bus="virtio"/>
Nov 15 08:37:31 user nova-compute[95467]:     </disk>
Nov 15 08:37:31 user nova-compute[95467]:     <disk type="block" device="disk">
Nov 15 08:37:31 user nova-compute[95467]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:37:31 user nova-compute[95467]:       <source dev="/dev/sdb"/>
Nov 15 08:37:31 user nova-compute[95467]:       <target dev="vdb" bus="virtio"/>
Nov 15 08:37:31 user nova-compute[95467]:       <serial>5e85d95d-936c-4e74-b53a-9e1b77c68fb1</serial>
Nov 15 08:37:31 user nova-compute[95467]:     </disk>
Nov 15 08:37:31 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:37:31 user nova-compute[95467]:       <mac address="fa:16:3e:81:ba:80"/>
Nov 15 08:37:31 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:37:31 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:37:31 user nova-compute[95467]:       <target dev="tap27b8a52f-50"/>
Nov 15 08:37:31 user nova-compute[95467]:     </interface>
Nov 15 08:37:31 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:37:31 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/console.log" append="off"/>
Nov 15 08:37:31 user nova-compute[95467]:     </serial>
Nov 15 08:37:31 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:37:31 user nova-compute[95467]:     <video>
Nov 15 08:37:31 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:37:31 user nova-compute[95467]:     </video>
Nov 15 08:37:31 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:37:31 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:37:31 user nova-compute[95467]:     </rng>
Nov 15 08:37:31 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:37:31 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:37:31 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:37:31 user nova-compute[95467]:     </memballoon>
Nov 15 08:37:31 user nova-compute[95467]:   </devices>
Nov 15 08:37:31 user nova-compute[95467]: </domain>
Nov 15 08:37:31 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:37:31 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:37:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:37:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:37:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:37:32 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:37:32 user nova-compute[95467]: DEBUG nova.objects.instance [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2945f42b-62a1-44c5-be3b-f1dbe6826c0f {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:37:32 user nova-compute[95467]: DEBUG nova.objects.base [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Object Instance<2945f42b-62a1-44c5-be3b-f1dbe6826c0f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=95467) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 08:37:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:37:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.164s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:37:32 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/disk. size=1073741824 {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 08:37:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:37:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:37:32 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Cannot resize image /opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/disk to a smaller size. {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 08:37:32 user nova-compute[95467]: DEBUG nova.objects.instance [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lazy-loading 'migration_context' on Instance uuid 2945f42b-62a1-44c5-be3b-f1dbe6826c0f {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:37:32 user nova-compute[95467]: DEBUG nova.objects.base [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Object Instance<2945f42b-62a1-44c5-be3b-f1dbe6826c0f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=95467) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 08:37:32 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:33:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1665521832',display_name='tempest-AttachVolumeTestJSON-server-1665521832',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1665521832',id=49,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHEZ4L2W1PqDn37Zx7UIz0j2KcbPq+rly9Qd/KJO59g5c8MCgjoXP3xcb3EyLIk0CvVsb/gd4fXybCigHKczFCKQxo4IJMRUgO0RY0jH5aIgYmljg+NxxHHdbnLulJeSuQ==',key_name='tempest-keypair-1324520091',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:33:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='a9a636c8b7074bd19eeee608156f8568',ramdisk_id='',reservation_id='r-fsabz05b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1507968277',owner_user_name='tempest-AttachVolumeTestJSON-1507968277-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:35:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e31df8ed5a914b2395b548606b65e580',uuid=2945f42b-62a1-44c5-be3b-f1dbe6826c0f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "27b8a52f-50f2-42e6-9c9f-9b74f9778096", "address": "fa:16:3e:81:ba:80", "network": {"id": "26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1542679712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9a636c8b7074bd19eeee608156f8568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b8a52f-50", "ovs_interfaceid": "27b8a52f-50f2-42e6-9c9f-9b74f9778096", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:37:32 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Converting VIF {"id": "27b8a52f-50f2-42e6-9c9f-9b74f9778096", "address": "fa:16:3e:81:ba:80", "network": {"id": "26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1542679712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9a636c8b7074bd19eeee608156f8568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b8a52f-50", "ovs_interfaceid": "27b8a52f-50f2-42e6-9c9f-9b74f9778096", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:37:32 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:ba:80,bridge_name='br-int',has_traffic_filtering=True,id=27b8a52f-50f2-42e6-9c9f-9b74f9778096,network=Network(26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27b8a52f-50') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:37:32 user nova-compute[95467]: DEBUG os_vif [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:ba:80,bridge_name='br-int',has_traffic_filtering=True,id=27b8a52f-50f2-42e6-9c9f-9b74f9778096,network=Network(26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27b8a52f-50') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:37:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:37:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:37:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:37:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:37:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '285d7eca-fd49-53a1-880b-efb515c32d78', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:37:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:37:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:37:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:37:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap27b8a52f-50, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:37:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap27b8a52f-50, col_values=(('qos', UUID('1614e64a-035b-476e-8429-0758eb9a69ec')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:37:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap27b8a52f-50, col_values=(('external_ids', {'iface-id': '27b8a52f-50f2-42e6-9c9f-9b74f9778096', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:ba:80', 'vm-uuid': '2945f42b-62a1-44c5-be3b-f1dbe6826c0f'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:37:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:37:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:37:32 user nova-compute[95467]: INFO os_vif [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:ba:80,bridge_name='br-int',has_traffic_filtering=True,id=27b8a52f-50f2-42e6-9c9f-9b74f9778096,network=Network(26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27b8a52f-50')
Nov 15 08:37:34 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:37:34 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:37:34 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:37:34 user nova-compute[95467]: DEBUG nova.compute.manager [req-0479324e-99d2-4fe7-99dd-645e7143ff89 req-63329f12-5c59-4c22-80c7-3913b3d54209 service nova] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Received event network-vif-plugged-27b8a52f-50f2-42e6-9c9f-9b74f9778096 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:37:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-0479324e-99d2-4fe7-99dd-645e7143ff89 req-63329f12-5c59-4c22-80c7-3913b3d54209 service nova] Acquiring lock "2945f42b-62a1-44c5-be3b-f1dbe6826c0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:37:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-0479324e-99d2-4fe7-99dd-645e7143ff89 req-63329f12-5c59-4c22-80c7-3913b3d54209 service nova] Lock "2945f42b-62a1-44c5-be3b-f1dbe6826c0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:37:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-0479324e-99d2-4fe7-99dd-645e7143ff89 req-63329f12-5c59-4c22-80c7-3913b3d54209 service nova] Lock "2945f42b-62a1-44c5-be3b-f1dbe6826c0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:37:34 user nova-compute[95467]: DEBUG nova.compute.manager [req-0479324e-99d2-4fe7-99dd-645e7143ff89 req-63329f12-5c59-4c22-80c7-3913b3d54209 service nova] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] No waiting events found dispatching network-vif-plugged-27b8a52f-50f2-42e6-9c9f-9b74f9778096 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:37:34 user nova-compute[95467]: WARNING nova.compute.manager [req-0479324e-99d2-4fe7-99dd-645e7143ff89 req-63329f12-5c59-4c22-80c7-3913b3d54209 service nova] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Received unexpected event network-vif-plugged-27b8a52f-50f2-42e6-9c9f-9b74f9778096 for instance with vm_state stopped and task_state powering-on.
Nov 15 08:37:34 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:37:34 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:37:34 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:37:34 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:37:36 user nova-compute[95467]: DEBUG nova.compute.manager [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Instance event wait completed in 0 seconds for  {{(pid=95467) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 08:37:36 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Instance rebooted successfully.
Nov 15 08:37:36 user nova-compute[95467]: DEBUG nova.compute.manager [None req-110ec932-e9ae-436a-9331-c2efee0d2cc9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:37:36 user nova-compute[95467]: DEBUG nova.compute.manager [req-720e800d-0284-4ac5-b5af-32f2f67f8a02 req-f729c6a5-1076-4ea2-8954-0cf123c1ba72 service nova] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Received event network-vif-plugged-27b8a52f-50f2-42e6-9c9f-9b74f9778096 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:37:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-720e800d-0284-4ac5-b5af-32f2f67f8a02 req-f729c6a5-1076-4ea2-8954-0cf123c1ba72 service nova] Acquiring lock "2945f42b-62a1-44c5-be3b-f1dbe6826c0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:37:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-720e800d-0284-4ac5-b5af-32f2f67f8a02 req-f729c6a5-1076-4ea2-8954-0cf123c1ba72 service nova] Lock "2945f42b-62a1-44c5-be3b-f1dbe6826c0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:37:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-720e800d-0284-4ac5-b5af-32f2f67f8a02 req-f729c6a5-1076-4ea2-8954-0cf123c1ba72 service nova] Lock "2945f42b-62a1-44c5-be3b-f1dbe6826c0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:37:36 user nova-compute[95467]: DEBUG nova.compute.manager [req-720e800d-0284-4ac5-b5af-32f2f67f8a02 req-f729c6a5-1076-4ea2-8954-0cf123c1ba72 service nova] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] No waiting events found dispatching network-vif-plugged-27b8a52f-50f2-42e6-9c9f-9b74f9778096 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:37:36 user nova-compute[95467]: WARNING nova.compute.manager [req-720e800d-0284-4ac5-b5af-32f2f67f8a02 req-f729c6a5-1076-4ea2-8954-0cf123c1ba72 service nova] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Received unexpected event network-vif-plugged-27b8a52f-50f2-42e6-9c9f-9b74f9778096 for instance with vm_state active and task_state None.
Nov 15 08:37:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:37:38 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:37:42 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:37:45 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:37:45 user nova-compute[95467]: DEBUG nova.compute.manager [req-9317b14c-ee79-4bed-8105-56015a363d47 req-f03eec57-4539-49ce-a0e8-a01bd1cac88c service nova] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Received event network-changed-469317c8-e304-434f-aa57-d791c555d494 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:37:45 user nova-compute[95467]: DEBUG nova.compute.manager [req-9317b14c-ee79-4bed-8105-56015a363d47 req-f03eec57-4539-49ce-a0e8-a01bd1cac88c service nova] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Refreshing instance network info cache due to event network-changed-469317c8-e304-434f-aa57-d791c555d494. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:37:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-9317b14c-ee79-4bed-8105-56015a363d47 req-f03eec57-4539-49ce-a0e8-a01bd1cac88c service nova] Acquiring lock "refresh_cache-c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:37:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-9317b14c-ee79-4bed-8105-56015a363d47 req-f03eec57-4539-49ce-a0e8-a01bd1cac88c service nova] Acquired lock "refresh_cache-c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:37:45 user nova-compute[95467]: DEBUG nova.network.neutron [req-9317b14c-ee79-4bed-8105-56015a363d47 req-f03eec57-4539-49ce-a0e8-a01bd1cac88c service nova] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Refreshing network info cache for port 469317c8-e304-434f-aa57-d791c555d494 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:37:46 user nova-compute[95467]: DEBUG nova.network.neutron [req-9317b14c-ee79-4bed-8105-56015a363d47 req-f03eec57-4539-49ce-a0e8-a01bd1cac88c service nova] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Updated VIF entry in instance network info cache for port 469317c8-e304-434f-aa57-d791c555d494. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:37:46 user nova-compute[95467]: DEBUG nova.network.neutron [req-9317b14c-ee79-4bed-8105-56015a363d47 req-f03eec57-4539-49ce-a0e8-a01bd1cac88c service nova] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Updating instance_info_cache with network_info: [{"id": "469317c8-e304-434f-aa57-d791c555d494", "address": "fa:16:3e:4f:39:f3", "network": {"id": "d67049b6-2e91-4d1e-8e42-5388ef75521a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984085217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7355ea3588ae4c2f9242e63084008710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469317c8-e3", "ovs_interfaceid": "469317c8-e304-434f-aa57-d791c555d494", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:37:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-9317b14c-ee79-4bed-8105-56015a363d47 req-f03eec57-4539-49ce-a0e8-a01bd1cac88c service nova] Releasing lock "refresh_cache-c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:37:47 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-c86e7b73-deda-42a5-a597-33efe937ab20 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Acquiring lock "c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:37:47 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-c86e7b73-deda-42a5-a597-33efe937ab20 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:37:47 user nova-compute[95467]: INFO nova.compute.manager [None req-c86e7b73-deda-42a5-a597-33efe937ab20 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Detaching volume df597122-35e7-4d3a-8ea0-b3c6073617d3
Nov 15 08:37:47 user nova-compute[95467]: INFO nova.virt.block_device [None req-c86e7b73-deda-42a5-a597-33efe937ab20 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Attempting to driver detach volume df597122-35e7-4d3a-8ea0-b3c6073617d3 from mountpoint /dev/vdb
Nov 15 08:37:47 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-c86e7b73-deda-42a5-a597-33efe937ab20 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Attempting to detach device vdb from instance c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c from the persistent domain config. {{(pid=95467) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 08:37:47 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-c86e7b73-deda-42a5-a597-33efe937ab20 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 08:37:47 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:37:47 user nova-compute[95467]:   <source dev="/dev/sdc"/>
Nov 15 08:37:47 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:37:47 user nova-compute[95467]:   <serial>df597122-35e7-4d3a-8ea0-b3c6073617d3</serial>
Nov 15 08:37:47 user nova-compute[95467]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 08:37:47 user nova-compute[95467]: </disk>
Nov 15 08:37:47 user nova-compute[95467]:  {{(pid=95467) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 08:37:47 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-c86e7b73-deda-42a5-a597-33efe937ab20 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Successfully detached device vdb from instance c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c from the persistent domain config.
Nov 15 08:37:47 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-c86e7b73-deda-42a5-a597-33efe937ab20 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c from the live domain config. {{(pid=95467) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 08:37:47 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-c86e7b73-deda-42a5-a597-33efe937ab20 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 08:37:47 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:37:47 user nova-compute[95467]:   <source dev="/dev/sdc"/>
Nov 15 08:37:47 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:37:47 user nova-compute[95467]:   <serial>df597122-35e7-4d3a-8ea0-b3c6073617d3</serial>
Nov 15 08:37:47 user nova-compute[95467]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 08:37:47 user nova-compute[95467]: </disk>
Nov 15 08:37:47 user nova-compute[95467]:  {{(pid=95467) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 08:37:47 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:37:47 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-c86e7b73-deda-42a5-a597-33efe937ab20 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c {{(pid=95467) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 08:37:48 user nova-compute[95467]: DEBUG nova.compute.manager [req-6a5967d7-387b-46b4-b3db-685b9d570ce8 req-bacaa71e-b458-4daf-bb5b-ed5f1710ca58 service nova] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Received event network-changed-469317c8-e304-434f-aa57-d791c555d494 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:37:48 user nova-compute[95467]: DEBUG nova.compute.manager [req-6a5967d7-387b-46b4-b3db-685b9d570ce8 req-bacaa71e-b458-4daf-bb5b-ed5f1710ca58 service nova] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Refreshing instance network info cache due to event network-changed-469317c8-e304-434f-aa57-d791c555d494. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:37:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-6a5967d7-387b-46b4-b3db-685b9d570ce8 req-bacaa71e-b458-4daf-bb5b-ed5f1710ca58 service nova] Acquiring lock "refresh_cache-c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:37:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-6a5967d7-387b-46b4-b3db-685b9d570ce8 req-bacaa71e-b458-4daf-bb5b-ed5f1710ca58 service nova] Acquired lock "refresh_cache-c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:37:48 user nova-compute[95467]: DEBUG nova.network.neutron [req-6a5967d7-387b-46b4-b3db-685b9d570ce8 req-bacaa71e-b458-4daf-bb5b-ed5f1710ca58 service nova] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Refreshing network info cache for port 469317c8-e304-434f-aa57-d791c555d494 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:37:48 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:37:48 user nova-compute[95467]: DEBUG nova.network.neutron [req-6a5967d7-387b-46b4-b3db-685b9d570ce8 req-bacaa71e-b458-4daf-bb5b-ed5f1710ca58 service nova] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Updated VIF entry in instance network info cache for port 469317c8-e304-434f-aa57-d791c555d494. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:37:48 user nova-compute[95467]: DEBUG nova.network.neutron [req-6a5967d7-387b-46b4-b3db-685b9d570ce8 req-bacaa71e-b458-4daf-bb5b-ed5f1710ca58 service nova] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Updating instance_info_cache with network_info: [{"id": "469317c8-e304-434f-aa57-d791c555d494", "address": "fa:16:3e:4f:39:f3", "network": {"id": "d67049b6-2e91-4d1e-8e42-5388ef75521a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984085217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7355ea3588ae4c2f9242e63084008710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469317c8-e3", "ovs_interfaceid": "469317c8-e304-434f-aa57-d791c555d494", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:37:48 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-6a5967d7-387b-46b4-b3db-685b9d570ce8 req-bacaa71e-b458-4daf-bb5b-ed5f1710ca58 service nova] Releasing lock "refresh_cache-c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:37:52 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:37:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:37:55 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:37:55 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=95467) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 08:37:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:37:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:37:58 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:37:59 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager.update_available_resource {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:37:59 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:37:59 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:37:59 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:37:59 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Auditing locally available compute resources for user (node: user) {{(pid=95467) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 08:37:59 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:37:59 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:37:59 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:38:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:38:00 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:38:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:38:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:38:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:38:00 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:38:00 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:38:00 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:38:00 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Hypervisor/Node resource view: name=user free_ram=8789MB free_disk=25.048538208007812GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=95467) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 08:38:00 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:38:00 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:38:01 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 2945f42b-62a1-44c5-be3b-f1dbe6826c0f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:38:01 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:38:01 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 08:38:01 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 08:38:01 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:38:01 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:38:01 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Compute_service record updated for user:user {{(pid=95467) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 08:38:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.277s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:38:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:38:03 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:38:03 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:38:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:38:05 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:38:06 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:38:07 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:38:07 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Starting heal instance info cache {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 08:38:07 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "refresh_cache-c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:38:07 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquired lock "refresh_cache-c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:38:07 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Forcefully refreshing network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 08:38:07 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:38:07 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-c86e7b73-deda-42a5-a597-33efe937ab20 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c is timed out.
Nov 15 08:38:07 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-c86e7b73-deda-42a5-a597-33efe937ab20 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Successfully detached device vdb from instance c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c from the live domain config.
Nov 15 08:38:07 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c86e7b73-deda-42a5-a597-33efe937ab20 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] calling os-brick to detach iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 08:38:07 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c86e7b73-deda-42a5-a597-33efe937ab20 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, {'target_iqn': 'iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vloNywIR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:38:07 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-c86e7b73-deda-42a5-a597-33efe937ab20 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:38:07 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-c86e7b73-deda-42a5-a597-33efe937ab20 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:38:07 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-c86e7b73-deda-42a5-a597-33efe937ab20 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:38:07 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:38:07 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:38:07 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8df677-6c8e-4a61-8b27-464145864fe9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:38:07 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c86e7b73-deda-42a5-a597-33efe937ab20 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 08:38:07 user nova-compute[95467]: No targets found.
Nov 15 08:38:07 user nova-compute[95467]: iSNS:
Nov 15 08:38:07 user nova-compute[95467]: No targets found.
Nov 15 08:38:07 user nova-compute[95467]: STATIC:
Nov 15 08:38:07 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3
Nov 15 08:38:07 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:38:07 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:38:07 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1
Nov 15 08:38:07 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:38:07 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:38:07 user nova-compute[95467]: FIRMWARE:
Nov 15 08:38:07 user nova-compute[95467]: No targets found.
Nov 15 08:38:07 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:38:07 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c86e7b73-deda-42a5-a597-33efe937ab20 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 08:38:07 user nova-compute[95467]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 08:38:07 user nova-compute[95467]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=95467) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 08:38:07 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c86e7b73-deda-42a5-a597-33efe937ab20 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3', 0)] {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 08:38:07 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:38:08 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:38:08 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5d6b35-fdb6-4f07-b099-2dfd71f061a0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:38:08 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:38:08 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:38:08 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29ba97d-8466-4c2d-838d-420530225671]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:38:08 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c86e7b73-deda-42a5-a597-33efe937ab20 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3 (non-flash)
Nov 15 08:38:08 user nova-compute[95467]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 (non-flash)
Nov 15 08:38:08 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:38:08 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c86e7b73-deda-42a5-a597-33efe937ab20 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3 (non-flash)
Nov 15 08:38:08 user nova-compute[95467]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 (non-flash)
Nov 15 08:38:08 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:38:08 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c86e7b73-deda-42a5-a597-33efe937ab20 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efec836fac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3'): ({'sdc'}, set())}) {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 08:38:08 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-c86e7b73-deda-42a5-a597-33efe937ab20 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Removing single pathed devices sdc {{(pid=95467) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 08:38:08 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:38:08 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:38:08 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a61c10-b81d-46c4-b836-ddda5a61b75d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:38:08 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:38:08 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:38:08 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28e9582-687a-48b0-9d9b-dad78b256f82]: (4, ('ok\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:38:08 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-c86e7b73-deda-42a5-a597-33efe937ab20 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Flushing IO for device /dev/sdc {{(pid=95467) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 08:38:08 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:38:08 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Updating instance_info_cache with network_info: [{"id": "469317c8-e304-434f-aa57-d791c555d494", "address": "fa:16:3e:4f:39:f3", "network": {"id": "d67049b6-2e91-4d1e-8e42-5388ef75521a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984085217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7355ea3588ae4c2f9242e63084008710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469317c8-e3", "ovs_interfaceid": "469317c8-e304-434f-aa57-d791c555d494", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:38:08 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:38:08 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e9fa9d-1e28-4ff5-955f-31370e6ef2f4]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:38:08 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-c86e7b73-deda-42a5-a597-33efe937ab20 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=95467) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 08:38:08 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:38:08 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Releasing lock "refresh_cache-c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:38:08 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Updated the network info_cache for instance {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 08:38:08 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:38:08 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd7b281-22b0-4ed4-be75-c27ec7ede3f6]: (4, ('1', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:38:08 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-c86e7b73-deda-42a5-a597-33efe937ab20 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 08:38:08 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-c86e7b73-deda-42a5-a597-33efe937ab20 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] SCSI volumes sdc have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 08:38:08 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c86e7b73-deda-42a5-a597-33efe937ab20 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3')] {{(pid=95467) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 08:38:08 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:38:08 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:38:08 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2fdff0-dcd0-4a81-9bf2-7d49b757ff5b]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:38:08 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c86e7b73-deda-42a5-a597-33efe937ab20 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:38:08 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3 -p 172.16.0.220:3260 --logout {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:38:08 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:38:08 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:38:08 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[54198fc2-76f4-42ef-8cfc-10cf5b69eaca]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:38:08 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c86e7b73-deda-42a5-a597-33efe937ab20 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3, portal: 172.16.0.220,3260]
Nov 15 08:38:08 user nova-compute[95467]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3, portal: 172.16.0.220,3260] successful.
Nov 15 08:38:08 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:38:08 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3 -p 172.16.0.220:3260 --op delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:38:08 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df597122-35e7-4d3a-8ea0-b3c6073617d3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:38:08 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee028c39-d2a0-4d42-8ba5-53dfa20cc9ed]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:38:08 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c86e7b73-deda-42a5-a597-33efe937ab20 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:38:08 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-c86e7b73-deda-42a5-a597-33efe937ab20 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:38:08 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c86e7b73-deda-42a5-a597-33efe937ab20 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] <== disconnect_volume: return (302ms) None {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:38:08 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c86e7b73-deda-42a5-a597-33efe937ab20 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Disconnected iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 08:38:08 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:38:08 user nova-compute[95467]: DEBUG nova.objects.instance [None req-c86e7b73-deda-42a5-a597-33efe937ab20 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lazy-loading 'flavor' on Instance uuid c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:38:08 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-c86e7b73-deda-42a5-a597-33efe937ab20 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.598s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:38:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:38:13 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:38:17 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:38:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:38:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:38:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:38:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:38:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=95467) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 08:38:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:38:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:38:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:38:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:38:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d11d7860-4a37-460d-aea7-ebbabf5919e5 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Acquiring lock "c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:38:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d11d7860-4a37-460d-aea7-ebbabf5919e5 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:38:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d11d7860-4a37-460d-aea7-ebbabf5919e5 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Acquiring lock "c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:38:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d11d7860-4a37-460d-aea7-ebbabf5919e5 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:38:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d11d7860-4a37-460d-aea7-ebbabf5919e5 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:38:39 user nova-compute[95467]: INFO nova.compute.manager [None req-d11d7860-4a37-460d-aea7-ebbabf5919e5 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Terminating instance
Nov 15 08:38:39 user nova-compute[95467]: DEBUG nova.compute.manager [None req-d11d7860-4a37-460d-aea7-ebbabf5919e5 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Start destroying the instance on the hypervisor. {{(pid=95467) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 08:38:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:38:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:38:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:38:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:38:40 user nova-compute[95467]: DEBUG nova.compute.manager [req-0d37dc0a-e613-42a4-9180-0af6091c52e2 req-9ebeb3be-c0fa-43ca-9c60-4973fac9447f service nova] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Received event network-vif-unplugged-469317c8-e304-434f-aa57-d791c555d494 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:38:40 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-0d37dc0a-e613-42a4-9180-0af6091c52e2 req-9ebeb3be-c0fa-43ca-9c60-4973fac9447f service nova] Acquiring lock "c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:38:40 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-0d37dc0a-e613-42a4-9180-0af6091c52e2 req-9ebeb3be-c0fa-43ca-9c60-4973fac9447f service nova] Lock "c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:38:40 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-0d37dc0a-e613-42a4-9180-0af6091c52e2 req-9ebeb3be-c0fa-43ca-9c60-4973fac9447f service nova] Lock "c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:38:40 user nova-compute[95467]: DEBUG nova.compute.manager [req-0d37dc0a-e613-42a4-9180-0af6091c52e2 req-9ebeb3be-c0fa-43ca-9c60-4973fac9447f service nova] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] No waiting events found dispatching network-vif-unplugged-469317c8-e304-434f-aa57-d791c555d494 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:38:40 user nova-compute[95467]: DEBUG nova.compute.manager [req-0d37dc0a-e613-42a4-9180-0af6091c52e2 req-9ebeb3be-c0fa-43ca-9c60-4973fac9447f service nova] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Received event network-vif-unplugged-469317c8-e304-434f-aa57-d791c555d494 for instance with task_state deleting. {{(pid=95467) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 08:38:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:38:40 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Instance destroyed successfully.
Nov 15 08:38:40 user nova-compute[95467]: DEBUG nova.objects.instance [None req-d11d7860-4a37-460d-aea7-ebbabf5919e5 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lazy-loading 'resources' on Instance uuid c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:38:40 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-d11d7860-4a37-460d-aea7-ebbabf5919e5 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:33:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1078493853',display_name='tempest-TestMinimumBasicScenario-server-1078493853',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1078493853',id=50,image_ref='5287dd1e-2bf5-4503-98db-e03e6d3d044f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFuo49k9cvv7YNAlDfgSDtSKD5rkKjZXUDBHBnwxYNRe8PhjZ3K4zmMBSfZv32JlPsh+fr3qErhJmjvAamhoAh2VTCuxfWFiDo8zp3ZYgGDbY08lk14VdY8/gEVybaHTzA==',key_name='tempest-TestMinimumBasicScenario-1958468488',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:33:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7355ea3588ae4c2f9242e63084008710',ramdisk_id='',reservation_id='r-zru7ldf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5287dd1e-2bf5-4503-98db-e03e6d3d044f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-721378270',owner_user_name='tempest-TestMinimumBasicScenario-721378270-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:36:02Z,user_data=None,user_id='7b095b34b1b74a28a9f0b96cb6f033aa',uuid=c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "469317c8-e304-434f-aa57-d791c555d494", "address": "fa:16:3e:4f:39:f3", "network": {"id": "d67049b6-2e91-4d1e-8e42-5388ef75521a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984085217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7355ea3588ae4c2f9242e63084008710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469317c8-e3", "ovs_interfaceid": "469317c8-e304-434f-aa57-d791c555d494", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:38:40 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-d11d7860-4a37-460d-aea7-ebbabf5919e5 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Converting VIF {"id": "469317c8-e304-434f-aa57-d791c555d494", "address": "fa:16:3e:4f:39:f3", "network": {"id": "d67049b6-2e91-4d1e-8e42-5388ef75521a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984085217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7355ea3588ae4c2f9242e63084008710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469317c8-e3", "ovs_interfaceid": "469317c8-e304-434f-aa57-d791c555d494", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:38:40 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-d11d7860-4a37-460d-aea7-ebbabf5919e5 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:39:f3,bridge_name='br-int',has_traffic_filtering=True,id=469317c8-e304-434f-aa57-d791c555d494,network=Network(d67049b6-2e91-4d1e-8e42-5388ef75521a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469317c8-e3') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:38:40 user nova-compute[95467]: DEBUG os_vif [None req-d11d7860-4a37-460d-aea7-ebbabf5919e5 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:39:f3,bridge_name='br-int',has_traffic_filtering=True,id=469317c8-e304-434f-aa57-d791c555d494,network=Network(d67049b6-2e91-4d1e-8e42-5388ef75521a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469317c8-e3') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:38:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:38:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap469317c8-e3, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:38:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:38:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:38:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:38:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aa2a936f-aa54-4d93-a37f-d6d20b40ad5e) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:38:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:38:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:38:40 user nova-compute[95467]: INFO os_vif [None req-d11d7860-4a37-460d-aea7-ebbabf5919e5 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:39:f3,bridge_name='br-int',has_traffic_filtering=True,id=469317c8-e304-434f-aa57-d791c555d494,network=Network(d67049b6-2e91-4d1e-8e42-5388ef75521a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469317c8-e3')
Nov 15 08:38:40 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-d11d7860-4a37-460d-aea7-ebbabf5919e5 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Deleting instance files /opt/stack/data/nova/instances/c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c_del
Nov 15 08:38:40 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-d11d7860-4a37-460d-aea7-ebbabf5919e5 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Deletion of /opt/stack/data/nova/instances/c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c_del complete
Nov 15 08:38:40 user nova-compute[95467]: INFO nova.compute.manager [None req-d11d7860-4a37-460d-aea7-ebbabf5919e5 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 15 08:38:40 user nova-compute[95467]: DEBUG oslo.service.loopingcall [None req-d11d7860-4a37-460d-aea7-ebbabf5919e5 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=95467) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 08:38:40 user nova-compute[95467]: DEBUG nova.compute.manager [-] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Deallocating network for instance {{(pid=95467) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 08:38:40 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] deallocate_for_instance() {{(pid=95467) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 08:38:41 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:38:41 user nova-compute[95467]: INFO nova.compute.manager [-] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Took 0.47 seconds to deallocate network for instance.
Nov 15 08:38:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d11d7860-4a37-460d-aea7-ebbabf5919e5 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:38:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d11d7860-4a37-460d-aea7-ebbabf5919e5 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:38:41 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-d11d7860-4a37-460d-aea7-ebbabf5919e5 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:38:41 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-d11d7860-4a37-460d-aea7-ebbabf5919e5 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:38:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d11d7860-4a37-460d-aea7-ebbabf5919e5 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.171s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:38:41 user nova-compute[95467]: INFO nova.scheduler.client.report [None req-d11d7860-4a37-460d-aea7-ebbabf5919e5 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Deleted allocations for instance c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c
Nov 15 08:38:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d11d7860-4a37-460d-aea7-ebbabf5919e5 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.678s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:38:42 user nova-compute[95467]: DEBUG nova.compute.manager [req-0e9f49f8-a7b3-4621-b060-867df4e71748 req-119f58d7-8a4c-40fc-8449-ecaed3f0a57f service nova] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Received event network-vif-plugged-469317c8-e304-434f-aa57-d791c555d494 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:38:42 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-0e9f49f8-a7b3-4621-b060-867df4e71748 req-119f58d7-8a4c-40fc-8449-ecaed3f0a57f service nova] Acquiring lock "c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:38:42 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-0e9f49f8-a7b3-4621-b060-867df4e71748 req-119f58d7-8a4c-40fc-8449-ecaed3f0a57f service nova] Lock "c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:38:42 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-0e9f49f8-a7b3-4621-b060-867df4e71748 req-119f58d7-8a4c-40fc-8449-ecaed3f0a57f service nova] Lock "c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:38:42 user nova-compute[95467]: DEBUG nova.compute.manager [req-0e9f49f8-a7b3-4621-b060-867df4e71748 req-119f58d7-8a4c-40fc-8449-ecaed3f0a57f service nova] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] No waiting events found dispatching network-vif-plugged-469317c8-e304-434f-aa57-d791c555d494 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:38:42 user nova-compute[95467]: WARNING nova.compute.manager [req-0e9f49f8-a7b3-4621-b060-867df4e71748 req-119f58d7-8a4c-40fc-8449-ecaed3f0a57f service nova] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Received unexpected event network-vif-plugged-469317c8-e304-434f-aa57-d791c555d494 for instance with vm_state deleted and task_state None.
Nov 15 08:38:42 user nova-compute[95467]: DEBUG nova.compute.manager [req-0e9f49f8-a7b3-4621-b060-867df4e71748 req-119f58d7-8a4c-40fc-8449-ecaed3f0a57f service nova] [instance: c8bcaab2-c48d-47b2-a545-1eb3c8ffce2c] Received event network-vif-deleted-469317c8-e304-434f-aa57-d791c555d494 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:38:45 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:38:50 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:38:55 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:38:56 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:38:56 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=95467) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 08:39:00 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:39:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:39:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:39:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=95467) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 08:39:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:39:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:39:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:39:01 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager.update_available_resource {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:39:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:39:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:39:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:39:01 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Auditing locally available compute resources for user (node: user) {{(pid=95467) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 08:39:01 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:39:01 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:39:01 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:39:02 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:39:02 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:39:02 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:39:02 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:39:02 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Hypervisor/Node resource view: name=user free_ram=8974MB free_disk=25.075763702392578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=95467) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 08:39:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:39:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:39:02 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 2945f42b-62a1-44c5-be3b-f1dbe6826c0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:39:02 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 08:39:02 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 08:39:02 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:39:02 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:39:02 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Compute_service record updated for user:user {{(pid=95467) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 08:39:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.180s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:39:03 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:39:03 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:39:05 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:39:05 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:39:08 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:39:09 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:39:09 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Starting heal instance info cache {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 08:39:09 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Rebuilding the list of instances to heal {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 08:39:09 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "refresh_cache-2945f42b-62a1-44c5-be3b-f1dbe6826c0f" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:39:09 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquired lock "refresh_cache-2945f42b-62a1-44c5-be3b-f1dbe6826c0f" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:39:09 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Forcefully refreshing network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 08:39:09 user nova-compute[95467]: DEBUG nova.objects.instance [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lazy-loading 'info_cache' on Instance uuid 2945f42b-62a1-44c5-be3b-f1dbe6826c0f {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:39:10 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Updating instance_info_cache with network_info: [{"id": "27b8a52f-50f2-42e6-9c9f-9b74f9778096", "address": "fa:16:3e:81:ba:80", "network": {"id": "26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1542679712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9a636c8b7074bd19eeee608156f8568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b8a52f-50", "ovs_interfaceid": "27b8a52f-50f2-42e6-9c9f-9b74f9778096", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:39:10 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Releasing lock "refresh_cache-2945f42b-62a1-44c5-be3b-f1dbe6826c0f" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:39:10 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Updated the network info_cache for instance {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 08:39:10 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:39:10 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:39:10 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:39:10 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=95467) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 08:39:10 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:39:10 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:39:10 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:39:15 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:39:20 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8b4c688f-87ee-43dd-a555-70930a77660d tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Acquiring lock "2945f42b-62a1-44c5-be3b-f1dbe6826c0f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:39:20 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8b4c688f-87ee-43dd-a555-70930a77660d tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "2945f42b-62a1-44c5-be3b-f1dbe6826c0f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:39:20 user nova-compute[95467]: INFO nova.compute.manager [None req-8b4c688f-87ee-43dd-a555-70930a77660d tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Detaching volume 5e85d95d-936c-4e74-b53a-9e1b77c68fb1
Nov 15 08:39:20 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:39:20 user nova-compute[95467]: INFO nova.virt.block_device [None req-8b4c688f-87ee-43dd-a555-70930a77660d tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Attempting to driver detach volume 5e85d95d-936c-4e74-b53a-9e1b77c68fb1 from mountpoint /dev/vdb
Nov 15 08:39:20 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-8b4c688f-87ee-43dd-a555-70930a77660d tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Attempting to detach device vdb from instance 2945f42b-62a1-44c5-be3b-f1dbe6826c0f from the persistent domain config. {{(pid=95467) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 08:39:20 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-8b4c688f-87ee-43dd-a555-70930a77660d tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 08:39:20 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:39:20 user nova-compute[95467]:   <source dev="/dev/sdb"/>
Nov 15 08:39:20 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:39:20 user nova-compute[95467]:   <serial>5e85d95d-936c-4e74-b53a-9e1b77c68fb1</serial>
Nov 15 08:39:20 user nova-compute[95467]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 08:39:20 user nova-compute[95467]: </disk>
Nov 15 08:39:20 user nova-compute[95467]:  {{(pid=95467) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 08:39:20 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-8b4c688f-87ee-43dd-a555-70930a77660d tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Successfully detached device vdb from instance 2945f42b-62a1-44c5-be3b-f1dbe6826c0f from the persistent domain config.
Nov 15 08:39:20 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-8b4c688f-87ee-43dd-a555-70930a77660d tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2945f42b-62a1-44c5-be3b-f1dbe6826c0f from the live domain config. {{(pid=95467) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 08:39:20 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-8b4c688f-87ee-43dd-a555-70930a77660d tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 08:39:20 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:39:20 user nova-compute[95467]:   <source dev="/dev/sdb"/>
Nov 15 08:39:20 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:39:20 user nova-compute[95467]:   <serial>5e85d95d-936c-4e74-b53a-9e1b77c68fb1</serial>
Nov 15 08:39:20 user nova-compute[95467]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 08:39:20 user nova-compute[95467]: </disk>
Nov 15 08:39:20 user nova-compute[95467]:  {{(pid=95467) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 08:39:21 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-8b4c688f-87ee-43dd-a555-70930a77660d tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2945f42b-62a1-44c5-be3b-f1dbe6826c0f {{(pid=95467) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 08:39:23 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:39:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:39:30 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:39:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Acquiring lock "fd289f63-f798-4ce2-81c6-fab844644f77" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:39:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "fd289f63-f798-4ce2-81c6-fab844644f77" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:39:34 user nova-compute[95467]: DEBUG nova.compute.manager [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Starting instance... {{(pid=95467) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 08:39:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:39:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:39:34 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=95467) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 08:39:34 user nova-compute[95467]: INFO nova.compute.claims [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Claim successful on node user
Nov 15 08:39:34 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:39:34 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:39:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.222s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:39:34 user nova-compute[95467]: DEBUG nova.compute.manager [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Start building networks asynchronously for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 08:39:34 user nova-compute[95467]: DEBUG nova.compute.manager [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Allocating IP information in the background. {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 08:39:34 user nova-compute[95467]: DEBUG nova.network.neutron [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] allocate_for_instance() {{(pid=95467) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 08:39:34 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 08:39:34 user nova-compute[95467]: DEBUG nova.compute.manager [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Start building block device mappings for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 08:39:34 user nova-compute[95467]: DEBUG nova.policy [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7b095b34b1b74a28a9f0b96cb6f033aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7355ea3588ae4c2f9242e63084008710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95467) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 08:39:34 user nova-compute[95467]: DEBUG nova.compute.manager [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Start spawning the instance on the hypervisor. {{(pid=95467) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 08:39:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Creating instance directory {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 08:39:34 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Creating image(s)
Nov 15 08:39:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Acquiring lock "/opt/stack/data/nova/instances/fd289f63-f798-4ce2-81c6-fab844644f77/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:39:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "/opt/stack/data/nova/instances/fd289f63-f798-4ce2-81c6-fab844644f77/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:39:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "/opt/stack/data/nova/instances/fd289f63-f798-4ce2-81c6-fab844644f77/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:39:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Acquiring lock "1bc64fc4d0d0036c65598f9c56a5c593d94982c5" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:39:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "1bc64fc4d0d0036c65598f9c56a5c593d94982c5" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:39:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1bc64fc4d0d0036c65598f9c56a5c593d94982c5.part --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:39:35 user nova-compute[95467]: DEBUG nova.network.neutron [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Successfully created port: 8da3553b-1b91-429a-b165-274a1f254c8c {{(pid=95467) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 08:39:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1bc64fc4d0d0036c65598f9c56a5c593d94982c5.part --force-share --output=json" returned: 0 in 0.183s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:39:35 user nova-compute[95467]: DEBUG nova.virt.images [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] b660b411-a40e-4687-a819-c5891baf783b was qcow2, converting to raw {{(pid=95467) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 08:39:35 user nova-compute[95467]: DEBUG nova.privsep.utils [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=95467) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 08:39:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1bc64fc4d0d0036c65598f9c56a5c593d94982c5.part /opt/stack/data/nova/instances/_base/1bc64fc4d0d0036c65598f9c56a5c593d94982c5.converted {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:39:35 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:39:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1bc64fc4d0d0036c65598f9c56a5c593d94982c5.part /opt/stack/data/nova/instances/_base/1bc64fc4d0d0036c65598f9c56a5c593d94982c5.converted" returned: 0 in 0.655s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:39:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1bc64fc4d0d0036c65598f9c56a5c593d94982c5.converted --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:39:36 user nova-compute[95467]: DEBUG nova.network.neutron [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Successfully updated port: 8da3553b-1b91-429a-b165-274a1f254c8c {{(pid=95467) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 08:39:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1bc64fc4d0d0036c65598f9c56a5c593d94982c5.converted --force-share --output=json" returned: 0 in 0.180s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:39:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "1bc64fc4d0d0036c65598f9c56a5c593d94982c5" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.475s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:39:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1bc64fc4d0d0036c65598f9c56a5c593d94982c5 --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:39:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Acquiring lock "refresh_cache-fd289f63-f798-4ce2-81c6-fab844644f77" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:39:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Acquired lock "refresh_cache-fd289f63-f798-4ce2-81c6-fab844644f77" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:39:36 user nova-compute[95467]: DEBUG nova.network.neutron [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:39:36 user nova-compute[95467]: DEBUG nova.compute.manager [req-f68ef509-60bb-40e5-ad83-9154d3f54b5f req-f3694cf8-cc2f-4244-b0ab-82b8a59e8634 service nova] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Received event network-changed-8da3553b-1b91-429a-b165-274a1f254c8c {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:39:36 user nova-compute[95467]: DEBUG nova.compute.manager [req-f68ef509-60bb-40e5-ad83-9154d3f54b5f req-f3694cf8-cc2f-4244-b0ab-82b8a59e8634 service nova] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Refreshing instance network info cache due to event network-changed-8da3553b-1b91-429a-b165-274a1f254c8c. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:39:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-f68ef509-60bb-40e5-ad83-9154d3f54b5f req-f3694cf8-cc2f-4244-b0ab-82b8a59e8634 service nova] Acquiring lock "refresh_cache-fd289f63-f798-4ce2-81c6-fab844644f77" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:39:36 user nova-compute[95467]: DEBUG nova.network.neutron [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Instance cache missing network info. {{(pid=95467) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 08:39:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1bc64fc4d0d0036c65598f9c56a5c593d94982c5 --force-share --output=json" returned: 0 in 0.181s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:39:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Acquiring lock "1bc64fc4d0d0036c65598f9c56a5c593d94982c5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:39:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "1bc64fc4d0d0036c65598f9c56a5c593d94982c5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:39:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1bc64fc4d0d0036c65598f9c56a5c593d94982c5 --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:39:36 user nova-compute[95467]: DEBUG nova.network.neutron [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Updating instance_info_cache with network_info: [{"id": "8da3553b-1b91-429a-b165-274a1f254c8c", "address": "fa:16:3e:01:ef:a0", "network": {"id": "d67049b6-2e91-4d1e-8e42-5388ef75521a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984085217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7355ea3588ae4c2f9242e63084008710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8da3553b-1b", "ovs_interfaceid": "8da3553b-1b91-429a-b165-274a1f254c8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:39:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1bc64fc4d0d0036c65598f9c56a5c593d94982c5 --force-share --output=json" returned: 0 in 0.174s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:39:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1bc64fc4d0d0036c65598f9c56a5c593d94982c5,backing_fmt=raw /opt/stack/data/nova/instances/fd289f63-f798-4ce2-81c6-fab844644f77/disk 1073741824 {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:39:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Releasing lock "refresh_cache-fd289f63-f798-4ce2-81c6-fab844644f77" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:39:36 user nova-compute[95467]: DEBUG nova.compute.manager [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Instance network_info: |[{"id": "8da3553b-1b91-429a-b165-274a1f254c8c", "address": "fa:16:3e:01:ef:a0", "network": {"id": "d67049b6-2e91-4d1e-8e42-5388ef75521a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984085217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7355ea3588ae4c2f9242e63084008710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8da3553b-1b", "ovs_interfaceid": "8da3553b-1b91-429a-b165-274a1f254c8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 08:39:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-f68ef509-60bb-40e5-ad83-9154d3f54b5f req-f3694cf8-cc2f-4244-b0ab-82b8a59e8634 service nova] Acquired lock "refresh_cache-fd289f63-f798-4ce2-81c6-fab844644f77" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:39:36 user nova-compute[95467]: DEBUG nova.network.neutron [req-f68ef509-60bb-40e5-ad83-9154d3f54b5f req-f3694cf8-cc2f-4244-b0ab-82b8a59e8634 service nova] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Refreshing network info cache for port 8da3553b-1b91-429a-b165-274a1f254c8c {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:39:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1bc64fc4d0d0036c65598f9c56a5c593d94982c5,backing_fmt=raw /opt/stack/data/nova/instances/fd289f63-f798-4ce2-81c6-fab844644f77/disk 1073741824" returned: 0 in 0.051s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:39:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "1bc64fc4d0d0036c65598f9c56a5c593d94982c5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:39:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1bc64fc4d0d0036c65598f9c56a5c593d94982c5 --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:39:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1bc64fc4d0d0036c65598f9c56a5c593d94982c5 --force-share --output=json" returned: 0 in 0.172s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:39:36 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fd289f63-f798-4ce2-81c6-fab844644f77/disk. size=1073741824 {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 08:39:36 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd289f63-f798-4ce2-81c6-fab844644f77/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:39:37 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd289f63-f798-4ce2-81c6-fab844644f77/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:39:37 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Cannot resize image /opt/stack/data/nova/instances/fd289f63-f798-4ce2-81c6-fab844644f77/disk to a smaller size. {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 08:39:37 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Created local disks {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 08:39:37 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Ensure instance console log exists: /opt/stack/data/nova/instances/fd289f63-f798-4ce2-81c6-fab844644f77/console.log {{(pid=95467) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 08:39:37 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:39:37 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:39:37 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:39:37 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Start _get_guest_xml network_info=[{"id": "8da3553b-1b91-429a-b165-274a1f254c8c", "address": "fa:16:3e:01:ef:a0", "network": {"id": "d67049b6-2e91-4d1e-8e42-5388ef75521a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984085217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7355ea3588ae4c2f9242e63084008710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8da3553b-1b", "ovs_interfaceid": "8da3553b-1b91-429a-b165-274a1f254c8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:39:31Z,direct_url=<?>,disk_format='qcow2',id=b660b411-a40e-4687-a819-c5891baf783b,min_disk=0,min_ram=0,name='tempest-scenario-img--1061763451',owner='7355ea3588ae4c2f9242e63084008710',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:39:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'b660b411-a40e-4687-a819-c5891baf783b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:39:37 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:39:37 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:39:37 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:39:37 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:39:37 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:39:37 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:39:37 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:39:37 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:39:31Z,direct_url=<?>,disk_format='qcow2',id=b660b411-a40e-4687-a819-c5891baf783b,min_disk=0,min_ram=0,name='tempest-scenario-img--1061763451',owner='7355ea3588ae4c2f9242e63084008710',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:39:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:39:37 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:39:37 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:39:37 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:39:37 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:39:37 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:39:37 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:39:37 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:39:37 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:39:37 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:39:37 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:39:37 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:39:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-714632764',display_name='tempest-TestMinimumBasicScenario-server-714632764',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-714632764',id=51,image_ref='b660b411-a40e-4687-a819-c5891baf783b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIKmXtZ9KdS9rhcL4ObJxwUWN7w+PpgehOowCqFulrc1MTQdYal5X9NIIMcz8yKQhhDsKQLa64/vhUkMpw4j4E3mq8VSrdEJCi98jVsRmqkVmDmbH7zE4cCLXkS6AZUYqA==',key_name='tempest-TestMinimumBasicScenario-91627207',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7355ea3588ae4c2f9242e63084008710',ramdisk_id='',reservation_id='r-jfrdwfa0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b660b411-a40e-4687-a819-c5891baf783b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-721378270',owner_user_name='tempest-TestMinimumBasicScenario-721378270-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:39:35Z,user_data=None,user_id='7b095b34b1b74a28a9f0b96cb6f033aa',uuid=fd289f63-f798-4ce2-81c6-fab844644f77,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8da3553b-1b91-429a-b165-274a1f254c8c", "address": "fa:16:3e:01:ef:a0", "network": {"id": "d67049b6-2e91-4d1e-8e42-5388ef75521a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984085217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7355ea3588ae4c2f9242e63084008710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8da3553b-1b", "ovs_interfaceid": "8da3553b-1b91-429a-b165-274a1f254c8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:39:37 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Converting VIF {"id": "8da3553b-1b91-429a-b165-274a1f254c8c", "address": "fa:16:3e:01:ef:a0", "network": {"id": "d67049b6-2e91-4d1e-8e42-5388ef75521a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984085217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7355ea3588ae4c2f9242e63084008710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8da3553b-1b", "ovs_interfaceid": "8da3553b-1b91-429a-b165-274a1f254c8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:39:37 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:ef:a0,bridge_name='br-int',has_traffic_filtering=True,id=8da3553b-1b91-429a-b165-274a1f254c8c,network=Network(d67049b6-2e91-4d1e-8e42-5388ef75521a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8da3553b-1b') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:39:37 user nova-compute[95467]: DEBUG nova.objects.instance [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lazy-loading 'pci_devices' on Instance uuid fd289f63-f798-4ce2-81c6-fab844644f77 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:39:37 user nova-compute[95467]: DEBUG nova.network.neutron [req-f68ef509-60bb-40e5-ad83-9154d3f54b5f req-f3694cf8-cc2f-4244-b0ab-82b8a59e8634 service nova] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Updated VIF entry in instance network info cache for port 8da3553b-1b91-429a-b165-274a1f254c8c. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:39:37 user nova-compute[95467]: DEBUG nova.network.neutron [req-f68ef509-60bb-40e5-ad83-9154d3f54b5f req-f3694cf8-cc2f-4244-b0ab-82b8a59e8634 service nova] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Updating instance_info_cache with network_info: [{"id": "8da3553b-1b91-429a-b165-274a1f254c8c", "address": "fa:16:3e:01:ef:a0", "network": {"id": "d67049b6-2e91-4d1e-8e42-5388ef75521a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984085217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7355ea3588ae4c2f9242e63084008710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8da3553b-1b", "ovs_interfaceid": "8da3553b-1b91-429a-b165-274a1f254c8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:39:37 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:39:37 user nova-compute[95467]:   <uuid>fd289f63-f798-4ce2-81c6-fab844644f77</uuid>
Nov 15 08:39:37 user nova-compute[95467]:   <name>instance-00000033</name>
Nov 15 08:39:37 user nova-compute[95467]:   <memory>524288</memory>
Nov 15 08:39:37 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:39:37 user nova-compute[95467]:   <metadata>
Nov 15 08:39:37 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:39:37 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:39:37 user nova-compute[95467]:       <nova:name>tempest-TestMinimumBasicScenario-server-714632764</nova:name>
Nov 15 08:39:37 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:39:37</nova:creationTime>
Nov 15 08:39:37 user nova-compute[95467]:       <nova:flavor name="m1.tiny">
Nov 15 08:39:37 user nova-compute[95467]:         <nova:memory>512</nova:memory>
Nov 15 08:39:37 user nova-compute[95467]:         <nova:disk>1</nova:disk>
Nov 15 08:39:37 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:39:37 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:39:37 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:39:37 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:39:37 user nova-compute[95467]:       <nova:owner>
Nov 15 08:39:37 user nova-compute[95467]:         <nova:user uuid="7b095b34b1b74a28a9f0b96cb6f033aa">tempest-TestMinimumBasicScenario-721378270-project-member</nova:user>
Nov 15 08:39:37 user nova-compute[95467]:         <nova:project uuid="7355ea3588ae4c2f9242e63084008710">tempest-TestMinimumBasicScenario-721378270</nova:project>
Nov 15 08:39:37 user nova-compute[95467]:       </nova:owner>
Nov 15 08:39:37 user nova-compute[95467]:       <nova:root type="image" uuid="b660b411-a40e-4687-a819-c5891baf783b"/>
Nov 15 08:39:37 user nova-compute[95467]:       <nova:ports>
Nov 15 08:39:37 user nova-compute[95467]:         <nova:port uuid="8da3553b-1b91-429a-b165-274a1f254c8c">
Nov 15 08:39:37 user nova-compute[95467]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 08:39:37 user nova-compute[95467]:         </nova:port>
Nov 15 08:39:37 user nova-compute[95467]:       </nova:ports>
Nov 15 08:39:37 user nova-compute[95467]:     </nova:instance>
Nov 15 08:39:37 user nova-compute[95467]:   </metadata>
Nov 15 08:39:37 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:39:37 user nova-compute[95467]:     <system>
Nov 15 08:39:37 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:39:37 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:39:37 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:39:37 user nova-compute[95467]:       <entry name="serial">fd289f63-f798-4ce2-81c6-fab844644f77</entry>
Nov 15 08:39:37 user nova-compute[95467]:       <entry name="uuid">fd289f63-f798-4ce2-81c6-fab844644f77</entry>
Nov 15 08:39:37 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:39:37 user nova-compute[95467]:     </system>
Nov 15 08:39:37 user nova-compute[95467]:   </sysinfo>
Nov 15 08:39:37 user nova-compute[95467]:   <os>
Nov 15 08:39:37 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:39:37 user nova-compute[95467]:     <boot dev="hd"/>
Nov 15 08:39:37 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:39:37 user nova-compute[95467]:   </os>
Nov 15 08:39:37 user nova-compute[95467]:   <features>
Nov 15 08:39:37 user nova-compute[95467]:     <acpi/>
Nov 15 08:39:37 user nova-compute[95467]:     <apic/>
Nov 15 08:39:37 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:39:37 user nova-compute[95467]:   </features>
Nov 15 08:39:37 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:39:37 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:39:37 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:39:37 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:39:37 user nova-compute[95467]:   </clock>
Nov 15 08:39:37 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:39:37 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:39:37 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:39:37 user nova-compute[95467]:   </cpu>
Nov 15 08:39:37 user nova-compute[95467]:   <devices>
Nov 15 08:39:37 user nova-compute[95467]:     <disk type="file" device="disk">
Nov 15 08:39:37 user nova-compute[95467]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 08:39:37 user nova-compute[95467]:       <source file="/opt/stack/data/nova/instances/fd289f63-f798-4ce2-81c6-fab844644f77/disk"/>
Nov 15 08:39:37 user nova-compute[95467]:       <target dev="vda" bus="virtio"/>
Nov 15 08:39:37 user nova-compute[95467]:     </disk>
Nov 15 08:39:37 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:39:37 user nova-compute[95467]:       <mac address="fa:16:3e:01:ef:a0"/>
Nov 15 08:39:37 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:39:37 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:39:37 user nova-compute[95467]:       <target dev="tap8da3553b-1b"/>
Nov 15 08:39:37 user nova-compute[95467]:     </interface>
Nov 15 08:39:37 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:39:37 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/fd289f63-f798-4ce2-81c6-fab844644f77/console.log" append="off"/>
Nov 15 08:39:37 user nova-compute[95467]:     </serial>
Nov 15 08:39:37 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:39:37 user nova-compute[95467]:     <video>
Nov 15 08:39:37 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:39:37 user nova-compute[95467]:     </video>
Nov 15 08:39:37 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:39:37 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:39:37 user nova-compute[95467]:     </rng>
Nov 15 08:39:37 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:39:37 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:39:37 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:39:37 user nova-compute[95467]:     </memballoon>
Nov 15 08:39:37 user nova-compute[95467]:   </devices>
Nov 15 08:39:37 user nova-compute[95467]: </domain>
Nov 15 08:39:37 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:39:37 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:39:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-714632764',display_name='tempest-TestMinimumBasicScenario-server-714632764',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-714632764',id=51,image_ref='b660b411-a40e-4687-a819-c5891baf783b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIKmXtZ9KdS9rhcL4ObJxwUWN7w+PpgehOowCqFulrc1MTQdYal5X9NIIMcz8yKQhhDsKQLa64/vhUkMpw4j4E3mq8VSrdEJCi98jVsRmqkVmDmbH7zE4cCLXkS6AZUYqA==',key_name='tempest-TestMinimumBasicScenario-91627207',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7355ea3588ae4c2f9242e63084008710',ramdisk_id='',reservation_id='r-jfrdwfa0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b660b411-a40e-4687-a819-c5891baf783b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-721378270',owner_user_name='tempest-TestMinimumBasicScenario-721378270-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:39:35Z,user_data=None,user_id='7b095b34b1b74a28a9f0b96cb6f033aa',uuid=fd289f63-f798-4ce2-81c6-fab844644f77,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8da3553b-1b91-429a-b165-274a1f254c8c", "address": "fa:16:3e:01:ef:a0", "network": {"id": "d67049b6-2e91-4d1e-8e42-5388ef75521a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984085217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7355ea3588ae4c2f9242e63084008710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8da3553b-1b", "ovs_interfaceid": "8da3553b-1b91-429a-b165-274a1f254c8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:39:37 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Converting VIF {"id": "8da3553b-1b91-429a-b165-274a1f254c8c", "address": "fa:16:3e:01:ef:a0", "network": {"id": "d67049b6-2e91-4d1e-8e42-5388ef75521a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984085217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7355ea3588ae4c2f9242e63084008710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8da3553b-1b", "ovs_interfaceid": "8da3553b-1b91-429a-b165-274a1f254c8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:39:37 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:ef:a0,bridge_name='br-int',has_traffic_filtering=True,id=8da3553b-1b91-429a-b165-274a1f254c8c,network=Network(d67049b6-2e91-4d1e-8e42-5388ef75521a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8da3553b-1b') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:39:37 user nova-compute[95467]: DEBUG os_vif [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:ef:a0,bridge_name='br-int',has_traffic_filtering=True,id=8da3553b-1b91-429a-b165-274a1f254c8c,network=Network(d67049b6-2e91-4d1e-8e42-5388ef75521a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8da3553b-1b') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:39:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:39:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:39:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:39:37 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-f68ef509-60bb-40e5-ad83-9154d3f54b5f req-f3694cf8-cc2f-4244-b0ab-82b8a59e8634 service nova] Releasing lock "refresh_cache-fd289f63-f798-4ce2-81c6-fab844644f77" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:39:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:39:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e5f111c6-f05c-59ba-af0c-80c0622f2663', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:39:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:39:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:39:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:39:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8da3553b-1b, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:39:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8da3553b-1b, col_values=(('qos', UUID('329878f3-da7e-456e-b1d7-9eb65238178d')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:39:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8da3553b-1b, col_values=(('external_ids', {'iface-id': '8da3553b-1b91-429a-b165-274a1f254c8c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:ef:a0', 'vm-uuid': 'fd289f63-f798-4ce2-81c6-fab844644f77'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:39:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:39:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:39:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:39:37 user nova-compute[95467]: INFO os_vif [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:ef:a0,bridge_name='br-int',has_traffic_filtering=True,id=8da3553b-1b91-429a-b165-274a1f254c8c,network=Network(d67049b6-2e91-4d1e-8e42-5388ef75521a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8da3553b-1b')
Nov 15 08:39:37 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:39:37 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] No VIF found with MAC fa:16:3e:01:ef:a0, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:39:38 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:39:38 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:39:38 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:39:38 user nova-compute[95467]: DEBUG nova.compute.manager [req-ad2b7b84-d450-46fe-80c8-47c0fb6009f5 req-629cb8aa-2ac2-48bd-8bf3-fad4bd48c49b service nova] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Received event network-vif-plugged-8da3553b-1b91-429a-b165-274a1f254c8c {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:39:38 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ad2b7b84-d450-46fe-80c8-47c0fb6009f5 req-629cb8aa-2ac2-48bd-8bf3-fad4bd48c49b service nova] Acquiring lock "fd289f63-f798-4ce2-81c6-fab844644f77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:39:38 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ad2b7b84-d450-46fe-80c8-47c0fb6009f5 req-629cb8aa-2ac2-48bd-8bf3-fad4bd48c49b service nova] Lock "fd289f63-f798-4ce2-81c6-fab844644f77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:39:38 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ad2b7b84-d450-46fe-80c8-47c0fb6009f5 req-629cb8aa-2ac2-48bd-8bf3-fad4bd48c49b service nova] Lock "fd289f63-f798-4ce2-81c6-fab844644f77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:39:38 user nova-compute[95467]: DEBUG nova.compute.manager [req-ad2b7b84-d450-46fe-80c8-47c0fb6009f5 req-629cb8aa-2ac2-48bd-8bf3-fad4bd48c49b service nova] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] No waiting events found dispatching network-vif-plugged-8da3553b-1b91-429a-b165-274a1f254c8c {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:39:38 user nova-compute[95467]: WARNING nova.compute.manager [req-ad2b7b84-d450-46fe-80c8-47c0fb6009f5 req-629cb8aa-2ac2-48bd-8bf3-fad4bd48c49b service nova] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Received unexpected event network-vif-plugged-8da3553b-1b91-429a-b165-274a1f254c8c for instance with vm_state building and task_state spawning.
Nov 15 08:39:38 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:39:39 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:39:39 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:39:39 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:39:40 user nova-compute[95467]: DEBUG nova.compute.manager [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Instance event wait completed in 0 seconds for  {{(pid=95467) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 08:39:40 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Guest created on hypervisor {{(pid=95467) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 08:39:40 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Instance spawned successfully.
Nov 15 08:39:40 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 08:39:40 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Found default for hw_cdrom_bus of ide {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:39:40 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Found default for hw_disk_bus of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:39:40 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Found default for hw_input_bus of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:39:40 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Found default for hw_pointer_model of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:39:40 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Found default for hw_video_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:39:40 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Found default for hw_vif_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:39:40 user nova-compute[95467]: INFO nova.compute.manager [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Took 5.81 seconds to spawn the instance on the hypervisor.
Nov 15 08:39:40 user nova-compute[95467]: DEBUG nova.compute.manager [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:39:40 user nova-compute[95467]: INFO nova.compute.manager [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Took 6.36 seconds to build instance.
Nov 15 08:39:40 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-794c67d2-5d60-49e6-8a36-bfacd2e115fe tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "fd289f63-f798-4ce2-81c6-fab844644f77" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.461s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:39:40 user nova-compute[95467]: DEBUG nova.compute.manager [req-83e8bd67-6626-445f-8aa0-2ac8bcd083eb req-40a2d270-e74c-4c36-b71a-f67828c2993b service nova] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Received event network-vif-plugged-8da3553b-1b91-429a-b165-274a1f254c8c {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:39:40 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-83e8bd67-6626-445f-8aa0-2ac8bcd083eb req-40a2d270-e74c-4c36-b71a-f67828c2993b service nova] Acquiring lock "fd289f63-f798-4ce2-81c6-fab844644f77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:39:40 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-83e8bd67-6626-445f-8aa0-2ac8bcd083eb req-40a2d270-e74c-4c36-b71a-f67828c2993b service nova] Lock "fd289f63-f798-4ce2-81c6-fab844644f77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:39:40 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-83e8bd67-6626-445f-8aa0-2ac8bcd083eb req-40a2d270-e74c-4c36-b71a-f67828c2993b service nova] Lock "fd289f63-f798-4ce2-81c6-fab844644f77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:39:40 user nova-compute[95467]: DEBUG nova.compute.manager [req-83e8bd67-6626-445f-8aa0-2ac8bcd083eb req-40a2d270-e74c-4c36-b71a-f67828c2993b service nova] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] No waiting events found dispatching network-vif-plugged-8da3553b-1b91-429a-b165-274a1f254c8c {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:39:40 user nova-compute[95467]: WARNING nova.compute.manager [req-83e8bd67-6626-445f-8aa0-2ac8bcd083eb req-40a2d270-e74c-4c36-b71a-f67828c2993b service nova] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Received unexpected event network-vif-plugged-8da3553b-1b91-429a-b165-274a1f254c8c for instance with vm_state active and task_state None.
Nov 15 08:39:41 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-8b4c688f-87ee-43dd-a555-70930a77660d tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2945f42b-62a1-44c5-be3b-f1dbe6826c0f is timed out.
Nov 15 08:39:41 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-8b4c688f-87ee-43dd-a555-70930a77660d tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Successfully detached device vdb from instance 2945f42b-62a1-44c5-be3b-f1dbe6826c0f from the live domain config.
Nov 15 08:39:41 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b4c688f-87ee-43dd-a555-70930a77660d tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] calling os-brick to detach iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 08:39:41 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b4c688f-87ee-43dd-a555-70930a77660d tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, {'target_iqn': 'iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aXoYUDZA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:39:41 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-8b4c688f-87ee-43dd-a555-70930a77660d tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:39:41 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-8b4c688f-87ee-43dd-a555-70930a77660d tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:39:41 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-8b4c688f-87ee-43dd-a555-70930a77660d tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:39:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:39:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:39:41 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc134578-f436-452f-a53c-79aad1a6bf37]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:39:41 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b4c688f-87ee-43dd-a555-70930a77660d tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 08:39:41 user nova-compute[95467]: No targets found.
Nov 15 08:39:41 user nova-compute[95467]: iSNS:
Nov 15 08:39:41 user nova-compute[95467]: No targets found.
Nov 15 08:39:41 user nova-compute[95467]: STATIC:
Nov 15 08:39:41 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1
Nov 15 08:39:41 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:39:41 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:39:41 user nova-compute[95467]: FIRMWARE:
Nov 15 08:39:41 user nova-compute[95467]: No targets found.
Nov 15 08:39:41 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:39:41 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b4c688f-87ee-43dd-a555-70930a77660d tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 08:39:41 user nova-compute[95467]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 08:39:41 user nova-compute[95467]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=95467) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 08:39:41 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b4c688f-87ee-43dd-a555-70930a77660d tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1', 0)] {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 08:39:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:39:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:39:41 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5abc466-b253-42d3-a1f5-69d3f9f6435e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:39:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:39:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:39:41 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ded248f-1fcc-4984-b170-c37715d268de]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:39:41 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b4c688f-87ee-43dd-a555-70930a77660d tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 (non-flash)
Nov 15 08:39:41 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:39:41 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b4c688f-87ee-43dd-a555-70930a77660d tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 (non-flash)
Nov 15 08:39:41 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:39:41 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b4c688f-87ee-43dd-a555-70930a77660d tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efec81d0040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1'): ({'sdb'}, set())}) {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 08:39:41 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-8b4c688f-87ee-43dd-a555-70930a77660d tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Removing single pathed devices sdb {{(pid=95467) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 08:39:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:39:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:39:41 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9e413a-3c13-4955-a57e-60bb6807c0ba]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:39:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:39:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:39:41 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50c35bf-c157-46c9-aae8-8910f677c8fd]: (4, ('ok\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:39:41 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-8b4c688f-87ee-43dd-a555-70930a77660d tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Flushing IO for device /dev/sdb {{(pid=95467) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 08:39:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:39:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:39:41 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b5b44f-4025-4bde-a4f8-22f4d4c12c8b]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:39:41 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-8b4c688f-87ee-43dd-a555-70930a77660d tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=95467) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 08:39:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:39:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:39:41 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8836a49c-5933-466b-b1e3-a145cf2524c6]: (4, ('1', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:39:41 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-8b4c688f-87ee-43dd-a555-70930a77660d tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 08:39:41 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-8b4c688f-87ee-43dd-a555-70930a77660d tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] SCSI volumes sdb have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 08:39:41 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b4c688f-87ee-43dd-a555-70930a77660d tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1')] {{(pid=95467) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 08:39:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:39:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:39:41 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4205528-348c-4f73-a21b-4b62c409ccdd]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:39:41 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b4c688f-87ee-43dd-a555-70930a77660d tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:39:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 -p 172.16.0.220:3260 --logout {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:39:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:39:41 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[71035e7c-3631-419b-9014-df18198c5e31]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:39:41 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b4c688f-87ee-43dd-a555-70930a77660d tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1, portal: 172.16.0.220,3260]
Nov 15 08:39:41 user nova-compute[95467]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1, portal: 172.16.0.220,3260] successful.
Nov 15 08:39:41 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:39:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 -p 172.16.0.220:3260 --op delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:39:41 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e85d95d-936c-4e74-b53a-9e1b77c68fb1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:39:41 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8367a54d-3aed-4463-bf2b-c090eb0a7a00]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:39:41 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b4c688f-87ee-43dd-a555-70930a77660d tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:39:41 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-8b4c688f-87ee-43dd-a555-70930a77660d tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:39:41 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b4c688f-87ee-43dd-a555-70930a77660d tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] <== disconnect_volume: return (277ms) None {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:39:41 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b4c688f-87ee-43dd-a555-70930a77660d tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Disconnected iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 08:39:42 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:39:42 user nova-compute[95467]: DEBUG nova.objects.instance [None req-8b4c688f-87ee-43dd-a555-70930a77660d tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lazy-loading 'flavor' on Instance uuid 2945f42b-62a1-44c5-be3b-f1dbe6826c0f {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:39:42 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8b4c688f-87ee-43dd-a555-70930a77660d tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "2945f42b-62a1-44c5-be3b-f1dbe6826c0f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.557s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:39:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:39:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-82aa6b5c-50b1-429e-b323-cd86f55d1ee3 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Acquiring lock "2945f42b-62a1-44c5-be3b-f1dbe6826c0f" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:39:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-82aa6b5c-50b1-429e-b323-cd86f55d1ee3 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "2945f42b-62a1-44c5-be3b-f1dbe6826c0f" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:39:43 user nova-compute[95467]: DEBUG nova.compute.manager [None req-82aa6b5c-50b1-429e-b323-cd86f55d1ee3 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:39:43 user nova-compute[95467]: DEBUG nova.compute.manager [None req-82aa6b5c-50b1-429e-b323-cd86f55d1ee3 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=95467) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 15 08:39:43 user nova-compute[95467]: DEBUG nova.objects.instance [None req-82aa6b5c-50b1-429e-b323-cd86f55d1ee3 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lazy-loading 'flavor' on Instance uuid 2945f42b-62a1-44c5-be3b-f1dbe6826c0f {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:39:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:39:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:39:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:39:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:39:43 user nova-compute[95467]: DEBUG nova.compute.manager [req-a38ae2dc-763b-43aa-bc75-6894055f8276 req-e5a354cc-8404-4145-a165-d7966d7518af service nova] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Received event network-vif-unplugged-27b8a52f-50f2-42e6-9c9f-9b74f9778096 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:39:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-a38ae2dc-763b-43aa-bc75-6894055f8276 req-e5a354cc-8404-4145-a165-d7966d7518af service nova] Acquiring lock "2945f42b-62a1-44c5-be3b-f1dbe6826c0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:39:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-a38ae2dc-763b-43aa-bc75-6894055f8276 req-e5a354cc-8404-4145-a165-d7966d7518af service nova] Lock "2945f42b-62a1-44c5-be3b-f1dbe6826c0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:39:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-a38ae2dc-763b-43aa-bc75-6894055f8276 req-e5a354cc-8404-4145-a165-d7966d7518af service nova] Lock "2945f42b-62a1-44c5-be3b-f1dbe6826c0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:39:43 user nova-compute[95467]: DEBUG nova.compute.manager [req-a38ae2dc-763b-43aa-bc75-6894055f8276 req-e5a354cc-8404-4145-a165-d7966d7518af service nova] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] No waiting events found dispatching network-vif-unplugged-27b8a52f-50f2-42e6-9c9f-9b74f9778096 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:39:43 user nova-compute[95467]: WARNING nova.compute.manager [req-a38ae2dc-763b-43aa-bc75-6894055f8276 req-e5a354cc-8404-4145-a165-d7966d7518af service nova] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Received unexpected event network-vif-unplugged-27b8a52f-50f2-42e6-9c9f-9b74f9778096 for instance with vm_state active and task_state powering-off.
Nov 15 08:39:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:39:44 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Instance destroyed successfully.
Nov 15 08:39:44 user nova-compute[95467]: DEBUG nova.compute.manager [None req-82aa6b5c-50b1-429e-b323-cd86f55d1ee3 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:39:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-82aa6b5c-50b1-429e-b323-cd86f55d1ee3 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "2945f42b-62a1-44c5-be3b-f1dbe6826c0f" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.865s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:39:45 user nova-compute[95467]: DEBUG nova.compute.manager [req-e04d9cee-30f7-4985-a111-92ee365314d5 req-c44b6a3e-5779-4b4e-8a8a-bd4db744a714 service nova] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Received event network-vif-plugged-27b8a52f-50f2-42e6-9c9f-9b74f9778096 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:39:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-e04d9cee-30f7-4985-a111-92ee365314d5 req-c44b6a3e-5779-4b4e-8a8a-bd4db744a714 service nova] Acquiring lock "2945f42b-62a1-44c5-be3b-f1dbe6826c0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:39:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-e04d9cee-30f7-4985-a111-92ee365314d5 req-c44b6a3e-5779-4b4e-8a8a-bd4db744a714 service nova] Lock "2945f42b-62a1-44c5-be3b-f1dbe6826c0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:39:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-e04d9cee-30f7-4985-a111-92ee365314d5 req-c44b6a3e-5779-4b4e-8a8a-bd4db744a714 service nova] Lock "2945f42b-62a1-44c5-be3b-f1dbe6826c0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:39:45 user nova-compute[95467]: DEBUG nova.compute.manager [req-e04d9cee-30f7-4985-a111-92ee365314d5 req-c44b6a3e-5779-4b4e-8a8a-bd4db744a714 service nova] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] No waiting events found dispatching network-vif-plugged-27b8a52f-50f2-42e6-9c9f-9b74f9778096 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:39:45 user nova-compute[95467]: WARNING nova.compute.manager [req-e04d9cee-30f7-4985-a111-92ee365314d5 req-c44b6a3e-5779-4b4e-8a8a-bd4db744a714 service nova] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Received unexpected event network-vif-plugged-27b8a52f-50f2-42e6-9c9f-9b74f9778096 for instance with vm_state stopped and task_state None.
Nov 15 08:39:47 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:39:52 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:39:56 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:39:56 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=95467) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 08:39:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:39:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:40:01 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:40:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:40:02 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager.update_available_resource {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:40:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:40:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:40:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:40:02 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Auditing locally available compute resources for user (node: user) {{(pid=95467) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 08:40:02 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:40:02 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:40:02 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:40:03 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:40:03 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd289f63-f798-4ce2-81c6-fab844644f77/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:40:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:40:03 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd289f63-f798-4ce2-81c6-fab844644f77/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:40:03 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd289f63-f798-4ce2-81c6-fab844644f77/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:40:03 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd289f63-f798-4ce2-81c6-fab844644f77/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:40:03 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:40:03 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:40:03 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Hypervisor/Node resource view: name=user free_ram=8908MB free_disk=25.02615737915039GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=95467) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 08:40:03 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:40:03 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:40:03 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 2945f42b-62a1-44c5-be3b-f1dbe6826c0f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:40:03 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance fd289f63-f798-4ce2-81c6-fab844644f77 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:40:03 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 08:40:03 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 08:40:04 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:40:04 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:40:04 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Compute_service record updated for user:user {{(pid=95467) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 08:40:04 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.483s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:40:06 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:40:06 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:40:06 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:40:07 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:40:08 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:40:09 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:40:10 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:40:10 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Starting heal instance info cache {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 08:40:10 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Rebuilding the list of instances to heal {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 08:40:10 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "refresh_cache-2945f42b-62a1-44c5-be3b-f1dbe6826c0f" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:40:10 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquired lock "refresh_cache-2945f42b-62a1-44c5-be3b-f1dbe6826c0f" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:40:10 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Forcefully refreshing network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 08:40:10 user nova-compute[95467]: DEBUG nova.objects.instance [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lazy-loading 'info_cache' on Instance uuid 2945f42b-62a1-44c5-be3b-f1dbe6826c0f {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:40:11 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Updating instance_info_cache with network_info: [{"id": "27b8a52f-50f2-42e6-9c9f-9b74f9778096", "address": "fa:16:3e:81:ba:80", "network": {"id": "26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1542679712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9a636c8b7074bd19eeee608156f8568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b8a52f-50", "ovs_interfaceid": "27b8a52f-50f2-42e6-9c9f-9b74f9778096", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:40:11 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Releasing lock "refresh_cache-2945f42b-62a1-44c5-be3b-f1dbe6826c0f" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:40:11 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Updated the network info_cache for instance {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 08:40:11 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:40:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:40:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:40:17 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:40:17 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:40:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:40:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:40:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:40:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:40:42 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:40:47 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:40:52 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:40:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:40:57 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:40:57 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=95467) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 08:41:00 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:41:01 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:41:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:41:03 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager.update_available_resource {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:41:03 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:41:03 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:41:03 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:41:03 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Auditing locally available compute resources for user (node: user) {{(pid=95467) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 08:41:03 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:41:03 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:41:03 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:41:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:41:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd289f63-f798-4ce2-81c6-fab844644f77/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:41:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd289f63-f798-4ce2-81c6-fab844644f77/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:41:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd289f63-f798-4ce2-81c6-fab844644f77/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:41:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd289f63-f798-4ce2-81c6-fab844644f77/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:41:04 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:41:04 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:41:04 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Hypervisor/Node resource view: name=user free_ram=8975MB free_disk=25.024383544921875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=95467) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 08:41:04 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:41:04 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:41:05 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 2945f42b-62a1-44c5-be3b-f1dbe6826c0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:41:05 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance fd289f63-f798-4ce2-81c6-fab844644f77 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:41:05 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 08:41:05 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 08:41:05 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Refreshing inventories for resource provider f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 08:41:05 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Updating ProviderTree inventory for provider f56c3524-ed11-494e-82e4-b1a23920d1ae from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 08:41:05 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Updating inventory in ProviderTree for provider f56c3524-ed11-494e-82e4-b1a23920d1ae with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 08:41:05 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Refreshing aggregate associations for resource provider f56c3524-ed11-494e-82e4-b1a23920d1ae, aggregates: None {{(pid=95467) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 08:41:05 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Refreshing trait associations for resource provider f56c3524-ed11-494e-82e4-b1a23920d1ae, traits: COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSSE3,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI {{(pid=95467) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 08:41:05 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:41:05 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:41:05 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Compute_service record updated for user:user {{(pid=95467) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 08:41:05 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.474s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:41:06 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:41:06 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:41:06 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Cleaning up deleted instances with incomplete migration  {{(pid=95467) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 08:41:07 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:41:07 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:41:08 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:41:11 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:41:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:41:12 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:41:12 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Starting heal instance info cache {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 08:41:12 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "refresh_cache-fd289f63-f798-4ce2-81c6-fab844644f77" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:41:12 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquired lock "refresh_cache-fd289f63-f798-4ce2-81c6-fab844644f77" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:41:12 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Forcefully refreshing network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 08:41:13 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Updating instance_info_cache with network_info: [{"id": "8da3553b-1b91-429a-b165-274a1f254c8c", "address": "fa:16:3e:01:ef:a0", "network": {"id": "d67049b6-2e91-4d1e-8e42-5388ef75521a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984085217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7355ea3588ae4c2f9242e63084008710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8da3553b-1b", "ovs_interfaceid": "8da3553b-1b91-429a-b165-274a1f254c8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:41:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Releasing lock "refresh_cache-fd289f63-f798-4ce2-81c6-fab844644f77" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:41:13 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Updated the network info_cache for instance {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 08:41:13 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:41:17 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:41:21 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:41:21 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Cleaning up deleted instances {{(pid=95467) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 08:41:21 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] There are 0 instances to clean {{(pid=95467) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 08:41:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:41:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:41:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=95467) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 08:41:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:41:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:41:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:41:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3a1d949e-de4e-4e5b-9ba2-cbb711cd212a tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Acquiring lock "fd289f63-f798-4ce2-81c6-fab844644f77" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:41:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3a1d949e-de4e-4e5b-9ba2-cbb711cd212a tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "fd289f63-f798-4ce2-81c6-fab844644f77" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:41:26 user nova-compute[95467]: DEBUG nova.objects.instance [None req-3a1d949e-de4e-4e5b-9ba2-cbb711cd212a tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lazy-loading 'flavor' on Instance uuid fd289f63-f798-4ce2-81c6-fab844644f77 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:41:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3a1d949e-de4e-4e5b-9ba2-cbb711cd212a tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "fd289f63-f798-4ce2-81c6-fab844644f77" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:41:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3a1d949e-de4e-4e5b-9ba2-cbb711cd212a tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Acquiring lock "fd289f63-f798-4ce2-81c6-fab844644f77" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:41:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3a1d949e-de4e-4e5b-9ba2-cbb711cd212a tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "fd289f63-f798-4ce2-81c6-fab844644f77" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:41:26 user nova-compute[95467]: INFO nova.compute.manager [None req-3a1d949e-de4e-4e5b-9ba2-cbb711cd212a tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Attaching volume 0760323d-4844-4036-a200-22c7e316384f to /dev/vdb
Nov 15 08:41:26 user nova-compute[95467]: DEBUG os_brick.utils [None req-3a1d949e-de4e-4e5b-9ba2-cbb711cd212a tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:41:26 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:41:26 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:41:26 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ba119c-18e5-4fcf-a201-1dfa15c32d75]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:882ae90641f\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:41:26 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:41:26 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:41:26 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9027b1-57de-4258-96a0-c7de0799c145]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:41:26 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:41:26 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:41:26 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d33a471f-3c22-4d23-9365-d205899fe052]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:41:26 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[03469b7b-046e-44ad-b905-b52c4d948836]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:41:26 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3a1d949e-de4e-4e5b-9ba2-cbb711cd212a tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Running cmd (subprocess): nvme version {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:41:27 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3a1d949e-de4e-4e5b-9ba2-cbb711cd212a tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] 'nvme version' failed. Not Retrying. {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:41:27 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3a1d949e-de4e-4e5b-9ba2-cbb711cd212a tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] nvme not present on system {{(pid=95467) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 08:41:27 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:41:27 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:41:27 user nova-compute[95467]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 08:41:27 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9ee2ba-9348-4add-af3b-9049d7036306]: (4, '') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:41:27 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-3a1d949e-de4e-4e5b-9ba2-cbb711cd212a tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=95467) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 08:41:27 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-3a1d949e-de4e-4e5b-9ba2-cbb711cd212a tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 08:41:27 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-3a1d949e-de4e-4e5b-9ba2-cbb711cd212a tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] LIGHTOS: no hostnqn found. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 08:41:27 user nova-compute[95467]: DEBUG os_brick.utils [None req-3a1d949e-de4e-4e5b-9ba2-cbb711cd212a tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:882ae90641f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:41:27 user nova-compute[95467]: DEBUG nova.virt.block_device [None req-3a1d949e-de4e-4e5b-9ba2-cbb711cd212a tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Updating existing volume attachment record: 17e4f58b-fdfc-4dbb-93e6-8285ec3e51fd {{(pid=95467) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 08:41:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:41:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:41:32 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a1d949e-de4e-4e5b-9ba2-cbb711cd212a tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Calling os-brick to attach iSCSI Volume {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 08:41:32 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a1d949e-de4e-4e5b-9ba2-cbb711cd212a tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0760323d-4844-4036-a200-22c7e316384f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rnPzvBpF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:41:32 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-3a1d949e-de4e-4e5b-9ba2-cbb711cd212a tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:41:32 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-3a1d949e-de4e-4e5b-9ba2-cbb711cd212a tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:41:32 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-3a1d949e-de4e-4e5b-9ba2-cbb711cd212a tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:41:32 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-3a1d949e-de4e-4e5b-9ba2-cbb711cd212a tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:41:32 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-3a1d949e-de4e-4e5b-9ba2-cbb711cd212a tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0760323d-4844-4036-a200-22c7e316384f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:41:32 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-3a1d949e-de4e-4e5b-9ba2-cbb711cd212a tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0760323d-4844-4036-a200-22c7e316384f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:41:32 user nova-compute[95467]: INFO os_brick.initiator.connectors.iscsi [None req-3a1d949e-de4e-4e5b-9ba2-cbb711cd212a tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 08:41:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0760323d-4844-4036-a200-22c7e316384f -p 172.16.0.220:3260 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:41:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0760323d-4844-4036-a200-22c7e316384f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:41:32 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e16dcc-9df8-40a0-bf46-21b1458e60ca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:41:32 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a1d949e-de4e-4e5b-9ba2-cbb711cd212a tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 08:41:32 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:41:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0760323d-4844-4036-a200-22c7e316384f -p 172.16.0.220:3260 --interface default --op new {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:41:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0760323d-4844-4036-a200-22c7e316384f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:41:32 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80a27e1-b9aa-4f6a-9375-fa3085d672ed]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0760323d-4844-4036-a200-22c7e316384f] added\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:41:32 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a1d949e-de4e-4e5b-9ba2-cbb711cd212a tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0760323d-4844-4036-a200-22c7e316384f] added
Nov 15 08:41:32 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:41:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0760323d-4844-4036-a200-22c7e316384f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:41:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0760323d-4844-4036-a200-22c7e316384f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:41:32 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d620b85-0fb7-4b64-86ae-67cb321a9012]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:41:32 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a1d949e-de4e-4e5b-9ba2-cbb711cd212a tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:41:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0760323d-4844-4036-a200-22c7e316384f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:41:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0760323d-4844-4036-a200-22c7e316384f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:41:32 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa26ebed-39b3-4420-a421-d28d37f60a2c]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:41:32 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a1d949e-de4e-4e5b-9ba2-cbb711cd212a tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:41:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0760323d-4844-4036-a200-22c7e316384f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rnPzvBpF {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:41:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0760323d-4844-4036-a200-22c7e316384f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rnPzvBpF" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:41:32 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9b7a04-da2d-4f0b-b809-a9920b1887f3]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:41:32 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a1d949e-de4e-4e5b-9ba2-cbb711cd212a tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rnPzvBpF'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:41:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0760323d-4844-4036-a200-22c7e316384f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:41:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0760323d-4844-4036-a200-22c7e316384f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:41:32 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[96258294-3f59-4064-9f6b-2dcfd54baf34]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:41:32 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a1d949e-de4e-4e5b-9ba2-cbb711cd212a tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:41:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:41:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:41:32 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5561ba-229f-4c1b-a620-33c7289f793c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:41:32 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a1d949e-de4e-4e5b-9ba2-cbb711cd212a tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 08:41:32 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:41:32 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a1d949e-de4e-4e5b-9ba2-cbb711cd212a tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 08:41:32 user nova-compute[95467]:  {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:41:32 user nova-compute[95467]: WARNING os_brick.initiator.connectors.iscsi [None req-3a1d949e-de4e-4e5b-9ba2-cbb711cd212a tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 08:41:32 user nova-compute[95467]: 
Nov 15 08:41:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0760323d-4844-4036-a200-22c7e316384f -p 172.16.0.220:3260 --login {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:41:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0760323d-4844-4036-a200-22c7e316384f -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:41:32 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb1073f-89a6-4010-8993-4543ae1549b6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0760323d-4844-4036-a200-22c7e316384f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0760323d-4844-4036-a200-22c7e316384f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:41:32 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a1d949e-de4e-4e5b-9ba2-cbb711cd212a tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0760323d-4844-4036-a200-22c7e316384f, portal: 172.16.0.220,3260]
Nov 15 08:41:32 user nova-compute[95467]: Login to [iface: default, target: iqn.2010-10.org.openstack:0760323d-4844-4036-a200-22c7e316384f, portal: 172.16.0.220,3260] successful.
Nov 15 08:41:32 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:41:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0760323d-4844-4036-a200-22c7e316384f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:41:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0760323d-4844-4036-a200-22c7e316384f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:41:32 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[629ad8ea-12c4-4603-a0d7-71f5f793c9d4]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:41:32 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a1d949e-de4e-4e5b-9ba2-cbb711cd212a tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:41:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:41:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:41:32 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8214ed90-265e-4548-8110-7f576ab5f307]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0760323d-4844-4036-a200-22c7e316384f (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:41:32 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a1d949e-de4e-4e5b-9ba2-cbb711cd212a tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0760323d-4844-4036-a200-22c7e316384f (non-flash)
Nov 15 08:41:32 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:41:32 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a1d949e-de4e-4e5b-9ba2-cbb711cd212a tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0760323d-4844-4036-a200-22c7e316384f (non-flash)
Nov 15 08:41:32 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:41:32 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-3a1d949e-de4e-4e5b-9ba2-cbb711cd212a tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0760323d-4844-4036-a200-22c7e316384f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:41:32 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a1d949e-de4e-4e5b-9ba2-cbb711cd212a tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Connected to 172.16.0.220:3260 {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 08:41:32 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-3a1d949e-de4e-4e5b-9ba2-cbb711cd212a tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=95467) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 08:41:32 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-3a1d949e-de4e-4e5b-9ba2-cbb711cd212a tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=95467) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 08:41:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:41:32 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:41:32 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf67d6c-718f-4837-b5e2-10c47423aa77]: (4, ('- - 0', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:41:32 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-3a1d949e-de4e-4e5b-9ba2-cbb711cd212a tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:41:32 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a1d949e-de4e-4e5b-9ba2-cbb711cd212a tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0760323d-4844-4036-a200-22c7e316384f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rnPzvBpF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 08:41:33 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-3a1d949e-de4e-4e5b-9ba2-cbb711cd212a tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:41:33 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a1d949e-de4e-4e5b-9ba2-cbb711cd212a tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '23435326332356662', 'path': '/dev/sdb'} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:41:33 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a1d949e-de4e-4e5b-9ba2-cbb711cd212a tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23435326332356662', 'path': '/dev/sdb'} {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 08:41:33 user nova-compute[95467]: DEBUG nova.objects.instance [None req-3a1d949e-de4e-4e5b-9ba2-cbb711cd212a tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lazy-loading 'flavor' on Instance uuid fd289f63-f798-4ce2-81c6-fab844644f77 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:41:33 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-3a1d949e-de4e-4e5b-9ba2-cbb711cd212a tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 08:41:33 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:41:33 user nova-compute[95467]:   <source dev="/dev/sdb"/>
Nov 15 08:41:33 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:41:33 user nova-compute[95467]:   <serial>0760323d-4844-4036-a200-22c7e316384f</serial>
Nov 15 08:41:33 user nova-compute[95467]: </disk>
Nov 15 08:41:33 user nova-compute[95467]:  {{(pid=95467) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 08:41:34 user nova-compute[95467]: DEBUG nova.objects.instance [None req-e8c9ce93-a809-43de-968b-cae0bc9b66f9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lazy-loading 'flavor' on Instance uuid 2945f42b-62a1-44c5-be3b-f1dbe6826c0f {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:41:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e8c9ce93-a809-43de-968b-cae0bc9b66f9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Acquiring lock "refresh_cache-2945f42b-62a1-44c5-be3b-f1dbe6826c0f" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:41:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e8c9ce93-a809-43de-968b-cae0bc9b66f9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Acquired lock "refresh_cache-2945f42b-62a1-44c5-be3b-f1dbe6826c0f" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:41:34 user nova-compute[95467]: DEBUG nova.network.neutron [None req-e8c9ce93-a809-43de-968b-cae0bc9b66f9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:41:34 user nova-compute[95467]: DEBUG nova.objects.instance [None req-e8c9ce93-a809-43de-968b-cae0bc9b66f9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lazy-loading 'info_cache' on Instance uuid 2945f42b-62a1-44c5-be3b-f1dbe6826c0f {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:41:34 user nova-compute[95467]: DEBUG nova.objects.base [None req-e8c9ce93-a809-43de-968b-cae0bc9b66f9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Object Instance<2945f42b-62a1-44c5-be3b-f1dbe6826c0f> lazy-loaded attributes: flavor,info_cache {{(pid=95467) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 08:41:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3a1d949e-de4e-4e5b-9ba2-cbb711cd212a tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:41:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3a1d949e-de4e-4e5b-9ba2-cbb711cd212a tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] No BDM found with device name vdb, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:41:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3a1d949e-de4e-4e5b-9ba2-cbb711cd212a tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] No VIF found with MAC fa:16:3e:01:ef:a0, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:41:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3a1d949e-de4e-4e5b-9ba2-cbb711cd212a tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "fd289f63-f798-4ce2-81c6-fab844644f77" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.417s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:41:34 user nova-compute[95467]: DEBUG nova.network.neutron [None req-e8c9ce93-a809-43de-968b-cae0bc9b66f9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Updating instance_info_cache with network_info: [{"id": "27b8a52f-50f2-42e6-9c9f-9b74f9778096", "address": "fa:16:3e:81:ba:80", "network": {"id": "26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1542679712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9a636c8b7074bd19eeee608156f8568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b8a52f-50", "ovs_interfaceid": "27b8a52f-50f2-42e6-9c9f-9b74f9778096", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:41:34 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-e8c9ce93-a809-43de-968b-cae0bc9b66f9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Releasing lock "refresh_cache-2945f42b-62a1-44c5-be3b-f1dbe6826c0f" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:41:34 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Instance destroyed successfully.
Nov 15 08:41:34 user nova-compute[95467]: DEBUG nova.objects.instance [None req-e8c9ce93-a809-43de-968b-cae0bc9b66f9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lazy-loading 'resources' on Instance uuid 2945f42b-62a1-44c5-be3b-f1dbe6826c0f {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:41:34 user nova-compute[95467]: DEBUG nova.objects.base [None req-e8c9ce93-a809-43de-968b-cae0bc9b66f9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Object Instance<2945f42b-62a1-44c5-be3b-f1dbe6826c0f> lazy-loaded attributes: flavor,info_cache,resources {{(pid=95467) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 08:41:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-e8c9ce93-a809-43de-968b-cae0bc9b66f9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:33:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1665521832',display_name='tempest-AttachVolumeTestJSON-server-1665521832',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1665521832',id=49,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHEZ4L2W1PqDn37Zx7UIz0j2KcbPq+rly9Qd/KJO59g5c8MCgjoXP3xcb3EyLIk0CvVsb/gd4fXybCigHKczFCKQxo4IJMRUgO0RY0jH5aIgYmljg+NxxHHdbnLulJeSuQ==',key_name='tempest-keypair-1324520091',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:33:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a9a636c8b7074bd19eeee608156f8568',ramdisk_id='',reservation_id='r-fsabz05b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1507968277',owner_user_name='tempest-AttachVolumeTestJSON-1507968277-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:39:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e31df8ed5a914b2395b548606b65e580',uuid=2945f42b-62a1-44c5-be3b-f1dbe6826c0f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "27b8a52f-50f2-42e6-9c9f-9b74f9778096", "address": "fa:16:3e:81:ba:80", "network": {"id": "26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1542679712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9a636c8b7074bd19eeee608156f8568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b8a52f-50", "ovs_interfaceid": "27b8a52f-50f2-42e6-9c9f-9b74f9778096", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:41:34 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-e8c9ce93-a809-43de-968b-cae0bc9b66f9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Converting VIF {"id": "27b8a52f-50f2-42e6-9c9f-9b74f9778096", "address": "fa:16:3e:81:ba:80", "network": {"id": "26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1542679712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9a636c8b7074bd19eeee608156f8568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b8a52f-50", "ovs_interfaceid": "27b8a52f-50f2-42e6-9c9f-9b74f9778096", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:41:34 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-e8c9ce93-a809-43de-968b-cae0bc9b66f9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:ba:80,bridge_name='br-int',has_traffic_filtering=True,id=27b8a52f-50f2-42e6-9c9f-9b74f9778096,network=Network(26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27b8a52f-50') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:41:34 user nova-compute[95467]: DEBUG os_vif [None req-e8c9ce93-a809-43de-968b-cae0bc9b66f9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:ba:80,bridge_name='br-int',has_traffic_filtering=True,id=27b8a52f-50f2-42e6-9c9f-9b74f9778096,network=Network(26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27b8a52f-50') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:41:34 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:41:34 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap27b8a52f-50, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:41:34 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:41:34 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:41:34 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1614e64a-035b-476e-8429-0758eb9a69ec) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:41:34 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:41:34 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:41:34 user nova-compute[95467]: INFO os_vif [None req-e8c9ce93-a809-43de-968b-cae0bc9b66f9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:ba:80,bridge_name='br-int',has_traffic_filtering=True,id=27b8a52f-50f2-42e6-9c9f-9b74f9778096,network=Network(26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27b8a52f-50')
Nov 15 08:41:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-e8c9ce93-a809-43de-968b-cae0bc9b66f9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Start _get_guest_xml network_info=[{"id": "27b8a52f-50f2-42e6-9c9f-9b74f9778096", "address": "fa:16:3e:81:ba:80", "network": {"id": "26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1542679712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9a636c8b7074bd19eeee608156f8568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b8a52f-50", "ovs_interfaceid": "27b8a52f-50f2-42e6-9c9f-9b74f9778096", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'ed9c48aa-ce73-4b3b-9db1-235898be671b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:41:34 user nova-compute[95467]: DEBUG nova.objects.instance [None req-e8c9ce93-a809-43de-968b-cae0bc9b66f9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lazy-loading 'numa_topology' on Instance uuid 2945f42b-62a1-44c5-be3b-f1dbe6826c0f {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:41:34 user nova-compute[95467]: DEBUG nova.objects.base [None req-e8c9ce93-a809-43de-968b-cae0bc9b66f9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Object Instance<2945f42b-62a1-44c5-be3b-f1dbe6826c0f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=95467) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 08:41:34 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-e8c9ce93-a809-43de-968b-cae0bc9b66f9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:41:34 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-e8c9ce93-a809-43de-968b-cae0bc9b66f9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:41:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-e8c9ce93-a809-43de-968b-cae0bc9b66f9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:41:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-e8c9ce93-a809-43de-968b-cae0bc9b66f9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:41:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-e8c9ce93-a809-43de-968b-cae0bc9b66f9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:41:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-e8c9ce93-a809-43de-968b-cae0bc9b66f9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:41:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-e8c9ce93-a809-43de-968b-cae0bc9b66f9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:41:34 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-e8c9ce93-a809-43de-968b-cae0bc9b66f9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:41:34 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-e8c9ce93-a809-43de-968b-cae0bc9b66f9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:41:34 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-e8c9ce93-a809-43de-968b-cae0bc9b66f9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:41:34 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-e8c9ce93-a809-43de-968b-cae0bc9b66f9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:41:34 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-e8c9ce93-a809-43de-968b-cae0bc9b66f9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:41:34 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-e8c9ce93-a809-43de-968b-cae0bc9b66f9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:41:34 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-e8c9ce93-a809-43de-968b-cae0bc9b66f9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:41:34 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-e8c9ce93-a809-43de-968b-cae0bc9b66f9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:41:34 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-e8c9ce93-a809-43de-968b-cae0bc9b66f9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:41:34 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-e8c9ce93-a809-43de-968b-cae0bc9b66f9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:41:34 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-e8c9ce93-a809-43de-968b-cae0bc9b66f9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:41:34 user nova-compute[95467]: DEBUG nova.objects.instance [None req-e8c9ce93-a809-43de-968b-cae0bc9b66f9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2945f42b-62a1-44c5-be3b-f1dbe6826c0f {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:41:34 user nova-compute[95467]: DEBUG nova.objects.base [None req-e8c9ce93-a809-43de-968b-cae0bc9b66f9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Object Instance<2945f42b-62a1-44c5-be3b-f1dbe6826c0f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=95467) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 08:41:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-e8c9ce93-a809-43de-968b-cae0bc9b66f9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:33:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1665521832',display_name='tempest-AttachVolumeTestJSON-server-1665521832',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1665521832',id=49,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHEZ4L2W1PqDn37Zx7UIz0j2KcbPq+rly9Qd/KJO59g5c8MCgjoXP3xcb3EyLIk0CvVsb/gd4fXybCigHKczFCKQxo4IJMRUgO0RY0jH5aIgYmljg+NxxHHdbnLulJeSuQ==',key_name='tempest-keypair-1324520091',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:33:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a9a636c8b7074bd19eeee608156f8568',ramdisk_id='',reservation_id='r-fsabz05b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1507968277',owner_user_name='tempest-AttachVolumeTestJSON-1507968277-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:39:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e31df8ed5a914b2395b548606b65e580',uuid=2945f42b-62a1-44c5-be3b-f1dbe6826c0f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "27b8a52f-50f2-42e6-9c9f-9b74f9778096", "address": "fa:16:3e:81:ba:80", "network": {"id": "26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1542679712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9a636c8b7074bd19eeee608156f8568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b8a52f-50", "ovs_interfaceid": "27b8a52f-50f2-42e6-9c9f-9b74f9778096", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:41:34 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-e8c9ce93-a809-43de-968b-cae0bc9b66f9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Converting VIF {"id": "27b8a52f-50f2-42e6-9c9f-9b74f9778096", "address": "fa:16:3e:81:ba:80", "network": {"id": "26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1542679712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9a636c8b7074bd19eeee608156f8568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b8a52f-50", "ovs_interfaceid": "27b8a52f-50f2-42e6-9c9f-9b74f9778096", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:41:34 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-e8c9ce93-a809-43de-968b-cae0bc9b66f9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:ba:80,bridge_name='br-int',has_traffic_filtering=True,id=27b8a52f-50f2-42e6-9c9f-9b74f9778096,network=Network(26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27b8a52f-50') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:41:34 user nova-compute[95467]: DEBUG nova.objects.instance [None req-e8c9ce93-a809-43de-968b-cae0bc9b66f9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lazy-loading 'pci_devices' on Instance uuid 2945f42b-62a1-44c5-be3b-f1dbe6826c0f {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:41:34 user nova-compute[95467]: DEBUG nova.objects.base [None req-e8c9ce93-a809-43de-968b-cae0bc9b66f9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Object Instance<2945f42b-62a1-44c5-be3b-f1dbe6826c0f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=95467) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 08:41:34 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-e8c9ce93-a809-43de-968b-cae0bc9b66f9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:41:34 user nova-compute[95467]:   <uuid>2945f42b-62a1-44c5-be3b-f1dbe6826c0f</uuid>
Nov 15 08:41:34 user nova-compute[95467]:   <name>instance-00000031</name>
Nov 15 08:41:34 user nova-compute[95467]:   <memory>524288</memory>
Nov 15 08:41:34 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:41:34 user nova-compute[95467]:   <metadata>
Nov 15 08:41:34 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:41:34 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:41:34 user nova-compute[95467]:       <nova:name>tempest-AttachVolumeTestJSON-server-1665521832</nova:name>
Nov 15 08:41:34 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:41:34</nova:creationTime>
Nov 15 08:41:34 user nova-compute[95467]:       <nova:flavor name="m1.tiny">
Nov 15 08:41:34 user nova-compute[95467]:         <nova:memory>512</nova:memory>
Nov 15 08:41:34 user nova-compute[95467]:         <nova:disk>1</nova:disk>
Nov 15 08:41:34 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:41:34 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:41:34 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:41:34 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:41:34 user nova-compute[95467]:       <nova:owner>
Nov 15 08:41:34 user nova-compute[95467]:         <nova:user uuid="e31df8ed5a914b2395b548606b65e580">tempest-AttachVolumeTestJSON-1507968277-project-member</nova:user>
Nov 15 08:41:34 user nova-compute[95467]:         <nova:project uuid="a9a636c8b7074bd19eeee608156f8568">tempest-AttachVolumeTestJSON-1507968277</nova:project>
Nov 15 08:41:34 user nova-compute[95467]:       </nova:owner>
Nov 15 08:41:34 user nova-compute[95467]:       <nova:root type="image" uuid="ed9c48aa-ce73-4b3b-9db1-235898be671b"/>
Nov 15 08:41:34 user nova-compute[95467]:       <nova:ports>
Nov 15 08:41:34 user nova-compute[95467]:         <nova:port uuid="27b8a52f-50f2-42e6-9c9f-9b74f9778096">
Nov 15 08:41:34 user nova-compute[95467]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 08:41:34 user nova-compute[95467]:         </nova:port>
Nov 15 08:41:34 user nova-compute[95467]:       </nova:ports>
Nov 15 08:41:34 user nova-compute[95467]:     </nova:instance>
Nov 15 08:41:34 user nova-compute[95467]:   </metadata>
Nov 15 08:41:34 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:41:34 user nova-compute[95467]:     <system>
Nov 15 08:41:34 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:41:34 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:41:34 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:41:34 user nova-compute[95467]:       <entry name="serial">2945f42b-62a1-44c5-be3b-f1dbe6826c0f</entry>
Nov 15 08:41:34 user nova-compute[95467]:       <entry name="uuid">2945f42b-62a1-44c5-be3b-f1dbe6826c0f</entry>
Nov 15 08:41:34 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:41:34 user nova-compute[95467]:     </system>
Nov 15 08:41:34 user nova-compute[95467]:   </sysinfo>
Nov 15 08:41:34 user nova-compute[95467]:   <os>
Nov 15 08:41:34 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:41:34 user nova-compute[95467]:     <boot dev="hd"/>
Nov 15 08:41:34 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:41:34 user nova-compute[95467]:   </os>
Nov 15 08:41:34 user nova-compute[95467]:   <features>
Nov 15 08:41:34 user nova-compute[95467]:     <acpi/>
Nov 15 08:41:34 user nova-compute[95467]:     <apic/>
Nov 15 08:41:34 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:41:34 user nova-compute[95467]:   </features>
Nov 15 08:41:34 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:41:34 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:41:34 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:41:34 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:41:34 user nova-compute[95467]:   </clock>
Nov 15 08:41:34 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:41:34 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:41:34 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:41:34 user nova-compute[95467]:   </cpu>
Nov 15 08:41:34 user nova-compute[95467]:   <devices>
Nov 15 08:41:34 user nova-compute[95467]:     <disk type="file" device="disk">
Nov 15 08:41:34 user nova-compute[95467]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 08:41:34 user nova-compute[95467]:       <source file="/opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/disk"/>
Nov 15 08:41:34 user nova-compute[95467]:       <target dev="vda" bus="virtio"/>
Nov 15 08:41:34 user nova-compute[95467]:     </disk>
Nov 15 08:41:34 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:41:34 user nova-compute[95467]:       <mac address="fa:16:3e:81:ba:80"/>
Nov 15 08:41:34 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:41:34 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:41:34 user nova-compute[95467]:       <target dev="tap27b8a52f-50"/>
Nov 15 08:41:34 user nova-compute[95467]:     </interface>
Nov 15 08:41:34 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:41:34 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/console.log" append="off"/>
Nov 15 08:41:34 user nova-compute[95467]:     </serial>
Nov 15 08:41:34 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:41:34 user nova-compute[95467]:     <video>
Nov 15 08:41:34 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:41:34 user nova-compute[95467]:     </video>
Nov 15 08:41:34 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:41:34 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:41:34 user nova-compute[95467]:     </rng>
Nov 15 08:41:34 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:41:34 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:41:34 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:41:34 user nova-compute[95467]:     </memballoon>
Nov 15 08:41:34 user nova-compute[95467]:   </devices>
Nov 15 08:41:34 user nova-compute[95467]: </domain>
Nov 15 08:41:34 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:41:34 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-e8c9ce93-a809-43de-968b-cae0bc9b66f9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:41:34 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-e8c9ce93-a809-43de-968b-cae0bc9b66f9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:41:34 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-e8c9ce93-a809-43de-968b-cae0bc9b66f9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:41:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-e8c9ce93-a809-43de-968b-cae0bc9b66f9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:41:35 user nova-compute[95467]: DEBUG nova.objects.instance [None req-e8c9ce93-a809-43de-968b-cae0bc9b66f9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2945f42b-62a1-44c5-be3b-f1dbe6826c0f {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:41:35 user nova-compute[95467]: DEBUG nova.objects.base [None req-e8c9ce93-a809-43de-968b-cae0bc9b66f9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Object Instance<2945f42b-62a1-44c5-be3b-f1dbe6826c0f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=95467) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 08:41:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-e8c9ce93-a809-43de-968b-cae0bc9b66f9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:41:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-e8c9ce93-a809-43de-968b-cae0bc9b66f9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.174s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:41:35 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-e8c9ce93-a809-43de-968b-cae0bc9b66f9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/disk. size=1073741824 {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 08:41:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-e8c9ce93-a809-43de-968b-cae0bc9b66f9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:41:35 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:41:35 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-e8c9ce93-a809-43de-968b-cae0bc9b66f9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:41:35 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-e8c9ce93-a809-43de-968b-cae0bc9b66f9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Cannot resize image /opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/disk to a smaller size. {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 08:41:35 user nova-compute[95467]: DEBUG nova.objects.instance [None req-e8c9ce93-a809-43de-968b-cae0bc9b66f9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lazy-loading 'migration_context' on Instance uuid 2945f42b-62a1-44c5-be3b-f1dbe6826c0f {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:41:35 user nova-compute[95467]: DEBUG nova.objects.base [None req-e8c9ce93-a809-43de-968b-cae0bc9b66f9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Object Instance<2945f42b-62a1-44c5-be3b-f1dbe6826c0f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=95467) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 08:41:35 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-e8c9ce93-a809-43de-968b-cae0bc9b66f9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:33:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1665521832',display_name='tempest-AttachVolumeTestJSON-server-1665521832',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1665521832',id=49,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHEZ4L2W1PqDn37Zx7UIz0j2KcbPq+rly9Qd/KJO59g5c8MCgjoXP3xcb3EyLIk0CvVsb/gd4fXybCigHKczFCKQxo4IJMRUgO0RY0jH5aIgYmljg+NxxHHdbnLulJeSuQ==',key_name='tempest-keypair-1324520091',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:33:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='a9a636c8b7074bd19eeee608156f8568',ramdisk_id='',reservation_id='r-fsabz05b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1507968277',owner_user_name='tempest-AttachVolumeTestJSON-1507968277-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:39:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e31df8ed5a914b2395b548606b65e580',uuid=2945f42b-62a1-44c5-be3b-f1dbe6826c0f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "27b8a52f-50f2-42e6-9c9f-9b74f9778096", "address": "fa:16:3e:81:ba:80", "network": {"id": "26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1542679712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9a636c8b7074bd19eeee608156f8568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b8a52f-50", "ovs_interfaceid": "27b8a52f-50f2-42e6-9c9f-9b74f9778096", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:41:35 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-e8c9ce93-a809-43de-968b-cae0bc9b66f9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Converting VIF {"id": "27b8a52f-50f2-42e6-9c9f-9b74f9778096", "address": "fa:16:3e:81:ba:80", "network": {"id": "26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1542679712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9a636c8b7074bd19eeee608156f8568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b8a52f-50", "ovs_interfaceid": "27b8a52f-50f2-42e6-9c9f-9b74f9778096", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:41:35 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-e8c9ce93-a809-43de-968b-cae0bc9b66f9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:ba:80,bridge_name='br-int',has_traffic_filtering=True,id=27b8a52f-50f2-42e6-9c9f-9b74f9778096,network=Network(26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27b8a52f-50') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:41:35 user nova-compute[95467]: DEBUG os_vif [None req-e8c9ce93-a809-43de-968b-cae0bc9b66f9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:ba:80,bridge_name='br-int',has_traffic_filtering=True,id=27b8a52f-50f2-42e6-9c9f-9b74f9778096,network=Network(26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27b8a52f-50') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:41:35 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:41:35 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:41:35 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:41:35 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:41:35 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '285d7eca-fd49-53a1-880b-efb515c32d78', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:41:35 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:41:35 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:41:35 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:41:35 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:41:35 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap27b8a52f-50, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:41:35 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap27b8a52f-50, col_values=(('qos', UUID('ca3d45de-b0c6-4b1d-a960-8374961191fe')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:41:35 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap27b8a52f-50, col_values=(('external_ids', {'iface-id': '27b8a52f-50f2-42e6-9c9f-9b74f9778096', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:ba:80', 'vm-uuid': '2945f42b-62a1-44c5-be3b-f1dbe6826c0f'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:41:35 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:41:35 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:41:35 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:41:35 user nova-compute[95467]: INFO os_vif [None req-e8c9ce93-a809-43de-968b-cae0bc9b66f9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:ba:80,bridge_name='br-int',has_traffic_filtering=True,id=27b8a52f-50f2-42e6-9c9f-9b74f9778096,network=Network(26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27b8a52f-50')
Nov 15 08:41:36 user nova-compute[95467]: DEBUG nova.compute.manager [req-bb9b4de1-32d0-4e7c-949f-ff1d130e3238 req-6c3b864f-3414-42f7-bfc0-e4b967a4cc62 service nova] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Received event network-changed-8da3553b-1b91-429a-b165-274a1f254c8c {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:41:36 user nova-compute[95467]: DEBUG nova.compute.manager [req-bb9b4de1-32d0-4e7c-949f-ff1d130e3238 req-6c3b864f-3414-42f7-bfc0-e4b967a4cc62 service nova] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Refreshing instance network info cache due to event network-changed-8da3553b-1b91-429a-b165-274a1f254c8c. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:41:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-bb9b4de1-32d0-4e7c-949f-ff1d130e3238 req-6c3b864f-3414-42f7-bfc0-e4b967a4cc62 service nova] Acquiring lock "refresh_cache-fd289f63-f798-4ce2-81c6-fab844644f77" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:41:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-bb9b4de1-32d0-4e7c-949f-ff1d130e3238 req-6c3b864f-3414-42f7-bfc0-e4b967a4cc62 service nova] Acquired lock "refresh_cache-fd289f63-f798-4ce2-81c6-fab844644f77" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:41:36 user nova-compute[95467]: DEBUG nova.network.neutron [req-bb9b4de1-32d0-4e7c-949f-ff1d130e3238 req-6c3b864f-3414-42f7-bfc0-e4b967a4cc62 service nova] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Refreshing network info cache for port 8da3553b-1b91-429a-b165-274a1f254c8c {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:41:36 user nova-compute[95467]: DEBUG nova.network.neutron [req-bb9b4de1-32d0-4e7c-949f-ff1d130e3238 req-6c3b864f-3414-42f7-bfc0-e4b967a4cc62 service nova] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Updated VIF entry in instance network info cache for port 8da3553b-1b91-429a-b165-274a1f254c8c. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:41:36 user nova-compute[95467]: DEBUG nova.network.neutron [req-bb9b4de1-32d0-4e7c-949f-ff1d130e3238 req-6c3b864f-3414-42f7-bfc0-e4b967a4cc62 service nova] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Updating instance_info_cache with network_info: [{"id": "8da3553b-1b91-429a-b165-274a1f254c8c", "address": "fa:16:3e:01:ef:a0", "network": {"id": "d67049b6-2e91-4d1e-8e42-5388ef75521a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984085217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7355ea3588ae4c2f9242e63084008710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8da3553b-1b", "ovs_interfaceid": "8da3553b-1b91-429a-b165-274a1f254c8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:41:36 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-bb9b4de1-32d0-4e7c-949f-ff1d130e3238 req-6c3b864f-3414-42f7-bfc0-e4b967a4cc62 service nova] Releasing lock "refresh_cache-fd289f63-f798-4ce2-81c6-fab844644f77" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:41:36 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:41:36 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:41:36 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:41:36 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:41:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:41:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:41:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:41:38 user nova-compute[95467]: DEBUG nova.compute.manager [req-5f09cf36-3afe-42e1-aaca-62eb97a26bb6 req-be599996-36d3-49c1-aee5-7bd19e3eac9f service nova] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Received event network-vif-plugged-27b8a52f-50f2-42e6-9c9f-9b74f9778096 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:41:38 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-5f09cf36-3afe-42e1-aaca-62eb97a26bb6 req-be599996-36d3-49c1-aee5-7bd19e3eac9f service nova] Acquiring lock "2945f42b-62a1-44c5-be3b-f1dbe6826c0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:41:38 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-5f09cf36-3afe-42e1-aaca-62eb97a26bb6 req-be599996-36d3-49c1-aee5-7bd19e3eac9f service nova] Lock "2945f42b-62a1-44c5-be3b-f1dbe6826c0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:41:38 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-5f09cf36-3afe-42e1-aaca-62eb97a26bb6 req-be599996-36d3-49c1-aee5-7bd19e3eac9f service nova] Lock "2945f42b-62a1-44c5-be3b-f1dbe6826c0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:41:38 user nova-compute[95467]: DEBUG nova.compute.manager [req-5f09cf36-3afe-42e1-aaca-62eb97a26bb6 req-be599996-36d3-49c1-aee5-7bd19e3eac9f service nova] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] No waiting events found dispatching network-vif-plugged-27b8a52f-50f2-42e6-9c9f-9b74f9778096 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:41:38 user nova-compute[95467]: WARNING nova.compute.manager [req-5f09cf36-3afe-42e1-aaca-62eb97a26bb6 req-be599996-36d3-49c1-aee5-7bd19e3eac9f service nova] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Received unexpected event network-vif-plugged-27b8a52f-50f2-42e6-9c9f-9b74f9778096 for instance with vm_state stopped and task_state powering-on.
Nov 15 08:41:38 user nova-compute[95467]: DEBUG nova.compute.manager [req-5f09cf36-3afe-42e1-aaca-62eb97a26bb6 req-be599996-36d3-49c1-aee5-7bd19e3eac9f service nova] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Received event network-vif-plugged-27b8a52f-50f2-42e6-9c9f-9b74f9778096 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:41:38 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-5f09cf36-3afe-42e1-aaca-62eb97a26bb6 req-be599996-36d3-49c1-aee5-7bd19e3eac9f service nova] Acquiring lock "2945f42b-62a1-44c5-be3b-f1dbe6826c0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:41:38 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-5f09cf36-3afe-42e1-aaca-62eb97a26bb6 req-be599996-36d3-49c1-aee5-7bd19e3eac9f service nova] Lock "2945f42b-62a1-44c5-be3b-f1dbe6826c0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:41:38 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-5f09cf36-3afe-42e1-aaca-62eb97a26bb6 req-be599996-36d3-49c1-aee5-7bd19e3eac9f service nova] Lock "2945f42b-62a1-44c5-be3b-f1dbe6826c0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:41:38 user nova-compute[95467]: DEBUG nova.compute.manager [req-5f09cf36-3afe-42e1-aaca-62eb97a26bb6 req-be599996-36d3-49c1-aee5-7bd19e3eac9f service nova] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] No waiting events found dispatching network-vif-plugged-27b8a52f-50f2-42e6-9c9f-9b74f9778096 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:41:38 user nova-compute[95467]: WARNING nova.compute.manager [req-5f09cf36-3afe-42e1-aaca-62eb97a26bb6 req-be599996-36d3-49c1-aee5-7bd19e3eac9f service nova] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Received unexpected event network-vif-plugged-27b8a52f-50f2-42e6-9c9f-9b74f9778096 for instance with vm_state stopped and task_state powering-on.
Nov 15 08:41:38 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:41:38 user nova-compute[95467]: DEBUG nova.compute.manager [req-489144fd-fc31-4999-a8b9-55a58318d627 req-08f1ae90-2755-4364-9090-cede9835e9ec service nova] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Received event network-changed-8da3553b-1b91-429a-b165-274a1f254c8c {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:41:38 user nova-compute[95467]: DEBUG nova.compute.manager [req-489144fd-fc31-4999-a8b9-55a58318d627 req-08f1ae90-2755-4364-9090-cede9835e9ec service nova] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Refreshing instance network info cache due to event network-changed-8da3553b-1b91-429a-b165-274a1f254c8c. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:41:38 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-489144fd-fc31-4999-a8b9-55a58318d627 req-08f1ae90-2755-4364-9090-cede9835e9ec service nova] Acquiring lock "refresh_cache-fd289f63-f798-4ce2-81c6-fab844644f77" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:41:38 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-489144fd-fc31-4999-a8b9-55a58318d627 req-08f1ae90-2755-4364-9090-cede9835e9ec service nova] Acquired lock "refresh_cache-fd289f63-f798-4ce2-81c6-fab844644f77" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:41:38 user nova-compute[95467]: DEBUG nova.network.neutron [req-489144fd-fc31-4999-a8b9-55a58318d627 req-08f1ae90-2755-4364-9090-cede9835e9ec service nova] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Refreshing network info cache for port 8da3553b-1b91-429a-b165-274a1f254c8c {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:41:38 user nova-compute[95467]: DEBUG nova.network.neutron [req-489144fd-fc31-4999-a8b9-55a58318d627 req-08f1ae90-2755-4364-9090-cede9835e9ec service nova] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Updated VIF entry in instance network info cache for port 8da3553b-1b91-429a-b165-274a1f254c8c. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:41:38 user nova-compute[95467]: DEBUG nova.network.neutron [req-489144fd-fc31-4999-a8b9-55a58318d627 req-08f1ae90-2755-4364-9090-cede9835e9ec service nova] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Updating instance_info_cache with network_info: [{"id": "8da3553b-1b91-429a-b165-274a1f254c8c", "address": "fa:16:3e:01:ef:a0", "network": {"id": "d67049b6-2e91-4d1e-8e42-5388ef75521a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984085217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7355ea3588ae4c2f9242e63084008710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8da3553b-1b", "ovs_interfaceid": "8da3553b-1b91-429a-b165-274a1f254c8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:41:38 user nova-compute[95467]: DEBUG nova.compute.manager [None req-e8c9ce93-a809-43de-968b-cae0bc9b66f9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Instance event wait completed in 0 seconds for  {{(pid=95467) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 08:41:38 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Instance rebooted successfully.
Nov 15 08:41:38 user nova-compute[95467]: DEBUG nova.compute.manager [None req-e8c9ce93-a809-43de-968b-cae0bc9b66f9 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:41:38 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-489144fd-fc31-4999-a8b9-55a58318d627 req-08f1ae90-2755-4364-9090-cede9835e9ec service nova] Releasing lock "refresh_cache-fd289f63-f798-4ce2-81c6-fab844644f77" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:41:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8852a678-a7be-4e5e-b995-20fabc220e62 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Acquiring lock "fd289f63-f798-4ce2-81c6-fab844644f77" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:41:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8852a678-a7be-4e5e-b995-20fabc220e62 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "fd289f63-f798-4ce2-81c6-fab844644f77" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:41:39 user nova-compute[95467]: INFO nova.compute.manager [None req-8852a678-a7be-4e5e-b995-20fabc220e62 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Rebooting instance
Nov 15 08:41:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8852a678-a7be-4e5e-b995-20fabc220e62 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Acquiring lock "refresh_cache-fd289f63-f798-4ce2-81c6-fab844644f77" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:41:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8852a678-a7be-4e5e-b995-20fabc220e62 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Acquired lock "refresh_cache-fd289f63-f798-4ce2-81c6-fab844644f77" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:41:39 user nova-compute[95467]: DEBUG nova.network.neutron [None req-8852a678-a7be-4e5e-b995-20fabc220e62 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:41:39 user nova-compute[95467]: DEBUG nova.network.neutron [None req-8852a678-a7be-4e5e-b995-20fabc220e62 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Updating instance_info_cache with network_info: [{"id": "8da3553b-1b91-429a-b165-274a1f254c8c", "address": "fa:16:3e:01:ef:a0", "network": {"id": "d67049b6-2e91-4d1e-8e42-5388ef75521a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984085217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7355ea3588ae4c2f9242e63084008710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8da3553b-1b", "ovs_interfaceid": "8da3553b-1b91-429a-b165-274a1f254c8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:41:39 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8852a678-a7be-4e5e-b995-20fabc220e62 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Releasing lock "refresh_cache-fd289f63-f798-4ce2-81c6-fab844644f77" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:41:39 user nova-compute[95467]: DEBUG nova.compute.manager [None req-8852a678-a7be-4e5e-b995-20fabc220e62 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:41:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:41:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:41:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:41:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:41:41 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:41:41 user nova-compute[95467]: DEBUG nova.compute.manager [req-291d3a7b-58e3-4967-80ec-0ac455a6b003 req-56cedaa8-47e9-4fbe-9792-ca9a96bdcee9 service nova] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Received event network-vif-unplugged-8da3553b-1b91-429a-b165-274a1f254c8c {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:41:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-291d3a7b-58e3-4967-80ec-0ac455a6b003 req-56cedaa8-47e9-4fbe-9792-ca9a96bdcee9 service nova] Acquiring lock "fd289f63-f798-4ce2-81c6-fab844644f77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:41:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-291d3a7b-58e3-4967-80ec-0ac455a6b003 req-56cedaa8-47e9-4fbe-9792-ca9a96bdcee9 service nova] Lock "fd289f63-f798-4ce2-81c6-fab844644f77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:41:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-291d3a7b-58e3-4967-80ec-0ac455a6b003 req-56cedaa8-47e9-4fbe-9792-ca9a96bdcee9 service nova] Lock "fd289f63-f798-4ce2-81c6-fab844644f77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:41:41 user nova-compute[95467]: DEBUG nova.compute.manager [req-291d3a7b-58e3-4967-80ec-0ac455a6b003 req-56cedaa8-47e9-4fbe-9792-ca9a96bdcee9 service nova] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] No waiting events found dispatching network-vif-unplugged-8da3553b-1b91-429a-b165-274a1f254c8c {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:41:41 user nova-compute[95467]: WARNING nova.compute.manager [req-291d3a7b-58e3-4967-80ec-0ac455a6b003 req-56cedaa8-47e9-4fbe-9792-ca9a96bdcee9 service nova] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Received unexpected event network-vif-unplugged-8da3553b-1b91-429a-b165-274a1f254c8c for instance with vm_state active and task_state reboot_started.
Nov 15 08:41:42 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-8852a678-a7be-4e5e-b995-20fabc220e62 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Instance shutdown successfully.
Nov 15 08:41:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:41:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:41:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:41:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:41:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:41:44 user nova-compute[95467]: DEBUG nova.compute.manager [req-497b08ce-a867-4888-bb28-f9ce8d1276c4 req-7504c336-c512-474d-ad4a-eb39cff40211 service nova] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Received event network-vif-plugged-8da3553b-1b91-429a-b165-274a1f254c8c {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:41:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-497b08ce-a867-4888-bb28-f9ce8d1276c4 req-7504c336-c512-474d-ad4a-eb39cff40211 service nova] Acquiring lock "fd289f63-f798-4ce2-81c6-fab844644f77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:41:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-497b08ce-a867-4888-bb28-f9ce8d1276c4 req-7504c336-c512-474d-ad4a-eb39cff40211 service nova] Lock "fd289f63-f798-4ce2-81c6-fab844644f77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:41:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-497b08ce-a867-4888-bb28-f9ce8d1276c4 req-7504c336-c512-474d-ad4a-eb39cff40211 service nova] Lock "fd289f63-f798-4ce2-81c6-fab844644f77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:41:44 user nova-compute[95467]: DEBUG nova.compute.manager [req-497b08ce-a867-4888-bb28-f9ce8d1276c4 req-7504c336-c512-474d-ad4a-eb39cff40211 service nova] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] No waiting events found dispatching network-vif-plugged-8da3553b-1b91-429a-b165-274a1f254c8c {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:41:44 user nova-compute[95467]: WARNING nova.compute.manager [req-497b08ce-a867-4888-bb28-f9ce8d1276c4 req-7504c336-c512-474d-ad4a-eb39cff40211 service nova] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Received unexpected event network-vif-plugged-8da3553b-1b91-429a-b165-274a1f254c8c for instance with vm_state active and task_state reboot_started.
Nov 15 08:41:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:41:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:41:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:41:45 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:41:46 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Instance running successfully.
Nov 15 08:41:46 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-8852a678-a7be-4e5e-b995-20fabc220e62 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Instance soft rebooted successfully.
Nov 15 08:41:46 user nova-compute[95467]: DEBUG nova.compute.manager [None req-8852a678-a7be-4e5e-b995-20fabc220e62 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:41:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-8852a678-a7be-4e5e-b995-20fabc220e62 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "fd289f63-f798-4ce2-81c6-fab844644f77" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.059s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:41:46 user nova-compute[95467]: DEBUG nova.compute.manager [req-80434e9a-faaf-41b2-b503-e7dc2e788617 req-ddc0c803-579f-49b5-93cb-91fa3a67271d service nova] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Received event network-vif-plugged-8da3553b-1b91-429a-b165-274a1f254c8c {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:41:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-80434e9a-faaf-41b2-b503-e7dc2e788617 req-ddc0c803-579f-49b5-93cb-91fa3a67271d service nova] Acquiring lock "fd289f63-f798-4ce2-81c6-fab844644f77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:41:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-80434e9a-faaf-41b2-b503-e7dc2e788617 req-ddc0c803-579f-49b5-93cb-91fa3a67271d service nova] Lock "fd289f63-f798-4ce2-81c6-fab844644f77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:41:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-80434e9a-faaf-41b2-b503-e7dc2e788617 req-ddc0c803-579f-49b5-93cb-91fa3a67271d service nova] Lock "fd289f63-f798-4ce2-81c6-fab844644f77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:41:46 user nova-compute[95467]: DEBUG nova.compute.manager [req-80434e9a-faaf-41b2-b503-e7dc2e788617 req-ddc0c803-579f-49b5-93cb-91fa3a67271d service nova] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] No waiting events found dispatching network-vif-plugged-8da3553b-1b91-429a-b165-274a1f254c8c {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:41:46 user nova-compute[95467]: WARNING nova.compute.manager [req-80434e9a-faaf-41b2-b503-e7dc2e788617 req-ddc0c803-579f-49b5-93cb-91fa3a67271d service nova] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Received unexpected event network-vif-plugged-8da3553b-1b91-429a-b165-274a1f254c8c for instance with vm_state active and task_state None.
Nov 15 08:41:46 user nova-compute[95467]: DEBUG nova.compute.manager [req-80434e9a-faaf-41b2-b503-e7dc2e788617 req-ddc0c803-579f-49b5-93cb-91fa3a67271d service nova] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Received event network-vif-plugged-8da3553b-1b91-429a-b165-274a1f254c8c {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:41:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-80434e9a-faaf-41b2-b503-e7dc2e788617 req-ddc0c803-579f-49b5-93cb-91fa3a67271d service nova] Acquiring lock "fd289f63-f798-4ce2-81c6-fab844644f77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:41:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-80434e9a-faaf-41b2-b503-e7dc2e788617 req-ddc0c803-579f-49b5-93cb-91fa3a67271d service nova] Lock "fd289f63-f798-4ce2-81c6-fab844644f77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:41:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-80434e9a-faaf-41b2-b503-e7dc2e788617 req-ddc0c803-579f-49b5-93cb-91fa3a67271d service nova] Lock "fd289f63-f798-4ce2-81c6-fab844644f77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:41:46 user nova-compute[95467]: DEBUG nova.compute.manager [req-80434e9a-faaf-41b2-b503-e7dc2e788617 req-ddc0c803-579f-49b5-93cb-91fa3a67271d service nova] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] No waiting events found dispatching network-vif-plugged-8da3553b-1b91-429a-b165-274a1f254c8c {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:41:46 user nova-compute[95467]: WARNING nova.compute.manager [req-80434e9a-faaf-41b2-b503-e7dc2e788617 req-ddc0c803-579f-49b5-93cb-91fa3a67271d service nova] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Received unexpected event network-vif-plugged-8da3553b-1b91-429a-b165-274a1f254c8c for instance with vm_state active and task_state None.
Nov 15 08:41:48 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:41:50 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:41:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:41:55 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:41:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:41:59 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:41:59 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=95467) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 08:42:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:42:02 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:42:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:42:04 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager.update_available_resource {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:42:04 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:42:04 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:42:04 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:42:04 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Auditing locally available compute resources for user (node: user) {{(pid=95467) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 08:42:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:42:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:42:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:42:05 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:42:05 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd289f63-f798-4ce2-81c6-fab844644f77/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:42:05 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd289f63-f798-4ce2-81c6-fab844644f77/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:42:05 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd289f63-f798-4ce2-81c6-fab844644f77/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:42:05 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd289f63-f798-4ce2-81c6-fab844644f77/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:42:05 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:42:05 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:42:05 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:42:05 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:42:05 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Hypervisor/Node resource view: name=user free_ram=8741MB free_disk=25.01380157470703GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=95467) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 08:42:05 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:42:05 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:42:05 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 2945f42b-62a1-44c5-be3b-f1dbe6826c0f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:42:05 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance fd289f63-f798-4ce2-81c6-fab844644f77 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:42:05 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 08:42:05 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 08:42:05 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:42:06 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:42:06 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Compute_service record updated for user:user {{(pid=95467) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 08:42:06 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.210s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:42:07 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:42:08 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:42:08 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:42:08 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:42:10 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:42:12 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:42:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:42:13 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:42:14 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:42:14 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Starting heal instance info cache {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 08:42:14 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Rebuilding the list of instances to heal {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 08:42:14 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "refresh_cache-2945f42b-62a1-44c5-be3b-f1dbe6826c0f" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:42:14 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquired lock "refresh_cache-2945f42b-62a1-44c5-be3b-f1dbe6826c0f" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:42:14 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Forcefully refreshing network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 08:42:14 user nova-compute[95467]: DEBUG nova.objects.instance [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lazy-loading 'info_cache' on Instance uuid 2945f42b-62a1-44c5-be3b-f1dbe6826c0f {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:42:15 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Updating instance_info_cache with network_info: [{"id": "27b8a52f-50f2-42e6-9c9f-9b74f9778096", "address": "fa:16:3e:81:ba:80", "network": {"id": "26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1542679712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9a636c8b7074bd19eeee608156f8568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b8a52f-50", "ovs_interfaceid": "27b8a52f-50f2-42e6-9c9f-9b74f9778096", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:42:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Releasing lock "refresh_cache-2945f42b-62a1-44c5-be3b-f1dbe6826c0f" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:42:15 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Updated the network info_cache for instance {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 08:42:15 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:42:18 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:42:20 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:42:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:42:30 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:42:35 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:42:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:42:45 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:42:50 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:42:50 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:42:50 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=95467) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 08:42:50 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:42:50 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:42:50 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:42:55 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:43:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:43:01 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:43:01 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=95467) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 08:43:03 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:43:05 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:43:05 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:43:05 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:43:05 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=95467) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 08:43:05 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:43:05 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:43:05 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:43:06 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager.update_available_resource {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:43:06 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:43:06 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:43:06 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:43:06 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Auditing locally available compute resources for user (node: user) {{(pid=95467) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 08:43:06 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:43:06 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:43:06 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:43:07 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:43:07 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd289f63-f798-4ce2-81c6-fab844644f77/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:43:07 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd289f63-f798-4ce2-81c6-fab844644f77/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:43:07 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd289f63-f798-4ce2-81c6-fab844644f77/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:43:07 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd289f63-f798-4ce2-81c6-fab844644f77/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:43:07 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:43:07 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:43:07 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:43:07 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Hypervisor/Node resource view: name=user free_ram=8896MB free_disk=25.013126373291016GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=95467) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 08:43:07 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:43:07 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:43:08 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance 2945f42b-62a1-44c5-be3b-f1dbe6826c0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:43:08 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance fd289f63-f798-4ce2-81c6-fab844644f77 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:43:08 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 08:43:08 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 08:43:08 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:43:08 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:43:08 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Compute_service record updated for user:user {{(pid=95467) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 08:43:08 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.242s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:43:10 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:43:10 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:43:10 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:43:13 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:43:13 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:43:14 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:43:14 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Starting heal instance info cache {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 08:43:14 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "refresh_cache-fd289f63-f798-4ce2-81c6-fab844644f77" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:43:14 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquired lock "refresh_cache-fd289f63-f798-4ce2-81c6-fab844644f77" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:43:14 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Forcefully refreshing network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 08:43:15 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Updating instance_info_cache with network_info: [{"id": "8da3553b-1b91-429a-b165-274a1f254c8c", "address": "fa:16:3e:01:ef:a0", "network": {"id": "d67049b6-2e91-4d1e-8e42-5388ef75521a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984085217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7355ea3588ae4c2f9242e63084008710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8da3553b-1b", "ovs_interfaceid": "8da3553b-1b91-429a-b165-274a1f254c8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:43:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Releasing lock "refresh_cache-fd289f63-f798-4ce2-81c6-fab844644f77" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:43:15 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Updated the network info_cache for instance {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 08:43:15 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:43:20 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:43:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-b77ce478-b130-4bcd-87ca-7e86cfe1b833 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Acquiring lock "2945f42b-62a1-44c5-be3b-f1dbe6826c0f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:43:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-b77ce478-b130-4bcd-87ca-7e86cfe1b833 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "2945f42b-62a1-44c5-be3b-f1dbe6826c0f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:43:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-b77ce478-b130-4bcd-87ca-7e86cfe1b833 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Acquiring lock "2945f42b-62a1-44c5-be3b-f1dbe6826c0f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:43:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-b77ce478-b130-4bcd-87ca-7e86cfe1b833 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "2945f42b-62a1-44c5-be3b-f1dbe6826c0f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:43:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-b77ce478-b130-4bcd-87ca-7e86cfe1b833 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "2945f42b-62a1-44c5-be3b-f1dbe6826c0f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:43:25 user nova-compute[95467]: INFO nova.compute.manager [None req-b77ce478-b130-4bcd-87ca-7e86cfe1b833 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Terminating instance
Nov 15 08:43:25 user nova-compute[95467]: DEBUG nova.compute.manager [None req-b77ce478-b130-4bcd-87ca-7e86cfe1b833 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Start destroying the instance on the hypervisor. {{(pid=95467) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 08:43:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:43:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:43:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:43:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:43:25 user nova-compute[95467]: DEBUG nova.compute.manager [req-5743a352-889c-4bbf-886c-48c158bb295c req-e9f2dcdf-b6eb-4e6c-94ea-1154f6724dc8 service nova] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Received event network-vif-unplugged-27b8a52f-50f2-42e6-9c9f-9b74f9778096 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:43:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-5743a352-889c-4bbf-886c-48c158bb295c req-e9f2dcdf-b6eb-4e6c-94ea-1154f6724dc8 service nova] Acquiring lock "2945f42b-62a1-44c5-be3b-f1dbe6826c0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:43:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-5743a352-889c-4bbf-886c-48c158bb295c req-e9f2dcdf-b6eb-4e6c-94ea-1154f6724dc8 service nova] Lock "2945f42b-62a1-44c5-be3b-f1dbe6826c0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:43:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-5743a352-889c-4bbf-886c-48c158bb295c req-e9f2dcdf-b6eb-4e6c-94ea-1154f6724dc8 service nova] Lock "2945f42b-62a1-44c5-be3b-f1dbe6826c0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:43:25 user nova-compute[95467]: DEBUG nova.compute.manager [req-5743a352-889c-4bbf-886c-48c158bb295c req-e9f2dcdf-b6eb-4e6c-94ea-1154f6724dc8 service nova] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] No waiting events found dispatching network-vif-unplugged-27b8a52f-50f2-42e6-9c9f-9b74f9778096 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:43:25 user nova-compute[95467]: DEBUG nova.compute.manager [req-5743a352-889c-4bbf-886c-48c158bb295c req-e9f2dcdf-b6eb-4e6c-94ea-1154f6724dc8 service nova] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Received event network-vif-unplugged-27b8a52f-50f2-42e6-9c9f-9b74f9778096 for instance with task_state deleting. {{(pid=95467) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 08:43:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:43:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:43:25 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Instance destroyed successfully.
Nov 15 08:43:25 user nova-compute[95467]: DEBUG nova.objects.instance [None req-b77ce478-b130-4bcd-87ca-7e86cfe1b833 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lazy-loading 'resources' on Instance uuid 2945f42b-62a1-44c5-be3b-f1dbe6826c0f {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:43:25 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-b77ce478-b130-4bcd-87ca-7e86cfe1b833 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:33:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1665521832',display_name='tempest-AttachVolumeTestJSON-server-1665521832',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1665521832',id=49,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHEZ4L2W1PqDn37Zx7UIz0j2KcbPq+rly9Qd/KJO59g5c8MCgjoXP3xcb3EyLIk0CvVsb/gd4fXybCigHKczFCKQxo4IJMRUgO0RY0jH5aIgYmljg+NxxHHdbnLulJeSuQ==',key_name='tempest-keypair-1324520091',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:33:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a9a636c8b7074bd19eeee608156f8568',ramdisk_id='',reservation_id='r-fsabz05b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1507968277',owner_user_name='tempest-AttachVolumeTestJSON-1507968277-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:41:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e31df8ed5a914b2395b548606b65e580',uuid=2945f42b-62a1-44c5-be3b-f1dbe6826c0f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27b8a52f-50f2-42e6-9c9f-9b74f9778096", "address": "fa:16:3e:81:ba:80", "network": {"id": "26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1542679712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9a636c8b7074bd19eeee608156f8568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b8a52f-50", "ovs_interfaceid": "27b8a52f-50f2-42e6-9c9f-9b74f9778096", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:43:25 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-b77ce478-b130-4bcd-87ca-7e86cfe1b833 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Converting VIF {"id": "27b8a52f-50f2-42e6-9c9f-9b74f9778096", "address": "fa:16:3e:81:ba:80", "network": {"id": "26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1542679712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9a636c8b7074bd19eeee608156f8568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b8a52f-50", "ovs_interfaceid": "27b8a52f-50f2-42e6-9c9f-9b74f9778096", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:43:25 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-b77ce478-b130-4bcd-87ca-7e86cfe1b833 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:ba:80,bridge_name='br-int',has_traffic_filtering=True,id=27b8a52f-50f2-42e6-9c9f-9b74f9778096,network=Network(26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27b8a52f-50') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:43:25 user nova-compute[95467]: DEBUG os_vif [None req-b77ce478-b130-4bcd-87ca-7e86cfe1b833 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:ba:80,bridge_name='br-int',has_traffic_filtering=True,id=27b8a52f-50f2-42e6-9c9f-9b74f9778096,network=Network(26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27b8a52f-50') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:43:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:43:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap27b8a52f-50, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:43:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:43:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:43:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:43:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ca3d45de-b0c6-4b1d-a960-8374961191fe) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:43:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:43:25 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:43:25 user nova-compute[95467]: INFO os_vif [None req-b77ce478-b130-4bcd-87ca-7e86cfe1b833 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:ba:80,bridge_name='br-int',has_traffic_filtering=True,id=27b8a52f-50f2-42e6-9c9f-9b74f9778096,network=Network(26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27b8a52f-50')
Nov 15 08:43:25 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-b77ce478-b130-4bcd-87ca-7e86cfe1b833 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Deleting instance files /opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f_del
Nov 15 08:43:25 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-b77ce478-b130-4bcd-87ca-7e86cfe1b833 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Deletion of /opt/stack/data/nova/instances/2945f42b-62a1-44c5-be3b-f1dbe6826c0f_del complete
Nov 15 08:43:25 user nova-compute[95467]: INFO nova.compute.manager [None req-b77ce478-b130-4bcd-87ca-7e86cfe1b833 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 15 08:43:25 user nova-compute[95467]: DEBUG oslo.service.loopingcall [None req-b77ce478-b130-4bcd-87ca-7e86cfe1b833 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=95467) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 08:43:25 user nova-compute[95467]: DEBUG nova.compute.manager [-] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Deallocating network for instance {{(pid=95467) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 08:43:25 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] deallocate_for_instance() {{(pid=95467) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 08:43:27 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:43:27 user nova-compute[95467]: INFO nova.compute.manager [-] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Took 1.10 seconds to deallocate network for instance.
Nov 15 08:43:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-b77ce478-b130-4bcd-87ca-7e86cfe1b833 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:43:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-b77ce478-b130-4bcd-87ca-7e86cfe1b833 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:43:27 user nova-compute[95467]: DEBUG nova.compute.manager [req-4984b422-f197-484e-ad47-8cad3448c5de req-5a1032a8-e965-4770-9d0a-e08c6f1c8dc0 service nova] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Received event network-vif-deleted-27b8a52f-50f2-42e6-9c9f-9b74f9778096 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:43:27 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-b77ce478-b130-4bcd-87ca-7e86cfe1b833 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:43:27 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-b77ce478-b130-4bcd-87ca-7e86cfe1b833 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:43:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-b77ce478-b130-4bcd-87ca-7e86cfe1b833 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.188s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:43:27 user nova-compute[95467]: INFO nova.scheduler.client.report [None req-b77ce478-b130-4bcd-87ca-7e86cfe1b833 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Deleted allocations for instance 2945f42b-62a1-44c5-be3b-f1dbe6826c0f
Nov 15 08:43:27 user nova-compute[95467]: DEBUG nova.compute.manager [req-bba00eee-fc10-4dfc-a2f1-0bbc6f8095be req-356d4845-b09d-4301-96d7-955a72cb1101 service nova] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Received event network-vif-plugged-27b8a52f-50f2-42e6-9c9f-9b74f9778096 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:43:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-bba00eee-fc10-4dfc-a2f1-0bbc6f8095be req-356d4845-b09d-4301-96d7-955a72cb1101 service nova] Acquiring lock "2945f42b-62a1-44c5-be3b-f1dbe6826c0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:43:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-bba00eee-fc10-4dfc-a2f1-0bbc6f8095be req-356d4845-b09d-4301-96d7-955a72cb1101 service nova] Lock "2945f42b-62a1-44c5-be3b-f1dbe6826c0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:43:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-bba00eee-fc10-4dfc-a2f1-0bbc6f8095be req-356d4845-b09d-4301-96d7-955a72cb1101 service nova] Lock "2945f42b-62a1-44c5-be3b-f1dbe6826c0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:43:27 user nova-compute[95467]: DEBUG nova.compute.manager [req-bba00eee-fc10-4dfc-a2f1-0bbc6f8095be req-356d4845-b09d-4301-96d7-955a72cb1101 service nova] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] No waiting events found dispatching network-vif-plugged-27b8a52f-50f2-42e6-9c9f-9b74f9778096 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:43:27 user nova-compute[95467]: WARNING nova.compute.manager [req-bba00eee-fc10-4dfc-a2f1-0bbc6f8095be req-356d4845-b09d-4301-96d7-955a72cb1101 service nova] [instance: 2945f42b-62a1-44c5-be3b-f1dbe6826c0f] Received unexpected event network-vif-plugged-27b8a52f-50f2-42e6-9c9f-9b74f9778096 for instance with vm_state deleted and task_state None.
Nov 15 08:43:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-b77ce478-b130-4bcd-87ca-7e86cfe1b833 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "2945f42b-62a1-44c5-be3b-f1dbe6826c0f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.434s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:43:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:43:30 user nova-compute[95467]: DEBUG nova.compute.manager [req-a14b1284-cd48-4192-9f7a-648eb2207bf2 req-56e4d8f2-b542-45f4-a0ea-0e58e6ef8ccc service nova] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Received event network-changed-8da3553b-1b91-429a-b165-274a1f254c8c {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:43:30 user nova-compute[95467]: DEBUG nova.compute.manager [req-a14b1284-cd48-4192-9f7a-648eb2207bf2 req-56e4d8f2-b542-45f4-a0ea-0e58e6ef8ccc service nova] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Refreshing instance network info cache due to event network-changed-8da3553b-1b91-429a-b165-274a1f254c8c. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:43:30 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-a14b1284-cd48-4192-9f7a-648eb2207bf2 req-56e4d8f2-b542-45f4-a0ea-0e58e6ef8ccc service nova] Acquiring lock "refresh_cache-fd289f63-f798-4ce2-81c6-fab844644f77" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:43:30 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-a14b1284-cd48-4192-9f7a-648eb2207bf2 req-56e4d8f2-b542-45f4-a0ea-0e58e6ef8ccc service nova] Acquired lock "refresh_cache-fd289f63-f798-4ce2-81c6-fab844644f77" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:43:30 user nova-compute[95467]: DEBUG nova.network.neutron [req-a14b1284-cd48-4192-9f7a-648eb2207bf2 req-56e4d8f2-b542-45f4-a0ea-0e58e6ef8ccc service nova] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Refreshing network info cache for port 8da3553b-1b91-429a-b165-274a1f254c8c {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:43:30 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:43:30 user nova-compute[95467]: DEBUG nova.network.neutron [req-a14b1284-cd48-4192-9f7a-648eb2207bf2 req-56e4d8f2-b542-45f4-a0ea-0e58e6ef8ccc service nova] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Updated VIF entry in instance network info cache for port 8da3553b-1b91-429a-b165-274a1f254c8c. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:43:30 user nova-compute[95467]: DEBUG nova.network.neutron [req-a14b1284-cd48-4192-9f7a-648eb2207bf2 req-56e4d8f2-b542-45f4-a0ea-0e58e6ef8ccc service nova] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Updating instance_info_cache with network_info: [{"id": "8da3553b-1b91-429a-b165-274a1f254c8c", "address": "fa:16:3e:01:ef:a0", "network": {"id": "d67049b6-2e91-4d1e-8e42-5388ef75521a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984085217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7355ea3588ae4c2f9242e63084008710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8da3553b-1b", "ovs_interfaceid": "8da3553b-1b91-429a-b165-274a1f254c8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:43:30 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-a14b1284-cd48-4192-9f7a-648eb2207bf2 req-56e4d8f2-b542-45f4-a0ea-0e58e6ef8ccc service nova] Releasing lock "refresh_cache-fd289f63-f798-4ce2-81c6-fab844644f77" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:43:31 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d6cbaf3d-00b8-47fe-9e07-043f02e4d74d tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Acquiring lock "fd289f63-f798-4ce2-81c6-fab844644f77" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:43:31 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d6cbaf3d-00b8-47fe-9e07-043f02e4d74d tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "fd289f63-f798-4ce2-81c6-fab844644f77" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:43:31 user nova-compute[95467]: INFO nova.compute.manager [None req-d6cbaf3d-00b8-47fe-9e07-043f02e4d74d tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Detaching volume 0760323d-4844-4036-a200-22c7e316384f
Nov 15 08:43:31 user nova-compute[95467]: INFO nova.virt.block_device [None req-d6cbaf3d-00b8-47fe-9e07-043f02e4d74d tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Attempting to driver detach volume 0760323d-4844-4036-a200-22c7e316384f from mountpoint /dev/vdb
Nov 15 08:43:31 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-d6cbaf3d-00b8-47fe-9e07-043f02e4d74d tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Attempting to detach device vdb from instance fd289f63-f798-4ce2-81c6-fab844644f77 from the persistent domain config. {{(pid=95467) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 08:43:31 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-d6cbaf3d-00b8-47fe-9e07-043f02e4d74d tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 08:43:31 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:43:31 user nova-compute[95467]:   <source dev="/dev/sdb"/>
Nov 15 08:43:31 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:43:31 user nova-compute[95467]:   <serial>0760323d-4844-4036-a200-22c7e316384f</serial>
Nov 15 08:43:31 user nova-compute[95467]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 08:43:31 user nova-compute[95467]: </disk>
Nov 15 08:43:31 user nova-compute[95467]:  {{(pid=95467) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 08:43:31 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-d6cbaf3d-00b8-47fe-9e07-043f02e4d74d tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Successfully detached device vdb from instance fd289f63-f798-4ce2-81c6-fab844644f77 from the persistent domain config.
Nov 15 08:43:31 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-d6cbaf3d-00b8-47fe-9e07-043f02e4d74d tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fd289f63-f798-4ce2-81c6-fab844644f77 from the live domain config. {{(pid=95467) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 08:43:31 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-d6cbaf3d-00b8-47fe-9e07-043f02e4d74d tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 08:43:31 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:43:31 user nova-compute[95467]:   <source dev="/dev/sdb"/>
Nov 15 08:43:31 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:43:31 user nova-compute[95467]:   <serial>0760323d-4844-4036-a200-22c7e316384f</serial>
Nov 15 08:43:31 user nova-compute[95467]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 08:43:31 user nova-compute[95467]: </disk>
Nov 15 08:43:31 user nova-compute[95467]:  {{(pid=95467) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 08:43:31 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-d6cbaf3d-00b8-47fe-9e07-043f02e4d74d tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fd289f63-f798-4ce2-81c6-fab844644f77 {{(pid=95467) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 08:43:32 user nova-compute[95467]: DEBUG nova.compute.manager [req-412e5064-2a5b-40f0-9528-d1c4c0ad5caf req-fd1e1681-c987-497e-b731-9f7216c91f8f service nova] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Received event network-changed-8da3553b-1b91-429a-b165-274a1f254c8c {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:43:32 user nova-compute[95467]: DEBUG nova.compute.manager [req-412e5064-2a5b-40f0-9528-d1c4c0ad5caf req-fd1e1681-c987-497e-b731-9f7216c91f8f service nova] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Refreshing instance network info cache due to event network-changed-8da3553b-1b91-429a-b165-274a1f254c8c. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:43:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-412e5064-2a5b-40f0-9528-d1c4c0ad5caf req-fd1e1681-c987-497e-b731-9f7216c91f8f service nova] Acquiring lock "refresh_cache-fd289f63-f798-4ce2-81c6-fab844644f77" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:43:32 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-412e5064-2a5b-40f0-9528-d1c4c0ad5caf req-fd1e1681-c987-497e-b731-9f7216c91f8f service nova] Acquired lock "refresh_cache-fd289f63-f798-4ce2-81c6-fab844644f77" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:43:32 user nova-compute[95467]: DEBUG nova.network.neutron [req-412e5064-2a5b-40f0-9528-d1c4c0ad5caf req-fd1e1681-c987-497e-b731-9f7216c91f8f service nova] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Refreshing network info cache for port 8da3553b-1b91-429a-b165-274a1f254c8c {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:43:33 user nova-compute[95467]: DEBUG nova.network.neutron [req-412e5064-2a5b-40f0-9528-d1c4c0ad5caf req-fd1e1681-c987-497e-b731-9f7216c91f8f service nova] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Updated VIF entry in instance network info cache for port 8da3553b-1b91-429a-b165-274a1f254c8c. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:43:33 user nova-compute[95467]: DEBUG nova.network.neutron [req-412e5064-2a5b-40f0-9528-d1c4c0ad5caf req-fd1e1681-c987-497e-b731-9f7216c91f8f service nova] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Updating instance_info_cache with network_info: [{"id": "8da3553b-1b91-429a-b165-274a1f254c8c", "address": "fa:16:3e:01:ef:a0", "network": {"id": "d67049b6-2e91-4d1e-8e42-5388ef75521a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984085217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7355ea3588ae4c2f9242e63084008710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8da3553b-1b", "ovs_interfaceid": "8da3553b-1b91-429a-b165-274a1f254c8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:43:33 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-412e5064-2a5b-40f0-9528-d1c4c0ad5caf req-fd1e1681-c987-497e-b731-9f7216c91f8f service nova] Releasing lock "refresh_cache-fd289f63-f798-4ce2-81c6-fab844644f77" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:43:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:43:35 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:43:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:43:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:43:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=95467) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 08:43:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:43:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:43:40 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:43:45 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:43:50 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:43:50 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:43:50 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=95467) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 08:43:50 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:43:50 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:43:50 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:43:51 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-d6cbaf3d-00b8-47fe-9e07-043f02e4d74d tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fd289f63-f798-4ce2-81c6-fab844644f77 is timed out.
Nov 15 08:43:51 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-d6cbaf3d-00b8-47fe-9e07-043f02e4d74d tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Successfully detached device vdb from instance fd289f63-f798-4ce2-81c6-fab844644f77 from the live domain config.
Nov 15 08:43:51 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6cbaf3d-00b8-47fe-9e07-043f02e4d74d tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] calling os-brick to detach iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 08:43:51 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6cbaf3d-00b8-47fe-9e07-043f02e4d74d tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, {'target_iqn': 'iqn.2010-10.org.openstack:0760323d-4844-4036-a200-22c7e316384f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rnPzvBpF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:43:51 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-d6cbaf3d-00b8-47fe-9e07-043f02e4d74d tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:43:51 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-d6cbaf3d-00b8-47fe-9e07-043f02e4d74d tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:43:51 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-d6cbaf3d-00b8-47fe-9e07-043f02e4d74d tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:43:51 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:43:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:43:52 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e87fdb7-aee6-4f80-a3aa-8cccd2c80eba]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0760323d-4844-4036-a200-22c7e316384f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:43:52 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6cbaf3d-00b8-47fe-9e07-043f02e4d74d tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 08:43:52 user nova-compute[95467]: No targets found.
Nov 15 08:43:52 user nova-compute[95467]: iSNS:
Nov 15 08:43:52 user nova-compute[95467]: No targets found.
Nov 15 08:43:52 user nova-compute[95467]: STATIC:
Nov 15 08:43:52 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:0760323d-4844-4036-a200-22c7e316384f
Nov 15 08:43:52 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:43:52 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:43:52 user nova-compute[95467]: FIRMWARE:
Nov 15 08:43:52 user nova-compute[95467]: No targets found.
Nov 15 08:43:52 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:43:52 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6cbaf3d-00b8-47fe-9e07-043f02e4d74d tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 08:43:52 user nova-compute[95467]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 08:43:52 user nova-compute[95467]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=95467) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 08:43:52 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6cbaf3d-00b8-47fe-9e07-043f02e4d74d tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0760323d-4844-4036-a200-22c7e316384f', 0)] {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 08:43:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:43:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:43:52 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e37367f-2948-4ed7-9961-26e850b96db0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0760323d-4844-4036-a200-22c7e316384f\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:43:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:43:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:43:52 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[be31010f-3a26-48a7-bb9c-8bbe059bdffe]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0760323d-4844-4036-a200-22c7e316384f (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:43:52 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6cbaf3d-00b8-47fe-9e07-043f02e4d74d tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0760323d-4844-4036-a200-22c7e316384f (non-flash)
Nov 15 08:43:52 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:43:52 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6cbaf3d-00b8-47fe-9e07-043f02e4d74d tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0760323d-4844-4036-a200-22c7e316384f (non-flash)
Nov 15 08:43:52 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:43:52 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6cbaf3d-00b8-47fe-9e07-043f02e4d74d tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efec81eb370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0760323d-4844-4036-a200-22c7e316384f'): ({'sdb'}, set())}) {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 08:43:52 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-d6cbaf3d-00b8-47fe-9e07-043f02e4d74d tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Removing single pathed devices sdb {{(pid=95467) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 08:43:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:43:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:43:52 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[355fda33-1865-484f-a71e-e45ac04017e5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:43:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:43:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:43:52 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ada360-2010-4ee6-856f-2f236384e233]: (4, ('ok\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:43:52 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-d6cbaf3d-00b8-47fe-9e07-043f02e4d74d tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Flushing IO for device /dev/sdb {{(pid=95467) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 08:43:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:43:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:43:52 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e4862f-c0d4-4014-99d0-661f4ba5c56d]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:43:52 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-d6cbaf3d-00b8-47fe-9e07-043f02e4d74d tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=95467) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 08:43:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:43:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:43:52 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e43ab6d-d374-4f5a-8051-862e75515099]: (4, ('1', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:43:52 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-d6cbaf3d-00b8-47fe-9e07-043f02e4d74d tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 08:43:52 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-d6cbaf3d-00b8-47fe-9e07-043f02e4d74d tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] SCSI volumes sdb have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 08:43:52 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6cbaf3d-00b8-47fe-9e07-043f02e4d74d tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0760323d-4844-4036-a200-22c7e316384f')] {{(pid=95467) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 08:43:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0760323d-4844-4036-a200-22c7e316384f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:43:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0760323d-4844-4036-a200-22c7e316384f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:43:52 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce276f10-9277-48a3-80ee-8a5c3eb97b31]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:43:52 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6cbaf3d-00b8-47fe-9e07-043f02e4d74d tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:43:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0760323d-4844-4036-a200-22c7e316384f -p 172.16.0.220:3260 --logout {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:43:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0760323d-4844-4036-a200-22c7e316384f -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:43:52 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4b3855-0f06-438e-88c1-9f3985cdc2ab]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:0760323d-4844-4036-a200-22c7e316384f, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:0760323d-4844-4036-a200-22c7e316384f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:43:52 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6cbaf3d-00b8-47fe-9e07-043f02e4d74d tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:0760323d-4844-4036-a200-22c7e316384f, portal: 172.16.0.220,3260]
Nov 15 08:43:52 user nova-compute[95467]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:0760323d-4844-4036-a200-22c7e316384f, portal: 172.16.0.220,3260] successful.
Nov 15 08:43:52 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:43:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0760323d-4844-4036-a200-22c7e316384f -p 172.16.0.220:3260 --op delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:43:52 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0760323d-4844-4036-a200-22c7e316384f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:43:52 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bbc0573-f443-4407-89b1-299d68d6fcaf]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:43:52 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6cbaf3d-00b8-47fe-9e07-043f02e4d74d tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:43:52 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-d6cbaf3d-00b8-47fe-9e07-043f02e4d74d tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:43:52 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6cbaf3d-00b8-47fe-9e07-043f02e4d74d tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] <== disconnect_volume: return (322ms) None {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:43:52 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6cbaf3d-00b8-47fe-9e07-043f02e4d74d tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Disconnected iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 08:43:53 user nova-compute[95467]: DEBUG nova.objects.instance [None req-d6cbaf3d-00b8-47fe-9e07-043f02e4d74d tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lazy-loading 'flavor' on Instance uuid fd289f63-f798-4ce2-81c6-fab844644f77 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:43:53 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-d6cbaf3d-00b8-47fe-9e07-043f02e4d74d tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "fd289f63-f798-4ce2-81c6-fab844644f77" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.666s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:43:55 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:44:00 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:44:02 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:44:02 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=95467) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 08:44:04 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:44:05 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:44:05 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:44:05 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:44:05 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=95467) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 08:44:05 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:44:05 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:44:05 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:44:07 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager.update_available_resource {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:44:07 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:44:07 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:44:07 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:44:07 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Auditing locally available compute resources for user (node: user) {{(pid=95467) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 08:44:07 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd289f63-f798-4ce2-81c6-fab844644f77/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:44:07 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd289f63-f798-4ce2-81c6-fab844644f77/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:44:07 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd289f63-f798-4ce2-81c6-fab844644f77/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:44:08 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd289f63-f798-4ce2-81c6-fab844644f77/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:44:08 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:44:08 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:44:08 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Hypervisor/Node resource view: name=user free_ram=8999MB free_disk=25.0404052734375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=95467) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 08:44:08 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:44:08 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:44:08 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance fd289f63-f798-4ce2-81c6-fab844644f77 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:44:08 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 08:44:08 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 08:44:08 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:44:08 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:44:08 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Compute_service record updated for user:user {{(pid=95467) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 08:44:08 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.210s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:44:10 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:44:11 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:44:11 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:44:13 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:44:14 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:44:15 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:44:15 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Starting heal instance info cache {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 08:44:15 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Rebuilding the list of instances to heal {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 08:44:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "refresh_cache-fd289f63-f798-4ce2-81c6-fab844644f77" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:44:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquired lock "refresh_cache-fd289f63-f798-4ce2-81c6-fab844644f77" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:44:15 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Forcefully refreshing network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 08:44:15 user nova-compute[95467]: DEBUG nova.objects.instance [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lazy-loading 'info_cache' on Instance uuid fd289f63-f798-4ce2-81c6-fab844644f77 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:44:15 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:44:16 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Updating instance_info_cache with network_info: [{"id": "8da3553b-1b91-429a-b165-274a1f254c8c", "address": "fa:16:3e:01:ef:a0", "network": {"id": "d67049b6-2e91-4d1e-8e42-5388ef75521a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984085217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7355ea3588ae4c2f9242e63084008710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8da3553b-1b", "ovs_interfaceid": "8da3553b-1b91-429a-b165-274a1f254c8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:44:16 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Releasing lock "refresh_cache-fd289f63-f798-4ce2-81c6-fab844644f77" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:44:16 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Updated the network info_cache for instance {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 08:44:18 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Acquiring lock "f13d65ca-1cce-4675-998e-c668b53a6d12" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:44:18 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "f13d65ca-1cce-4675-998e-c668b53a6d12" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:44:18 user nova-compute[95467]: DEBUG nova.compute.manager [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Starting instance... {{(pid=95467) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 08:44:18 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:44:18 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:44:18 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=95467) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 08:44:18 user nova-compute[95467]: INFO nova.compute.claims [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Claim successful on node user
Nov 15 08:44:19 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:44:19 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:44:19 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:44:19 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.235s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:44:19 user nova-compute[95467]: DEBUG nova.compute.manager [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Start building networks asynchronously for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 08:44:19 user nova-compute[95467]: DEBUG nova.compute.manager [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Allocating IP information in the background. {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 08:44:19 user nova-compute[95467]: DEBUG nova.network.neutron [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] allocate_for_instance() {{(pid=95467) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 08:44:19 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 08:44:19 user nova-compute[95467]: DEBUG nova.compute.manager [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Start building block device mappings for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 08:44:19 user nova-compute[95467]: DEBUG nova.policy [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e31df8ed5a914b2395b548606b65e580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a636c8b7074bd19eeee608156f8568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95467) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 08:44:19 user nova-compute[95467]: DEBUG nova.compute.manager [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Start spawning the instance on the hypervisor. {{(pid=95467) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 08:44:19 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Creating instance directory {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 08:44:19 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Creating image(s)
Nov 15 08:44:19 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Acquiring lock "/opt/stack/data/nova/instances/f13d65ca-1cce-4675-998e-c668b53a6d12/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:44:19 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "/opt/stack/data/nova/instances/f13d65ca-1cce-4675-998e-c668b53a6d12/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:44:19 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "/opt/stack/data/nova/instances/f13d65ca-1cce-4675-998e-c668b53a6d12/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:44:19 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:44:19 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.181s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:44:19 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Acquiring lock "a3fcf60225fcefd310404971cd18ab9851c548dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:44:19 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:44:19 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:44:19 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.172s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:44:19 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/f13d65ca-1cce-4675-998e-c668b53a6d12/disk 1073741824 {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:44:19 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/f13d65ca-1cce-4675-998e-c668b53a6d12/disk 1073741824" returned: 0 in 0.056s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:44:19 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:44:19 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:44:19 user nova-compute[95467]: DEBUG nova.network.neutron [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Successfully created port: 8a79119f-64d3-4539-9a53-d0eae8bbcf54 {{(pid=95467) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 08:44:19 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.178s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:44:19 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f13d65ca-1cce-4675-998e-c668b53a6d12/disk. size=1073741824 {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 08:44:19 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13d65ca-1cce-4675-998e-c668b53a6d12/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:44:20 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13d65ca-1cce-4675-998e-c668b53a6d12/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:44:20 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Cannot resize image /opt/stack/data/nova/instances/f13d65ca-1cce-4675-998e-c668b53a6d12/disk to a smaller size. {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 08:44:20 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Created local disks {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 08:44:20 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Ensure instance console log exists: /opt/stack/data/nova/instances/f13d65ca-1cce-4675-998e-c668b53a6d12/console.log {{(pid=95467) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 08:44:20 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:44:20 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:44:20 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:44:20 user nova-compute[95467]: DEBUG nova.network.neutron [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Successfully updated port: 8a79119f-64d3-4539-9a53-d0eae8bbcf54 {{(pid=95467) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 08:44:20 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Acquiring lock "refresh_cache-f13d65ca-1cce-4675-998e-c668b53a6d12" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:44:20 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Acquired lock "refresh_cache-f13d65ca-1cce-4675-998e-c668b53a6d12" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:44:20 user nova-compute[95467]: DEBUG nova.network.neutron [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:44:20 user nova-compute[95467]: DEBUG nova.compute.manager [req-724a2d15-79c9-472b-a9b3-f2e4bc249181 req-b69727da-501c-4483-9eaa-89279f5a0d81 service nova] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Received event network-changed-8a79119f-64d3-4539-9a53-d0eae8bbcf54 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:44:20 user nova-compute[95467]: DEBUG nova.compute.manager [req-724a2d15-79c9-472b-a9b3-f2e4bc249181 req-b69727da-501c-4483-9eaa-89279f5a0d81 service nova] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Refreshing instance network info cache due to event network-changed-8a79119f-64d3-4539-9a53-d0eae8bbcf54. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:44:20 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-724a2d15-79c9-472b-a9b3-f2e4bc249181 req-b69727da-501c-4483-9eaa-89279f5a0d81 service nova] Acquiring lock "refresh_cache-f13d65ca-1cce-4675-998e-c668b53a6d12" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:44:20 user nova-compute[95467]: DEBUG nova.network.neutron [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Instance cache missing network info. {{(pid=95467) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 08:44:20 user nova-compute[95467]: DEBUG nova.network.neutron [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Updating instance_info_cache with network_info: [{"id": "8a79119f-64d3-4539-9a53-d0eae8bbcf54", "address": "fa:16:3e:b2:9e:b7", "network": {"id": "26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1542679712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9a636c8b7074bd19eeee608156f8568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a79119f-64", "ovs_interfaceid": "8a79119f-64d3-4539-9a53-d0eae8bbcf54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:44:20 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Releasing lock "refresh_cache-f13d65ca-1cce-4675-998e-c668b53a6d12" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:44:20 user nova-compute[95467]: DEBUG nova.compute.manager [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Instance network_info: |[{"id": "8a79119f-64d3-4539-9a53-d0eae8bbcf54", "address": "fa:16:3e:b2:9e:b7", "network": {"id": "26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1542679712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9a636c8b7074bd19eeee608156f8568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a79119f-64", "ovs_interfaceid": "8a79119f-64d3-4539-9a53-d0eae8bbcf54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 08:44:20 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-724a2d15-79c9-472b-a9b3-f2e4bc249181 req-b69727da-501c-4483-9eaa-89279f5a0d81 service nova] Acquired lock "refresh_cache-f13d65ca-1cce-4675-998e-c668b53a6d12" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:44:20 user nova-compute[95467]: DEBUG nova.network.neutron [req-724a2d15-79c9-472b-a9b3-f2e4bc249181 req-b69727da-501c-4483-9eaa-89279f5a0d81 service nova] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Refreshing network info cache for port 8a79119f-64d3-4539-9a53-d0eae8bbcf54 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:44:20 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Start _get_guest_xml network_info=[{"id": "8a79119f-64d3-4539-9a53-d0eae8bbcf54", "address": "fa:16:3e:b2:9e:b7", "network": {"id": "26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1542679712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9a636c8b7074bd19eeee608156f8568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a79119f-64", "ovs_interfaceid": "8a79119f-64d3-4539-9a53-d0eae8bbcf54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'ed9c48aa-ce73-4b3b-9db1-235898be671b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:44:20 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:44:20 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:44:20 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:44:20 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:44:20 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:44:20 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:44:20 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:44:20 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:44:20 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:44:20 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:44:20 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:44:20 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:44:20 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:44:20 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:44:20 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:44:20 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:44:20 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:44:20 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:44:20 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:44:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-658357451',display_name='tempest-AttachVolumeTestJSON-server-658357451',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-658357451',id=52,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDXbZt7mr5YlmgEdQI3YIKKqBvMGkI+w2a/qKQVwpvss4nu1k7S3OK3/rNjiYIdoapmSPzWlHtdeZZJIbz4z7wFOFcuA9vxrWB2J152bL3xQL6yU7WTCELJuKx/dt4JzNg==',key_name='tempest-keypair-1376680918',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9a636c8b7074bd19eeee608156f8568',ramdisk_id='',reservation_id='r-odinttss',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1507968277',owner_user_name='tempest-AttachVolumeTestJSON-1507968277-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:44:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e31df8ed5a914b2395b548606b65e580',uuid=f13d65ca-1cce-4675-998e-c668b53a6d12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a79119f-64d3-4539-9a53-d0eae8bbcf54", "address": "fa:16:3e:b2:9e:b7", "network": {"id": "26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1542679712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9a636c8b7074bd19eeee608156f8568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a79119f-64", "ovs_interfaceid": "8a79119f-64d3-4539-9a53-d0eae8bbcf54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:44:20 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Converting VIF {"id": "8a79119f-64d3-4539-9a53-d0eae8bbcf54", "address": "fa:16:3e:b2:9e:b7", "network": {"id": "26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1542679712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9a636c8b7074bd19eeee608156f8568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a79119f-64", "ovs_interfaceid": "8a79119f-64d3-4539-9a53-d0eae8bbcf54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:44:20 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:9e:b7,bridge_name='br-int',has_traffic_filtering=True,id=8a79119f-64d3-4539-9a53-d0eae8bbcf54,network=Network(26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a79119f-64') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:44:20 user nova-compute[95467]: DEBUG nova.objects.instance [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lazy-loading 'pci_devices' on Instance uuid f13d65ca-1cce-4675-998e-c668b53a6d12 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:44:20 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:44:20 user nova-compute[95467]:   <uuid>f13d65ca-1cce-4675-998e-c668b53a6d12</uuid>
Nov 15 08:44:20 user nova-compute[95467]:   <name>instance-00000034</name>
Nov 15 08:44:20 user nova-compute[95467]:   <memory>524288</memory>
Nov 15 08:44:20 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:44:20 user nova-compute[95467]:   <metadata>
Nov 15 08:44:20 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:44:20 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:44:20 user nova-compute[95467]:       <nova:name>tempest-AttachVolumeTestJSON-server-658357451</nova:name>
Nov 15 08:44:20 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:44:20</nova:creationTime>
Nov 15 08:44:20 user nova-compute[95467]:       <nova:flavor name="m1.tiny">
Nov 15 08:44:20 user nova-compute[95467]:         <nova:memory>512</nova:memory>
Nov 15 08:44:20 user nova-compute[95467]:         <nova:disk>1</nova:disk>
Nov 15 08:44:20 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:44:20 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:44:20 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:44:20 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:44:20 user nova-compute[95467]:       <nova:owner>
Nov 15 08:44:20 user nova-compute[95467]:         <nova:user uuid="e31df8ed5a914b2395b548606b65e580">tempest-AttachVolumeTestJSON-1507968277-project-member</nova:user>
Nov 15 08:44:20 user nova-compute[95467]:         <nova:project uuid="a9a636c8b7074bd19eeee608156f8568">tempest-AttachVolumeTestJSON-1507968277</nova:project>
Nov 15 08:44:20 user nova-compute[95467]:       </nova:owner>
Nov 15 08:44:20 user nova-compute[95467]:       <nova:root type="image" uuid="ed9c48aa-ce73-4b3b-9db1-235898be671b"/>
Nov 15 08:44:20 user nova-compute[95467]:       <nova:ports>
Nov 15 08:44:20 user nova-compute[95467]:         <nova:port uuid="8a79119f-64d3-4539-9a53-d0eae8bbcf54">
Nov 15 08:44:20 user nova-compute[95467]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 08:44:20 user nova-compute[95467]:         </nova:port>
Nov 15 08:44:20 user nova-compute[95467]:       </nova:ports>
Nov 15 08:44:20 user nova-compute[95467]:     </nova:instance>
Nov 15 08:44:20 user nova-compute[95467]:   </metadata>
Nov 15 08:44:20 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:44:20 user nova-compute[95467]:     <system>
Nov 15 08:44:20 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:44:20 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:44:20 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:44:20 user nova-compute[95467]:       <entry name="serial">f13d65ca-1cce-4675-998e-c668b53a6d12</entry>
Nov 15 08:44:20 user nova-compute[95467]:       <entry name="uuid">f13d65ca-1cce-4675-998e-c668b53a6d12</entry>
Nov 15 08:44:20 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:44:20 user nova-compute[95467]:     </system>
Nov 15 08:44:20 user nova-compute[95467]:   </sysinfo>
Nov 15 08:44:20 user nova-compute[95467]:   <os>
Nov 15 08:44:20 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:44:20 user nova-compute[95467]:     <boot dev="hd"/>
Nov 15 08:44:20 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:44:20 user nova-compute[95467]:   </os>
Nov 15 08:44:20 user nova-compute[95467]:   <features>
Nov 15 08:44:20 user nova-compute[95467]:     <acpi/>
Nov 15 08:44:20 user nova-compute[95467]:     <apic/>
Nov 15 08:44:20 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:44:20 user nova-compute[95467]:   </features>
Nov 15 08:44:20 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:44:20 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:44:20 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:44:20 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:44:20 user nova-compute[95467]:   </clock>
Nov 15 08:44:20 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:44:20 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:44:20 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:44:20 user nova-compute[95467]:   </cpu>
Nov 15 08:44:20 user nova-compute[95467]:   <devices>
Nov 15 08:44:20 user nova-compute[95467]:     <disk type="file" device="disk">
Nov 15 08:44:20 user nova-compute[95467]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 08:44:20 user nova-compute[95467]:       <source file="/opt/stack/data/nova/instances/f13d65ca-1cce-4675-998e-c668b53a6d12/disk"/>
Nov 15 08:44:20 user nova-compute[95467]:       <target dev="vda" bus="virtio"/>
Nov 15 08:44:20 user nova-compute[95467]:     </disk>
Nov 15 08:44:20 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:44:20 user nova-compute[95467]:       <mac address="fa:16:3e:b2:9e:b7"/>
Nov 15 08:44:20 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:44:20 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:44:20 user nova-compute[95467]:       <target dev="tap8a79119f-64"/>
Nov 15 08:44:20 user nova-compute[95467]:     </interface>
Nov 15 08:44:20 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:44:20 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/f13d65ca-1cce-4675-998e-c668b53a6d12/console.log" append="off"/>
Nov 15 08:44:20 user nova-compute[95467]:     </serial>
Nov 15 08:44:20 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:44:20 user nova-compute[95467]:     <video>
Nov 15 08:44:20 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:44:20 user nova-compute[95467]:     </video>
Nov 15 08:44:20 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:44:20 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:44:20 user nova-compute[95467]:     </rng>
Nov 15 08:44:20 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:44:20 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:44:20 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:44:20 user nova-compute[95467]:     </memballoon>
Nov 15 08:44:20 user nova-compute[95467]:   </devices>
Nov 15 08:44:20 user nova-compute[95467]: </domain>
Nov 15 08:44:20 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:44:20 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:44:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-658357451',display_name='tempest-AttachVolumeTestJSON-server-658357451',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-658357451',id=52,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDXbZt7mr5YlmgEdQI3YIKKqBvMGkI+w2a/qKQVwpvss4nu1k7S3OK3/rNjiYIdoapmSPzWlHtdeZZJIbz4z7wFOFcuA9vxrWB2J152bL3xQL6yU7WTCELJuKx/dt4JzNg==',key_name='tempest-keypair-1376680918',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9a636c8b7074bd19eeee608156f8568',ramdisk_id='',reservation_id='r-odinttss',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1507968277',owner_user_name='tempest-AttachVolumeTestJSON-1507968277-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:44:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e31df8ed5a914b2395b548606b65e580',uuid=f13d65ca-1cce-4675-998e-c668b53a6d12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a79119f-64d3-4539-9a53-d0eae8bbcf54", "address": "fa:16:3e:b2:9e:b7", "network": {"id": "26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1542679712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9a636c8b7074bd19eeee608156f8568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a79119f-64", "ovs_interfaceid": "8a79119f-64d3-4539-9a53-d0eae8bbcf54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:44:20 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Converting VIF {"id": "8a79119f-64d3-4539-9a53-d0eae8bbcf54", "address": "fa:16:3e:b2:9e:b7", "network": {"id": "26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1542679712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9a636c8b7074bd19eeee608156f8568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a79119f-64", "ovs_interfaceid": "8a79119f-64d3-4539-9a53-d0eae8bbcf54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:44:20 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:9e:b7,bridge_name='br-int',has_traffic_filtering=True,id=8a79119f-64d3-4539-9a53-d0eae8bbcf54,network=Network(26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a79119f-64') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:44:20 user nova-compute[95467]: DEBUG os_vif [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:9e:b7,bridge_name='br-int',has_traffic_filtering=True,id=8a79119f-64d3-4539-9a53-d0eae8bbcf54,network=Network(26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a79119f-64') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:44:20 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:44:20 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:44:20 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:44:20 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:44:20 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '54c9ee78-07e8-5a0b-9396-e614a88ca48e', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:44:20 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:44:20 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:44:20 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:44:20 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8a79119f-64, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:44:20 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8a79119f-64, col_values=(('qos', UUID('5813d38d-69fe-44d7-9ece-836001f3966a')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:44:20 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8a79119f-64, col_values=(('external_ids', {'iface-id': '8a79119f-64d3-4539-9a53-d0eae8bbcf54', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:9e:b7', 'vm-uuid': 'f13d65ca-1cce-4675-998e-c668b53a6d12'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:44:20 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:44:20 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:44:20 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:44:20 user nova-compute[95467]: INFO os_vif [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:9e:b7,bridge_name='br-int',has_traffic_filtering=True,id=8a79119f-64d3-4539-9a53-d0eae8bbcf54,network=Network(26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a79119f-64')
Nov 15 08:44:20 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:44:20 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] No VIF found with MAC fa:16:3e:b2:9e:b7, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:44:21 user nova-compute[95467]: DEBUG nova.network.neutron [req-724a2d15-79c9-472b-a9b3-f2e4bc249181 req-b69727da-501c-4483-9eaa-89279f5a0d81 service nova] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Updated VIF entry in instance network info cache for port 8a79119f-64d3-4539-9a53-d0eae8bbcf54. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:44:21 user nova-compute[95467]: DEBUG nova.network.neutron [req-724a2d15-79c9-472b-a9b3-f2e4bc249181 req-b69727da-501c-4483-9eaa-89279f5a0d81 service nova] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Updating instance_info_cache with network_info: [{"id": "8a79119f-64d3-4539-9a53-d0eae8bbcf54", "address": "fa:16:3e:b2:9e:b7", "network": {"id": "26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1542679712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9a636c8b7074bd19eeee608156f8568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a79119f-64", "ovs_interfaceid": "8a79119f-64d3-4539-9a53-d0eae8bbcf54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:44:21 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-724a2d15-79c9-472b-a9b3-f2e4bc249181 req-b69727da-501c-4483-9eaa-89279f5a0d81 service nova] Releasing lock "refresh_cache-f13d65ca-1cce-4675-998e-c668b53a6d12" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:44:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:44:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:44:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:44:22 user nova-compute[95467]: DEBUG nova.compute.manager [req-f92a4026-0ea3-4d2d-865c-2eef01c6ed12 req-36544a31-2957-418f-a102-e9845a829473 service nova] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Received event network-vif-plugged-8a79119f-64d3-4539-9a53-d0eae8bbcf54 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:44:22 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-f92a4026-0ea3-4d2d-865c-2eef01c6ed12 req-36544a31-2957-418f-a102-e9845a829473 service nova] Acquiring lock "f13d65ca-1cce-4675-998e-c668b53a6d12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:44:22 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-f92a4026-0ea3-4d2d-865c-2eef01c6ed12 req-36544a31-2957-418f-a102-e9845a829473 service nova] Lock "f13d65ca-1cce-4675-998e-c668b53a6d12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:44:22 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-f92a4026-0ea3-4d2d-865c-2eef01c6ed12 req-36544a31-2957-418f-a102-e9845a829473 service nova] Lock "f13d65ca-1cce-4675-998e-c668b53a6d12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:44:22 user nova-compute[95467]: DEBUG nova.compute.manager [req-f92a4026-0ea3-4d2d-865c-2eef01c6ed12 req-36544a31-2957-418f-a102-e9845a829473 service nova] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] No waiting events found dispatching network-vif-plugged-8a79119f-64d3-4539-9a53-d0eae8bbcf54 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:44:22 user nova-compute[95467]: WARNING nova.compute.manager [req-f92a4026-0ea3-4d2d-865c-2eef01c6ed12 req-36544a31-2957-418f-a102-e9845a829473 service nova] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Received unexpected event network-vif-plugged-8a79119f-64d3-4539-9a53-d0eae8bbcf54 for instance with vm_state building and task_state spawning.
Nov 15 08:44:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:44:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:44:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:44:23 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:44:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-344d0603-9409-4d20-8d6f-b5736a4b6b98 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Acquiring lock "fd289f63-f798-4ce2-81c6-fab844644f77" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:44:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-344d0603-9409-4d20-8d6f-b5736a4b6b98 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "fd289f63-f798-4ce2-81c6-fab844644f77" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:44:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-344d0603-9409-4d20-8d6f-b5736a4b6b98 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Acquiring lock "fd289f63-f798-4ce2-81c6-fab844644f77-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:44:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-344d0603-9409-4d20-8d6f-b5736a4b6b98 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "fd289f63-f798-4ce2-81c6-fab844644f77-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:44:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-344d0603-9409-4d20-8d6f-b5736a4b6b98 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "fd289f63-f798-4ce2-81c6-fab844644f77-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:44:24 user nova-compute[95467]: INFO nova.compute.manager [None req-344d0603-9409-4d20-8d6f-b5736a4b6b98 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Terminating instance
Nov 15 08:44:24 user nova-compute[95467]: DEBUG nova.compute.manager [None req-344d0603-9409-4d20-8d6f-b5736a4b6b98 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Start destroying the instance on the hypervisor. {{(pid=95467) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 08:44:24 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:44:24 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:44:24 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:44:24 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:44:24 user nova-compute[95467]: DEBUG nova.compute.manager [req-8559c216-30af-48b0-be6f-1e4da60df3f3 req-543cbb52-dc97-4268-903b-9e81b57b1570 service nova] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Received event network-vif-unplugged-8da3553b-1b91-429a-b165-274a1f254c8c {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:44:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-8559c216-30af-48b0-be6f-1e4da60df3f3 req-543cbb52-dc97-4268-903b-9e81b57b1570 service nova] Acquiring lock "fd289f63-f798-4ce2-81c6-fab844644f77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:44:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-8559c216-30af-48b0-be6f-1e4da60df3f3 req-543cbb52-dc97-4268-903b-9e81b57b1570 service nova] Lock "fd289f63-f798-4ce2-81c6-fab844644f77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:44:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-8559c216-30af-48b0-be6f-1e4da60df3f3 req-543cbb52-dc97-4268-903b-9e81b57b1570 service nova] Lock "fd289f63-f798-4ce2-81c6-fab844644f77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:44:24 user nova-compute[95467]: DEBUG nova.compute.manager [req-8559c216-30af-48b0-be6f-1e4da60df3f3 req-543cbb52-dc97-4268-903b-9e81b57b1570 service nova] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] No waiting events found dispatching network-vif-unplugged-8da3553b-1b91-429a-b165-274a1f254c8c {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:44:24 user nova-compute[95467]: DEBUG nova.compute.manager [req-8559c216-30af-48b0-be6f-1e4da60df3f3 req-543cbb52-dc97-4268-903b-9e81b57b1570 service nova] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Received event network-vif-unplugged-8da3553b-1b91-429a-b165-274a1f254c8c for instance with task_state deleting. {{(pid=95467) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 08:44:24 user nova-compute[95467]: DEBUG nova.compute.manager [req-b726c0ce-790a-4456-9178-0a848cb41403 req-7d344128-e04d-43e0-80af-e5a32d4dc3e9 service nova] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Received event network-vif-plugged-8a79119f-64d3-4539-9a53-d0eae8bbcf54 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:44:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b726c0ce-790a-4456-9178-0a848cb41403 req-7d344128-e04d-43e0-80af-e5a32d4dc3e9 service nova] Acquiring lock "f13d65ca-1cce-4675-998e-c668b53a6d12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:44:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b726c0ce-790a-4456-9178-0a848cb41403 req-7d344128-e04d-43e0-80af-e5a32d4dc3e9 service nova] Lock "f13d65ca-1cce-4675-998e-c668b53a6d12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:44:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b726c0ce-790a-4456-9178-0a848cb41403 req-7d344128-e04d-43e0-80af-e5a32d4dc3e9 service nova] Lock "f13d65ca-1cce-4675-998e-c668b53a6d12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:44:24 user nova-compute[95467]: DEBUG nova.compute.manager [req-b726c0ce-790a-4456-9178-0a848cb41403 req-7d344128-e04d-43e0-80af-e5a32d4dc3e9 service nova] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] No waiting events found dispatching network-vif-plugged-8a79119f-64d3-4539-9a53-d0eae8bbcf54 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:44:24 user nova-compute[95467]: WARNING nova.compute.manager [req-b726c0ce-790a-4456-9178-0a848cb41403 req-7d344128-e04d-43e0-80af-e5a32d4dc3e9 service nova] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Received unexpected event network-vif-plugged-8a79119f-64d3-4539-9a53-d0eae8bbcf54 for instance with vm_state building and task_state spawning.
Nov 15 08:44:24 user nova-compute[95467]: DEBUG nova.compute.manager [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Instance event wait completed in 0 seconds for  {{(pid=95467) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 08:44:24 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Guest created on hypervisor {{(pid=95467) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 08:44:24 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Instance spawned successfully.
Nov 15 08:44:24 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 08:44:24 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Found default for hw_cdrom_bus of ide {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:44:24 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Found default for hw_disk_bus of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:44:24 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Found default for hw_input_bus of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:44:24 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Found default for hw_pointer_model of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:44:24 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Found default for hw_video_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:44:24 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Found default for hw_vif_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:44:24 user nova-compute[95467]: INFO nova.compute.manager [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Took 5.21 seconds to spawn the instance on the hypervisor.
Nov 15 08:44:24 user nova-compute[95467]: DEBUG nova.compute.manager [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:44:24 user nova-compute[95467]: INFO nova.compute.manager [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Took 5.78 seconds to build instance.
Nov 15 08:44:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-4ea7887b-bef6-44d9-98c4-8216e4097d86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "f13d65ca-1cce-4675-998e-c668b53a6d12" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.884s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:44:24 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Instance destroyed successfully.
Nov 15 08:44:24 user nova-compute[95467]: DEBUG nova.objects.instance [None req-344d0603-9409-4d20-8d6f-b5736a4b6b98 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lazy-loading 'resources' on Instance uuid fd289f63-f798-4ce2-81c6-fab844644f77 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:44:24 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-344d0603-9409-4d20-8d6f-b5736a4b6b98 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:39:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-714632764',display_name='tempest-TestMinimumBasicScenario-server-714632764',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-714632764',id=51,image_ref='b660b411-a40e-4687-a819-c5891baf783b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIKmXtZ9KdS9rhcL4ObJxwUWN7w+PpgehOowCqFulrc1MTQdYal5X9NIIMcz8yKQhhDsKQLa64/vhUkMpw4j4E3mq8VSrdEJCi98jVsRmqkVmDmbH7zE4cCLXkS6AZUYqA==',key_name='tempest-TestMinimumBasicScenario-91627207',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:39:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7355ea3588ae4c2f9242e63084008710',ramdisk_id='',reservation_id='r-jfrdwfa0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b660b411-a40e-4687-a819-c5891baf783b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-721378270',owner_user_name='tempest-TestMinimumBasicScenario-721378270-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:41:46Z,user_data=None,user_id='7b095b34b1b74a28a9f0b96cb6f033aa',uuid=fd289f63-f798-4ce2-81c6-fab844644f77,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8da3553b-1b91-429a-b165-274a1f254c8c", "address": "fa:16:3e:01:ef:a0", "network": {"id": "d67049b6-2e91-4d1e-8e42-5388ef75521a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984085217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7355ea3588ae4c2f9242e63084008710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8da3553b-1b", "ovs_interfaceid": "8da3553b-1b91-429a-b165-274a1f254c8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:44:24 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-344d0603-9409-4d20-8d6f-b5736a4b6b98 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Converting VIF {"id": "8da3553b-1b91-429a-b165-274a1f254c8c", "address": "fa:16:3e:01:ef:a0", "network": {"id": "d67049b6-2e91-4d1e-8e42-5388ef75521a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984085217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7355ea3588ae4c2f9242e63084008710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8da3553b-1b", "ovs_interfaceid": "8da3553b-1b91-429a-b165-274a1f254c8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:44:24 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-344d0603-9409-4d20-8d6f-b5736a4b6b98 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:01:ef:a0,bridge_name='br-int',has_traffic_filtering=True,id=8da3553b-1b91-429a-b165-274a1f254c8c,network=Network(d67049b6-2e91-4d1e-8e42-5388ef75521a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8da3553b-1b') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:44:24 user nova-compute[95467]: DEBUG os_vif [None req-344d0603-9409-4d20-8d6f-b5736a4b6b98 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:ef:a0,bridge_name='br-int',has_traffic_filtering=True,id=8da3553b-1b91-429a-b165-274a1f254c8c,network=Network(d67049b6-2e91-4d1e-8e42-5388ef75521a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8da3553b-1b') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:44:24 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:44:24 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8da3553b-1b, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:44:24 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:44:24 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:44:24 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:44:24 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=329878f3-da7e-456e-b1d7-9eb65238178d) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:44:24 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:44:24 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:44:24 user nova-compute[95467]: INFO os_vif [None req-344d0603-9409-4d20-8d6f-b5736a4b6b98 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:ef:a0,bridge_name='br-int',has_traffic_filtering=True,id=8da3553b-1b91-429a-b165-274a1f254c8c,network=Network(d67049b6-2e91-4d1e-8e42-5388ef75521a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8da3553b-1b')
Nov 15 08:44:24 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-344d0603-9409-4d20-8d6f-b5736a4b6b98 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Deleting instance files /opt/stack/data/nova/instances/fd289f63-f798-4ce2-81c6-fab844644f77_del
Nov 15 08:44:24 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-344d0603-9409-4d20-8d6f-b5736a4b6b98 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Deletion of /opt/stack/data/nova/instances/fd289f63-f798-4ce2-81c6-fab844644f77_del complete
Nov 15 08:44:24 user nova-compute[95467]: INFO nova.compute.manager [None req-344d0603-9409-4d20-8d6f-b5736a4b6b98 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 15 08:44:24 user nova-compute[95467]: DEBUG oslo.service.loopingcall [None req-344d0603-9409-4d20-8d6f-b5736a4b6b98 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=95467) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 08:44:24 user nova-compute[95467]: DEBUG nova.compute.manager [-] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Deallocating network for instance {{(pid=95467) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 08:44:24 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] deallocate_for_instance() {{(pid=95467) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 08:44:25 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:44:25 user nova-compute[95467]: INFO nova.compute.manager [-] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Took 0.41 seconds to deallocate network for instance.
Nov 15 08:44:25 user nova-compute[95467]: DEBUG nova.compute.manager [req-aabb3b4f-9a6b-4306-834f-473fe8eca6f2 req-cbf79ee7-bfe6-4266-aa5a-5635221cd1b8 service nova] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Received event network-vif-deleted-8da3553b-1b91-429a-b165-274a1f254c8c {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:44:25 user nova-compute[95467]: INFO nova.compute.manager [req-aabb3b4f-9a6b-4306-834f-473fe8eca6f2 req-cbf79ee7-bfe6-4266-aa5a-5635221cd1b8 service nova] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Neutron deleted interface 8da3553b-1b91-429a-b165-274a1f254c8c; detaching it from the instance and deleting it from the info cache
Nov 15 08:44:25 user nova-compute[95467]: DEBUG nova.network.neutron [req-aabb3b4f-9a6b-4306-834f-473fe8eca6f2 req-cbf79ee7-bfe6-4266-aa5a-5635221cd1b8 service nova] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:44:25 user nova-compute[95467]: DEBUG nova.compute.manager [req-aabb3b4f-9a6b-4306-834f-473fe8eca6f2 req-cbf79ee7-bfe6-4266-aa5a-5635221cd1b8 service nova] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Detach interface failed, port_id=8da3553b-1b91-429a-b165-274a1f254c8c, reason: Instance fd289f63-f798-4ce2-81c6-fab844644f77 could not be found. {{(pid=95467) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 08:44:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-344d0603-9409-4d20-8d6f-b5736a4b6b98 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:44:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-344d0603-9409-4d20-8d6f-b5736a4b6b98 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:44:25 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-344d0603-9409-4d20-8d6f-b5736a4b6b98 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:44:25 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-344d0603-9409-4d20-8d6f-b5736a4b6b98 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:44:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-344d0603-9409-4d20-8d6f-b5736a4b6b98 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.130s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:44:25 user nova-compute[95467]: INFO nova.scheduler.client.report [None req-344d0603-9409-4d20-8d6f-b5736a4b6b98 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Deleted allocations for instance fd289f63-f798-4ce2-81c6-fab844644f77
Nov 15 08:44:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-344d0603-9409-4d20-8d6f-b5736a4b6b98 tempest-TestMinimumBasicScenario-721378270 tempest-TestMinimumBasicScenario-721378270-project-member] Lock "fd289f63-f798-4ce2-81c6-fab844644f77" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.719s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:44:26 user nova-compute[95467]: DEBUG nova.compute.manager [req-30f87e3d-f658-416f-b08f-3fcfa0187d96 req-4cd7c428-43d5-48e8-8b2e-e38520f42435 service nova] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Received event network-vif-plugged-8da3553b-1b91-429a-b165-274a1f254c8c {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:44:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-30f87e3d-f658-416f-b08f-3fcfa0187d96 req-4cd7c428-43d5-48e8-8b2e-e38520f42435 service nova] Acquiring lock "fd289f63-f798-4ce2-81c6-fab844644f77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:44:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-30f87e3d-f658-416f-b08f-3fcfa0187d96 req-4cd7c428-43d5-48e8-8b2e-e38520f42435 service nova] Lock "fd289f63-f798-4ce2-81c6-fab844644f77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:44:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-30f87e3d-f658-416f-b08f-3fcfa0187d96 req-4cd7c428-43d5-48e8-8b2e-e38520f42435 service nova] Lock "fd289f63-f798-4ce2-81c6-fab844644f77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:44:26 user nova-compute[95467]: DEBUG nova.compute.manager [req-30f87e3d-f658-416f-b08f-3fcfa0187d96 req-4cd7c428-43d5-48e8-8b2e-e38520f42435 service nova] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] No waiting events found dispatching network-vif-plugged-8da3553b-1b91-429a-b165-274a1f254c8c {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:44:26 user nova-compute[95467]: WARNING nova.compute.manager [req-30f87e3d-f658-416f-b08f-3fcfa0187d96 req-4cd7c428-43d5-48e8-8b2e-e38520f42435 service nova] [instance: fd289f63-f798-4ce2-81c6-fab844644f77] Received unexpected event network-vif-plugged-8da3553b-1b91-429a-b165-274a1f254c8c for instance with vm_state deleted and task_state None.
Nov 15 08:44:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:44:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:44:34 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:44:39 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:44:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:44:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:44:48 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:44:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:44:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:44:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:44:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:44:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:44:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=95467) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 08:44:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:44:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:44:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:45:03 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:45:03 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=95467) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 08:45:04 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:45:05 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:45:06 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:45:07 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager.update_available_resource {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:45:07 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:45:07 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:45:07 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:45:07 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Auditing locally available compute resources for user (node: user) {{(pid=95467) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 08:45:07 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13d65ca-1cce-4675-998e-c668b53a6d12/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:45:07 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13d65ca-1cce-4675-998e-c668b53a6d12/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:45:07 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13d65ca-1cce-4675-998e-c668b53a6d12/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:45:08 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13d65ca-1cce-4675-998e-c668b53a6d12/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:45:08 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:45:08 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:45:08 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Hypervisor/Node resource view: name=user free_ram=8958MB free_disk=25.038516998291016GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=95467) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 08:45:08 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:45:08 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:45:08 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance f13d65ca-1cce-4675-998e-c668b53a6d12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:45:08 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 08:45:08 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 08:45:08 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:45:08 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:45:08 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Compute_service record updated for user:user {{(pid=95467) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 08:45:08 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.235s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:45:09 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:45:12 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:45:12 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:45:13 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:45:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:45:15 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:45:16 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:45:17 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:45:17 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Starting heal instance info cache {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 08:45:17 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Rebuilding the list of instances to heal {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 08:45:17 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "refresh_cache-f13d65ca-1cce-4675-998e-c668b53a6d12" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:45:17 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquired lock "refresh_cache-f13d65ca-1cce-4675-998e-c668b53a6d12" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:45:17 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Forcefully refreshing network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 08:45:17 user nova-compute[95467]: DEBUG nova.objects.instance [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lazy-loading 'info_cache' on Instance uuid f13d65ca-1cce-4675-998e-c668b53a6d12 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:45:17 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:45:18 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Updating instance_info_cache with network_info: [{"id": "8a79119f-64d3-4539-9a53-d0eae8bbcf54", "address": "fa:16:3e:b2:9e:b7", "network": {"id": "26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1542679712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9a636c8b7074bd19eeee608156f8568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a79119f-64", "ovs_interfaceid": "8a79119f-64d3-4539-9a53-d0eae8bbcf54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:45:18 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Releasing lock "refresh_cache-f13d65ca-1cce-4675-998e-c668b53a6d12" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:45:18 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Updated the network info_cache for instance {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 08:45:19 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:45:20 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:45:24 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:45:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:45:30 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:45:30 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:45:30 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:45:30 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:45:30 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:45:30 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:45:30 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:45:30 user nova-compute[95467]: DEBUG nova.virt.libvirt.imagecache [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Verify base images {{(pid=95467) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 15 08:45:30 user nova-compute[95467]: DEBUG nova.virt.libvirt.imagecache [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Image id ed9c48aa-ce73-4b3b-9db1-235898be671b yields fingerprint a3fcf60225fcefd310404971cd18ab9851c548dc {{(pid=95467) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 15 08:45:30 user nova-compute[95467]: INFO nova.virt.libvirt.imagecache [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] image ed9c48aa-ce73-4b3b-9db1-235898be671b at (/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc): checking
Nov 15 08:45:30 user nova-compute[95467]: DEBUG nova.virt.libvirt.imagecache [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] image ed9c48aa-ce73-4b3b-9db1-235898be671b at (/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc): image is in use {{(pid=95467) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 15 08:45:30 user nova-compute[95467]: DEBUG nova.virt.libvirt.imagecache [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=95467) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 15 08:45:30 user nova-compute[95467]: DEBUG nova.virt.libvirt.imagecache [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] f13d65ca-1cce-4675-998e-c668b53a6d12 is a valid instance name {{(pid=95467) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 15 08:45:30 user nova-compute[95467]: DEBUG nova.virt.libvirt.imagecache [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] f13d65ca-1cce-4675-998e-c668b53a6d12 has a disk file {{(pid=95467) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 15 08:45:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13d65ca-1cce-4675-998e-c668b53a6d12/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:45:30 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13d65ca-1cce-4675-998e-c668b53a6d12/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:45:30 user nova-compute[95467]: DEBUG nova.virt.libvirt.imagecache [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance f13d65ca-1cce-4675-998e-c668b53a6d12 is backed by a3fcf60225fcefd310404971cd18ab9851c548dc {{(pid=95467) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 15 08:45:30 user nova-compute[95467]: WARNING nova.virt.libvirt.imagecache [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Unknown base file: /opt/stack/data/nova/instances/_base/96b4c3c0fafcd805212dd36066d64c340ca18c05
Nov 15 08:45:30 user nova-compute[95467]: WARNING nova.virt.libvirt.imagecache [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Unknown base file: /opt/stack/data/nova/instances/_base/9cc4859b3e1415e88a37209eb7f11bcfbadb10dc
Nov 15 08:45:30 user nova-compute[95467]: WARNING nova.virt.libvirt.imagecache [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Unknown base file: /opt/stack/data/nova/instances/_base/a115bd1f411fe5a5744cec26eb779067173ad965
Nov 15 08:45:30 user nova-compute[95467]: WARNING nova.virt.libvirt.imagecache [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Unknown base file: /opt/stack/data/nova/instances/_base/a655b15ca592705b435c4494527eeb7b91653cfe
Nov 15 08:45:30 user nova-compute[95467]: WARNING nova.virt.libvirt.imagecache [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Unknown base file: /opt/stack/data/nova/instances/_base/8c2f34cc3466f923251e6f953906e0c05be64824
Nov 15 08:45:30 user nova-compute[95467]: WARNING nova.virt.libvirt.imagecache [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Unknown base file: /opt/stack/data/nova/instances/_base/166bd0c92028594abd6b0ce8dbcfc5710b6f9fc7
Nov 15 08:45:30 user nova-compute[95467]: WARNING nova.virt.libvirt.imagecache [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Unknown base file: /opt/stack/data/nova/instances/_base/e61da72c1043f46379d0876d858d609597343e00
Nov 15 08:45:30 user nova-compute[95467]: WARNING nova.virt.libvirt.imagecache [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Unknown base file: /opt/stack/data/nova/instances/_base/1bc64fc4d0d0036c65598f9c56a5c593d94982c5
Nov 15 08:45:30 user nova-compute[95467]: WARNING nova.virt.libvirt.imagecache [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Unknown base file: /opt/stack/data/nova/instances/_base/c1041976da7a9681b9314cc7dafbcbef8130d952
Nov 15 08:45:30 user nova-compute[95467]: INFO nova.virt.libvirt.imagecache [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Active base files: /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc
Nov 15 08:45:30 user nova-compute[95467]: INFO nova.virt.libvirt.imagecache [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Removable base files: /opt/stack/data/nova/instances/_base/96b4c3c0fafcd805212dd36066d64c340ca18c05 /opt/stack/data/nova/instances/_base/9cc4859b3e1415e88a37209eb7f11bcfbadb10dc /opt/stack/data/nova/instances/_base/a115bd1f411fe5a5744cec26eb779067173ad965 /opt/stack/data/nova/instances/_base/a655b15ca592705b435c4494527eeb7b91653cfe /opt/stack/data/nova/instances/_base/8c2f34cc3466f923251e6f953906e0c05be64824 /opt/stack/data/nova/instances/_base/166bd0c92028594abd6b0ce8dbcfc5710b6f9fc7 /opt/stack/data/nova/instances/_base/e61da72c1043f46379d0876d858d609597343e00 /opt/stack/data/nova/instances/_base/1bc64fc4d0d0036c65598f9c56a5c593d94982c5 /opt/stack/data/nova/instances/_base/c1041976da7a9681b9314cc7dafbcbef8130d952
Nov 15 08:45:30 user nova-compute[95467]: INFO nova.virt.libvirt.imagecache [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/96b4c3c0fafcd805212dd36066d64c340ca18c05
Nov 15 08:45:30 user nova-compute[95467]: INFO nova.virt.libvirt.imagecache [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9cc4859b3e1415e88a37209eb7f11bcfbadb10dc
Nov 15 08:45:30 user nova-compute[95467]: INFO nova.virt.libvirt.imagecache [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a115bd1f411fe5a5744cec26eb779067173ad965
Nov 15 08:45:30 user nova-compute[95467]: INFO nova.virt.libvirt.imagecache [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a655b15ca592705b435c4494527eeb7b91653cfe
Nov 15 08:45:30 user nova-compute[95467]: INFO nova.virt.libvirt.imagecache [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8c2f34cc3466f923251e6f953906e0c05be64824
Nov 15 08:45:30 user nova-compute[95467]: INFO nova.virt.libvirt.imagecache [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/166bd0c92028594abd6b0ce8dbcfc5710b6f9fc7
Nov 15 08:45:30 user nova-compute[95467]: INFO nova.virt.libvirt.imagecache [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e61da72c1043f46379d0876d858d609597343e00
Nov 15 08:45:30 user nova-compute[95467]: INFO nova.virt.libvirt.imagecache [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1bc64fc4d0d0036c65598f9c56a5c593d94982c5
Nov 15 08:45:30 user nova-compute[95467]: INFO nova.virt.libvirt.imagecache [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c1041976da7a9681b9314cc7dafbcbef8130d952
Nov 15 08:45:30 user nova-compute[95467]: DEBUG nova.virt.libvirt.imagecache [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Verification complete {{(pid=95467) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 15 08:45:30 user nova-compute[95467]: DEBUG nova.virt.libvirt.imagecache [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Verify swap images {{(pid=95467) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 15 08:45:30 user nova-compute[95467]: DEBUG nova.virt.libvirt.imagecache [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Verify ephemeral images {{(pid=95467) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 15 08:45:34 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:45:39 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:45:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:45:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:45:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:45:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:46:03 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:46:03 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=95467) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 08:46:04 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:46:06 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:46:06 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:46:06 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:46:06 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Cleaning up deleted instances with incomplete migration  {{(pid=95467) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 08:46:07 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager.update_available_resource {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:46:07 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:46:07 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:46:07 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:46:07 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Auditing locally available compute resources for user (node: user) {{(pid=95467) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 08:46:07 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13d65ca-1cce-4675-998e-c668b53a6d12/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:46:07 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13d65ca-1cce-4675-998e-c668b53a6d12/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:46:07 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13d65ca-1cce-4675-998e-c668b53a6d12/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:46:08 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13d65ca-1cce-4675-998e-c668b53a6d12/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:46:08 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:46:08 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:46:08 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Hypervisor/Node resource view: name=user free_ram=9057MB free_disk=25.077392578125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=95467) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 08:46:08 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:46:08 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:46:08 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance f13d65ca-1cce-4675-998e-c668b53a6d12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:46:08 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 08:46:08 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 08:46:08 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Refreshing inventories for resource provider f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 08:46:08 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Updating ProviderTree inventory for provider f56c3524-ed11-494e-82e4-b1a23920d1ae from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 08:46:08 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Updating inventory in ProviderTree for provider f56c3524-ed11-494e-82e4-b1a23920d1ae with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 08:46:08 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Refreshing aggregate associations for resource provider f56c3524-ed11-494e-82e4-b1a23920d1ae, aggregates: None {{(pid=95467) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 08:46:09 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Refreshing trait associations for resource provider f56c3524-ed11-494e-82e4-b1a23920d1ae, traits: COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSSE3,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI {{(pid=95467) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 08:46:09 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:46:09 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:46:09 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Compute_service record updated for user:user {{(pid=95467) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 08:46:09 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.493s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:46:09 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:46:09 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:46:09 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=95467) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 08:46:09 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:46:09 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:46:09 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:46:09 user nova-compute[95467]: DEBUG nova.compute.manager [req-82a04364-72c3-461f-8f6c-c2fac2cd198c req-d128cb30-470c-4f7b-9b96-9a5be44b05bd service nova] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Received event network-changed-8a79119f-64d3-4539-9a53-d0eae8bbcf54 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:46:09 user nova-compute[95467]: DEBUG nova.compute.manager [req-82a04364-72c3-461f-8f6c-c2fac2cd198c req-d128cb30-470c-4f7b-9b96-9a5be44b05bd service nova] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Refreshing instance network info cache due to event network-changed-8a79119f-64d3-4539-9a53-d0eae8bbcf54. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:46:09 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-82a04364-72c3-461f-8f6c-c2fac2cd198c req-d128cb30-470c-4f7b-9b96-9a5be44b05bd service nova] Acquiring lock "refresh_cache-f13d65ca-1cce-4675-998e-c668b53a6d12" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:46:09 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-82a04364-72c3-461f-8f6c-c2fac2cd198c req-d128cb30-470c-4f7b-9b96-9a5be44b05bd service nova] Acquired lock "refresh_cache-f13d65ca-1cce-4675-998e-c668b53a6d12" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:46:09 user nova-compute[95467]: DEBUG nova.network.neutron [req-82a04364-72c3-461f-8f6c-c2fac2cd198c req-d128cb30-470c-4f7b-9b96-9a5be44b05bd service nova] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Refreshing network info cache for port 8a79119f-64d3-4539-9a53-d0eae8bbcf54 {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:46:10 user nova-compute[95467]: DEBUG nova.network.neutron [req-82a04364-72c3-461f-8f6c-c2fac2cd198c req-d128cb30-470c-4f7b-9b96-9a5be44b05bd service nova] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Updated VIF entry in instance network info cache for port 8a79119f-64d3-4539-9a53-d0eae8bbcf54. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:46:10 user nova-compute[95467]: DEBUG nova.network.neutron [req-82a04364-72c3-461f-8f6c-c2fac2cd198c req-d128cb30-470c-4f7b-9b96-9a5be44b05bd service nova] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Updating instance_info_cache with network_info: [{"id": "8a79119f-64d3-4539-9a53-d0eae8bbcf54", "address": "fa:16:3e:b2:9e:b7", "network": {"id": "26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1542679712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9a636c8b7074bd19eeee608156f8568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a79119f-64", "ovs_interfaceid": "8a79119f-64d3-4539-9a53-d0eae8bbcf54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:46:10 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-82a04364-72c3-461f-8f6c-c2fac2cd198c req-d128cb30-470c-4f7b-9b96-9a5be44b05bd service nova] Releasing lock "refresh_cache-f13d65ca-1cce-4675-998e-c668b53a6d12" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:46:11 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-c3517d4e-4c2d-4eee-aa4d-675e36c29cb0 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Acquiring lock "f13d65ca-1cce-4675-998e-c668b53a6d12" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:46:11 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-c3517d4e-4c2d-4eee-aa4d-675e36c29cb0 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "f13d65ca-1cce-4675-998e-c668b53a6d12" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:46:11 user nova-compute[95467]: DEBUG nova.objects.instance [None req-c3517d4e-4c2d-4eee-aa4d-675e36c29cb0 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lazy-loading 'flavor' on Instance uuid f13d65ca-1cce-4675-998e-c668b53a6d12 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:46:11 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-c3517d4e-4c2d-4eee-aa4d-675e36c29cb0 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "f13d65ca-1cce-4675-998e-c668b53a6d12" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:46:11 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-c3517d4e-4c2d-4eee-aa4d-675e36c29cb0 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Acquiring lock "f13d65ca-1cce-4675-998e-c668b53a6d12" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:46:11 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-c3517d4e-4c2d-4eee-aa4d-675e36c29cb0 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "f13d65ca-1cce-4675-998e-c668b53a6d12" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:46:11 user nova-compute[95467]: INFO nova.compute.manager [None req-c3517d4e-4c2d-4eee-aa4d-675e36c29cb0 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Attaching volume e9157a01-18e4-45ff-88d6-e47d801d916e to /dev/vdb
Nov 15 08:46:11 user nova-compute[95467]: DEBUG os_brick.utils [None req-c3517d4e-4c2d-4eee-aa4d-675e36c29cb0 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:46:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:46:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:46:11 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1fea802-0fbd-44b8-b9e0-84e59aeb22f8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:882ae90641f\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:46:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:46:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:46:11 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[239ef952-a22d-46d8-83c0-54088c498bf6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:46:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:46:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:46:11 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6153859-bd4d-475a-869f-1b32b303f65a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:46:11 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0245e6e-7b10-4756-afac-1989250c9169]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:46:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-c3517d4e-4c2d-4eee-aa4d-675e36c29cb0 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Running cmd (subprocess): nvme version {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:46:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-c3517d4e-4c2d-4eee-aa4d-675e36c29cb0 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] 'nvme version' failed. Not Retrying. {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:46:11 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c3517d4e-4c2d-4eee-aa4d-675e36c29cb0 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] nvme not present on system {{(pid=95467) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 08:46:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:46:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:46:11 user nova-compute[95467]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 08:46:11 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f61f498a-ad7b-4f30-9f1e-421944105065]: (4, '') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:46:11 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-c3517d4e-4c2d-4eee-aa4d-675e36c29cb0 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=95467) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 08:46:11 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-c3517d4e-4c2d-4eee-aa4d-675e36c29cb0 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 08:46:11 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-c3517d4e-4c2d-4eee-aa4d-675e36c29cb0 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] LIGHTOS: no hostnqn found. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 08:46:11 user nova-compute[95467]: DEBUG os_brick.utils [None req-c3517d4e-4c2d-4eee-aa4d-675e36c29cb0 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:882ae90641f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:46:11 user nova-compute[95467]: DEBUG nova.virt.block_device [None req-c3517d4e-4c2d-4eee-aa4d-675e36c29cb0 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Updating existing volume attachment record: e6da3b88-d181-4891-b75a-d37e7b06e384 {{(pid=95467) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 08:46:13 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:46:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:46:13 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:46:13 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:46:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:46:15 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:46:16 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3517d4e-4c2d-4eee-aa4d-675e36c29cb0 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Calling os-brick to attach iSCSI Volume {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 08:46:16 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3517d4e-4c2d-4eee-aa4d-675e36c29cb0 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e9157a01-18e4-45ff-88d6-e47d801d916e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cPdmUejJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:46:16 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-c3517d4e-4c2d-4eee-aa4d-675e36c29cb0 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:46:16 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-c3517d4e-4c2d-4eee-aa4d-675e36c29cb0 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:46:16 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-c3517d4e-4c2d-4eee-aa4d-675e36c29cb0 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:46:16 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-c3517d4e-4c2d-4eee-aa4d-675e36c29cb0 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:46:16 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-c3517d4e-4c2d-4eee-aa4d-675e36c29cb0 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9157a01-18e4-45ff-88d6-e47d801d916e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:46:16 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-c3517d4e-4c2d-4eee-aa4d-675e36c29cb0 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9157a01-18e4-45ff-88d6-e47d801d916e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:46:16 user nova-compute[95467]: INFO os_brick.initiator.connectors.iscsi [None req-c3517d4e-4c2d-4eee-aa4d-675e36c29cb0 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 08:46:16 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9157a01-18e4-45ff-88d6-e47d801d916e -p 172.16.0.220:3260 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:46:16 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9157a01-18e4-45ff-88d6-e47d801d916e -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:46:16 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcea14e9-27ed-41ce-b7f2-37cd734a1199]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:46:16 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3517d4e-4c2d-4eee-aa4d-675e36c29cb0 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 08:46:16 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:46:16 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9157a01-18e4-45ff-88d6-e47d801d916e -p 172.16.0.220:3260 --interface default --op new {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:46:16 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9157a01-18e4-45ff-88d6-e47d801d916e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:46:16 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a5a0d0-3260-4066-8c9a-572e4b856517]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e9157a01-18e4-45ff-88d6-e47d801d916e] added\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:46:16 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3517d4e-4c2d-4eee-aa4d-675e36c29cb0 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e9157a01-18e4-45ff-88d6-e47d801d916e] added
Nov 15 08:46:16 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:46:16 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9157a01-18e4-45ff-88d6-e47d801d916e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:46:16 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9157a01-18e4-45ff-88d6-e47d801d916e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:46:16 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04948a1-dfa0-4443-ac60-f680d8f4567e]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:46:16 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3517d4e-4c2d-4eee-aa4d-675e36c29cb0 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:46:16 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9157a01-18e4-45ff-88d6-e47d801d916e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:46:16 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9157a01-18e4-45ff-88d6-e47d801d916e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:46:16 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[caaf57fd-d3f1-4443-ae9c-e5ba5e3312be]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:46:16 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3517d4e-4c2d-4eee-aa4d-675e36c29cb0 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:46:16 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9157a01-18e4-45ff-88d6-e47d801d916e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cPdmUejJ {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:46:16 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9157a01-18e4-45ff-88d6-e47d801d916e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cPdmUejJ" returned: 0 in 0.025s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:46:16 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed780ab6-20fa-4a3f-84f9-822dbb4db0a2]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:46:16 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3517d4e-4c2d-4eee-aa4d-675e36c29cb0 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cPdmUejJ'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:46:16 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9157a01-18e4-45ff-88d6-e47d801d916e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:46:16 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9157a01-18e4-45ff-88d6-e47d801d916e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:46:16 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ceb9d6b-21bc-48dd-9a51-7808b2333422]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:46:16 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3517d4e-4c2d-4eee-aa4d-675e36c29cb0 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:46:16 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:46:16 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:46:16 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aeb25cd-5a2c-49cd-b664-dc4af956bcb6]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:46:16 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3517d4e-4c2d-4eee-aa4d-675e36c29cb0 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 08:46:16 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:46:16 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3517d4e-4c2d-4eee-aa4d-675e36c29cb0 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 08:46:16 user nova-compute[95467]:  {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:46:16 user nova-compute[95467]: WARNING os_brick.initiator.connectors.iscsi [None req-c3517d4e-4c2d-4eee-aa4d-675e36c29cb0 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 08:46:16 user nova-compute[95467]: 
Nov 15 08:46:16 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9157a01-18e4-45ff-88d6-e47d801d916e -p 172.16.0.220:3260 --login {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:46:16 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9157a01-18e4-45ff-88d6-e47d801d916e -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:46:16 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[755a881e-c6ab-4bc6-ac24-1fde4afc1d78]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e9157a01-18e4-45ff-88d6-e47d801d916e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e9157a01-18e4-45ff-88d6-e47d801d916e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:46:16 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3517d4e-4c2d-4eee-aa4d-675e36c29cb0 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e9157a01-18e4-45ff-88d6-e47d801d916e, portal: 172.16.0.220,3260]
Nov 15 08:46:16 user nova-compute[95467]: Login to [iface: default, target: iqn.2010-10.org.openstack:e9157a01-18e4-45ff-88d6-e47d801d916e, portal: 172.16.0.220,3260] successful.
Nov 15 08:46:16 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:46:16 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9157a01-18e4-45ff-88d6-e47d801d916e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:46:16 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9157a01-18e4-45ff-88d6-e47d801d916e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:46:16 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[e832a596-2284-445b-a539-00b5978a6cd7]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:46:16 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3517d4e-4c2d-4eee-aa4d-675e36c29cb0 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:46:16 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:46:16 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:46:16 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3e1292-caad-43b9-9328-c7ec02d5e18a]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9157a01-18e4-45ff-88d6-e47d801d916e (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:46:16 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3517d4e-4c2d-4eee-aa4d-675e36c29cb0 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9157a01-18e4-45ff-88d6-e47d801d916e (non-flash)
Nov 15 08:46:16 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:46:16 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3517d4e-4c2d-4eee-aa4d-675e36c29cb0 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9157a01-18e4-45ff-88d6-e47d801d916e (non-flash)
Nov 15 08:46:16 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:46:16 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-c3517d4e-4c2d-4eee-aa4d-675e36c29cb0 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9157a01-18e4-45ff-88d6-e47d801d916e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:46:16 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3517d4e-4c2d-4eee-aa4d-675e36c29cb0 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Connected to 172.16.0.220:3260 {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 08:46:16 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-c3517d4e-4c2d-4eee-aa4d-675e36c29cb0 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=95467) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 08:46:16 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-c3517d4e-4c2d-4eee-aa4d-675e36c29cb0 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=95467) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 08:46:16 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:46:16 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:46:16 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[73bb1bd9-1e6a-49bf-8063-75d7b8b1cf65]: (4, ('- - 0', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:46:16 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-c3517d4e-4c2d-4eee-aa4d-675e36c29cb0 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:46:16 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3517d4e-4c2d-4eee-aa4d-675e36c29cb0 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e9157a01-18e4-45ff-88d6-e47d801d916e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cPdmUejJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 08:46:17 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-c3517d4e-4c2d-4eee-aa4d-675e36c29cb0 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:46:17 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3517d4e-4c2d-4eee-aa4d-675e36c29cb0 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '23532623936303564', 'path': '/dev/sdb'} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:46:17 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3517d4e-4c2d-4eee-aa4d-675e36c29cb0 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532623936303564', 'path': '/dev/sdb'} {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 08:46:17 user nova-compute[95467]: DEBUG nova.objects.instance [None req-c3517d4e-4c2d-4eee-aa4d-675e36c29cb0 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lazy-loading 'flavor' on Instance uuid f13d65ca-1cce-4675-998e-c668b53a6d12 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:46:17 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:46:17 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Starting heal instance info cache {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 08:46:17 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Rebuilding the list of instances to heal {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 08:46:17 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-c3517d4e-4c2d-4eee-aa4d-675e36c29cb0 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 08:46:17 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:46:17 user nova-compute[95467]:   <source dev="/dev/sdb"/>
Nov 15 08:46:17 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:46:17 user nova-compute[95467]:   <serial>e9157a01-18e4-45ff-88d6-e47d801d916e</serial>
Nov 15 08:46:17 user nova-compute[95467]: </disk>
Nov 15 08:46:17 user nova-compute[95467]:  {{(pid=95467) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 08:46:17 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "refresh_cache-f13d65ca-1cce-4675-998e-c668b53a6d12" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:46:17 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquired lock "refresh_cache-f13d65ca-1cce-4675-998e-c668b53a6d12" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:46:17 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Forcefully refreshing network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 08:46:17 user nova-compute[95467]: DEBUG nova.objects.instance [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lazy-loading 'info_cache' on Instance uuid f13d65ca-1cce-4675-998e-c668b53a6d12 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:46:18 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-c3517d4e-4c2d-4eee-aa4d-675e36c29cb0 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:46:18 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-c3517d4e-4c2d-4eee-aa4d-675e36c29cb0 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] No BDM found with device name vdb, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:46:18 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-c3517d4e-4c2d-4eee-aa4d-675e36c29cb0 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] No VIF found with MAC fa:16:3e:b2:9e:b7, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:46:18 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-c3517d4e-4c2d-4eee-aa4d-675e36c29cb0 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "f13d65ca-1cce-4675-998e-c668b53a6d12" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.399s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:46:18 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:46:18 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Updating instance_info_cache with network_info: [{"id": "8a79119f-64d3-4539-9a53-d0eae8bbcf54", "address": "fa:16:3e:b2:9e:b7", "network": {"id": "26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1542679712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9a636c8b7074bd19eeee608156f8568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a79119f-64", "ovs_interfaceid": "8a79119f-64d3-4539-9a53-d0eae8bbcf54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:46:18 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Releasing lock "refresh_cache-f13d65ca-1cce-4675-998e-c668b53a6d12" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:46:18 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Updated the network info_cache for instance {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 08:46:18 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:46:19 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-10a43652-d40e-4235-ac2e-235b61991919 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Acquiring lock "f13d65ca-1cce-4675-998e-c668b53a6d12" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:46:19 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-10a43652-d40e-4235-ac2e-235b61991919 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "f13d65ca-1cce-4675-998e-c668b53a6d12" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:46:19 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:46:19 user nova-compute[95467]: DEBUG nova.objects.instance [None req-10a43652-d40e-4235-ac2e-235b61991919 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lazy-loading 'flavor' on Instance uuid f13d65ca-1cce-4675-998e-c668b53a6d12 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:46:19 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-10a43652-d40e-4235-ac2e-235b61991919 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "f13d65ca-1cce-4675-998e-c668b53a6d12" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:46:20 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-10a43652-d40e-4235-ac2e-235b61991919 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Acquiring lock "f13d65ca-1cce-4675-998e-c668b53a6d12" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:46:20 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-10a43652-d40e-4235-ac2e-235b61991919 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "f13d65ca-1cce-4675-998e-c668b53a6d12" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:46:20 user nova-compute[95467]: INFO nova.compute.manager [None req-10a43652-d40e-4235-ac2e-235b61991919 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Attaching volume fcb14728-85d6-4913-8612-b34a94618ac1 to /dev/vdc
Nov 15 08:46:20 user nova-compute[95467]: DEBUG os_brick.utils [None req-10a43652-d40e-4235-ac2e-235b61991919 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:46:20 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:46:20 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:46:20 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad77d399-2e6d-4272-9d4e-ba35ac81c1ca]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:882ae90641f\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:46:20 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:46:20 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:46:20 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc3c1a5-a338-44d4-a3f7-2cd7ae1ff14b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:46:20 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:46:20 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:46:20 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[699e2bfe-889b-4915-b02d-1491ee534742]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:46:20 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[4baa8f29-f2f9-459a-a1bc-904b7e711748]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:46:20 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-10a43652-d40e-4235-ac2e-235b61991919 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Running cmd (subprocess): nvme version {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:46:20 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-10a43652-d40e-4235-ac2e-235b61991919 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] 'nvme version' failed. Not Retrying. {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:46:20 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.nvmeof [None req-10a43652-d40e-4235-ac2e-235b61991919 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] nvme not present on system {{(pid=95467) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 08:46:20 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:46:20 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:46:20 user nova-compute[95467]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 08:46:20 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ebfdd97-70b8-4292-bde5-b977a589e23c]: (4, '') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:46:20 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-10a43652-d40e-4235-ac2e-235b61991919 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=95467) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 08:46:20 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-10a43652-d40e-4235-ac2e-235b61991919 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 08:46:20 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-10a43652-d40e-4235-ac2e-235b61991919 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] LIGHTOS: no hostnqn found. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 08:46:20 user nova-compute[95467]: DEBUG os_brick.utils [None req-10a43652-d40e-4235-ac2e-235b61991919 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:882ae90641f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:46:20 user nova-compute[95467]: DEBUG nova.virt.block_device [None req-10a43652-d40e-4235-ac2e-235b61991919 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Updating existing volume attachment record: 6f53395f-63c8-4dee-ad3d-a4dc7688532e {{(pid=95467) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 08:46:24 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:46:24 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10a43652-d40e-4235-ac2e-235b61991919 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Calling os-brick to attach iSCSI Volume {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 08:46:24 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a43652-d40e-4235-ac2e-235b61991919 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fcb14728-85d6-4913-8612-b34a94618ac1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kqEetQFi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:46:24 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-10a43652-d40e-4235-ac2e-235b61991919 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:46:24 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-10a43652-d40e-4235-ac2e-235b61991919 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:46:24 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-10a43652-d40e-4235-ac2e-235b61991919 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:46:24 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-10a43652-d40e-4235-ac2e-235b61991919 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:46:24 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-10a43652-d40e-4235-ac2e-235b61991919 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fcb14728-85d6-4913-8612-b34a94618ac1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:46:24 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-10a43652-d40e-4235-ac2e-235b61991919 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fcb14728-85d6-4913-8612-b34a94618ac1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:46:24 user nova-compute[95467]: INFO os_brick.initiator.connectors.iscsi [None req-10a43652-d40e-4235-ac2e-235b61991919 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 08:46:24 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcb14728-85d6-4913-8612-b34a94618ac1 -p 172.16.0.220:3260 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:46:24 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcb14728-85d6-4913-8612-b34a94618ac1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:46:24 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ac003e-478d-4e78-ba2a-70631b05095c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:46:24 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a43652-d40e-4235-ac2e-235b61991919 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 08:46:24 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:46:24 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcb14728-85d6-4913-8612-b34a94618ac1 -p 172.16.0.220:3260 --interface default --op new {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:46:24 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcb14728-85d6-4913-8612-b34a94618ac1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:46:24 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3eb6c44-1ccd-4790-a13b-c189e97215ba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fcb14728-85d6-4913-8612-b34a94618ac1] added\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:46:24 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a43652-d40e-4235-ac2e-235b61991919 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fcb14728-85d6-4913-8612-b34a94618ac1] added
Nov 15 08:46:24 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:46:24 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcb14728-85d6-4913-8612-b34a94618ac1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:46:24 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcb14728-85d6-4913-8612-b34a94618ac1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:46:24 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed94f76-02c0-458a-9a22-46dc853ba339]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:46:24 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a43652-d40e-4235-ac2e-235b61991919 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:46:24 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcb14728-85d6-4913-8612-b34a94618ac1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:46:24 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcb14728-85d6-4913-8612-b34a94618ac1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:46:24 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[7278f36f-df60-43e2-aa7f-a18757500789]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:46:24 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a43652-d40e-4235-ac2e-235b61991919 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:46:24 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcb14728-85d6-4913-8612-b34a94618ac1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kqEetQFi {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:46:24 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcb14728-85d6-4913-8612-b34a94618ac1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kqEetQFi" returned: 0 in 0.025s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:46:24 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[25bb4468-1a51-4fcd-93b2-63878a7f3066]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:46:24 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a43652-d40e-4235-ac2e-235b61991919 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kqEetQFi'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:46:24 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcb14728-85d6-4913-8612-b34a94618ac1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:46:24 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcb14728-85d6-4913-8612-b34a94618ac1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:46:24 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[38cb588a-3082-4044-b5dd-4423f359167d]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:46:24 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a43652-d40e-4235-ac2e-235b61991919 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:46:24 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:46:24 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:46:24 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:46:24 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f8d6f6-6275-4318-8cb0-31064e41cda4]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9157a01-18e4-45ff-88d6-e47d801d916e (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:46:24 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a43652-d40e-4235-ac2e-235b61991919 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9157a01-18e4-45ff-88d6-e47d801d916e (non-flash)
Nov 15 08:46:24 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:46:24 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a43652-d40e-4235-ac2e-235b61991919 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9157a01-18e4-45ff-88d6-e47d801d916e (non-flash)
Nov 15 08:46:24 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:46:24 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcb14728-85d6-4913-8612-b34a94618ac1 -p 172.16.0.220:3260 --login {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:46:24 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcb14728-85d6-4913-8612-b34a94618ac1 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:46:24 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a2925f-bc99-4328-9422-5f3a33837560]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fcb14728-85d6-4913-8612-b34a94618ac1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fcb14728-85d6-4913-8612-b34a94618ac1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:46:24 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a43652-d40e-4235-ac2e-235b61991919 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fcb14728-85d6-4913-8612-b34a94618ac1, portal: 172.16.0.220,3260]
Nov 15 08:46:24 user nova-compute[95467]: Login to [iface: default, target: iqn.2010-10.org.openstack:fcb14728-85d6-4913-8612-b34a94618ac1, portal: 172.16.0.220,3260] successful.
Nov 15 08:46:24 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:46:24 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcb14728-85d6-4913-8612-b34a94618ac1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:46:24 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcb14728-85d6-4913-8612-b34a94618ac1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:46:24 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b8a406-6cfe-41f7-a997-10ad2da027cb]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:46:24 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a43652-d40e-4235-ac2e-235b61991919 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:46:24 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:46:25 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:46:25 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5dea87-10a2-43ce-bc60-6cd5b373b70e]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9157a01-18e4-45ff-88d6-e47d801d916e (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcb14728-85d6-4913-8612-b34a94618ac1 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:46:25 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a43652-d40e-4235-ac2e-235b61991919 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9157a01-18e4-45ff-88d6-e47d801d916e (non-flash)
Nov 15 08:46:25 user nova-compute[95467]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcb14728-85d6-4913-8612-b34a94618ac1 (non-flash)
Nov 15 08:46:25 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:46:25 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a43652-d40e-4235-ac2e-235b61991919 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9157a01-18e4-45ff-88d6-e47d801d916e (non-flash)
Nov 15 08:46:25 user nova-compute[95467]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcb14728-85d6-4913-8612-b34a94618ac1 (non-flash)
Nov 15 08:46:25 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:46:25 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-10a43652-d40e-4235-ac2e-235b61991919 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fcb14728-85d6-4913-8612-b34a94618ac1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:46:25 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a43652-d40e-4235-ac2e-235b61991919 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Connected to 172.16.0.220:3260 {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 08:46:25 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-10a43652-d40e-4235-ac2e-235b61991919 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] HCTL ('34', '-', '-', 0) found on session 63 with lun 0 {{(pid=95467) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 08:46:25 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-10a43652-d40e-4235-ac2e-235b61991919 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=95467) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 08:46:25 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:46:25 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:46:25 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[1037ec5e-77f7-44c8-8ba0-00d863ab1ff9]: (4, ('- - 0', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:46:25 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-10a43652-d40e-4235-ac2e-235b61991919 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Searching for a device in session 63 and hctl ['34', '*', '*', 0] yield: None {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:46:26 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-10a43652-d40e-4235-ac2e-235b61991919 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Searching for a device in session 63 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:46:26 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a43652-d40e-4235-ac2e-235b61991919 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:fcb14728-85d6-4913-8612-b34a94618ac1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kqEetQFi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 08:46:26 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-10a43652-d40e-4235-ac2e-235b61991919 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:46:26 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a43652-d40e-4235-ac2e-235b61991919 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '23734343832353366', 'path': '/dev/sdc'} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:46:26 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10a43652-d40e-4235-ac2e-235b61991919 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23734343832353366', 'path': '/dev/sdc'} {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 08:46:26 user nova-compute[95467]: DEBUG nova.objects.instance [None req-10a43652-d40e-4235-ac2e-235b61991919 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lazy-loading 'flavor' on Instance uuid f13d65ca-1cce-4675-998e-c668b53a6d12 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:46:26 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-10a43652-d40e-4235-ac2e-235b61991919 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 08:46:26 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:46:26 user nova-compute[95467]:   <source dev="/dev/sdc"/>
Nov 15 08:46:26 user nova-compute[95467]:   <target dev="vdc" bus="virtio"/>
Nov 15 08:46:26 user nova-compute[95467]:   <serial>fcb14728-85d6-4913-8612-b34a94618ac1</serial>
Nov 15 08:46:26 user nova-compute[95467]: </disk>
Nov 15 08:46:26 user nova-compute[95467]:  {{(pid=95467) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 08:46:26 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-10a43652-d40e-4235-ac2e-235b61991919 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:46:26 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-10a43652-d40e-4235-ac2e-235b61991919 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] No BDM found with device name vdb, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:46:26 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-10a43652-d40e-4235-ac2e-235b61991919 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] No BDM found with device name vdc, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:46:26 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-10a43652-d40e-4235-ac2e-235b61991919 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] No VIF found with MAC fa:16:3e:b2:9e:b7, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:46:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-10a43652-d40e-4235-ac2e-235b61991919 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "f13d65ca-1cce-4675-998e-c668b53a6d12" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.510s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:46:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:46:28 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-fbcd5dfc-2df6-4044-a1e0-1ae294dd7d46 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Acquiring lock "f13d65ca-1cce-4675-998e-c668b53a6d12" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:46:28 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-fbcd5dfc-2df6-4044-a1e0-1ae294dd7d46 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "f13d65ca-1cce-4675-998e-c668b53a6d12" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:46:28 user nova-compute[95467]: INFO nova.compute.manager [None req-fbcd5dfc-2df6-4044-a1e0-1ae294dd7d46 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Detaching volume e9157a01-18e4-45ff-88d6-e47d801d916e
Nov 15 08:46:28 user nova-compute[95467]: INFO nova.virt.block_device [None req-fbcd5dfc-2df6-4044-a1e0-1ae294dd7d46 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Attempting to driver detach volume e9157a01-18e4-45ff-88d6-e47d801d916e from mountpoint /dev/vdb
Nov 15 08:46:28 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-fbcd5dfc-2df6-4044-a1e0-1ae294dd7d46 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Attempting to detach device vdb from instance f13d65ca-1cce-4675-998e-c668b53a6d12 from the persistent domain config. {{(pid=95467) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 08:46:28 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-fbcd5dfc-2df6-4044-a1e0-1ae294dd7d46 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 08:46:28 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:46:28 user nova-compute[95467]:   <source dev="/dev/sdb"/>
Nov 15 08:46:28 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:46:28 user nova-compute[95467]:   <serial>e9157a01-18e4-45ff-88d6-e47d801d916e</serial>
Nov 15 08:46:28 user nova-compute[95467]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 08:46:28 user nova-compute[95467]: </disk>
Nov 15 08:46:28 user nova-compute[95467]:  {{(pid=95467) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 08:46:28 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-fbcd5dfc-2df6-4044-a1e0-1ae294dd7d46 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Successfully detached device vdb from instance f13d65ca-1cce-4675-998e-c668b53a6d12 from the persistent domain config.
Nov 15 08:46:28 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-fbcd5dfc-2df6-4044-a1e0-1ae294dd7d46 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f13d65ca-1cce-4675-998e-c668b53a6d12 from the live domain config. {{(pid=95467) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 08:46:28 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-fbcd5dfc-2df6-4044-a1e0-1ae294dd7d46 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 08:46:28 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:46:28 user nova-compute[95467]:   <source dev="/dev/sdb"/>
Nov 15 08:46:28 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:46:28 user nova-compute[95467]:   <serial>e9157a01-18e4-45ff-88d6-e47d801d916e</serial>
Nov 15 08:46:28 user nova-compute[95467]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 08:46:28 user nova-compute[95467]: </disk>
Nov 15 08:46:28 user nova-compute[95467]:  {{(pid=95467) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 08:46:28 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-fbcd5dfc-2df6-4044-a1e0-1ae294dd7d46 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f13d65ca-1cce-4675-998e-c668b53a6d12 {{(pid=95467) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 08:46:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:46:34 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:46:35 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:46:35 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Cleaning up deleted instances {{(pid=95467) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 08:46:35 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] There are 0 instances to clean {{(pid=95467) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 08:46:39 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:46:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:46:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:46:46 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._sync_power_states {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:46:46 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Triggering sync for uuid f13d65ca-1cce-4675-998e-c668b53a6d12 {{(pid=95467) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 08:46:46 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "f13d65ca-1cce-4675-998e-c668b53a6d12" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:46:48 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-fbcd5dfc-2df6-4044-a1e0-1ae294dd7d46 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f13d65ca-1cce-4675-998e-c668b53a6d12 is timed out.
Nov 15 08:46:48 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-fbcd5dfc-2df6-4044-a1e0-1ae294dd7d46 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Successfully detached device vdb from instance f13d65ca-1cce-4675-998e-c668b53a6d12 from the live domain config.
Nov 15 08:46:48 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbcd5dfc-2df6-4044-a1e0-1ae294dd7d46 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] calling os-brick to detach iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 08:46:48 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbcd5dfc-2df6-4044-a1e0-1ae294dd7d46 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, {'target_iqn': 'iqn.2010-10.org.openstack:e9157a01-18e4-45ff-88d6-e47d801d916e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cPdmUejJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:46:48 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-fbcd5dfc-2df6-4044-a1e0-1ae294dd7d46 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:46:48 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-fbcd5dfc-2df6-4044-a1e0-1ae294dd7d46 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:46:48 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-fbcd5dfc-2df6-4044-a1e0-1ae294dd7d46 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:46:48 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:46:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:46:49 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a53fe3-4a30-40e6-9803-319335c2e73d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fcb14728-85d6-4913-8612-b34a94618ac1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e9157a01-18e4-45ff-88d6-e47d801d916e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:46:49 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbcd5dfc-2df6-4044-a1e0-1ae294dd7d46 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 08:46:49 user nova-compute[95467]: No targets found.
Nov 15 08:46:49 user nova-compute[95467]: iSNS:
Nov 15 08:46:49 user nova-compute[95467]: No targets found.
Nov 15 08:46:49 user nova-compute[95467]: STATIC:
Nov 15 08:46:49 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:fcb14728-85d6-4913-8612-b34a94618ac1
Nov 15 08:46:49 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:46:49 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:46:49 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:e9157a01-18e4-45ff-88d6-e47d801d916e
Nov 15 08:46:49 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:46:49 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:46:49 user nova-compute[95467]: FIRMWARE:
Nov 15 08:46:49 user nova-compute[95467]: No targets found.
Nov 15 08:46:49 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:46:49 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbcd5dfc-2df6-4044-a1e0-1ae294dd7d46 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 08:46:49 user nova-compute[95467]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 08:46:49 user nova-compute[95467]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=95467) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 08:46:49 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbcd5dfc-2df6-4044-a1e0-1ae294dd7d46 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9157a01-18e4-45ff-88d6-e47d801d916e', 0)] {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 08:46:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:46:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:46:49 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad63abd-b55d-4c2c-84eb-03d5eb52a5b0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9157a01-18e4-45ff-88d6-e47d801d916e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fcb14728-85d6-4913-8612-b34a94618ac1\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:46:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:46:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:46:49 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2fdcda5-4dcc-4591-ac6e-8780f6e0f2fe]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9157a01-18e4-45ff-88d6-e47d801d916e (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcb14728-85d6-4913-8612-b34a94618ac1 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:46:49 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbcd5dfc-2df6-4044-a1e0-1ae294dd7d46 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9157a01-18e4-45ff-88d6-e47d801d916e (non-flash)
Nov 15 08:46:49 user nova-compute[95467]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcb14728-85d6-4913-8612-b34a94618ac1 (non-flash)
Nov 15 08:46:49 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:46:49 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbcd5dfc-2df6-4044-a1e0-1ae294dd7d46 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9157a01-18e4-45ff-88d6-e47d801d916e (non-flash)
Nov 15 08:46:49 user nova-compute[95467]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcb14728-85d6-4913-8612-b34a94618ac1 (non-flash)
Nov 15 08:46:49 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:46:49 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbcd5dfc-2df6-4044-a1e0-1ae294dd7d46 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efec824a4d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9157a01-18e4-45ff-88d6-e47d801d916e'): ({'sdb'}, set())}) {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 08:46:49 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-fbcd5dfc-2df6-4044-a1e0-1ae294dd7d46 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Removing single pathed devices sdb {{(pid=95467) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 08:46:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:46:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:46:49 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e35285d-2bf3-4bcb-9473-87ef297ab98a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:46:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:46:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:46:49 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e9c383-88fa-49e4-a2b6-e1b2def354b7]: (4, ('ok\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:46:49 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-fbcd5dfc-2df6-4044-a1e0-1ae294dd7d46 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Flushing IO for device /dev/sdb {{(pid=95467) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 08:46:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:46:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:46:49 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba3ce4e-7a00-43b8-a4b1-695e9adf8966]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:46:49 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-fbcd5dfc-2df6-4044-a1e0-1ae294dd7d46 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=95467) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 08:46:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:46:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:46:49 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[59660a72-8187-4a58-9906-0f676d97b2d2]: (4, ('1', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:46:49 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-fbcd5dfc-2df6-4044-a1e0-1ae294dd7d46 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 08:46:49 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-fbcd5dfc-2df6-4044-a1e0-1ae294dd7d46 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] SCSI volumes sdb have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 08:46:49 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbcd5dfc-2df6-4044-a1e0-1ae294dd7d46 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9157a01-18e4-45ff-88d6-e47d801d916e')] {{(pid=95467) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 08:46:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9157a01-18e4-45ff-88d6-e47d801d916e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:46:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9157a01-18e4-45ff-88d6-e47d801d916e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:46:49 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a273013a-dbef-4d8f-ba72-0de5a4a95586]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:46:49 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbcd5dfc-2df6-4044-a1e0-1ae294dd7d46 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:46:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9157a01-18e4-45ff-88d6-e47d801d916e -p 172.16.0.220:3260 --logout {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:46:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9157a01-18e4-45ff-88d6-e47d801d916e -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:46:49 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0c0cd5-dd79-4581-8bc8-39f932ec805a]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:e9157a01-18e4-45ff-88d6-e47d801d916e, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:e9157a01-18e4-45ff-88d6-e47d801d916e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:46:49 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbcd5dfc-2df6-4044-a1e0-1ae294dd7d46 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:e9157a01-18e4-45ff-88d6-e47d801d916e, portal: 172.16.0.220,3260]
Nov 15 08:46:49 user nova-compute[95467]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:e9157a01-18e4-45ff-88d6-e47d801d916e, portal: 172.16.0.220,3260] successful.
Nov 15 08:46:49 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:46:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9157a01-18e4-45ff-88d6-e47d801d916e -p 172.16.0.220:3260 --op delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:46:49 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9157a01-18e4-45ff-88d6-e47d801d916e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:46:49 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d370d05-56c5-4acd-aed3-c13ba2a139bb]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:46:49 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbcd5dfc-2df6-4044-a1e0-1ae294dd7d46 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:46:49 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-fbcd5dfc-2df6-4044-a1e0-1ae294dd7d46 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:46:49 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbcd5dfc-2df6-4044-a1e0-1ae294dd7d46 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] <== disconnect_volume: return (315ms) None {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:46:49 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbcd5dfc-2df6-4044-a1e0-1ae294dd7d46 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Disconnected iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 08:46:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:46:50 user nova-compute[95467]: DEBUG nova.objects.instance [None req-fbcd5dfc-2df6-4044-a1e0-1ae294dd7d46 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lazy-loading 'flavor' on Instance uuid f13d65ca-1cce-4675-998e-c668b53a6d12 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:46:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-fbcd5dfc-2df6-4044-a1e0-1ae294dd7d46 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "f13d65ca-1cce-4675-998e-c668b53a6d12" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.687s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:46:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "f13d65ca-1cce-4675-998e-c668b53a6d12" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 4.030s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:46:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "f13d65ca-1cce-4675-998e-c668b53a6d12" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:46:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-106d109e-d86c-4e03-a328-7fadc605be86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Acquiring lock "f13d65ca-1cce-4675-998e-c668b53a6d12" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:46:50 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-106d109e-d86c-4e03-a328-7fadc605be86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "f13d65ca-1cce-4675-998e-c668b53a6d12" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:46:51 user nova-compute[95467]: INFO nova.compute.manager [None req-106d109e-d86c-4e03-a328-7fadc605be86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Detaching volume fcb14728-85d6-4913-8612-b34a94618ac1
Nov 15 08:46:51 user nova-compute[95467]: INFO nova.virt.block_device [None req-106d109e-d86c-4e03-a328-7fadc605be86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Attempting to driver detach volume fcb14728-85d6-4913-8612-b34a94618ac1 from mountpoint /dev/vdc
Nov 15 08:46:51 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-106d109e-d86c-4e03-a328-7fadc605be86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Attempting to detach device vdc from instance f13d65ca-1cce-4675-998e-c668b53a6d12 from the persistent domain config. {{(pid=95467) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 08:46:51 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-106d109e-d86c-4e03-a328-7fadc605be86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 08:46:51 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:46:51 user nova-compute[95467]:   <source dev="/dev/sdc"/>
Nov 15 08:46:51 user nova-compute[95467]:   <target dev="vdc" bus="virtio"/>
Nov 15 08:46:51 user nova-compute[95467]:   <serial>fcb14728-85d6-4913-8612-b34a94618ac1</serial>
Nov 15 08:46:51 user nova-compute[95467]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 08:46:51 user nova-compute[95467]: </disk>
Nov 15 08:46:51 user nova-compute[95467]:  {{(pid=95467) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 08:46:51 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-106d109e-d86c-4e03-a328-7fadc605be86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Successfully detached device vdc from instance f13d65ca-1cce-4675-998e-c668b53a6d12 from the persistent domain config.
Nov 15 08:46:51 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-106d109e-d86c-4e03-a328-7fadc605be86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance f13d65ca-1cce-4675-998e-c668b53a6d12 from the live domain config. {{(pid=95467) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 08:46:51 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-106d109e-d86c-4e03-a328-7fadc605be86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 08:46:51 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:46:51 user nova-compute[95467]:   <source dev="/dev/sdc"/>
Nov 15 08:46:51 user nova-compute[95467]:   <target dev="vdc" bus="virtio"/>
Nov 15 08:46:51 user nova-compute[95467]:   <serial>fcb14728-85d6-4913-8612-b34a94618ac1</serial>
Nov 15 08:46:51 user nova-compute[95467]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 08:46:51 user nova-compute[95467]: </disk>
Nov 15 08:46:51 user nova-compute[95467]:  {{(pid=95467) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 08:46:51 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-106d109e-d86c-4e03-a328-7fadc605be86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance f13d65ca-1cce-4675-998e-c668b53a6d12 {{(pid=95467) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 08:46:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:46:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:47:04 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:47:04 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=95467) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 08:47:04 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:47:07 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:47:07 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:47:09 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager.update_available_resource {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:47:09 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:47:09 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:47:09 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:47:09 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Auditing locally available compute resources for user (node: user) {{(pid=95467) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 08:47:09 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13d65ca-1cce-4675-998e-c668b53a6d12/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:47:09 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13d65ca-1cce-4675-998e-c668b53a6d12/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:47:09 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13d65ca-1cce-4675-998e-c668b53a6d12/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:47:09 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:47:10 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13d65ca-1cce-4675-998e-c668b53a6d12/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:47:10 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:47:10 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:47:10 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Hypervisor/Node resource view: name=user free_ram=9037MB free_disk=25.075775146484375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=95467) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 08:47:10 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:47:10 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:47:10 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance f13d65ca-1cce-4675-998e-c668b53a6d12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:47:10 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 08:47:10 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 08:47:10 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:47:10 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:47:10 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Compute_service record updated for user:user {{(pid=95467) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 08:47:10 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.182s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:47:11 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-106d109e-d86c-4e03-a328-7fadc605be86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance f13d65ca-1cce-4675-998e-c668b53a6d12 is timed out.
Nov 15 08:47:11 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-106d109e-d86c-4e03-a328-7fadc605be86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Successfully detached device vdc from instance f13d65ca-1cce-4675-998e-c668b53a6d12 from the live domain config.
Nov 15 08:47:11 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-106d109e-d86c-4e03-a328-7fadc605be86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] calling os-brick to detach iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 08:47:11 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-106d109e-d86c-4e03-a328-7fadc605be86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, {'target_iqn': 'iqn.2010-10.org.openstack:fcb14728-85d6-4913-8612-b34a94618ac1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kqEetQFi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:47:11 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-106d109e-d86c-4e03-a328-7fadc605be86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:47:11 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-106d109e-d86c-4e03-a328-7fadc605be86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:47:11 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-106d109e-d86c-4e03-a328-7fadc605be86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:47:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:47:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:47:11 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[0217b041-c9cf-4fe0-b00c-3be59e224942]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fcb14728-85d6-4913-8612-b34a94618ac1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:47:11 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-106d109e-d86c-4e03-a328-7fadc605be86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 08:47:11 user nova-compute[95467]: No targets found.
Nov 15 08:47:11 user nova-compute[95467]: iSNS:
Nov 15 08:47:11 user nova-compute[95467]: No targets found.
Nov 15 08:47:11 user nova-compute[95467]: STATIC:
Nov 15 08:47:11 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:fcb14728-85d6-4913-8612-b34a94618ac1
Nov 15 08:47:11 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:47:11 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:47:11 user nova-compute[95467]: FIRMWARE:
Nov 15 08:47:11 user nova-compute[95467]: No targets found.
Nov 15 08:47:11 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:47:11 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-106d109e-d86c-4e03-a328-7fadc605be86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 08:47:11 user nova-compute[95467]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 08:47:11 user nova-compute[95467]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=95467) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 08:47:11 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-106d109e-d86c-4e03-a328-7fadc605be86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fcb14728-85d6-4913-8612-b34a94618ac1', 0)] {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 08:47:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:47:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:47:11 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e903b7-1f5b-4a25-9015-01d9dd9802b6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fcb14728-85d6-4913-8612-b34a94618ac1\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:47:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:47:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:47:11 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cfe36a0-bd2b-4c95-8728-72ba99cd2189]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcb14728-85d6-4913-8612-b34a94618ac1 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:47:11 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-106d109e-d86c-4e03-a328-7fadc605be86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcb14728-85d6-4913-8612-b34a94618ac1 (non-flash)
Nov 15 08:47:11 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:47:11 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-106d109e-d86c-4e03-a328-7fadc605be86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcb14728-85d6-4913-8612-b34a94618ac1 (non-flash)
Nov 15 08:47:11 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:47:11 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-106d109e-d86c-4e03-a328-7fadc605be86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efec83044c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fcb14728-85d6-4913-8612-b34a94618ac1'): ({'sdc'}, set())}) {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 08:47:11 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-106d109e-d86c-4e03-a328-7fadc605be86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Removing single pathed devices sdc {{(pid=95467) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 08:47:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:47:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:47:11 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a12775-344b-45dc-9456-aefa97a2a538]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:47:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:47:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:47:11 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d5be49-ea06-4571-b850-467104ed8482]: (4, ('ok\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:47:11 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-106d109e-d86c-4e03-a328-7fadc605be86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Flushing IO for device /dev/sdc {{(pid=95467) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 08:47:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:47:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:47:11 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e49293b-9bc7-4903-ba85-f6539e59d5fa]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:47:11 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-106d109e-d86c-4e03-a328-7fadc605be86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=95467) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 08:47:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:47:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:47:11 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfef3083-35fb-4b84-89cc-5b3493c2822d]: (4, ('1', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:47:11 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-106d109e-d86c-4e03-a328-7fadc605be86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 08:47:11 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-106d109e-d86c-4e03-a328-7fadc605be86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] SCSI volumes sdc have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 08:47:11 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-106d109e-d86c-4e03-a328-7fadc605be86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fcb14728-85d6-4913-8612-b34a94618ac1')] {{(pid=95467) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 08:47:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcb14728-85d6-4913-8612-b34a94618ac1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:47:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcb14728-85d6-4913-8612-b34a94618ac1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:47:11 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f4319c-d5f9-4538-8c04-82ceeea54a9d]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:47:11 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-106d109e-d86c-4e03-a328-7fadc605be86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:47:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcb14728-85d6-4913-8612-b34a94618ac1 -p 172.16.0.220:3260 --logout {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:47:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcb14728-85d6-4913-8612-b34a94618ac1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.042s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:47:11 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a84496b-9e83-4e89-a7a6-b819fa560568]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:fcb14728-85d6-4913-8612-b34a94618ac1, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:fcb14728-85d6-4913-8612-b34a94618ac1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:47:11 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-106d109e-d86c-4e03-a328-7fadc605be86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:fcb14728-85d6-4913-8612-b34a94618ac1, portal: 172.16.0.220,3260]
Nov 15 08:47:11 user nova-compute[95467]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:fcb14728-85d6-4913-8612-b34a94618ac1, portal: 172.16.0.220,3260] successful.
Nov 15 08:47:11 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:47:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcb14728-85d6-4913-8612-b34a94618ac1 -p 172.16.0.220:3260 --op delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:47:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcb14728-85d6-4913-8612-b34a94618ac1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:47:11 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e995a8-9ac6-4775-87d7-870b652c402a]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:47:11 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-106d109e-d86c-4e03-a328-7fadc605be86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:47:11 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-106d109e-d86c-4e03-a328-7fadc605be86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:47:11 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-106d109e-d86c-4e03-a328-7fadc605be86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] <== disconnect_volume: return (285ms) None {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:47:11 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-106d109e-d86c-4e03-a328-7fadc605be86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Disconnected iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 08:47:12 user nova-compute[95467]: DEBUG nova.objects.instance [None req-106d109e-d86c-4e03-a328-7fadc605be86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lazy-loading 'flavor' on Instance uuid f13d65ca-1cce-4675-998e-c668b53a6d12 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:47:12 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-106d109e-d86c-4e03-a328-7fadc605be86 tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "f13d65ca-1cce-4675-998e-c668b53a6d12" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.561s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:47:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-eb2423e3-0688-4f4b-b07f-a8ce971e21bf tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Acquiring lock "f13d65ca-1cce-4675-998e-c668b53a6d12" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:47:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-eb2423e3-0688-4f4b-b07f-a8ce971e21bf tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "f13d65ca-1cce-4675-998e-c668b53a6d12" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:47:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-eb2423e3-0688-4f4b-b07f-a8ce971e21bf tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Acquiring lock "f13d65ca-1cce-4675-998e-c668b53a6d12-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:47:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-eb2423e3-0688-4f4b-b07f-a8ce971e21bf tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "f13d65ca-1cce-4675-998e-c668b53a6d12-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:47:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-eb2423e3-0688-4f4b-b07f-a8ce971e21bf tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "f13d65ca-1cce-4675-998e-c668b53a6d12-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:47:13 user nova-compute[95467]: INFO nova.compute.manager [None req-eb2423e3-0688-4f4b-b07f-a8ce971e21bf tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Terminating instance
Nov 15 08:47:13 user nova-compute[95467]: DEBUG nova.compute.manager [None req-eb2423e3-0688-4f4b-b07f-a8ce971e21bf tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Start destroying the instance on the hypervisor. {{(pid=95467) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 08:47:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:47:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:47:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:47:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:47:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:47:14 user nova-compute[95467]: DEBUG nova.compute.manager [req-3fba8ae3-87d4-4a71-a83d-0d3b802656a1 req-03bd69ee-ec69-4246-a3ee-3ae5a8248e7c service nova] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Received event network-vif-unplugged-8a79119f-64d3-4539-9a53-d0eae8bbcf54 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:47:14 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-3fba8ae3-87d4-4a71-a83d-0d3b802656a1 req-03bd69ee-ec69-4246-a3ee-3ae5a8248e7c service nova] Acquiring lock "f13d65ca-1cce-4675-998e-c668b53a6d12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:47:14 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-3fba8ae3-87d4-4a71-a83d-0d3b802656a1 req-03bd69ee-ec69-4246-a3ee-3ae5a8248e7c service nova] Lock "f13d65ca-1cce-4675-998e-c668b53a6d12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:47:14 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-3fba8ae3-87d4-4a71-a83d-0d3b802656a1 req-03bd69ee-ec69-4246-a3ee-3ae5a8248e7c service nova] Lock "f13d65ca-1cce-4675-998e-c668b53a6d12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:47:14 user nova-compute[95467]: DEBUG nova.compute.manager [req-3fba8ae3-87d4-4a71-a83d-0d3b802656a1 req-03bd69ee-ec69-4246-a3ee-3ae5a8248e7c service nova] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] No waiting events found dispatching network-vif-unplugged-8a79119f-64d3-4539-9a53-d0eae8bbcf54 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:47:14 user nova-compute[95467]: DEBUG nova.compute.manager [req-3fba8ae3-87d4-4a71-a83d-0d3b802656a1 req-03bd69ee-ec69-4246-a3ee-3ae5a8248e7c service nova] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Received event network-vif-unplugged-8a79119f-64d3-4539-9a53-d0eae8bbcf54 for instance with task_state deleting. {{(pid=95467) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 08:47:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:47:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:47:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:47:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:47:14 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Instance destroyed successfully.
Nov 15 08:47:14 user nova-compute[95467]: DEBUG nova.objects.instance [None req-eb2423e3-0688-4f4b-b07f-a8ce971e21bf tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lazy-loading 'resources' on Instance uuid f13d65ca-1cce-4675-998e-c668b53a6d12 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:47:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:47:14 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-eb2423e3-0688-4f4b-b07f-a8ce971e21bf tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:44:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-658357451',display_name='tempest-AttachVolumeTestJSON-server-658357451',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-658357451',id=52,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDXbZt7mr5YlmgEdQI3YIKKqBvMGkI+w2a/qKQVwpvss4nu1k7S3OK3/rNjiYIdoapmSPzWlHtdeZZJIbz4z7wFOFcuA9vxrWB2J152bL3xQL6yU7WTCELJuKx/dt4JzNg==',key_name='tempest-keypair-1376680918',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:44:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a9a636c8b7074bd19eeee608156f8568',ramdisk_id='',reservation_id='r-odinttss',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1507968277',owner_user_name='tempest-AttachVolumeTestJSON-1507968277-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:44:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e31df8ed5a914b2395b548606b65e580',uuid=f13d65ca-1cce-4675-998e-c668b53a6d12,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a79119f-64d3-4539-9a53-d0eae8bbcf54", "address": "fa:16:3e:b2:9e:b7", "network": {"id": "26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1542679712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9a636c8b7074bd19eeee608156f8568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a79119f-64", "ovs_interfaceid": "8a79119f-64d3-4539-9a53-d0eae8bbcf54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:47:14 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-eb2423e3-0688-4f4b-b07f-a8ce971e21bf tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Converting VIF {"id": "8a79119f-64d3-4539-9a53-d0eae8bbcf54", "address": "fa:16:3e:b2:9e:b7", "network": {"id": "26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1542679712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9a636c8b7074bd19eeee608156f8568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a79119f-64", "ovs_interfaceid": "8a79119f-64d3-4539-9a53-d0eae8bbcf54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:47:14 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-eb2423e3-0688-4f4b-b07f-a8ce971e21bf tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:9e:b7,bridge_name='br-int',has_traffic_filtering=True,id=8a79119f-64d3-4539-9a53-d0eae8bbcf54,network=Network(26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a79119f-64') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:47:14 user nova-compute[95467]: DEBUG os_vif [None req-eb2423e3-0688-4f4b-b07f-a8ce971e21bf tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:9e:b7,bridge_name='br-int',has_traffic_filtering=True,id=8a79119f-64d3-4539-9a53-d0eae8bbcf54,network=Network(26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a79119f-64') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:47:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:47:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a79119f-64, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:47:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:47:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:47:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:47:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5813d38d-69fe-44d7-9ece-836001f3966a) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:47:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:47:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:47:14 user nova-compute[95467]: INFO os_vif [None req-eb2423e3-0688-4f4b-b07f-a8ce971e21bf tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:9e:b7,bridge_name='br-int',has_traffic_filtering=True,id=8a79119f-64d3-4539-9a53-d0eae8bbcf54,network=Network(26f6c48f-01dd-4f9d-a5d0-dfd2187ff2eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a79119f-64')
Nov 15 08:47:14 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-eb2423e3-0688-4f4b-b07f-a8ce971e21bf tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Deleting instance files /opt/stack/data/nova/instances/f13d65ca-1cce-4675-998e-c668b53a6d12_del
Nov 15 08:47:14 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-eb2423e3-0688-4f4b-b07f-a8ce971e21bf tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Deletion of /opt/stack/data/nova/instances/f13d65ca-1cce-4675-998e-c668b53a6d12_del complete
Nov 15 08:47:14 user nova-compute[95467]: INFO nova.compute.manager [None req-eb2423e3-0688-4f4b-b07f-a8ce971e21bf tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 15 08:47:14 user nova-compute[95467]: DEBUG oslo.service.loopingcall [None req-eb2423e3-0688-4f4b-b07f-a8ce971e21bf tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=95467) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 08:47:14 user nova-compute[95467]: DEBUG nova.compute.manager [-] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Deallocating network for instance {{(pid=95467) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 08:47:14 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] deallocate_for_instance() {{(pid=95467) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 08:47:14 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:47:15 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:47:15 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:47:15 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:47:15 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:47:15 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:47:15 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:47:15 user nova-compute[95467]: INFO nova.compute.manager [-] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Took 0.83 seconds to deallocate network for instance.
Nov 15 08:47:15 user nova-compute[95467]: DEBUG nova.compute.manager [req-e869a434-c032-4f3b-8941-dabf12295f16 req-933441ed-7d23-4163-8984-cb81d92551da service nova] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Received event network-vif-deleted-8a79119f-64d3-4539-9a53-d0eae8bbcf54 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:47:15 user nova-compute[95467]: INFO nova.compute.manager [req-e869a434-c032-4f3b-8941-dabf12295f16 req-933441ed-7d23-4163-8984-cb81d92551da service nova] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Neutron deleted interface 8a79119f-64d3-4539-9a53-d0eae8bbcf54; detaching it from the instance and deleting it from the info cache
Nov 15 08:47:15 user nova-compute[95467]: DEBUG nova.network.neutron [req-e869a434-c032-4f3b-8941-dabf12295f16 req-933441ed-7d23-4163-8984-cb81d92551da service nova] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:47:15 user nova-compute[95467]: DEBUG nova.compute.manager [req-e869a434-c032-4f3b-8941-dabf12295f16 req-933441ed-7d23-4163-8984-cb81d92551da service nova] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Detach interface failed, port_id=8a79119f-64d3-4539-9a53-d0eae8bbcf54, reason: Instance f13d65ca-1cce-4675-998e-c668b53a6d12 could not be found. {{(pid=95467) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 08:47:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-eb2423e3-0688-4f4b-b07f-a8ce971e21bf tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:47:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-eb2423e3-0688-4f4b-b07f-a8ce971e21bf tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:47:15 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:47:15 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-eb2423e3-0688-4f4b-b07f-a8ce971e21bf tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:47:15 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-eb2423e3-0688-4f4b-b07f-a8ce971e21bf tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:47:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-eb2423e3-0688-4f4b-b07f-a8ce971e21bf tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.106s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:47:15 user nova-compute[95467]: INFO nova.scheduler.client.report [None req-eb2423e3-0688-4f4b-b07f-a8ce971e21bf tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Deleted allocations for instance f13d65ca-1cce-4675-998e-c668b53a6d12
Nov 15 08:47:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-eb2423e3-0688-4f4b-b07f-a8ce971e21bf tempest-AttachVolumeTestJSON-1507968277 tempest-AttachVolumeTestJSON-1507968277-project-member] Lock "f13d65ca-1cce-4675-998e-c668b53a6d12" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.994s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:47:16 user nova-compute[95467]: DEBUG nova.compute.manager [req-5e43f4a8-9d8f-423a-8541-1f4c66633d95 req-6080d7e8-a812-429c-9254-e2eba1e8fa4b service nova] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Received event network-vif-plugged-8a79119f-64d3-4539-9a53-d0eae8bbcf54 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:47:16 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-5e43f4a8-9d8f-423a-8541-1f4c66633d95 req-6080d7e8-a812-429c-9254-e2eba1e8fa4b service nova] Acquiring lock "f13d65ca-1cce-4675-998e-c668b53a6d12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:47:16 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-5e43f4a8-9d8f-423a-8541-1f4c66633d95 req-6080d7e8-a812-429c-9254-e2eba1e8fa4b service nova] Lock "f13d65ca-1cce-4675-998e-c668b53a6d12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:47:16 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-5e43f4a8-9d8f-423a-8541-1f4c66633d95 req-6080d7e8-a812-429c-9254-e2eba1e8fa4b service nova] Lock "f13d65ca-1cce-4675-998e-c668b53a6d12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:47:16 user nova-compute[95467]: DEBUG nova.compute.manager [req-5e43f4a8-9d8f-423a-8541-1f4c66633d95 req-6080d7e8-a812-429c-9254-e2eba1e8fa4b service nova] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] No waiting events found dispatching network-vif-plugged-8a79119f-64d3-4539-9a53-d0eae8bbcf54 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:47:16 user nova-compute[95467]: WARNING nova.compute.manager [req-5e43f4a8-9d8f-423a-8541-1f4c66633d95 req-6080d7e8-a812-429c-9254-e2eba1e8fa4b service nova] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Received unexpected event network-vif-plugged-8a79119f-64d3-4539-9a53-d0eae8bbcf54 for instance with vm_state deleted and task_state None.
Nov 15 08:47:16 user nova-compute[95467]: DEBUG nova.compute.manager [req-5e43f4a8-9d8f-423a-8541-1f4c66633d95 req-6080d7e8-a812-429c-9254-e2eba1e8fa4b service nova] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Received event network-vif-plugged-8a79119f-64d3-4539-9a53-d0eae8bbcf54 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:47:16 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-5e43f4a8-9d8f-423a-8541-1f4c66633d95 req-6080d7e8-a812-429c-9254-e2eba1e8fa4b service nova] Acquiring lock "f13d65ca-1cce-4675-998e-c668b53a6d12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:47:16 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-5e43f4a8-9d8f-423a-8541-1f4c66633d95 req-6080d7e8-a812-429c-9254-e2eba1e8fa4b service nova] Lock "f13d65ca-1cce-4675-998e-c668b53a6d12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:47:16 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-5e43f4a8-9d8f-423a-8541-1f4c66633d95 req-6080d7e8-a812-429c-9254-e2eba1e8fa4b service nova] Lock "f13d65ca-1cce-4675-998e-c668b53a6d12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:47:16 user nova-compute[95467]: DEBUG nova.compute.manager [req-5e43f4a8-9d8f-423a-8541-1f4c66633d95 req-6080d7e8-a812-429c-9254-e2eba1e8fa4b service nova] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] No waiting events found dispatching network-vif-plugged-8a79119f-64d3-4539-9a53-d0eae8bbcf54 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:47:16 user nova-compute[95467]: WARNING nova.compute.manager [req-5e43f4a8-9d8f-423a-8541-1f4c66633d95 req-6080d7e8-a812-429c-9254-e2eba1e8fa4b service nova] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Received unexpected event network-vif-plugged-8a79119f-64d3-4539-9a53-d0eae8bbcf54 for instance with vm_state deleted and task_state None.
Nov 15 08:47:16 user nova-compute[95467]: DEBUG nova.compute.manager [req-5e43f4a8-9d8f-423a-8541-1f4c66633d95 req-6080d7e8-a812-429c-9254-e2eba1e8fa4b service nova] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Received event network-vif-plugged-8a79119f-64d3-4539-9a53-d0eae8bbcf54 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:47:16 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-5e43f4a8-9d8f-423a-8541-1f4c66633d95 req-6080d7e8-a812-429c-9254-e2eba1e8fa4b service nova] Acquiring lock "f13d65ca-1cce-4675-998e-c668b53a6d12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:47:16 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-5e43f4a8-9d8f-423a-8541-1f4c66633d95 req-6080d7e8-a812-429c-9254-e2eba1e8fa4b service nova] Lock "f13d65ca-1cce-4675-998e-c668b53a6d12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:47:16 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-5e43f4a8-9d8f-423a-8541-1f4c66633d95 req-6080d7e8-a812-429c-9254-e2eba1e8fa4b service nova] Lock "f13d65ca-1cce-4675-998e-c668b53a6d12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:47:16 user nova-compute[95467]: DEBUG nova.compute.manager [req-5e43f4a8-9d8f-423a-8541-1f4c66633d95 req-6080d7e8-a812-429c-9254-e2eba1e8fa4b service nova] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] No waiting events found dispatching network-vif-plugged-8a79119f-64d3-4539-9a53-d0eae8bbcf54 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:47:16 user nova-compute[95467]: WARNING nova.compute.manager [req-5e43f4a8-9d8f-423a-8541-1f4c66633d95 req-6080d7e8-a812-429c-9254-e2eba1e8fa4b service nova] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Received unexpected event network-vif-plugged-8a79119f-64d3-4539-9a53-d0eae8bbcf54 for instance with vm_state deleted and task_state None.
Nov 15 08:47:16 user nova-compute[95467]: DEBUG nova.compute.manager [req-5e43f4a8-9d8f-423a-8541-1f4c66633d95 req-6080d7e8-a812-429c-9254-e2eba1e8fa4b service nova] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Received event network-vif-unplugged-8a79119f-64d3-4539-9a53-d0eae8bbcf54 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:47:16 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-5e43f4a8-9d8f-423a-8541-1f4c66633d95 req-6080d7e8-a812-429c-9254-e2eba1e8fa4b service nova] Acquiring lock "f13d65ca-1cce-4675-998e-c668b53a6d12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:47:16 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-5e43f4a8-9d8f-423a-8541-1f4c66633d95 req-6080d7e8-a812-429c-9254-e2eba1e8fa4b service nova] Lock "f13d65ca-1cce-4675-998e-c668b53a6d12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:47:16 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-5e43f4a8-9d8f-423a-8541-1f4c66633d95 req-6080d7e8-a812-429c-9254-e2eba1e8fa4b service nova] Lock "f13d65ca-1cce-4675-998e-c668b53a6d12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:47:16 user nova-compute[95467]: DEBUG nova.compute.manager [req-5e43f4a8-9d8f-423a-8541-1f4c66633d95 req-6080d7e8-a812-429c-9254-e2eba1e8fa4b service nova] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] No waiting events found dispatching network-vif-unplugged-8a79119f-64d3-4539-9a53-d0eae8bbcf54 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:47:16 user nova-compute[95467]: WARNING nova.compute.manager [req-5e43f4a8-9d8f-423a-8541-1f4c66633d95 req-6080d7e8-a812-429c-9254-e2eba1e8fa4b service nova] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Received unexpected event network-vif-unplugged-8a79119f-64d3-4539-9a53-d0eae8bbcf54 for instance with vm_state deleted and task_state None.
Nov 15 08:47:16 user nova-compute[95467]: DEBUG nova.compute.manager [req-5e43f4a8-9d8f-423a-8541-1f4c66633d95 req-6080d7e8-a812-429c-9254-e2eba1e8fa4b service nova] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Received event network-vif-plugged-8a79119f-64d3-4539-9a53-d0eae8bbcf54 {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:47:16 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-5e43f4a8-9d8f-423a-8541-1f4c66633d95 req-6080d7e8-a812-429c-9254-e2eba1e8fa4b service nova] Acquiring lock "f13d65ca-1cce-4675-998e-c668b53a6d12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:47:16 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-5e43f4a8-9d8f-423a-8541-1f4c66633d95 req-6080d7e8-a812-429c-9254-e2eba1e8fa4b service nova] Lock "f13d65ca-1cce-4675-998e-c668b53a6d12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:47:16 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-5e43f4a8-9d8f-423a-8541-1f4c66633d95 req-6080d7e8-a812-429c-9254-e2eba1e8fa4b service nova] Lock "f13d65ca-1cce-4675-998e-c668b53a6d12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:47:16 user nova-compute[95467]: DEBUG nova.compute.manager [req-5e43f4a8-9d8f-423a-8541-1f4c66633d95 req-6080d7e8-a812-429c-9254-e2eba1e8fa4b service nova] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] No waiting events found dispatching network-vif-plugged-8a79119f-64d3-4539-9a53-d0eae8bbcf54 {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:47:16 user nova-compute[95467]: WARNING nova.compute.manager [req-5e43f4a8-9d8f-423a-8541-1f4c66633d95 req-6080d7e8-a812-429c-9254-e2eba1e8fa4b service nova] [instance: f13d65ca-1cce-4675-998e-c668b53a6d12] Received unexpected event network-vif-plugged-8a79119f-64d3-4539-9a53-d0eae8bbcf54 for instance with vm_state deleted and task_state None.
Nov 15 08:47:17 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:47:17 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Starting heal instance info cache {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 08:47:17 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Rebuilding the list of instances to heal {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 08:47:17 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Didn't find any instances for network info cache update. {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 08:47:17 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:47:19 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:47:19 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:47:24 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:47:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:47:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:47:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=95467) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 08:47:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:47:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:47:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:47:34 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:47:39 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:47:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:47:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:47:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:47:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=95467) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 08:47:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:47:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:47:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:47:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:47:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:48:04 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:48:04 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:48:05 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:48:05 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=95467) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 08:48:08 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:48:09 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:48:09 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:48:11 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager.update_available_resource {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:48:11 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:48:11 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:48:11 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:48:11 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Auditing locally available compute resources for user (node: user) {{(pid=95467) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 08:48:12 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:48:12 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:48:12 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Hypervisor/Node resource view: name=user free_ram=9171MB free_disk=25.102455139160156GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=95467) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 08:48:12 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:48:12 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:48:12 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 08:48:12 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 08:48:12 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:48:12 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:48:12 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Compute_service record updated for user:user {{(pid=95467) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 08:48:12 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.138s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:48:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:48:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:48:16 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:48:16 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:48:18 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:48:19 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:48:19 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Starting heal instance info cache {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 08:48:19 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Rebuilding the list of instances to heal {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 08:48:19 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Didn't find any instances for network info cache update. {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 08:48:19 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:48:19 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:48:19 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:48:19 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=95467) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 08:48:19 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:48:19 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:48:19 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:48:23 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:48:24 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:48:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:48:34 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:48:39 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:48:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:48:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:48:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:48:56 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:48:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:48:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:48:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:49:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:49:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:49:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:49:04 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:49:05 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:49:06 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:49:06 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=95467) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 08:49:08 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:49:08 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:49:09 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:49:11 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Acquiring lock "f72e8b13-7532-4900-a356-1c4b4a3b7cc8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:49:11 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lock "f72e8b13-7532-4900-a356-1c4b4a3b7cc8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:49:11 user nova-compute[95467]: DEBUG nova.compute.manager [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Starting instance... {{(pid=95467) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 08:49:11 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:49:11 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:49:11 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=95467) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 08:49:11 user nova-compute[95467]: INFO nova.compute.claims [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Claim successful on node user
Nov 15 08:49:11 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:49:11 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:49:11 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.203s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:49:11 user nova-compute[95467]: DEBUG nova.compute.manager [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Start building networks asynchronously for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 08:49:11 user nova-compute[95467]: DEBUG nova.compute.manager [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Allocating IP information in the background. {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 08:49:11 user nova-compute[95467]: DEBUG nova.network.neutron [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] allocate_for_instance() {{(pid=95467) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 08:49:11 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 08:49:11 user nova-compute[95467]: DEBUG nova.compute.manager [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Start building block device mappings for instance. {{(pid=95467) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 08:49:11 user nova-compute[95467]: DEBUG nova.policy [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '32c2bb738baf4a93b61a24413d5467d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41c0dc5f8ffe415cb84df29cff554d09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95467) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 08:49:11 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:49:11 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager.update_available_resource {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:49:11 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:49:11 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:49:11 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:49:11 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Auditing locally available compute resources for user (node: user) {{(pid=95467) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 08:49:11 user nova-compute[95467]: DEBUG nova.compute.manager [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Start spawning the instance on the hypervisor. {{(pid=95467) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 08:49:11 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Creating instance directory {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 08:49:11 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Creating image(s)
Nov 15 08:49:11 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Acquiring lock "/opt/stack/data/nova/instances/f72e8b13-7532-4900-a356-1c4b4a3b7cc8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:49:11 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lock "/opt/stack/data/nova/instances/f72e8b13-7532-4900-a356-1c4b4a3b7cc8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:49:11 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lock "/opt/stack/data/nova/instances/f72e8b13-7532-4900-a356-1c4b4a3b7cc8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:49:11 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:49:12 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.489s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:49:12 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Acquiring lock "a3fcf60225fcefd310404971cd18ab9851c548dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:49:12 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:49:12 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:49:12 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:49:12 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:49:12 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Hypervisor/Node resource view: name=user free_ram=8917MB free_disk=25.087913513183594GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=95467) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 08:49:12 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:49:12 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:49:12 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance f72e8b13-7532-4900-a356-1c4b4a3b7cc8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:49:12 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 08:49:12 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 08:49:12 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.188s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:49:12 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/f72e8b13-7532-4900-a356-1c4b4a3b7cc8/disk 1073741824 {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:49:12 user nova-compute[95467]: DEBUG nova.network.neutron [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Successfully created port: 1bf0b597-4b85-4ce5-b8ab-2a1f399c8a1f {{(pid=95467) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 08:49:12 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:49:12 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc,backing_fmt=raw /opt/stack/data/nova/instances/f72e8b13-7532-4900-a356-1c4b4a3b7cc8/disk 1073741824" returned: 0 in 0.060s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:49:12 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lock "a3fcf60225fcefd310404971cd18ab9851c548dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:49:12 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:49:12 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:49:12 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Compute_service record updated for user:user {{(pid=95467) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 08:49:12 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.287s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:49:12 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3fcf60225fcefd310404971cd18ab9851c548dc --force-share --output=json" returned: 0 in 0.178s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:49:12 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f72e8b13-7532-4900-a356-1c4b4a3b7cc8/disk. size=1073741824 {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 08:49:12 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f72e8b13-7532-4900-a356-1c4b4a3b7cc8/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:49:12 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f72e8b13-7532-4900-a356-1c4b4a3b7cc8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:49:12 user nova-compute[95467]: DEBUG nova.virt.disk.api [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Cannot resize image /opt/stack/data/nova/instances/f72e8b13-7532-4900-a356-1c4b4a3b7cc8/disk to a smaller size. {{(pid=95467) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 08:49:12 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Created local disks {{(pid=95467) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 08:49:12 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Ensure instance console log exists: /opt/stack/data/nova/instances/f72e8b13-7532-4900-a356-1c4b4a3b7cc8/console.log {{(pid=95467) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 08:49:12 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:49:12 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:49:12 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:49:13 user nova-compute[95467]: DEBUG nova.network.neutron [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Successfully updated port: 1bf0b597-4b85-4ce5-b8ab-2a1f399c8a1f {{(pid=95467) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 08:49:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Acquiring lock "refresh_cache-f72e8b13-7532-4900-a356-1c4b4a3b7cc8" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:49:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Acquired lock "refresh_cache-f72e8b13-7532-4900-a356-1c4b4a3b7cc8" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:49:13 user nova-compute[95467]: DEBUG nova.network.neutron [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Building network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 08:49:13 user nova-compute[95467]: DEBUG nova.network.neutron [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Instance cache missing network info. {{(pid=95467) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 08:49:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:49:13 user nova-compute[95467]: DEBUG nova.compute.manager [req-ed02bf6b-b2d8-4edd-994e-f535a185db4f req-def64499-9ca2-4be0-a5a5-ae2b4d0c687f service nova] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Received event network-changed-1bf0b597-4b85-4ce5-b8ab-2a1f399c8a1f {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:49:13 user nova-compute[95467]: DEBUG nova.compute.manager [req-ed02bf6b-b2d8-4edd-994e-f535a185db4f req-def64499-9ca2-4be0-a5a5-ae2b4d0c687f service nova] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Refreshing instance network info cache due to event network-changed-1bf0b597-4b85-4ce5-b8ab-2a1f399c8a1f. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:49:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ed02bf6b-b2d8-4edd-994e-f535a185db4f req-def64499-9ca2-4be0-a5a5-ae2b4d0c687f service nova] Acquiring lock "refresh_cache-f72e8b13-7532-4900-a356-1c4b4a3b7cc8" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:49:13 user nova-compute[95467]: DEBUG nova.network.neutron [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Updating instance_info_cache with network_info: [{"id": "1bf0b597-4b85-4ce5-b8ab-2a1f399c8a1f", "address": "fa:16:3e:fe:52:18", "network": {"id": "fbab5af1-c1c6-4bdf-bfe3-b47ff49c5771", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-349235580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41c0dc5f8ffe415cb84df29cff554d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf0b597-4b", "ovs_interfaceid": "1bf0b597-4b85-4ce5-b8ab-2a1f399c8a1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:49:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Releasing lock "refresh_cache-f72e8b13-7532-4900-a356-1c4b4a3b7cc8" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:49:13 user nova-compute[95467]: DEBUG nova.compute.manager [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Instance network_info: |[{"id": "1bf0b597-4b85-4ce5-b8ab-2a1f399c8a1f", "address": "fa:16:3e:fe:52:18", "network": {"id": "fbab5af1-c1c6-4bdf-bfe3-b47ff49c5771", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-349235580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41c0dc5f8ffe415cb84df29cff554d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf0b597-4b", "ovs_interfaceid": "1bf0b597-4b85-4ce5-b8ab-2a1f399c8a1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=95467) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 08:49:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ed02bf6b-b2d8-4edd-994e-f535a185db4f req-def64499-9ca2-4be0-a5a5-ae2b4d0c687f service nova] Acquired lock "refresh_cache-f72e8b13-7532-4900-a356-1c4b4a3b7cc8" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:49:13 user nova-compute[95467]: DEBUG nova.network.neutron [req-ed02bf6b-b2d8-4edd-994e-f535a185db4f req-def64499-9ca2-4be0-a5a5-ae2b4d0c687f service nova] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Refreshing network info cache for port 1bf0b597-4b85-4ce5-b8ab-2a1f399c8a1f {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:49:13 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Start _get_guest_xml network_info=[{"id": "1bf0b597-4b85-4ce5-b8ab-2a1f399c8a1f", "address": "fa:16:3e:fe:52:18", "network": {"id": "fbab5af1-c1c6-4bdf-bfe3-b47ff49c5771", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-349235580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41c0dc5f8ffe415cb84df29cff554d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf0b597-4b", "ovs_interfaceid": "1bf0b597-4b85-4ce5-b8ab-2a1f399c8a1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'ed9c48aa-ce73-4b3b-9db1-235898be671b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 08:49:13 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:49:13 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:49:13 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 08:49:13 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] CPU controller missing on host. {{(pid=95467) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 08:49:13 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 08:49:13 user nova-compute[95467]: DEBUG nova.virt.libvirt.host [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] CPU controller found on host. {{(pid=95467) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 08:49:13 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=95467) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 08:49:13 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T08:05:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T08:05:59Z,direct_url=<?>,disk_format='qcow2',id=ed9c48aa-ce73-4b3b-9db1-235898be671b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7a38b3c02f7432780351fffae6b27d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T08:06:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 08:49:13 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Flavor limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 08:49:13 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Image limits 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 08:49:13 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Flavor pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 08:49:13 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Image pref 0:0:0 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 08:49:13 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=95467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 08:49:13 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 08:49:13 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 08:49:13 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Got 1 possible topologies {{(pid=95467) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 08:49:13 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 08:49:13 user nova-compute[95467]: DEBUG nova.virt.hardware [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=95467) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 08:49:13 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:49:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-145521287',display_name='tempest-SnapshotDataIntegrityTests-server-145521287',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-145521287',id=53,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKW0RGUenyiBq2Zn3FkpehZSymFhFzZniCVOww7sylcEOWjwxUu9VkliuKMJ1DcyuTLR8HOeW/AxlBZ8KTIfQVT6GKX/u5xZw18Eg1MbPdfS3yflwjJX40oYT6XlK7grNg==',key_name='tempest-keypair-1544801961',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41c0dc5f8ffe415cb84df29cff554d09',ramdisk_id='',reservation_id='r-8hviksb8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-988051725',owner_user_name='tempest-SnapshotDataIntegrityTests-988051725-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:49:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32c2bb738baf4a93b61a24413d5467d6',uuid=f72e8b13-7532-4900-a356-1c4b4a3b7cc8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1bf0b597-4b85-4ce5-b8ab-2a1f399c8a1f", "address": "fa:16:3e:fe:52:18", "network": {"id": "fbab5af1-c1c6-4bdf-bfe3-b47ff49c5771", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-349235580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41c0dc5f8ffe415cb84df29cff554d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf0b597-4b", "ovs_interfaceid": "1bf0b597-4b85-4ce5-b8ab-2a1f399c8a1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=95467) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 08:49:13 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Converting VIF {"id": "1bf0b597-4b85-4ce5-b8ab-2a1f399c8a1f", "address": "fa:16:3e:fe:52:18", "network": {"id": "fbab5af1-c1c6-4bdf-bfe3-b47ff49c5771", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-349235580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41c0dc5f8ffe415cb84df29cff554d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf0b597-4b", "ovs_interfaceid": "1bf0b597-4b85-4ce5-b8ab-2a1f399c8a1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:49:13 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:52:18,bridge_name='br-int',has_traffic_filtering=True,id=1bf0b597-4b85-4ce5-b8ab-2a1f399c8a1f,network=Network(fbab5af1-c1c6-4bdf-bfe3-b47ff49c5771),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bf0b597-4b') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:49:13 user nova-compute[95467]: DEBUG nova.objects.instance [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lazy-loading 'pci_devices' on Instance uuid f72e8b13-7532-4900-a356-1c4b4a3b7cc8 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:49:13 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] End _get_guest_xml xml=<domain type="kvm">
Nov 15 08:49:13 user nova-compute[95467]:   <uuid>f72e8b13-7532-4900-a356-1c4b4a3b7cc8</uuid>
Nov 15 08:49:13 user nova-compute[95467]:   <name>instance-00000035</name>
Nov 15 08:49:13 user nova-compute[95467]:   <memory>524288</memory>
Nov 15 08:49:13 user nova-compute[95467]:   <vcpu>1</vcpu>
Nov 15 08:49:13 user nova-compute[95467]:   <metadata>
Nov 15 08:49:13 user nova-compute[95467]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 08:49:13 user nova-compute[95467]:       <nova:package version="0.0.0"/>
Nov 15 08:49:13 user nova-compute[95467]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-145521287</nova:name>
Nov 15 08:49:13 user nova-compute[95467]:       <nova:creationTime>2023-11-15 08:49:13</nova:creationTime>
Nov 15 08:49:13 user nova-compute[95467]:       <nova:flavor name="m1.tiny">
Nov 15 08:49:13 user nova-compute[95467]:         <nova:memory>512</nova:memory>
Nov 15 08:49:13 user nova-compute[95467]:         <nova:disk>1</nova:disk>
Nov 15 08:49:13 user nova-compute[95467]:         <nova:swap>0</nova:swap>
Nov 15 08:49:13 user nova-compute[95467]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 08:49:13 user nova-compute[95467]:         <nova:vcpus>1</nova:vcpus>
Nov 15 08:49:13 user nova-compute[95467]:       </nova:flavor>
Nov 15 08:49:13 user nova-compute[95467]:       <nova:owner>
Nov 15 08:49:13 user nova-compute[95467]:         <nova:user uuid="32c2bb738baf4a93b61a24413d5467d6">tempest-SnapshotDataIntegrityTests-988051725-project-member</nova:user>
Nov 15 08:49:13 user nova-compute[95467]:         <nova:project uuid="41c0dc5f8ffe415cb84df29cff554d09">tempest-SnapshotDataIntegrityTests-988051725</nova:project>
Nov 15 08:49:13 user nova-compute[95467]:       </nova:owner>
Nov 15 08:49:13 user nova-compute[95467]:       <nova:root type="image" uuid="ed9c48aa-ce73-4b3b-9db1-235898be671b"/>
Nov 15 08:49:13 user nova-compute[95467]:       <nova:ports>
Nov 15 08:49:13 user nova-compute[95467]:         <nova:port uuid="1bf0b597-4b85-4ce5-b8ab-2a1f399c8a1f">
Nov 15 08:49:13 user nova-compute[95467]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 08:49:13 user nova-compute[95467]:         </nova:port>
Nov 15 08:49:13 user nova-compute[95467]:       </nova:ports>
Nov 15 08:49:13 user nova-compute[95467]:     </nova:instance>
Nov 15 08:49:13 user nova-compute[95467]:   </metadata>
Nov 15 08:49:13 user nova-compute[95467]:   <sysinfo type="smbios">
Nov 15 08:49:13 user nova-compute[95467]:     <system>
Nov 15 08:49:13 user nova-compute[95467]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 08:49:13 user nova-compute[95467]:       <entry name="product">OpenStack Nova</entry>
Nov 15 08:49:13 user nova-compute[95467]:       <entry name="version">0.0.0</entry>
Nov 15 08:49:13 user nova-compute[95467]:       <entry name="serial">f72e8b13-7532-4900-a356-1c4b4a3b7cc8</entry>
Nov 15 08:49:13 user nova-compute[95467]:       <entry name="uuid">f72e8b13-7532-4900-a356-1c4b4a3b7cc8</entry>
Nov 15 08:49:13 user nova-compute[95467]:       <entry name="family">Virtual Machine</entry>
Nov 15 08:49:13 user nova-compute[95467]:     </system>
Nov 15 08:49:13 user nova-compute[95467]:   </sysinfo>
Nov 15 08:49:13 user nova-compute[95467]:   <os>
Nov 15 08:49:13 user nova-compute[95467]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 08:49:13 user nova-compute[95467]:     <boot dev="hd"/>
Nov 15 08:49:13 user nova-compute[95467]:     <smbios mode="sysinfo"/>
Nov 15 08:49:13 user nova-compute[95467]:   </os>
Nov 15 08:49:13 user nova-compute[95467]:   <features>
Nov 15 08:49:13 user nova-compute[95467]:     <acpi/>
Nov 15 08:49:13 user nova-compute[95467]:     <apic/>
Nov 15 08:49:13 user nova-compute[95467]:     <vmcoreinfo/>
Nov 15 08:49:13 user nova-compute[95467]:   </features>
Nov 15 08:49:13 user nova-compute[95467]:   <clock offset="utc">
Nov 15 08:49:13 user nova-compute[95467]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 08:49:13 user nova-compute[95467]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 08:49:13 user nova-compute[95467]:     <timer name="hpet" present="no"/>
Nov 15 08:49:13 user nova-compute[95467]:   </clock>
Nov 15 08:49:13 user nova-compute[95467]:   <cpu mode="custom" match="exact">
Nov 15 08:49:13 user nova-compute[95467]:     <model>Nehalem</model>
Nov 15 08:49:13 user nova-compute[95467]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 08:49:13 user nova-compute[95467]:   </cpu>
Nov 15 08:49:13 user nova-compute[95467]:   <devices>
Nov 15 08:49:13 user nova-compute[95467]:     <disk type="file" device="disk">
Nov 15 08:49:13 user nova-compute[95467]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 08:49:13 user nova-compute[95467]:       <source file="/opt/stack/data/nova/instances/f72e8b13-7532-4900-a356-1c4b4a3b7cc8/disk"/>
Nov 15 08:49:13 user nova-compute[95467]:       <target dev="vda" bus="virtio"/>
Nov 15 08:49:13 user nova-compute[95467]:     </disk>
Nov 15 08:49:13 user nova-compute[95467]:     <interface type="ethernet">
Nov 15 08:49:13 user nova-compute[95467]:       <mac address="fa:16:3e:fe:52:18"/>
Nov 15 08:49:13 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:49:13 user nova-compute[95467]:       <mtu size="1442"/>
Nov 15 08:49:13 user nova-compute[95467]:       <target dev="tap1bf0b597-4b"/>
Nov 15 08:49:13 user nova-compute[95467]:     </interface>
Nov 15 08:49:13 user nova-compute[95467]:     <serial type="pty">
Nov 15 08:49:13 user nova-compute[95467]:       <log file="/opt/stack/data/nova/instances/f72e8b13-7532-4900-a356-1c4b4a3b7cc8/console.log" append="off"/>
Nov 15 08:49:13 user nova-compute[95467]:     </serial>
Nov 15 08:49:13 user nova-compute[95467]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 08:49:13 user nova-compute[95467]:     <video>
Nov 15 08:49:13 user nova-compute[95467]:       <model type="virtio"/>
Nov 15 08:49:13 user nova-compute[95467]:     </video>
Nov 15 08:49:13 user nova-compute[95467]:     <rng model="virtio">
Nov 15 08:49:13 user nova-compute[95467]:       <backend model="random">/dev/urandom</backend>
Nov 15 08:49:13 user nova-compute[95467]:     </rng>
Nov 15 08:49:13 user nova-compute[95467]:     <controller type="usb" index="0" model="none"/>
Nov 15 08:49:13 user nova-compute[95467]:     <memballoon model="virtio">
Nov 15 08:49:13 user nova-compute[95467]:       <stats period="10"/>
Nov 15 08:49:13 user nova-compute[95467]:     </memballoon>
Nov 15 08:49:13 user nova-compute[95467]:   </devices>
Nov 15 08:49:13 user nova-compute[95467]: </domain>
Nov 15 08:49:13 user nova-compute[95467]:  {{(pid=95467) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 08:49:13 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:49:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-145521287',display_name='tempest-SnapshotDataIntegrityTests-server-145521287',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-145521287',id=53,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKW0RGUenyiBq2Zn3FkpehZSymFhFzZniCVOww7sylcEOWjwxUu9VkliuKMJ1DcyuTLR8HOeW/AxlBZ8KTIfQVT6GKX/u5xZw18Eg1MbPdfS3yflwjJX40oYT6XlK7grNg==',key_name='tempest-keypair-1544801961',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41c0dc5f8ffe415cb84df29cff554d09',ramdisk_id='',reservation_id='r-8hviksb8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-988051725',owner_user_name='tempest-SnapshotDataIntegrityTests-988051725-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T08:49:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32c2bb738baf4a93b61a24413d5467d6',uuid=f72e8b13-7532-4900-a356-1c4b4a3b7cc8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1bf0b597-4b85-4ce5-b8ab-2a1f399c8a1f", "address": "fa:16:3e:fe:52:18", "network": {"id": "fbab5af1-c1c6-4bdf-bfe3-b47ff49c5771", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-349235580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41c0dc5f8ffe415cb84df29cff554d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf0b597-4b", "ovs_interfaceid": "1bf0b597-4b85-4ce5-b8ab-2a1f399c8a1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 08:49:13 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Converting VIF {"id": "1bf0b597-4b85-4ce5-b8ab-2a1f399c8a1f", "address": "fa:16:3e:fe:52:18", "network": {"id": "fbab5af1-c1c6-4bdf-bfe3-b47ff49c5771", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-349235580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41c0dc5f8ffe415cb84df29cff554d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf0b597-4b", "ovs_interfaceid": "1bf0b597-4b85-4ce5-b8ab-2a1f399c8a1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:49:13 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:52:18,bridge_name='br-int',has_traffic_filtering=True,id=1bf0b597-4b85-4ce5-b8ab-2a1f399c8a1f,network=Network(fbab5af1-c1c6-4bdf-bfe3-b47ff49c5771),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bf0b597-4b') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:49:13 user nova-compute[95467]: DEBUG os_vif [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:52:18,bridge_name='br-int',has_traffic_filtering=True,id=1bf0b597-4b85-4ce5-b8ab-2a1f399c8a1f,network=Network(fbab5af1-c1c6-4bdf-bfe3-b47ff49c5771),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bf0b597-4b') {{(pid=95467) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 08:49:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:49:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:49:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 08:49:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:49:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0ac8b327-4b82-54e4-9833-432c9c763c2d', '_type': 'linux-noop'}}, row=False) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:49:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:49:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:49:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:49:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1bf0b597-4b, may_exist=True, interface_attrs={}) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:49:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1bf0b597-4b, col_values=(('qos', UUID('c23a0952-aa67-48f1-ae36-28b701aac6a5')),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:49:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1bf0b597-4b, col_values=(('external_ids', {'iface-id': '1bf0b597-4b85-4ce5-b8ab-2a1f399c8a1f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:52:18', 'vm-uuid': 'f72e8b13-7532-4900-a356-1c4b4a3b7cc8'}),), if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:49:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:49:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:49:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:49:13 user nova-compute[95467]: INFO os_vif [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:52:18,bridge_name='br-int',has_traffic_filtering=True,id=1bf0b597-4b85-4ce5-b8ab-2a1f399c8a1f,network=Network(fbab5af1-c1c6-4bdf-bfe3-b47ff49c5771),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bf0b597-4b')
Nov 15 08:49:13 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:49:13 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] No VIF found with MAC fa:16:3e:fe:52:18, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:49:14 user nova-compute[95467]: DEBUG nova.network.neutron [req-ed02bf6b-b2d8-4edd-994e-f535a185db4f req-def64499-9ca2-4be0-a5a5-ae2b4d0c687f service nova] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Updated VIF entry in instance network info cache for port 1bf0b597-4b85-4ce5-b8ab-2a1f399c8a1f. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:49:14 user nova-compute[95467]: DEBUG nova.network.neutron [req-ed02bf6b-b2d8-4edd-994e-f535a185db4f req-def64499-9ca2-4be0-a5a5-ae2b4d0c687f service nova] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Updating instance_info_cache with network_info: [{"id": "1bf0b597-4b85-4ce5-b8ab-2a1f399c8a1f", "address": "fa:16:3e:fe:52:18", "network": {"id": "fbab5af1-c1c6-4bdf-bfe3-b47ff49c5771", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-349235580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41c0dc5f8ffe415cb84df29cff554d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf0b597-4b", "ovs_interfaceid": "1bf0b597-4b85-4ce5-b8ab-2a1f399c8a1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:49:14 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ed02bf6b-b2d8-4edd-994e-f535a185db4f req-def64499-9ca2-4be0-a5a5-ae2b4d0c687f service nova] Releasing lock "refresh_cache-f72e8b13-7532-4900-a356-1c4b4a3b7cc8" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:49:15 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:49:15 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:49:15 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:49:15 user nova-compute[95467]: DEBUG nova.compute.manager [req-49b12f6a-ee8d-4bcf-85eb-d2495071fc84 req-26072b62-3052-4d68-ae5b-0b6e586bd907 service nova] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Received event network-vif-plugged-1bf0b597-4b85-4ce5-b8ab-2a1f399c8a1f {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:49:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-49b12f6a-ee8d-4bcf-85eb-d2495071fc84 req-26072b62-3052-4d68-ae5b-0b6e586bd907 service nova] Acquiring lock "f72e8b13-7532-4900-a356-1c4b4a3b7cc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:49:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-49b12f6a-ee8d-4bcf-85eb-d2495071fc84 req-26072b62-3052-4d68-ae5b-0b6e586bd907 service nova] Lock "f72e8b13-7532-4900-a356-1c4b4a3b7cc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:49:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-49b12f6a-ee8d-4bcf-85eb-d2495071fc84 req-26072b62-3052-4d68-ae5b-0b6e586bd907 service nova] Lock "f72e8b13-7532-4900-a356-1c4b4a3b7cc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:49:15 user nova-compute[95467]: DEBUG nova.compute.manager [req-49b12f6a-ee8d-4bcf-85eb-d2495071fc84 req-26072b62-3052-4d68-ae5b-0b6e586bd907 service nova] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] No waiting events found dispatching network-vif-plugged-1bf0b597-4b85-4ce5-b8ab-2a1f399c8a1f {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:49:15 user nova-compute[95467]: WARNING nova.compute.manager [req-49b12f6a-ee8d-4bcf-85eb-d2495071fc84 req-26072b62-3052-4d68-ae5b-0b6e586bd907 service nova] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Received unexpected event network-vif-plugged-1bf0b597-4b85-4ce5-b8ab-2a1f399c8a1f for instance with vm_state building and task_state spawning.
Nov 15 08:49:15 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:49:15 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:49:15 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:49:16 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:49:17 user nova-compute[95467]: DEBUG nova.compute.manager [req-e4bd35f4-039a-446e-b8a3-b07a9d6a7e86 req-85590167-82ab-46c8-ab3d-354dbb346c43 service nova] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Received event network-vif-plugged-1bf0b597-4b85-4ce5-b8ab-2a1f399c8a1f {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:49:17 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-e4bd35f4-039a-446e-b8a3-b07a9d6a7e86 req-85590167-82ab-46c8-ab3d-354dbb346c43 service nova] Acquiring lock "f72e8b13-7532-4900-a356-1c4b4a3b7cc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:49:17 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-e4bd35f4-039a-446e-b8a3-b07a9d6a7e86 req-85590167-82ab-46c8-ab3d-354dbb346c43 service nova] Lock "f72e8b13-7532-4900-a356-1c4b4a3b7cc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:49:17 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-e4bd35f4-039a-446e-b8a3-b07a9d6a7e86 req-85590167-82ab-46c8-ab3d-354dbb346c43 service nova] Lock "f72e8b13-7532-4900-a356-1c4b4a3b7cc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:49:17 user nova-compute[95467]: DEBUG nova.compute.manager [req-e4bd35f4-039a-446e-b8a3-b07a9d6a7e86 req-85590167-82ab-46c8-ab3d-354dbb346c43 service nova] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] No waiting events found dispatching network-vif-plugged-1bf0b597-4b85-4ce5-b8ab-2a1f399c8a1f {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:49:17 user nova-compute[95467]: WARNING nova.compute.manager [req-e4bd35f4-039a-446e-b8a3-b07a9d6a7e86 req-85590167-82ab-46c8-ab3d-354dbb346c43 service nova] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Received unexpected event network-vif-plugged-1bf0b597-4b85-4ce5-b8ab-2a1f399c8a1f for instance with vm_state building and task_state spawning.
Nov 15 08:49:17 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:49:17 user nova-compute[95467]: DEBUG nova.compute.manager [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Instance event wait completed in 0 seconds for  {{(pid=95467) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 08:49:17 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Guest created on hypervisor {{(pid=95467) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 08:49:17 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Instance spawned successfully.
Nov 15 08:49:17 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 08:49:17 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Found default for hw_cdrom_bus of ide {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:49:17 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Found default for hw_disk_bus of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:49:17 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Found default for hw_input_bus of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:49:17 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Found default for hw_pointer_model of None {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:49:17 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Found default for hw_video_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:49:17 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Found default for hw_vif_model of virtio {{(pid=95467) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 08:49:17 user nova-compute[95467]: INFO nova.compute.manager [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Took 6.07 seconds to spawn the instance on the hypervisor.
Nov 15 08:49:17 user nova-compute[95467]: DEBUG nova.compute.manager [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Checking state {{(pid=95467) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 08:49:17 user nova-compute[95467]: INFO nova.compute.manager [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Took 6.68 seconds to build instance.
Nov 15 08:49:17 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-988b1654-bbea-4bab-a3cc-7ca0a0df971d tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lock "f72e8b13-7532-4900-a356-1c4b4a3b7cc8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.798s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:49:18 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:49:18 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:49:19 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:49:19 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:49:20 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:49:20 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Starting heal instance info cache {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 08:49:20 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Rebuilding the list of instances to heal {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 08:49:20 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "refresh_cache-f72e8b13-7532-4900-a356-1c4b4a3b7cc8" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:49:20 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquired lock "refresh_cache-f72e8b13-7532-4900-a356-1c4b4a3b7cc8" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:49:20 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Forcefully refreshing network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 08:49:20 user nova-compute[95467]: DEBUG nova.objects.instance [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lazy-loading 'info_cache' on Instance uuid f72e8b13-7532-4900-a356-1c4b4a3b7cc8 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:49:21 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Updating instance_info_cache with network_info: [{"id": "1bf0b597-4b85-4ce5-b8ab-2a1f399c8a1f", "address": "fa:16:3e:fe:52:18", "network": {"id": "fbab5af1-c1c6-4bdf-bfe3-b47ff49c5771", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-349235580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41c0dc5f8ffe415cb84df29cff554d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf0b597-4b", "ovs_interfaceid": "1bf0b597-4b85-4ce5-b8ab-2a1f399c8a1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:49:21 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Releasing lock "refresh_cache-f72e8b13-7532-4900-a356-1c4b4a3b7cc8" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:49:21 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Updated the network info_cache for instance {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 08:49:23 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:49:23 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:49:23 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=95467) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 08:49:23 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:49:23 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:49:23 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:49:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:49:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:49:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:49:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:49:38 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:49:38 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:49:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:49:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:49:48 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:49:48 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:49:50 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:49:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:49:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:50:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:50:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:50:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=95467) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 08:50:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:50:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:50:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:50:07 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:50:07 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=95467) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 08:50:08 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:50:08 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:50:08 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=95467) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 08:50:08 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:50:08 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:50:08 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:50:09 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:50:12 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager.update_available_resource {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:50:12 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:50:12 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:50:12 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:50:12 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Auditing locally available compute resources for user (node: user) {{(pid=95467) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 08:50:12 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f72e8b13-7532-4900-a356-1c4b4a3b7cc8/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:50:12 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f72e8b13-7532-4900-a356-1c4b4a3b7cc8/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:50:12 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f72e8b13-7532-4900-a356-1c4b4a3b7cc8/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:50:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f72e8b13-7532-4900-a356-1c4b4a3b7cc8/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:50:13 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:50:13 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:50:13 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Hypervisor/Node resource view: name=user free_ram=9002MB free_disk=25.056655883789062GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=95467) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 08:50:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:50:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:50:13 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance f72e8b13-7532-4900-a356-1c4b4a3b7cc8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:50:13 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 08:50:13 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 08:50:13 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:50:13 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:50:13 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Compute_service record updated for user:user {{(pid=95467) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 08:50:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.212s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:50:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:50:14 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:50:16 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:50:18 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:50:18 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:50:18 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=95467) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 08:50:18 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:50:18 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:50:18 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:50:19 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:50:19 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:50:20 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:50:21 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:50:21 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Starting heal instance info cache {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 08:50:21 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Rebuilding the list of instances to heal {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 08:50:21 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "refresh_cache-f72e8b13-7532-4900-a356-1c4b4a3b7cc8" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:50:21 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquired lock "refresh_cache-f72e8b13-7532-4900-a356-1c4b4a3b7cc8" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:50:21 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Forcefully refreshing network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 08:50:21 user nova-compute[95467]: DEBUG nova.objects.instance [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lazy-loading 'info_cache' on Instance uuid f72e8b13-7532-4900-a356-1c4b4a3b7cc8 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:50:22 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Updating instance_info_cache with network_info: [{"id": "1bf0b597-4b85-4ce5-b8ab-2a1f399c8a1f", "address": "fa:16:3e:fe:52:18", "network": {"id": "fbab5af1-c1c6-4bdf-bfe3-b47ff49c5771", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-349235580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41c0dc5f8ffe415cb84df29cff554d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf0b597-4b", "ovs_interfaceid": "1bf0b597-4b85-4ce5-b8ab-2a1f399c8a1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:50:22 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Releasing lock "refresh_cache-f72e8b13-7532-4900-a356-1c4b4a3b7cc8" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:50:22 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Updated the network info_cache for instance {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 08:50:23 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:50:23 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:50:23 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=95467) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 08:50:23 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:50:23 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:50:23 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:50:25 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:50:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:50:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:50:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:50:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=95467) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 08:50:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:50:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:50:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:50:38 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:50:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:50:48 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:50:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:50:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:50:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=95467) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 08:50:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:50:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:50:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:50:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:51:01 user nova-compute[95467]: DEBUG nova.compute.manager [req-d229bef5-f785-4583-b5aa-ad7999ebc2f2 req-5eab6e15-2a98-4b8b-a5d2-c69ec99a3018 service nova] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Received event network-changed-1bf0b597-4b85-4ce5-b8ab-2a1f399c8a1f {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:51:01 user nova-compute[95467]: DEBUG nova.compute.manager [req-d229bef5-f785-4583-b5aa-ad7999ebc2f2 req-5eab6e15-2a98-4b8b-a5d2-c69ec99a3018 service nova] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Refreshing instance network info cache due to event network-changed-1bf0b597-4b85-4ce5-b8ab-2a1f399c8a1f. {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 08:51:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-d229bef5-f785-4583-b5aa-ad7999ebc2f2 req-5eab6e15-2a98-4b8b-a5d2-c69ec99a3018 service nova] Acquiring lock "refresh_cache-f72e8b13-7532-4900-a356-1c4b4a3b7cc8" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:51:01 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-d229bef5-f785-4583-b5aa-ad7999ebc2f2 req-5eab6e15-2a98-4b8b-a5d2-c69ec99a3018 service nova] Acquired lock "refresh_cache-f72e8b13-7532-4900-a356-1c4b4a3b7cc8" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:51:01 user nova-compute[95467]: DEBUG nova.network.neutron [req-d229bef5-f785-4583-b5aa-ad7999ebc2f2 req-5eab6e15-2a98-4b8b-a5d2-c69ec99a3018 service nova] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Refreshing network info cache for port 1bf0b597-4b85-4ce5-b8ab-2a1f399c8a1f {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 08:51:02 user nova-compute[95467]: DEBUG nova.network.neutron [req-d229bef5-f785-4583-b5aa-ad7999ebc2f2 req-5eab6e15-2a98-4b8b-a5d2-c69ec99a3018 service nova] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Updated VIF entry in instance network info cache for port 1bf0b597-4b85-4ce5-b8ab-2a1f399c8a1f. {{(pid=95467) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 08:51:02 user nova-compute[95467]: DEBUG nova.network.neutron [req-d229bef5-f785-4583-b5aa-ad7999ebc2f2 req-5eab6e15-2a98-4b8b-a5d2-c69ec99a3018 service nova] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Updating instance_info_cache with network_info: [{"id": "1bf0b597-4b85-4ce5-b8ab-2a1f399c8a1f", "address": "fa:16:3e:fe:52:18", "network": {"id": "fbab5af1-c1c6-4bdf-bfe3-b47ff49c5771", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-349235580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41c0dc5f8ffe415cb84df29cff554d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf0b597-4b", "ovs_interfaceid": "1bf0b597-4b85-4ce5-b8ab-2a1f399c8a1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:51:02 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-d229bef5-f785-4583-b5aa-ad7999ebc2f2 req-5eab6e15-2a98-4b8b-a5d2-c69ec99a3018 service nova] Releasing lock "refresh_cache-f72e8b13-7532-4900-a356-1c4b4a3b7cc8" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:51:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:51:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:51:04 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-698e6a19-02a3-4e71-98cf-715556651f35 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Acquiring lock "f72e8b13-7532-4900-a356-1c4b4a3b7cc8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:51:04 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-698e6a19-02a3-4e71-98cf-715556651f35 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lock "f72e8b13-7532-4900-a356-1c4b4a3b7cc8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:51:04 user nova-compute[95467]: DEBUG nova.objects.instance [None req-698e6a19-02a3-4e71-98cf-715556651f35 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lazy-loading 'flavor' on Instance uuid f72e8b13-7532-4900-a356-1c4b4a3b7cc8 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:51:04 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-698e6a19-02a3-4e71-98cf-715556651f35 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lock "f72e8b13-7532-4900-a356-1c4b4a3b7cc8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:51:04 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-698e6a19-02a3-4e71-98cf-715556651f35 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Acquiring lock "f72e8b13-7532-4900-a356-1c4b4a3b7cc8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:51:04 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-698e6a19-02a3-4e71-98cf-715556651f35 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lock "f72e8b13-7532-4900-a356-1c4b4a3b7cc8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:51:04 user nova-compute[95467]: INFO nova.compute.manager [None req-698e6a19-02a3-4e71-98cf-715556651f35 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Attaching volume bab673d5-243a-45d4-95aa-bea9d5fd7697 to /dev/vdb
Nov 15 08:51:04 user nova-compute[95467]: DEBUG os_brick.utils [None req-698e6a19-02a3-4e71-98cf-715556651f35 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:51:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:51:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:51:04 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7116928-c33c-4f37-a982-7fa78a3fa9a9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:882ae90641f\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:51:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:51:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:51:04 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b054cd1-5f48-430f-8c09-8b06e08de002]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:51:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:51:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:51:04 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[1469555c-3b2e-49f0-aed0-03b3d513a604]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:51:04 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ffb2dc-a049-4926-b6ee-95964e9b632d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:51:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-698e6a19-02a3-4e71-98cf-715556651f35 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Running cmd (subprocess): nvme version {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:51:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-698e6a19-02a3-4e71-98cf-715556651f35 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] 'nvme version' failed. Not Retrying. {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:51:04 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.nvmeof [None req-698e6a19-02a3-4e71-98cf-715556651f35 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] nvme not present on system {{(pid=95467) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 08:51:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:51:04 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:51:04 user nova-compute[95467]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 08:51:04 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f2e867-d199-4b64-aeb3-8b62376a08b2]: (4, '') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:51:04 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-698e6a19-02a3-4e71-98cf-715556651f35 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=95467) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 08:51:04 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-698e6a19-02a3-4e71-98cf-715556651f35 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 08:51:04 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-698e6a19-02a3-4e71-98cf-715556651f35 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] LIGHTOS: no hostnqn found. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 08:51:04 user nova-compute[95467]: DEBUG os_brick.utils [None req-698e6a19-02a3-4e71-98cf-715556651f35 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:882ae90641f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:51:04 user nova-compute[95467]: DEBUG nova.virt.block_device [None req-698e6a19-02a3-4e71-98cf-715556651f35 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Updating existing volume attachment record: 555cc851-55d2-44b4-a1ae-199ba5c17c81 {{(pid=95467) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 08:51:08 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:51:08 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:51:08 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=95467) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 08:51:08 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:51:08 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-698e6a19-02a3-4e71-98cf-715556651f35 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Calling os-brick to attach iSCSI Volume {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 08:51:08 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-698e6a19-02a3-4e71-98cf-715556651f35 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bab673d5-243a-45d4-95aa-bea9d5fd7697', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RqNulHKp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:51:08 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-698e6a19-02a3-4e71-98cf-715556651f35 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:51:08 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-698e6a19-02a3-4e71-98cf-715556651f35 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:51:08 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-698e6a19-02a3-4e71-98cf-715556651f35 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:51:08 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-698e6a19-02a3-4e71-98cf-715556651f35 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:51:08 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-698e6a19-02a3-4e71-98cf-715556651f35 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bab673d5-243a-45d4-95aa-bea9d5fd7697" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:51:08 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-698e6a19-02a3-4e71-98cf-715556651f35 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bab673d5-243a-45d4-95aa-bea9d5fd7697" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:51:08 user nova-compute[95467]: INFO os_brick.initiator.connectors.iscsi [None req-698e6a19-02a3-4e71-98cf-715556651f35 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 08:51:08 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bab673d5-243a-45d4-95aa-bea9d5fd7697 -p 172.16.0.220:3260 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:51:08 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bab673d5-243a-45d4-95aa-bea9d5fd7697 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:51:08 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[3393f716-8107-4d11-9c5e-eddb23213fbc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:51:08 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-698e6a19-02a3-4e71-98cf-715556651f35 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 08:51:08 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:51:08 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bab673d5-243a-45d4-95aa-bea9d5fd7697 -p 172.16.0.220:3260 --interface default --op new {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:51:09 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bab673d5-243a-45d4-95aa-bea9d5fd7697 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:51:09 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53e6408-358d-4080-bd0c-ff9dc891b214]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bab673d5-243a-45d4-95aa-bea9d5fd7697] added\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:51:09 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-698e6a19-02a3-4e71-98cf-715556651f35 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bab673d5-243a-45d4-95aa-bea9d5fd7697] added
Nov 15 08:51:09 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:51:09 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bab673d5-243a-45d4-95aa-bea9d5fd7697 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:51:09 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bab673d5-243a-45d4-95aa-bea9d5fd7697 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:51:09 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42c7842-58e7-4b2a-9286-a2ba9a30a126]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:51:09 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-698e6a19-02a3-4e71-98cf-715556651f35 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:51:09 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bab673d5-243a-45d4-95aa-bea9d5fd7697 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:51:09 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bab673d5-243a-45d4-95aa-bea9d5fd7697 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:51:09 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[151204b8-301d-4bf4-9e12-4339540adf98]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:51:09 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-698e6a19-02a3-4e71-98cf-715556651f35 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:51:09 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bab673d5-243a-45d4-95aa-bea9d5fd7697 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RqNulHKp {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:51:09 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bab673d5-243a-45d4-95aa-bea9d5fd7697 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RqNulHKp" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:51:09 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea110fa1-e976-48a0-abf1-0f2d7b0ae3e3]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:51:09 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-698e6a19-02a3-4e71-98cf-715556651f35 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RqNulHKp'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:51:09 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bab673d5-243a-45d4-95aa-bea9d5fd7697 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:51:09 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bab673d5-243a-45d4-95aa-bea9d5fd7697 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:51:09 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f12689-5ee1-4ed8-99ff-5bc5e480c439]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:51:09 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-698e6a19-02a3-4e71-98cf-715556651f35 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:51:09 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:51:09 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:51:09 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[663501da-5a07-4ffc-9b26-a5c77ec27a1c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:51:09 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-698e6a19-02a3-4e71-98cf-715556651f35 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 08:51:09 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:51:09 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-698e6a19-02a3-4e71-98cf-715556651f35 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 08:51:09 user nova-compute[95467]:  {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:51:09 user nova-compute[95467]: WARNING os_brick.initiator.connectors.iscsi [None req-698e6a19-02a3-4e71-98cf-715556651f35 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 08:51:09 user nova-compute[95467]: 
Nov 15 08:51:09 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bab673d5-243a-45d4-95aa-bea9d5fd7697 -p 172.16.0.220:3260 --login {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:51:09 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bab673d5-243a-45d4-95aa-bea9d5fd7697 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:51:09 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[990651bd-6fb6-4c59-bc24-368147e0c797]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bab673d5-243a-45d4-95aa-bea9d5fd7697, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bab673d5-243a-45d4-95aa-bea9d5fd7697, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:51:09 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-698e6a19-02a3-4e71-98cf-715556651f35 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bab673d5-243a-45d4-95aa-bea9d5fd7697, portal: 172.16.0.220,3260]
Nov 15 08:51:09 user nova-compute[95467]: Login to [iface: default, target: iqn.2010-10.org.openstack:bab673d5-243a-45d4-95aa-bea9d5fd7697, portal: 172.16.0.220,3260] successful.
Nov 15 08:51:09 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:51:09 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bab673d5-243a-45d4-95aa-bea9d5fd7697 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:51:09 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bab673d5-243a-45d4-95aa-bea9d5fd7697 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:51:09 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6943af8-6937-407d-b346-a6fb5b258dd2]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:51:09 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-698e6a19-02a3-4e71-98cf-715556651f35 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:51:09 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:51:09 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:51:09 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed475f8b-c17c-4d89-a763-4f2666344af1]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bab673d5-243a-45d4-95aa-bea9d5fd7697 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:51:09 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-698e6a19-02a3-4e71-98cf-715556651f35 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bab673d5-243a-45d4-95aa-bea9d5fd7697 (non-flash)
Nov 15 08:51:09 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:51:09 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-698e6a19-02a3-4e71-98cf-715556651f35 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bab673d5-243a-45d4-95aa-bea9d5fd7697 (non-flash)
Nov 15 08:51:09 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:51:09 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-698e6a19-02a3-4e71-98cf-715556651f35 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bab673d5-243a-45d4-95aa-bea9d5fd7697" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.246s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:51:09 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-698e6a19-02a3-4e71-98cf-715556651f35 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Connected to 172.16.0.220:3260 {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 08:51:09 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-698e6a19-02a3-4e71-98cf-715556651f35 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=95467) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 08:51:09 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-698e6a19-02a3-4e71-98cf-715556651f35 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=95467) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 08:51:09 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:51:09 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:51:09 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68f14c6-a828-46c1-b954-f95c8b4d3d91]: (4, ('- - 0', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:51:09 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-698e6a19-02a3-4e71-98cf-715556651f35 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:51:09 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-698e6a19-02a3-4e71-98cf-715556651f35 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:bab673d5-243a-45d4-95aa-bea9d5fd7697', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RqNulHKp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 08:51:10 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-698e6a19-02a3-4e71-98cf-715556651f35 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:51:10 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-698e6a19-02a3-4e71-98cf-715556651f35 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '26136653138613037', 'path': '/dev/sdb'} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:51:10 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-698e6a19-02a3-4e71-98cf-715556651f35 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26136653138613037', 'path': '/dev/sdb'} {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 08:51:10 user nova-compute[95467]: DEBUG nova.objects.instance [None req-698e6a19-02a3-4e71-98cf-715556651f35 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lazy-loading 'flavor' on Instance uuid f72e8b13-7532-4900-a356-1c4b4a3b7cc8 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:51:10 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-698e6a19-02a3-4e71-98cf-715556651f35 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 08:51:10 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:51:10 user nova-compute[95467]:   <source dev="/dev/sdb"/>
Nov 15 08:51:10 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:51:10 user nova-compute[95467]:   <serial>bab673d5-243a-45d4-95aa-bea9d5fd7697</serial>
Nov 15 08:51:10 user nova-compute[95467]: </disk>
Nov 15 08:51:10 user nova-compute[95467]:  {{(pid=95467) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 08:51:10 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-698e6a19-02a3-4e71-98cf-715556651f35 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:51:10 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-698e6a19-02a3-4e71-98cf-715556651f35 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] No BDM found with device name vdb, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:51:10 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-698e6a19-02a3-4e71-98cf-715556651f35 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] No VIF found with MAC fa:16:3e:fe:52:18, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:51:10 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-698e6a19-02a3-4e71-98cf-715556651f35 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lock "f72e8b13-7532-4900-a356-1c4b4a3b7cc8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.368s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:51:11 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:51:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:51:13 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager.update_available_resource {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:51:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:51:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:51:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:51:13 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Auditing locally available compute resources for user (node: user) {{(pid=95467) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 08:51:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f72e8b13-7532-4900-a356-1c4b4a3b7cc8/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:51:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:51:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f72e8b13-7532-4900-a356-1c4b4a3b7cc8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:51:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f72e8b13-7532-4900-a356-1c4b4a3b7cc8/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:51:14 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f72e8b13-7532-4900-a356-1c4b4a3b7cc8/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:51:14 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=95467) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 08:51:14 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:51:14 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:51:14 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Hypervisor/Node resource view: name=user free_ram=9010MB free_disk=25.047863006591797GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=95467) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 08:51:14 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:51:14 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:51:14 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance f72e8b13-7532-4900-a356-1c4b4a3b7cc8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:51:14 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 08:51:14 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 08:51:14 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Refreshing inventories for resource provider f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 08:51:14 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Updating ProviderTree inventory for provider f56c3524-ed11-494e-82e4-b1a23920d1ae from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 08:51:14 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Updating inventory in ProviderTree for provider f56c3524-ed11-494e-82e4-b1a23920d1ae with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 08:51:14 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Refreshing aggregate associations for resource provider f56c3524-ed11-494e-82e4-b1a23920d1ae, aggregates: None {{(pid=95467) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 08:51:14 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Refreshing trait associations for resource provider f56c3524-ed11-494e-82e4-b1a23920d1ae, traits: COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSSE3,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI {{(pid=95467) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 08:51:14 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:51:14 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:51:14 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Compute_service record updated for user:user {{(pid=95467) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 08:51:14 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.491s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:51:15 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:51:16 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:51:16 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:51:17 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:51:17 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Cleaning up deleted instances with incomplete migration  {{(pid=95467) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 08:51:18 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:51:18 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:51:19 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:51:20 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f406e0df-354c-4934-81ce-df5ebdb0d1bb tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Acquiring lock "f72e8b13-7532-4900-a356-1c4b4a3b7cc8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:51:20 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f406e0df-354c-4934-81ce-df5ebdb0d1bb tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lock "f72e8b13-7532-4900-a356-1c4b4a3b7cc8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:51:20 user nova-compute[95467]: INFO nova.compute.manager [None req-f406e0df-354c-4934-81ce-df5ebdb0d1bb tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Detaching volume bab673d5-243a-45d4-95aa-bea9d5fd7697
Nov 15 08:51:20 user nova-compute[95467]: INFO nova.virt.block_device [None req-f406e0df-354c-4934-81ce-df5ebdb0d1bb tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Attempting to driver detach volume bab673d5-243a-45d4-95aa-bea9d5fd7697 from mountpoint /dev/vdb
Nov 15 08:51:20 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-f406e0df-354c-4934-81ce-df5ebdb0d1bb tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Attempting to detach device vdb from instance f72e8b13-7532-4900-a356-1c4b4a3b7cc8 from the persistent domain config. {{(pid=95467) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 08:51:20 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-f406e0df-354c-4934-81ce-df5ebdb0d1bb tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 08:51:20 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:51:20 user nova-compute[95467]:   <source dev="/dev/sdb"/>
Nov 15 08:51:20 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:51:20 user nova-compute[95467]:   <serial>bab673d5-243a-45d4-95aa-bea9d5fd7697</serial>
Nov 15 08:51:20 user nova-compute[95467]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 08:51:20 user nova-compute[95467]: </disk>
Nov 15 08:51:20 user nova-compute[95467]:  {{(pid=95467) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 08:51:20 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-f406e0df-354c-4934-81ce-df5ebdb0d1bb tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Successfully detached device vdb from instance f72e8b13-7532-4900-a356-1c4b4a3b7cc8 from the persistent domain config.
Nov 15 08:51:20 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-f406e0df-354c-4934-81ce-df5ebdb0d1bb tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f72e8b13-7532-4900-a356-1c4b4a3b7cc8 from the live domain config. {{(pid=95467) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 08:51:20 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-f406e0df-354c-4934-81ce-df5ebdb0d1bb tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 08:51:20 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:51:20 user nova-compute[95467]:   <source dev="/dev/sdb"/>
Nov 15 08:51:20 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:51:20 user nova-compute[95467]:   <serial>bab673d5-243a-45d4-95aa-bea9d5fd7697</serial>
Nov 15 08:51:20 user nova-compute[95467]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 08:51:20 user nova-compute[95467]: </disk>
Nov 15 08:51:20 user nova-compute[95467]:  {{(pid=95467) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 08:51:20 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:51:20 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-f406e0df-354c-4934-81ce-df5ebdb0d1bb tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f72e8b13-7532-4900-a356-1c4b4a3b7cc8 {{(pid=95467) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 08:51:22 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:51:23 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:51:23 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Starting heal instance info cache {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 08:51:23 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Rebuilding the list of instances to heal {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 08:51:23 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "refresh_cache-f72e8b13-7532-4900-a356-1c4b4a3b7cc8" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:51:23 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquired lock "refresh_cache-f72e8b13-7532-4900-a356-1c4b4a3b7cc8" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:51:23 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Forcefully refreshing network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 08:51:23 user nova-compute[95467]: DEBUG nova.objects.instance [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lazy-loading 'info_cache' on Instance uuid f72e8b13-7532-4900-a356-1c4b4a3b7cc8 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:51:23 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:51:23 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:51:23 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=95467) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 08:51:23 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:51:23 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:51:23 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:51:24 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Updating instance_info_cache with network_info: [{"id": "1bf0b597-4b85-4ce5-b8ab-2a1f399c8a1f", "address": "fa:16:3e:fe:52:18", "network": {"id": "fbab5af1-c1c6-4bdf-bfe3-b47ff49c5771", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-349235580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41c0dc5f8ffe415cb84df29cff554d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf0b597-4b", "ovs_interfaceid": "1bf0b597-4b85-4ce5-b8ab-2a1f399c8a1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:51:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Releasing lock "refresh_cache-f72e8b13-7532-4900-a356-1c4b4a3b7cc8" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:51:24 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Updated the network info_cache for instance {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 08:51:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:51:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:51:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=95467) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 08:51:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:51:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:51:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:51:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:51:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:51:35 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:51:35 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Cleaning up deleted instances {{(pid=95467) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 08:51:35 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] There are 0 instances to clean {{(pid=95467) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 08:51:38 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:51:38 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:51:38 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=95467) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 08:51:38 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:51:38 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:51:38 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:51:40 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-f406e0df-354c-4934-81ce-df5ebdb0d1bb tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f72e8b13-7532-4900-a356-1c4b4a3b7cc8 is timed out.
Nov 15 08:51:40 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-f406e0df-354c-4934-81ce-df5ebdb0d1bb tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Successfully detached device vdb from instance f72e8b13-7532-4900-a356-1c4b4a3b7cc8 from the live domain config.
Nov 15 08:51:40 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f406e0df-354c-4934-81ce-df5ebdb0d1bb tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] calling os-brick to detach iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 08:51:40 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f406e0df-354c-4934-81ce-df5ebdb0d1bb tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, {'target_iqn': 'iqn.2010-10.org.openstack:bab673d5-243a-45d4-95aa-bea9d5fd7697', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RqNulHKp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:51:40 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-f406e0df-354c-4934-81ce-df5ebdb0d1bb tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:51:40 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-f406e0df-354c-4934-81ce-df5ebdb0d1bb tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:51:40 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-f406e0df-354c-4934-81ce-df5ebdb0d1bb tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:51:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:51:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:51:40 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[35253c04-058e-4ee3-ba83-4ffcc3c248a6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bab673d5-243a-45d4-95aa-bea9d5fd7697\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:51:40 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f406e0df-354c-4934-81ce-df5ebdb0d1bb tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 08:51:40 user nova-compute[95467]: No targets found.
Nov 15 08:51:40 user nova-compute[95467]: iSNS:
Nov 15 08:51:40 user nova-compute[95467]: No targets found.
Nov 15 08:51:40 user nova-compute[95467]: STATIC:
Nov 15 08:51:40 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:bab673d5-243a-45d4-95aa-bea9d5fd7697
Nov 15 08:51:40 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:51:40 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:51:40 user nova-compute[95467]: FIRMWARE:
Nov 15 08:51:40 user nova-compute[95467]: No targets found.
Nov 15 08:51:40 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:51:40 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f406e0df-354c-4934-81ce-df5ebdb0d1bb tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 08:51:40 user nova-compute[95467]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 08:51:40 user nova-compute[95467]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=95467) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 08:51:40 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f406e0df-354c-4934-81ce-df5ebdb0d1bb tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bab673d5-243a-45d4-95aa-bea9d5fd7697', 0)] {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 08:51:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:51:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:51:40 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[1faa314c-6072-4126-b94b-b255bc18f196]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bab673d5-243a-45d4-95aa-bea9d5fd7697\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:51:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:51:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:51:40 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd08106-f2d3-4802-b3dd-ef89eb47bdcd]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bab673d5-243a-45d4-95aa-bea9d5fd7697 (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:51:40 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f406e0df-354c-4934-81ce-df5ebdb0d1bb tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bab673d5-243a-45d4-95aa-bea9d5fd7697 (non-flash)
Nov 15 08:51:40 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:51:40 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f406e0df-354c-4934-81ce-df5ebdb0d1bb tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bab673d5-243a-45d4-95aa-bea9d5fd7697 (non-flash)
Nov 15 08:51:40 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:51:40 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f406e0df-354c-4934-81ce-df5ebdb0d1bb tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efec824aef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bab673d5-243a-45d4-95aa-bea9d5fd7697'): ({'sdb'}, set())}) {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 08:51:40 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-f406e0df-354c-4934-81ce-df5ebdb0d1bb tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Removing single pathed devices sdb {{(pid=95467) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 08:51:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:51:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:51:40 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[148c8e54-81f6-40a4-803f-2e3ea5e5ca93]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:51:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:51:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:51:40 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b182b40d-4877-48c2-a977-dfd75fdf3f6f]: (4, ('ok\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:51:40 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-f406e0df-354c-4934-81ce-df5ebdb0d1bb tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Flushing IO for device /dev/sdb {{(pid=95467) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 08:51:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:51:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:51:40 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c22a74-ed04-4c3b-a1fc-4c786e4527d8]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:51:40 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-f406e0df-354c-4934-81ce-df5ebdb0d1bb tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=95467) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 08:51:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:51:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:51:40 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5e4034-e6a8-48bb-8412-1371534f1b2d]: (4, ('1', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:51:40 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-f406e0df-354c-4934-81ce-df5ebdb0d1bb tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 08:51:40 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-f406e0df-354c-4934-81ce-df5ebdb0d1bb tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] SCSI volumes sdb have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 08:51:40 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f406e0df-354c-4934-81ce-df5ebdb0d1bb tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bab673d5-243a-45d4-95aa-bea9d5fd7697')] {{(pid=95467) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 08:51:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bab673d5-243a-45d4-95aa-bea9d5fd7697 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:51:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bab673d5-243a-45d4-95aa-bea9d5fd7697 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:51:40 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[92896e53-86f7-4331-9dc4-f9ba7b324b5e]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:51:40 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f406e0df-354c-4934-81ce-df5ebdb0d1bb tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:51:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bab673d5-243a-45d4-95aa-bea9d5fd7697 -p 172.16.0.220:3260 --logout {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:51:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bab673d5-243a-45d4-95aa-bea9d5fd7697 -p 172.16.0.220:3260 --logout" returned: 0 in 0.041s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:51:40 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb05316f-9e0c-4659-b0b6-135b6d265220]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:bab673d5-243a-45d4-95aa-bea9d5fd7697, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:bab673d5-243a-45d4-95aa-bea9d5fd7697, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:51:40 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f406e0df-354c-4934-81ce-df5ebdb0d1bb tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:bab673d5-243a-45d4-95aa-bea9d5fd7697, portal: 172.16.0.220,3260]
Nov 15 08:51:40 user nova-compute[95467]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:bab673d5-243a-45d4-95aa-bea9d5fd7697, portal: 172.16.0.220,3260] successful.
Nov 15 08:51:40 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:51:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bab673d5-243a-45d4-95aa-bea9d5fd7697 -p 172.16.0.220:3260 --op delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:51:40 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bab673d5-243a-45d4-95aa-bea9d5fd7697 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:51:40 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63646bb-5d70-4944-b403-26c12aac5e6a]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:51:40 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f406e0df-354c-4934-81ce-df5ebdb0d1bb tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:51:40 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-f406e0df-354c-4934-81ce-df5ebdb0d1bb tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.267s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:51:40 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-f406e0df-354c-4934-81ce-df5ebdb0d1bb tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] <== disconnect_volume: return (268ms) None {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:51:40 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f406e0df-354c-4934-81ce-df5ebdb0d1bb tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Disconnected iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 08:51:41 user nova-compute[95467]: DEBUG nova.objects.instance [None req-f406e0df-354c-4934-81ce-df5ebdb0d1bb tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lazy-loading 'flavor' on Instance uuid f72e8b13-7532-4900-a356-1c4b4a3b7cc8 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:51:41 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-f406e0df-354c-4934-81ce-df5ebdb0d1bb tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lock "f72e8b13-7532-4900-a356-1c4b4a3b7cc8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.683s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:51:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:51:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:51:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=95467) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 08:51:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:51:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:51:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:51:48 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:51:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:51:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:51:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=95467) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 08:51:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:51:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:51:53 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:51:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:51:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:51:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=95467) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 08:51:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:51:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:51:58 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:52:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:52:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:52:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=95467) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 08:52:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:52:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:52:03 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:52:08 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:52:08 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=95467) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 08:52:08 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:52:08 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:52:08 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=95467) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 08:52:08 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:52:08 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:52:08 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:52:12 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-58cf8894-40d4-4441-bab3-30ff22885cee tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Acquiring lock "f72e8b13-7532-4900-a356-1c4b4a3b7cc8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:52:12 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-58cf8894-40d4-4441-bab3-30ff22885cee tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lock "f72e8b13-7532-4900-a356-1c4b4a3b7cc8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:52:12 user nova-compute[95467]: DEBUG nova.objects.instance [None req-58cf8894-40d4-4441-bab3-30ff22885cee tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lazy-loading 'flavor' on Instance uuid f72e8b13-7532-4900-a356-1c4b4a3b7cc8 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:52:12 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-58cf8894-40d4-4441-bab3-30ff22885cee tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lock "f72e8b13-7532-4900-a356-1c4b4a3b7cc8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.154s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:52:12 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-58cf8894-40d4-4441-bab3-30ff22885cee tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Acquiring lock "f72e8b13-7532-4900-a356-1c4b4a3b7cc8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:52:12 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-58cf8894-40d4-4441-bab3-30ff22885cee tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lock "f72e8b13-7532-4900-a356-1c4b4a3b7cc8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:52:12 user nova-compute[95467]: INFO nova.compute.manager [None req-58cf8894-40d4-4441-bab3-30ff22885cee tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Attaching volume 88d6fab0-f54b-4637-b945-a0dfeb0eb7fc to /dev/vdb
Nov 15 08:52:12 user nova-compute[95467]: DEBUG os_brick.utils [None req-58cf8894-40d4-4441-bab3-30ff22885cee tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:52:12 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:52:12 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:52:12 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[704798ff-85c3-47f6-8cae-b519f1b78c18]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:882ae90641f\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:52:12 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:52:12 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:52:12 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11ab0f7-e79f-4c81-8c3b-a8a03e9439b6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:52:12 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:52:12 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:52:12 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[366d8055-0f5c-49d4-a349-f1c476a9e414]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:52:12 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff7bbfb-7977-469e-b841-eeaaefb49b07]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:52:12 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-58cf8894-40d4-4441-bab3-30ff22885cee tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Running cmd (subprocess): nvme version {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:52:12 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-58cf8894-40d4-4441-bab3-30ff22885cee tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] 'nvme version' failed. Not Retrying. {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:52:12 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.nvmeof [None req-58cf8894-40d4-4441-bab3-30ff22885cee tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] nvme not present on system {{(pid=95467) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 08:52:12 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:52:12 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:52:12 user nova-compute[95467]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 08:52:12 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a4aa9f-80f5-4b99-aaad-c765dcc3fb62]: (4, '') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:52:12 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-58cf8894-40d4-4441-bab3-30ff22885cee tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=95467) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 08:52:12 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-58cf8894-40d4-4441-bab3-30ff22885cee tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 08:52:12 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-58cf8894-40d4-4441-bab3-30ff22885cee tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] LIGHTOS: no hostnqn found. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 08:52:12 user nova-compute[95467]: DEBUG os_brick.utils [None req-58cf8894-40d4-4441-bab3-30ff22885cee tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:882ae90641f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:52:12 user nova-compute[95467]: DEBUG nova.virt.block_device [None req-58cf8894-40d4-4441-bab3-30ff22885cee tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Updating existing volume attachment record: c0f69778-8bad-4b62-a42f-31811717bff2 {{(pid=95467) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 08:52:12 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:52:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:52:13 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager.update_available_resource {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:52:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:52:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:52:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:52:13 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Auditing locally available compute resources for user (node: user) {{(pid=95467) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 08:52:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f72e8b13-7532-4900-a356-1c4b4a3b7cc8/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:52:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f72e8b13-7532-4900-a356-1c4b4a3b7cc8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:52:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f72e8b13-7532-4900-a356-1c4b4a3b7cc8/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:52:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:52:14 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f72e8b13-7532-4900-a356-1c4b4a3b7cc8/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:52:14 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:52:14 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:52:14 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Hypervisor/Node resource view: name=user free_ram=9031MB free_disk=25.046886444091797GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=95467) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 08:52:14 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:52:14 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:52:14 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance f72e8b13-7532-4900-a356-1c4b4a3b7cc8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:52:14 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 08:52:14 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 08:52:14 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:52:14 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:52:14 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Compute_service record updated for user:user {{(pid=95467) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 08:52:14 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.173s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:52:17 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58cf8894-40d4-4441-bab3-30ff22885cee tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Calling os-brick to attach iSCSI Volume {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 08:52:17 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-58cf8894-40d4-4441-bab3-30ff22885cee tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:88d6fab0-f54b-4637-b945-a0dfeb0eb7fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dzLyUrTp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:52:17 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-58cf8894-40d4-4441-bab3-30ff22885cee tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:52:17 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-58cf8894-40d4-4441-bab3-30ff22885cee tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:52:17 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-58cf8894-40d4-4441-bab3-30ff22885cee tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:52:17 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-58cf8894-40d4-4441-bab3-30ff22885cee tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:52:17 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-58cf8894-40d4-4441-bab3-30ff22885cee tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88d6fab0-f54b-4637-b945-a0dfeb0eb7fc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:52:17 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-58cf8894-40d4-4441-bab3-30ff22885cee tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88d6fab0-f54b-4637-b945-a0dfeb0eb7fc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:52:17 user nova-compute[95467]: INFO os_brick.initiator.connectors.iscsi [None req-58cf8894-40d4-4441-bab3-30ff22885cee tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 08:52:17 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88d6fab0-f54b-4637-b945-a0dfeb0eb7fc -p 172.16.0.220:3260 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:52:17 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88d6fab0-f54b-4637-b945-a0dfeb0eb7fc -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:52:17 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[63760bb5-04f3-40f6-be0e-ec01dc2c2eda]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:52:17 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-58cf8894-40d4-4441-bab3-30ff22885cee tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 08:52:17 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:52:17 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88d6fab0-f54b-4637-b945-a0dfeb0eb7fc -p 172.16.0.220:3260 --interface default --op new {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:52:17 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88d6fab0-f54b-4637-b945-a0dfeb0eb7fc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:52:17 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf5e5e6c-5d0e-4d7b-b121-268a2b15126c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:88d6fab0-f54b-4637-b945-a0dfeb0eb7fc] added\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:52:17 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-58cf8894-40d4-4441-bab3-30ff22885cee tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:88d6fab0-f54b-4637-b945-a0dfeb0eb7fc] added
Nov 15 08:52:17 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:52:17 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88d6fab0-f54b-4637-b945-a0dfeb0eb7fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:52:17 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88d6fab0-f54b-4637-b945-a0dfeb0eb7fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:52:17 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2094cea-602e-4961-b633-bd247a062bbd]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:52:17 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-58cf8894-40d4-4441-bab3-30ff22885cee tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:52:17 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88d6fab0-f54b-4637-b945-a0dfeb0eb7fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:52:17 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88d6fab0-f54b-4637-b945-a0dfeb0eb7fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:52:17 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[636b9c7f-4b73-47b1-afd2-314cd45076c6]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:52:17 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-58cf8894-40d4-4441-bab3-30ff22885cee tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:52:17 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88d6fab0-f54b-4637-b945-a0dfeb0eb7fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dzLyUrTp {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:52:17 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88d6fab0-f54b-4637-b945-a0dfeb0eb7fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dzLyUrTp" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:52:17 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e066e0a-8f8d-483e-94ee-1dad806ab103]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:52:17 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-58cf8894-40d4-4441-bab3-30ff22885cee tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dzLyUrTp'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:52:17 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88d6fab0-f54b-4637-b945-a0dfeb0eb7fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:52:17 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88d6fab0-f54b-4637-b945-a0dfeb0eb7fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:52:17 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa12e43-3714-4ca3-a9e4-e718030305fd]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:52:17 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-58cf8894-40d4-4441-bab3-30ff22885cee tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:52:17 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:52:17 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.025s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:52:17 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ec26e6-45ec-4efb-a42c-74cb6ad855a4]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:52:17 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-58cf8894-40d4-4441-bab3-30ff22885cee tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 08:52:17 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:52:17 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-58cf8894-40d4-4441-bab3-30ff22885cee tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 08:52:17 user nova-compute[95467]:  {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:52:17 user nova-compute[95467]: WARNING os_brick.initiator.connectors.iscsi [None req-58cf8894-40d4-4441-bab3-30ff22885cee tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 08:52:17 user nova-compute[95467]: 
Nov 15 08:52:17 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88d6fab0-f54b-4637-b945-a0dfeb0eb7fc -p 172.16.0.220:3260 --login {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:52:17 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88d6fab0-f54b-4637-b945-a0dfeb0eb7fc -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:52:17 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[98840821-095c-4031-bb1e-97ec0b3e67de]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:88d6fab0-f54b-4637-b945-a0dfeb0eb7fc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:88d6fab0-f54b-4637-b945-a0dfeb0eb7fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:52:17 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-58cf8894-40d4-4441-bab3-30ff22885cee tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:88d6fab0-f54b-4637-b945-a0dfeb0eb7fc, portal: 172.16.0.220,3260]
Nov 15 08:52:17 user nova-compute[95467]: Login to [iface: default, target: iqn.2010-10.org.openstack:88d6fab0-f54b-4637-b945-a0dfeb0eb7fc, portal: 172.16.0.220,3260] successful.
Nov 15 08:52:17 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:52:17 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88d6fab0-f54b-4637-b945-a0dfeb0eb7fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:52:17 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88d6fab0-f54b-4637-b945-a0dfeb0eb7fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:52:17 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98dfd97-1168-4e8f-be11-f811f41eed3a]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:52:17 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-58cf8894-40d4-4441-bab3-30ff22885cee tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:52:17 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:52:17 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:52:17 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a052aa6-fc8a-445a-bfa3-958f7111404c]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d6fab0-f54b-4637-b945-a0dfeb0eb7fc (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:52:17 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-58cf8894-40d4-4441-bab3-30ff22885cee tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d6fab0-f54b-4637-b945-a0dfeb0eb7fc (non-flash)
Nov 15 08:52:17 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:52:17 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-58cf8894-40d4-4441-bab3-30ff22885cee tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d6fab0-f54b-4637-b945-a0dfeb0eb7fc (non-flash)
Nov 15 08:52:17 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:52:17 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-58cf8894-40d4-4441-bab3-30ff22885cee tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88d6fab0-f54b-4637-b945-a0dfeb0eb7fc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:52:17 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-58cf8894-40d4-4441-bab3-30ff22885cee tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Connected to 172.16.0.220:3260 {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 08:52:17 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-58cf8894-40d4-4441-bab3-30ff22885cee tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=95467) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 08:52:17 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-58cf8894-40d4-4441-bab3-30ff22885cee tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=95467) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 08:52:17 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:52:17 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:52:17 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd817a83-7906-491e-9f51-d74588b1373b]: (4, ('- - 0', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:52:17 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-58cf8894-40d4-4441-bab3-30ff22885cee tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:52:17 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-58cf8894-40d4-4441-bab3-30ff22885cee tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:88d6fab0-f54b-4637-b945-a0dfeb0eb7fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dzLyUrTp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 08:52:17 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:52:17 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:52:18 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-58cf8894-40d4-4441-bab3-30ff22885cee tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:52:18 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-58cf8894-40d4-4441-bab3-30ff22885cee tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '23361376462313235', 'path': '/dev/sdb'} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:52:18 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58cf8894-40d4-4441-bab3-30ff22885cee tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23361376462313235', 'path': '/dev/sdb'} {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 08:52:18 user nova-compute[95467]: DEBUG nova.objects.instance [None req-58cf8894-40d4-4441-bab3-30ff22885cee tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lazy-loading 'flavor' on Instance uuid f72e8b13-7532-4900-a356-1c4b4a3b7cc8 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:52:18 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-58cf8894-40d4-4441-bab3-30ff22885cee tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 08:52:18 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:52:18 user nova-compute[95467]:   <source dev="/dev/sdb"/>
Nov 15 08:52:18 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:52:18 user nova-compute[95467]:   <serial>88d6fab0-f54b-4637-b945-a0dfeb0eb7fc</serial>
Nov 15 08:52:18 user nova-compute[95467]: </disk>
Nov 15 08:52:18 user nova-compute[95467]:  {{(pid=95467) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 08:52:18 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-58cf8894-40d4-4441-bab3-30ff22885cee tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:52:18 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-58cf8894-40d4-4441-bab3-30ff22885cee tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] No BDM found with device name vdb, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:52:18 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-58cf8894-40d4-4441-bab3-30ff22885cee tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] No VIF found with MAC fa:16:3e:fe:52:18, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:52:18 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-58cf8894-40d4-4441-bab3-30ff22885cee tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lock "f72e8b13-7532-4900-a356-1c4b4a3b7cc8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.459s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:52:18 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:52:18 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:52:18 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=95467) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 08:52:18 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:52:18 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:52:18 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:52:20 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:52:21 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:52:21 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-777725c3-3e7b-43a5-80f6-c2152b9ef253 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Acquiring lock "f72e8b13-7532-4900-a356-1c4b4a3b7cc8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:52:21 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-777725c3-3e7b-43a5-80f6-c2152b9ef253 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lock "f72e8b13-7532-4900-a356-1c4b4a3b7cc8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:52:21 user nova-compute[95467]: INFO nova.compute.manager [None req-777725c3-3e7b-43a5-80f6-c2152b9ef253 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Detaching volume 88d6fab0-f54b-4637-b945-a0dfeb0eb7fc
Nov 15 08:52:21 user nova-compute[95467]: INFO nova.virt.block_device [None req-777725c3-3e7b-43a5-80f6-c2152b9ef253 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Attempting to driver detach volume 88d6fab0-f54b-4637-b945-a0dfeb0eb7fc from mountpoint /dev/vdb
Nov 15 08:52:21 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-777725c3-3e7b-43a5-80f6-c2152b9ef253 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Attempting to detach device vdb from instance f72e8b13-7532-4900-a356-1c4b4a3b7cc8 from the persistent domain config. {{(pid=95467) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 08:52:21 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-777725c3-3e7b-43a5-80f6-c2152b9ef253 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 08:52:21 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:52:21 user nova-compute[95467]:   <source dev="/dev/sdb"/>
Nov 15 08:52:21 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:52:21 user nova-compute[95467]:   <serial>88d6fab0-f54b-4637-b945-a0dfeb0eb7fc</serial>
Nov 15 08:52:21 user nova-compute[95467]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 08:52:21 user nova-compute[95467]: </disk>
Nov 15 08:52:21 user nova-compute[95467]:  {{(pid=95467) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 08:52:21 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-777725c3-3e7b-43a5-80f6-c2152b9ef253 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Successfully detached device vdb from instance f72e8b13-7532-4900-a356-1c4b4a3b7cc8 from the persistent domain config.
Nov 15 08:52:21 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-777725c3-3e7b-43a5-80f6-c2152b9ef253 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f72e8b13-7532-4900-a356-1c4b4a3b7cc8 from the live domain config. {{(pid=95467) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 08:52:21 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-777725c3-3e7b-43a5-80f6-c2152b9ef253 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 08:52:21 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:52:21 user nova-compute[95467]:   <source dev="/dev/sdb"/>
Nov 15 08:52:21 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:52:21 user nova-compute[95467]:   <serial>88d6fab0-f54b-4637-b945-a0dfeb0eb7fc</serial>
Nov 15 08:52:21 user nova-compute[95467]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 08:52:21 user nova-compute[95467]: </disk>
Nov 15 08:52:21 user nova-compute[95467]:  {{(pid=95467) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 08:52:22 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-777725c3-3e7b-43a5-80f6-c2152b9ef253 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f72e8b13-7532-4900-a356-1c4b4a3b7cc8 {{(pid=95467) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 08:52:22 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:52:23 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:52:23 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:52:24 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:52:24 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Starting heal instance info cache {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 08:52:24 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Rebuilding the list of instances to heal {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 08:52:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "refresh_cache-f72e8b13-7532-4900-a356-1c4b4a3b7cc8" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:52:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquired lock "refresh_cache-f72e8b13-7532-4900-a356-1c4b4a3b7cc8" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:52:24 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Forcefully refreshing network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 08:52:24 user nova-compute[95467]: DEBUG nova.objects.instance [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lazy-loading 'info_cache' on Instance uuid f72e8b13-7532-4900-a356-1c4b4a3b7cc8 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:52:25 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Updating instance_info_cache with network_info: [{"id": "1bf0b597-4b85-4ce5-b8ab-2a1f399c8a1f", "address": "fa:16:3e:fe:52:18", "network": {"id": "fbab5af1-c1c6-4bdf-bfe3-b47ff49c5771", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-349235580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41c0dc5f8ffe415cb84df29cff554d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf0b597-4b", "ovs_interfaceid": "1bf0b597-4b85-4ce5-b8ab-2a1f399c8a1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:52:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Releasing lock "refresh_cache-f72e8b13-7532-4900-a356-1c4b4a3b7cc8" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:52:25 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Updated the network info_cache for instance {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 08:52:28 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:52:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:52:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:52:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=95467) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 08:52:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:52:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:52:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:52:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:52:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:52:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=95467) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 08:52:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:52:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:52:33 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:52:38 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:52:42 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-777725c3-3e7b-43a5-80f6-c2152b9ef253 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f72e8b13-7532-4900-a356-1c4b4a3b7cc8 is timed out.
Nov 15 08:52:42 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-777725c3-3e7b-43a5-80f6-c2152b9ef253 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Successfully detached device vdb from instance f72e8b13-7532-4900-a356-1c4b4a3b7cc8 from the live domain config.
Nov 15 08:52:42 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-777725c3-3e7b-43a5-80f6-c2152b9ef253 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] calling os-brick to detach iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 08:52:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-777725c3-3e7b-43a5-80f6-c2152b9ef253 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, {'target_iqn': 'iqn.2010-10.org.openstack:88d6fab0-f54b-4637-b945-a0dfeb0eb7fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dzLyUrTp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:52:42 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-777725c3-3e7b-43a5-80f6-c2152b9ef253 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:52:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-777725c3-3e7b-43a5-80f6-c2152b9ef253 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:52:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-777725c3-3e7b-43a5-80f6-c2152b9ef253 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:52:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:52:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:52:42 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[0006a1da-51d0-4d03-8ed0-627b1f21f5b2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:88d6fab0-f54b-4637-b945-a0dfeb0eb7fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:52:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-777725c3-3e7b-43a5-80f6-c2152b9ef253 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 08:52:42 user nova-compute[95467]: No targets found.
Nov 15 08:52:42 user nova-compute[95467]: iSNS:
Nov 15 08:52:42 user nova-compute[95467]: No targets found.
Nov 15 08:52:42 user nova-compute[95467]: STATIC:
Nov 15 08:52:42 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:88d6fab0-f54b-4637-b945-a0dfeb0eb7fc
Nov 15 08:52:42 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:52:42 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:52:42 user nova-compute[95467]: FIRMWARE:
Nov 15 08:52:42 user nova-compute[95467]: No targets found.
Nov 15 08:52:42 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:52:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-777725c3-3e7b-43a5-80f6-c2152b9ef253 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 08:52:42 user nova-compute[95467]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 08:52:42 user nova-compute[95467]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=95467) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 08:52:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-777725c3-3e7b-43a5-80f6-c2152b9ef253 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88d6fab0-f54b-4637-b945-a0dfeb0eb7fc', 0)] {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 08:52:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:52:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:52:42 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[49dfa01c-8833-46e4-8804-327e22698d6a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88d6fab0-f54b-4637-b945-a0dfeb0eb7fc\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:52:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:52:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:52:42 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee60c0c-a1a2-480d-9ca5-be2a116bee52]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d6fab0-f54b-4637-b945-a0dfeb0eb7fc (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:52:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-777725c3-3e7b-43a5-80f6-c2152b9ef253 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d6fab0-f54b-4637-b945-a0dfeb0eb7fc (non-flash)
Nov 15 08:52:42 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:52:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-777725c3-3e7b-43a5-80f6-c2152b9ef253 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d6fab0-f54b-4637-b945-a0dfeb0eb7fc (non-flash)
Nov 15 08:52:42 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:52:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-777725c3-3e7b-43a5-80f6-c2152b9ef253 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efed8436d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88d6fab0-f54b-4637-b945-a0dfeb0eb7fc'): ({'sdb'}, set())}) {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 08:52:42 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-777725c3-3e7b-43a5-80f6-c2152b9ef253 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Removing single pathed devices sdb {{(pid=95467) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 08:52:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:52:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:52:42 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[6641b6d0-259e-4286-997c-981c7b82256c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:52:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:52:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:52:42 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6071a7d-e377-437b-aec3-af2f41d34bdb]: (4, ('ok\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:52:42 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-777725c3-3e7b-43a5-80f6-c2152b9ef253 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Flushing IO for device /dev/sdb {{(pid=95467) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 08:52:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:52:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:52:42 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b4454a-b26b-4cfe-9e56-d06232c49638]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:52:42 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-777725c3-3e7b-43a5-80f6-c2152b9ef253 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=95467) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 08:52:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:52:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:52:42 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac236e3a-6e7e-454b-ac90-46d46f8b4811]: (4, ('1', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:52:42 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-777725c3-3e7b-43a5-80f6-c2152b9ef253 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 08:52:42 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-777725c3-3e7b-43a5-80f6-c2152b9ef253 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] SCSI volumes sdb have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 08:52:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-777725c3-3e7b-43a5-80f6-c2152b9ef253 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88d6fab0-f54b-4637-b945-a0dfeb0eb7fc')] {{(pid=95467) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 08:52:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88d6fab0-f54b-4637-b945-a0dfeb0eb7fc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:52:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88d6fab0-f54b-4637-b945-a0dfeb0eb7fc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:52:42 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c243b5db-425c-412e-a601-fd59d9b17168]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:52:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-777725c3-3e7b-43a5-80f6-c2152b9ef253 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:52:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88d6fab0-f54b-4637-b945-a0dfeb0eb7fc -p 172.16.0.220:3260 --logout {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:52:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88d6fab0-f54b-4637-b945-a0dfeb0eb7fc -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:52:42 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f90aea89-be1b-492f-aa7e-e6f21e454f18]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:88d6fab0-f54b-4637-b945-a0dfeb0eb7fc, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:88d6fab0-f54b-4637-b945-a0dfeb0eb7fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:52:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-777725c3-3e7b-43a5-80f6-c2152b9ef253 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:88d6fab0-f54b-4637-b945-a0dfeb0eb7fc, portal: 172.16.0.220,3260]
Nov 15 08:52:42 user nova-compute[95467]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:88d6fab0-f54b-4637-b945-a0dfeb0eb7fc, portal: 172.16.0.220,3260] successful.
Nov 15 08:52:42 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:52:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88d6fab0-f54b-4637-b945-a0dfeb0eb7fc -p 172.16.0.220:3260 --op delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:52:42 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88d6fab0-f54b-4637-b945-a0dfeb0eb7fc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:52:42 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bca0f5b-d15a-4d49-ba12-d0c407930aed]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:52:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-777725c3-3e7b-43a5-80f6-c2152b9ef253 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:52:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-777725c3-3e7b-43a5-80f6-c2152b9ef253 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.258s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:52:42 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-777725c3-3e7b-43a5-80f6-c2152b9ef253 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] <== disconnect_volume: return (259ms) None {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:52:42 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-777725c3-3e7b-43a5-80f6-c2152b9ef253 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Disconnected iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 08:52:43 user nova-compute[95467]: DEBUG nova.objects.instance [None req-777725c3-3e7b-43a5-80f6-c2152b9ef253 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lazy-loading 'flavor' on Instance uuid f72e8b13-7532-4900-a356-1c4b4a3b7cc8 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:52:43 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-777725c3-3e7b-43a5-80f6-c2152b9ef253 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lock "f72e8b13-7532-4900-a356-1c4b4a3b7cc8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.669s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:52:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:52:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:52:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=95467) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 08:52:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:52:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:52:43 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:52:48 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:52:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:52:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:52:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=95467) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 08:52:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:52:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:52:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:52:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:52:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:52:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=95467) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 08:52:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:52:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:52:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:53:04 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:53:04 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:53:04 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=95467) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 08:53:04 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:53:04 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:53:04 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:53:09 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:53:09 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:53:09 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=95467) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 08:53:09 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:53:09 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:53:09 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:53:10 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:53:10 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=95467) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 08:53:13 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:53:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-079d97cc-91c6-4df5-8c14-559d200fd2fc tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Acquiring lock "f72e8b13-7532-4900-a356-1c4b4a3b7cc8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:53:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-079d97cc-91c6-4df5-8c14-559d200fd2fc tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lock "f72e8b13-7532-4900-a356-1c4b4a3b7cc8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:53:13 user nova-compute[95467]: DEBUG nova.objects.instance [None req-079d97cc-91c6-4df5-8c14-559d200fd2fc tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lazy-loading 'flavor' on Instance uuid f72e8b13-7532-4900-a356-1c4b4a3b7cc8 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:53:13 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager.update_available_resource {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:53:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-079d97cc-91c6-4df5-8c14-559d200fd2fc tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lock "f72e8b13-7532-4900-a356-1c4b4a3b7cc8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:53:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:53:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:53:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:53:13 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Auditing locally available compute resources for user (node: user) {{(pid=95467) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 08:53:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f72e8b13-7532-4900-a356-1c4b4a3b7cc8/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:53:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-079d97cc-91c6-4df5-8c14-559d200fd2fc tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Acquiring lock "f72e8b13-7532-4900-a356-1c4b4a3b7cc8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:53:13 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-079d97cc-91c6-4df5-8c14-559d200fd2fc tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lock "f72e8b13-7532-4900-a356-1c4b4a3b7cc8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:53:13 user nova-compute[95467]: INFO nova.compute.manager [None req-079d97cc-91c6-4df5-8c14-559d200fd2fc tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Attaching volume 63760e85-7a2b-44d4-9141-9de3a733987e to /dev/vdb
Nov 15 08:53:13 user nova-compute[95467]: DEBUG os_brick.utils [None req-079d97cc-91c6-4df5-8c14-559d200fd2fc tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:53:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:53:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:53:13 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a281f9-b2b2-4e52-987a-f5cad876e9d2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:882ae90641f\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:53:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:53:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:53:13 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b590c6-29b7-4058-8569-0a1537f2ff79]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:53:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:53:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f72e8b13-7532-4900-a356-1c4b4a3b7cc8/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:53:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f72e8b13-7532-4900-a356-1c4b4a3b7cc8/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:53:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:53:13 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b555b7e-fe43-471c-9813-00a6a42a80db]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:53:13 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee32685-f7e3-4f61-bed5-7a48a23dd111]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:53:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-079d97cc-91c6-4df5-8c14-559d200fd2fc tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Running cmd (subprocess): nvme version {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:53:13 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-079d97cc-91c6-4df5-8c14-559d200fd2fc tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] 'nvme version' failed. Not Retrying. {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:53:13 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.nvmeof [None req-079d97cc-91c6-4df5-8c14-559d200fd2fc tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] nvme not present on system {{(pid=95467) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 08:53:14 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:53:14 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:53:14 user nova-compute[95467]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 08:53:14 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0da774f-2ddb-48c6-b27e-0144d8e4d137]: (4, '') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:53:14 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-079d97cc-91c6-4df5-8c14-559d200fd2fc tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=95467) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 08:53:14 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-079d97cc-91c6-4df5-8c14-559d200fd2fc tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 08:53:14 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-079d97cc-91c6-4df5-8c14-559d200fd2fc tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] LIGHTOS: no hostnqn found. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 08:53:14 user nova-compute[95467]: DEBUG os_brick.utils [None req-079d97cc-91c6-4df5-8c14-559d200fd2fc tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] <== get_connector_properties: return (162ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:882ae90641f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:53:14 user nova-compute[95467]: DEBUG nova.virt.block_device [None req-079d97cc-91c6-4df5-8c14-559d200fd2fc tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Updating existing volume attachment record: 779030d1-1317-44d1-834d-f749945ec88e {{(pid=95467) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 08:53:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:53:14 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f72e8b13-7532-4900-a356-1c4b4a3b7cc8/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:53:14 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:53:14 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:53:14 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Hypervisor/Node resource view: name=user free_ram=9017MB free_disk=25.046016693115234GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=95467) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 08:53:14 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:53:14 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:53:14 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance f72e8b13-7532-4900-a356-1c4b4a3b7cc8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:53:14 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 08:53:14 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 08:53:14 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:53:14 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:53:14 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Compute_service record updated for user:user {{(pid=95467) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 08:53:14 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.167s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:53:15 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:53:16 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:53:18 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:53:18 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-079d97cc-91c6-4df5-8c14-559d200fd2fc tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Calling os-brick to attach iSCSI Volume {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 08:53:18 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-079d97cc-91c6-4df5-8c14-559d200fd2fc tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:63760e85-7a2b-44d4-9141-9de3a733987e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mAsfutED', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:53:18 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-079d97cc-91c6-4df5-8c14-559d200fd2fc tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:53:18 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-079d97cc-91c6-4df5-8c14-559d200fd2fc tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:53:18 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-079d97cc-91c6-4df5-8c14-559d200fd2fc tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:53:18 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-079d97cc-91c6-4df5-8c14-559d200fd2fc tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:53:18 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-079d97cc-91c6-4df5-8c14-559d200fd2fc tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63760e85-7a2b-44d4-9141-9de3a733987e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:53:18 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-079d97cc-91c6-4df5-8c14-559d200fd2fc tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63760e85-7a2b-44d4-9141-9de3a733987e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:53:18 user nova-compute[95467]: INFO os_brick.initiator.connectors.iscsi [None req-079d97cc-91c6-4df5-8c14-559d200fd2fc tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 08:53:18 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63760e85-7a2b-44d4-9141-9de3a733987e -p 172.16.0.220:3260 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:53:18 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63760e85-7a2b-44d4-9141-9de3a733987e -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:53:18 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a9deb8-1b8a-4ffd-a8a1-5a143fed994b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:53:18 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-079d97cc-91c6-4df5-8c14-559d200fd2fc tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 08:53:18 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:53:18 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63760e85-7a2b-44d4-9141-9de3a733987e -p 172.16.0.220:3260 --interface default --op new {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:53:18 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63760e85-7a2b-44d4-9141-9de3a733987e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:53:18 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7688769-2646-4c91-8ccb-7dea33a9059a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:63760e85-7a2b-44d4-9141-9de3a733987e] added\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:53:18 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-079d97cc-91c6-4df5-8c14-559d200fd2fc tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:63760e85-7a2b-44d4-9141-9de3a733987e] added
Nov 15 08:53:18 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:53:18 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63760e85-7a2b-44d4-9141-9de3a733987e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:53:18 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63760e85-7a2b-44d4-9141-9de3a733987e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:53:18 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1548a4f-7809-4a51-87e1-1831cbc738e2]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:53:18 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-079d97cc-91c6-4df5-8c14-559d200fd2fc tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:53:18 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63760e85-7a2b-44d4-9141-9de3a733987e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:53:18 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63760e85-7a2b-44d4-9141-9de3a733987e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:53:18 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f178de-0099-4ced-8928-126d9cda76a2]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:53:18 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-079d97cc-91c6-4df5-8c14-559d200fd2fc tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:53:18 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63760e85-7a2b-44d4-9141-9de3a733987e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mAsfutED {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:53:18 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63760e85-7a2b-44d4-9141-9de3a733987e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mAsfutED" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:53:18 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[6588739a-3d8b-4b09-acf8-11616acddde0]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:53:18 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-079d97cc-91c6-4df5-8c14-559d200fd2fc tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mAsfutED'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:53:18 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63760e85-7a2b-44d4-9141-9de3a733987e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:53:18 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63760e85-7a2b-44d4-9141-9de3a733987e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:53:18 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a7ab95-7e54-42a1-8129-41696678e21a]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:53:18 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-079d97cc-91c6-4df5-8c14-559d200fd2fc tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:53:18 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:53:18 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:53:18 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c130f01-5aa3-48cb-9e74-1104c7438425]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:53:18 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-079d97cc-91c6-4df5-8c14-559d200fd2fc tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 08:53:18 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:53:18 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-079d97cc-91c6-4df5-8c14-559d200fd2fc tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 08:53:18 user nova-compute[95467]:  {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:53:18 user nova-compute[95467]: WARNING os_brick.initiator.connectors.iscsi [None req-079d97cc-91c6-4df5-8c14-559d200fd2fc tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 08:53:18 user nova-compute[95467]: 
Nov 15 08:53:18 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63760e85-7a2b-44d4-9141-9de3a733987e -p 172.16.0.220:3260 --login {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:53:18 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63760e85-7a2b-44d4-9141-9de3a733987e -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:53:18 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ad4780-6201-424c-a773-f89b2c8338cb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:63760e85-7a2b-44d4-9141-9de3a733987e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:63760e85-7a2b-44d4-9141-9de3a733987e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:53:18 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-079d97cc-91c6-4df5-8c14-559d200fd2fc tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:63760e85-7a2b-44d4-9141-9de3a733987e, portal: 172.16.0.220,3260]
Nov 15 08:53:18 user nova-compute[95467]: Login to [iface: default, target: iqn.2010-10.org.openstack:63760e85-7a2b-44d4-9141-9de3a733987e, portal: 172.16.0.220,3260] successful.
Nov 15 08:53:18 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:53:18 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63760e85-7a2b-44d4-9141-9de3a733987e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:53:18 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63760e85-7a2b-44d4-9141-9de3a733987e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:53:18 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6435884-d4dd-4304-8449-3d3ba2ca31d3]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:53:18 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-079d97cc-91c6-4df5-8c14-559d200fd2fc tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:53:18 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:53:18 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:53:18 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[819f657d-b4a4-4919-94d8-2fbb14bce45f]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63760e85-7a2b-44d4-9141-9de3a733987e (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:53:18 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-079d97cc-91c6-4df5-8c14-559d200fd2fc tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63760e85-7a2b-44d4-9141-9de3a733987e (non-flash)
Nov 15 08:53:18 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:53:18 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-079d97cc-91c6-4df5-8c14-559d200fd2fc tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63760e85-7a2b-44d4-9141-9de3a733987e (non-flash)
Nov 15 08:53:18 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:53:18 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-079d97cc-91c6-4df5-8c14-559d200fd2fc tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63760e85-7a2b-44d4-9141-9de3a733987e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:53:18 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-079d97cc-91c6-4df5-8c14-559d200fd2fc tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Connected to 172.16.0.220:3260 {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 08:53:18 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-079d97cc-91c6-4df5-8c14-559d200fd2fc tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=95467) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 08:53:18 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-079d97cc-91c6-4df5-8c14-559d200fd2fc tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=95467) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 08:53:18 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:53:18 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:53:18 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac601aa-39c3-4375-93ed-8ad2b6e2d90b]: (4, ('- - 0', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:53:18 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-079d97cc-91c6-4df5-8c14-559d200fd2fc tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: None {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:53:19 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:53:19 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:53:19 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-079d97cc-91c6-4df5-8c14-559d200fd2fc tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:53:19 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-079d97cc-91c6-4df5-8c14-559d200fd2fc tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:63760e85-7a2b-44d4-9141-9de3a733987e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mAsfutED', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 08:53:19 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-079d97cc-91c6-4df5-8c14-559d200fd2fc tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.278s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:53:19 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-079d97cc-91c6-4df5-8c14-559d200fd2fc tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] <== connect_volume: return (1279ms) {'type': 'block', 'scsi_wwn': '26362613630636136', 'path': '/dev/sdb'} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:53:19 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-079d97cc-91c6-4df5-8c14-559d200fd2fc tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362613630636136', 'path': '/dev/sdb'} {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 08:53:19 user nova-compute[95467]: DEBUG nova.objects.instance [None req-079d97cc-91c6-4df5-8c14-559d200fd2fc tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lazy-loading 'flavor' on Instance uuid f72e8b13-7532-4900-a356-1c4b4a3b7cc8 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:53:19 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-079d97cc-91c6-4df5-8c14-559d200fd2fc tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 08:53:19 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:53:19 user nova-compute[95467]:   <source dev="/dev/sdb"/>
Nov 15 08:53:19 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:53:19 user nova-compute[95467]:   <serial>63760e85-7a2b-44d4-9141-9de3a733987e</serial>
Nov 15 08:53:19 user nova-compute[95467]: </disk>
Nov 15 08:53:19 user nova-compute[95467]:  {{(pid=95467) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 08:53:20 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-079d97cc-91c6-4df5-8c14-559d200fd2fc tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:53:20 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-079d97cc-91c6-4df5-8c14-559d200fd2fc tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] No BDM found with device name vdb, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:53:20 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-079d97cc-91c6-4df5-8c14-559d200fd2fc tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] No VIF found with MAC fa:16:3e:fe:52:18, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:53:20 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-079d97cc-91c6-4df5-8c14-559d200fd2fc tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lock "f72e8b13-7532-4900-a356-1c4b4a3b7cc8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.594s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:53:21 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:53:22 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:53:22 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:53:22 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-5088aff9-1b50-48ad-a965-8f9dd28fdb94 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Acquiring lock "f72e8b13-7532-4900-a356-1c4b4a3b7cc8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:53:22 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-5088aff9-1b50-48ad-a965-8f9dd28fdb94 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lock "f72e8b13-7532-4900-a356-1c4b4a3b7cc8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:53:22 user nova-compute[95467]: INFO nova.compute.manager [None req-5088aff9-1b50-48ad-a965-8f9dd28fdb94 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Detaching volume 63760e85-7a2b-44d4-9141-9de3a733987e
Nov 15 08:53:22 user nova-compute[95467]: INFO nova.virt.block_device [None req-5088aff9-1b50-48ad-a965-8f9dd28fdb94 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Attempting to driver detach volume 63760e85-7a2b-44d4-9141-9de3a733987e from mountpoint /dev/vdb
Nov 15 08:53:22 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-5088aff9-1b50-48ad-a965-8f9dd28fdb94 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Attempting to detach device vdb from instance f72e8b13-7532-4900-a356-1c4b4a3b7cc8 from the persistent domain config. {{(pid=95467) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 08:53:22 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-5088aff9-1b50-48ad-a965-8f9dd28fdb94 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 08:53:22 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:53:22 user nova-compute[95467]:   <source dev="/dev/sdb"/>
Nov 15 08:53:22 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:53:22 user nova-compute[95467]:   <serial>63760e85-7a2b-44d4-9141-9de3a733987e</serial>
Nov 15 08:53:22 user nova-compute[95467]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 08:53:22 user nova-compute[95467]: </disk>
Nov 15 08:53:22 user nova-compute[95467]:  {{(pid=95467) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 08:53:22 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-5088aff9-1b50-48ad-a965-8f9dd28fdb94 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Successfully detached device vdb from instance f72e8b13-7532-4900-a356-1c4b4a3b7cc8 from the persistent domain config.
Nov 15 08:53:22 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-5088aff9-1b50-48ad-a965-8f9dd28fdb94 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f72e8b13-7532-4900-a356-1c4b4a3b7cc8 from the live domain config. {{(pid=95467) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 08:53:22 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-5088aff9-1b50-48ad-a965-8f9dd28fdb94 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 08:53:22 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:53:22 user nova-compute[95467]:   <source dev="/dev/sdb"/>
Nov 15 08:53:22 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:53:22 user nova-compute[95467]:   <serial>63760e85-7a2b-44d4-9141-9de3a733987e</serial>
Nov 15 08:53:22 user nova-compute[95467]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 08:53:22 user nova-compute[95467]: </disk>
Nov 15 08:53:22 user nova-compute[95467]:  {{(pid=95467) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 08:53:23 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-5088aff9-1b50-48ad-a965-8f9dd28fdb94 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f72e8b13-7532-4900-a356-1c4b4a3b7cc8 {{(pid=95467) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 08:53:23 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:53:24 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:53:24 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:53:24 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Starting heal instance info cache {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 08:53:24 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Rebuilding the list of instances to heal {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 08:53:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "refresh_cache-f72e8b13-7532-4900-a356-1c4b4a3b7cc8" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:53:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquired lock "refresh_cache-f72e8b13-7532-4900-a356-1c4b4a3b7cc8" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:53:24 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Forcefully refreshing network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 08:53:24 user nova-compute[95467]: DEBUG nova.objects.instance [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lazy-loading 'info_cache' on Instance uuid f72e8b13-7532-4900-a356-1c4b4a3b7cc8 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:53:25 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Updating instance_info_cache with network_info: [{"id": "1bf0b597-4b85-4ce5-b8ab-2a1f399c8a1f", "address": "fa:16:3e:fe:52:18", "network": {"id": "fbab5af1-c1c6-4bdf-bfe3-b47ff49c5771", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-349235580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41c0dc5f8ffe415cb84df29cff554d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf0b597-4b", "ovs_interfaceid": "1bf0b597-4b85-4ce5-b8ab-2a1f399c8a1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:53:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Releasing lock "refresh_cache-f72e8b13-7532-4900-a356-1c4b4a3b7cc8" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:53:25 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Updated the network info_cache for instance {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 08:53:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:53:34 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:53:39 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:53:43 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-5088aff9-1b50-48ad-a965-8f9dd28fdb94 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f72e8b13-7532-4900-a356-1c4b4a3b7cc8 is timed out.
Nov 15 08:53:43 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-5088aff9-1b50-48ad-a965-8f9dd28fdb94 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Successfully detached device vdb from instance f72e8b13-7532-4900-a356-1c4b4a3b7cc8 from the live domain config.
Nov 15 08:53:43 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5088aff9-1b50-48ad-a965-8f9dd28fdb94 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] calling os-brick to detach iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 08:53:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-5088aff9-1b50-48ad-a965-8f9dd28fdb94 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, {'target_iqn': 'iqn.2010-10.org.openstack:63760e85-7a2b-44d4-9141-9de3a733987e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mAsfutED', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:53:43 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-5088aff9-1b50-48ad-a965-8f9dd28fdb94 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:53:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-5088aff9-1b50-48ad-a965-8f9dd28fdb94 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:53:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-5088aff9-1b50-48ad-a965-8f9dd28fdb94 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:53:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:53:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:53:43 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80bc46a-739e-4de9-85e5-f1802be1c3ef]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:63760e85-7a2b-44d4-9141-9de3a733987e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:53:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-5088aff9-1b50-48ad-a965-8f9dd28fdb94 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 08:53:43 user nova-compute[95467]: No targets found.
Nov 15 08:53:43 user nova-compute[95467]: iSNS:
Nov 15 08:53:43 user nova-compute[95467]: No targets found.
Nov 15 08:53:43 user nova-compute[95467]: STATIC:
Nov 15 08:53:43 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:63760e85-7a2b-44d4-9141-9de3a733987e
Nov 15 08:53:43 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:53:43 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:53:43 user nova-compute[95467]: FIRMWARE:
Nov 15 08:53:43 user nova-compute[95467]: No targets found.
Nov 15 08:53:43 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:53:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-5088aff9-1b50-48ad-a965-8f9dd28fdb94 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 08:53:43 user nova-compute[95467]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 08:53:43 user nova-compute[95467]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=95467) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 08:53:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-5088aff9-1b50-48ad-a965-8f9dd28fdb94 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63760e85-7a2b-44d4-9141-9de3a733987e', 0)] {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 08:53:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:53:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:53:43 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8d7e8c-f0e1-4e72-9d06-cf7a4f63b1f1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63760e85-7a2b-44d4-9141-9de3a733987e\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:53:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:53:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:53:43 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b670fea-def3-44f6-8ccf-68b76408fc3f]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63760e85-7a2b-44d4-9141-9de3a733987e (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:53:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-5088aff9-1b50-48ad-a965-8f9dd28fdb94 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63760e85-7a2b-44d4-9141-9de3a733987e (non-flash)
Nov 15 08:53:43 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:53:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-5088aff9-1b50-48ad-a965-8f9dd28fdb94 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63760e85-7a2b-44d4-9141-9de3a733987e (non-flash)
Nov 15 08:53:43 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:53:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-5088aff9-1b50-48ad-a965-8f9dd28fdb94 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efec8306320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63760e85-7a2b-44d4-9141-9de3a733987e'): ({'sdb'}, set())}) {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 08:53:43 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-5088aff9-1b50-48ad-a965-8f9dd28fdb94 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Removing single pathed devices sdb {{(pid=95467) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 08:53:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:53:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:53:43 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1cc854-6337-4ec8-a2d1-771219ca071b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:53:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:53:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:53:43 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc789d7-ef1d-4f8c-86b0-5a76f49d97c4]: (4, ('ok\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:53:43 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-5088aff9-1b50-48ad-a965-8f9dd28fdb94 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Flushing IO for device /dev/sdb {{(pid=95467) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 08:53:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:53:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:53:43 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e5e761-e2c4-48a4-8541-80602d87f383]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:53:43 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-5088aff9-1b50-48ad-a965-8f9dd28fdb94 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=95467) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 08:53:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:53:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:53:43 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7f4f8f-fed1-4933-b6ea-f8af0e5288a6]: (4, ('1', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:53:43 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-5088aff9-1b50-48ad-a965-8f9dd28fdb94 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 08:53:43 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-5088aff9-1b50-48ad-a965-8f9dd28fdb94 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] SCSI volumes sdb have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 08:53:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-5088aff9-1b50-48ad-a965-8f9dd28fdb94 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63760e85-7a2b-44d4-9141-9de3a733987e')] {{(pid=95467) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 08:53:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63760e85-7a2b-44d4-9141-9de3a733987e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:53:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63760e85-7a2b-44d4-9141-9de3a733987e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:53:43 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[21dc011e-8936-404a-af47-4d16d3577ec3]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:53:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-5088aff9-1b50-48ad-a965-8f9dd28fdb94 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:53:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63760e85-7a2b-44d4-9141-9de3a733987e -p 172.16.0.220:3260 --logout {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:53:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63760e85-7a2b-44d4-9141-9de3a733987e -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:53:43 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[260c4663-722e-47a2-9067-bd16aa38741f]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:63760e85-7a2b-44d4-9141-9de3a733987e, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:63760e85-7a2b-44d4-9141-9de3a733987e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:53:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-5088aff9-1b50-48ad-a965-8f9dd28fdb94 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:63760e85-7a2b-44d4-9141-9de3a733987e, portal: 172.16.0.220,3260]
Nov 15 08:53:43 user nova-compute[95467]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:63760e85-7a2b-44d4-9141-9de3a733987e, portal: 172.16.0.220,3260] successful.
Nov 15 08:53:43 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:53:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63760e85-7a2b-44d4-9141-9de3a733987e -p 172.16.0.220:3260 --op delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:53:43 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63760e85-7a2b-44d4-9141-9de3a733987e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:53:43 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[41cc44ae-1d53-48cd-a2c9-81f77be2107b]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:53:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-5088aff9-1b50-48ad-a965-8f9dd28fdb94 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:53:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-5088aff9-1b50-48ad-a965-8f9dd28fdb94 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:53:43 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-5088aff9-1b50-48ad-a965-8f9dd28fdb94 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] <== disconnect_volume: return (308ms) None {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:53:43 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5088aff9-1b50-48ad-a965-8f9dd28fdb94 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Disconnected iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 08:53:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:53:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:53:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=95467) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 08:53:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:53:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:53:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:53:44 user nova-compute[95467]: DEBUG nova.objects.instance [None req-5088aff9-1b50-48ad-a965-8f9dd28fdb94 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lazy-loading 'flavor' on Instance uuid f72e8b13-7532-4900-a356-1c4b4a3b7cc8 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:53:44 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-5088aff9-1b50-48ad-a965-8f9dd28fdb94 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lock "f72e8b13-7532-4900-a356-1c4b4a3b7cc8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.583s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:53:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:53:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:53:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=95467) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 08:53:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:53:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:53:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:53:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:53:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:53:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:53:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=95467) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 08:53:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:53:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:53:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:54:04 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:54:04 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:54:04 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=95467) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 08:54:04 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:54:04 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:54:04 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:54:09 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:54:09 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:54:09 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=95467) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 08:54:09 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:54:09 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:54:09 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:54:12 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:54:12 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=95467) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 08:54:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:54:14 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-bbccf41c-e6c3-4fc1-852c-57c9cf0bc57f tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Acquiring lock "f72e8b13-7532-4900-a356-1c4b4a3b7cc8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:54:14 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-bbccf41c-e6c3-4fc1-852c-57c9cf0bc57f tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lock "f72e8b13-7532-4900-a356-1c4b4a3b7cc8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:54:14 user nova-compute[95467]: DEBUG nova.objects.instance [None req-bbccf41c-e6c3-4fc1-852c-57c9cf0bc57f tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lazy-loading 'flavor' on Instance uuid f72e8b13-7532-4900-a356-1c4b4a3b7cc8 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:54:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-bbccf41c-e6c3-4fc1-852c-57c9cf0bc57f tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lock "f72e8b13-7532-4900-a356-1c4b4a3b7cc8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:54:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-bbccf41c-e6c3-4fc1-852c-57c9cf0bc57f tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Acquiring lock "f72e8b13-7532-4900-a356-1c4b4a3b7cc8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:54:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-bbccf41c-e6c3-4fc1-852c-57c9cf0bc57f tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lock "f72e8b13-7532-4900-a356-1c4b4a3b7cc8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:54:15 user nova-compute[95467]: INFO nova.compute.manager [None req-bbccf41c-e6c3-4fc1-852c-57c9cf0bc57f tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Attaching volume 3bc5e53d-8f9e-4d09-8179-af4ae9098f1f to /dev/vdb
Nov 15 08:54:15 user nova-compute[95467]: DEBUG os_brick.utils [None req-bbccf41c-e6c3-4fc1-852c-57c9cf0bc57f tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:54:15 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:54:15 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:54:15 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10a13aa-e6e9-4b9b-8cbc-8e5e89335feb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:882ae90641f\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:54:15 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:54:15 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:54:15 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[170e23ba-30b3-4a78-b224-82dc2897c476]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:54:15 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:54:15 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:54:15 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c356ba-b97b-43a1-8172-85740c57d7ef]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:54:15 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57ea124-1a70-400c-b502-186b30cd744a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:54:15 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-bbccf41c-e6c3-4fc1-852c-57c9cf0bc57f tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Running cmd (subprocess): nvme version {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:54:15 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-bbccf41c-e6c3-4fc1-852c-57c9cf0bc57f tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] 'nvme version' failed. Not Retrying. {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:54:15 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bbccf41c-e6c3-4fc1-852c-57c9cf0bc57f tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] nvme not present on system {{(pid=95467) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 08:54:15 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:54:15 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 08:54:15 user nova-compute[95467]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 08:54:15 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[918406e2-4dbd-4415-a704-0e52b5f71e87]: (4, '') {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:54:15 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-bbccf41c-e6c3-4fc1-852c-57c9cf0bc57f tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=95467) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 08:54:15 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-bbccf41c-e6c3-4fc1-852c-57c9cf0bc57f tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 08:54:15 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.lightos [None req-bbccf41c-e6c3-4fc1-852c-57c9cf0bc57f tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] LIGHTOS: no hostnqn found. {{(pid=95467) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 08:54:15 user nova-compute[95467]: DEBUG os_brick.utils [None req-bbccf41c-e6c3-4fc1-852c-57c9cf0bc57f tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:882ae90641f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:54:15 user nova-compute[95467]: DEBUG nova.virt.block_device [None req-bbccf41c-e6c3-4fc1-852c-57c9cf0bc57f tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Updating existing volume attachment record: e20642e0-3cf9-47af-8650-002c8252dca0 {{(pid=95467) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 08:54:15 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:54:15 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager.update_available_resource {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:54:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:54:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:54:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:54:15 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Auditing locally available compute resources for user (node: user) {{(pid=95467) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 08:54:15 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f72e8b13-7532-4900-a356-1c4b4a3b7cc8/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:54:15 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f72e8b13-7532-4900-a356-1c4b4a3b7cc8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:54:15 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f72e8b13-7532-4900-a356-1c4b4a3b7cc8/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:54:16 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f72e8b13-7532-4900-a356-1c4b4a3b7cc8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:54:16 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:54:16 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:54:16 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Hypervisor/Node resource view: name=user free_ram=9028MB free_disk=25.04494857788086GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=95467) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 08:54:16 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:54:16 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:54:16 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance f72e8b13-7532-4900-a356-1c4b4a3b7cc8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:54:16 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 08:54:16 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 08:54:16 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:54:16 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:54:16 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Compute_service record updated for user:user {{(pid=95467) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 08:54:16 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.185s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:54:18 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:54:18 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:54:19 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:54:19 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:54:19 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbccf41c-e6c3-4fc1-852c-57c9cf0bc57f tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Calling os-brick to attach iSCSI Volume {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 08:54:19 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbccf41c-e6c3-4fc1-852c-57c9cf0bc57f tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3bc5e53d-8f9e-4d09-8179-af4ae9098f1f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eYTNEMGi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:54:19 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-bbccf41c-e6c3-4fc1-852c-57c9cf0bc57f tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:54:19 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-bbccf41c-e6c3-4fc1-852c-57c9cf0bc57f tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:54:19 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-bbccf41c-e6c3-4fc1-852c-57c9cf0bc57f tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:54:19 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-bbccf41c-e6c3-4fc1-852c-57c9cf0bc57f tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:54:19 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-bbccf41c-e6c3-4fc1-852c-57c9cf0bc57f tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3bc5e53d-8f9e-4d09-8179-af4ae9098f1f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:54:19 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-bbccf41c-e6c3-4fc1-852c-57c9cf0bc57f tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3bc5e53d-8f9e-4d09-8179-af4ae9098f1f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:54:19 user nova-compute[95467]: INFO os_brick.initiator.connectors.iscsi [None req-bbccf41c-e6c3-4fc1-852c-57c9cf0bc57f tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 08:54:19 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bc5e53d-8f9e-4d09-8179-af4ae9098f1f -p 172.16.0.220:3260 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:54:19 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bc5e53d-8f9e-4d09-8179-af4ae9098f1f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:54:19 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[fccc0a47-168a-4fba-a64f-83eae3692685]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:54:19 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbccf41c-e6c3-4fc1-852c-57c9cf0bc57f tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 08:54:19 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:54:19 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bc5e53d-8f9e-4d09-8179-af4ae9098f1f -p 172.16.0.220:3260 --interface default --op new {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:54:19 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bc5e53d-8f9e-4d09-8179-af4ae9098f1f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:54:19 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd183c3-8e7e-42f2-859c-b3f3c79761d2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3bc5e53d-8f9e-4d09-8179-af4ae9098f1f] added\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:54:19 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbccf41c-e6c3-4fc1-852c-57c9cf0bc57f tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3bc5e53d-8f9e-4d09-8179-af4ae9098f1f] added
Nov 15 08:54:19 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:54:19 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bc5e53d-8f9e-4d09-8179-af4ae9098f1f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:54:19 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bc5e53d-8f9e-4d09-8179-af4ae9098f1f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:54:19 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b660fc72-eb9c-453a-89b5-aa16a903c650]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:54:19 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbccf41c-e6c3-4fc1-852c-57c9cf0bc57f tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:54:19 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bc5e53d-8f9e-4d09-8179-af4ae9098f1f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:54:19 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bc5e53d-8f9e-4d09-8179-af4ae9098f1f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:54:19 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5fe8e6e-6d24-4b94-b3eb-bc5fac4dfa2b]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:54:19 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbccf41c-e6c3-4fc1-852c-57c9cf0bc57f tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:54:19 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bc5e53d-8f9e-4d09-8179-af4ae9098f1f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eYTNEMGi {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:54:19 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bc5e53d-8f9e-4d09-8179-af4ae9098f1f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eYTNEMGi" returned: 0 in 0.022s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:54:19 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a1392c-4bba-4302-94df-5712ffbce9bc]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:54:19 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbccf41c-e6c3-4fc1-852c-57c9cf0bc57f tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eYTNEMGi'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:54:19 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bc5e53d-8f9e-4d09-8179-af4ae9098f1f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:54:19 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bc5e53d-8f9e-4d09-8179-af4ae9098f1f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:54:19 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd40fdae-76a3-47d5-81fc-fc0828219b9c]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:54:19 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbccf41c-e6c3-4fc1-852c-57c9cf0bc57f tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:54:19 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:54:19 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:54:19 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[64de5b56-1547-4fb2-b258-1d4d405a44e5]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:54:19 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbccf41c-e6c3-4fc1-852c-57c9cf0bc57f tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 08:54:19 user nova-compute[95467]:  {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:54:19 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbccf41c-e6c3-4fc1-852c-57c9cf0bc57f tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 08:54:19 user nova-compute[95467]:  {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:54:19 user nova-compute[95467]: WARNING os_brick.initiator.connectors.iscsi [None req-bbccf41c-e6c3-4fc1-852c-57c9cf0bc57f tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 08:54:19 user nova-compute[95467]: 
Nov 15 08:54:19 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bc5e53d-8f9e-4d09-8179-af4ae9098f1f -p 172.16.0.220:3260 --login {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:54:19 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bc5e53d-8f9e-4d09-8179-af4ae9098f1f -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:54:19 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dfe41ee-4fec-406e-9008-779d9570c7fa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3bc5e53d-8f9e-4d09-8179-af4ae9098f1f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3bc5e53d-8f9e-4d09-8179-af4ae9098f1f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:54:19 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbccf41c-e6c3-4fc1-852c-57c9cf0bc57f tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3bc5e53d-8f9e-4d09-8179-af4ae9098f1f, portal: 172.16.0.220,3260]
Nov 15 08:54:19 user nova-compute[95467]: Login to [iface: default, target: iqn.2010-10.org.openstack:3bc5e53d-8f9e-4d09-8179-af4ae9098f1f, portal: 172.16.0.220,3260] successful.
Nov 15 08:54:19 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:54:19 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bc5e53d-8f9e-4d09-8179-af4ae9098f1f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:54:20 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bc5e53d-8f9e-4d09-8179-af4ae9098f1f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:54:20 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f646130e-07a7-475b-a422-2f68e7aad613]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:54:20 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbccf41c-e6c3-4fc1-852c-57c9cf0bc57f tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:54:20 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:54:20 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:54:20 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[1381057f-13ba-4bda-b5f2-53bb0e182461]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5e53d-8f9e-4d09-8179-af4ae9098f1f (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:54:20 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbccf41c-e6c3-4fc1-852c-57c9cf0bc57f tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5e53d-8f9e-4d09-8179-af4ae9098f1f (non-flash)
Nov 15 08:54:20 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:54:20 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbccf41c-e6c3-4fc1-852c-57c9cf0bc57f tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5e53d-8f9e-4d09-8179-af4ae9098f1f (non-flash)
Nov 15 08:54:20 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:54:20 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-bbccf41c-e6c3-4fc1-852c-57c9cf0bc57f tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3bc5e53d-8f9e-4d09-8179-af4ae9098f1f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:54:20 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbccf41c-e6c3-4fc1-852c-57c9cf0bc57f tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Connected to 172.16.0.220:3260 {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 08:54:20 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-bbccf41c-e6c3-4fc1-852c-57c9cf0bc57f tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=95467) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 08:54:20 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-bbccf41c-e6c3-4fc1-852c-57c9cf0bc57f tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=95467) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 08:54:20 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:54:20 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:54:20 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[df38a99d-30af-4b49-9799-b7757fc5818a]: (4, ('- - 0', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:54:20 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-bbccf41c-e6c3-4fc1-852c-57c9cf0bc57f tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: None {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:54:21 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-bbccf41c-e6c3-4fc1-852c-57c9cf0bc57f tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=95467) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 08:54:21 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbccf41c-e6c3-4fc1-852c-57c9cf0bc57f tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3bc5e53d-8f9e-4d09-8179-af4ae9098f1f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eYTNEMGi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=95467) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 08:54:21 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-bbccf41c-e6c3-4fc1-852c-57c9cf0bc57f tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:54:21 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbccf41c-e6c3-4fc1-852c-57c9cf0bc57f tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23031663231353930', 'path': '/dev/sdb'} {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:54:21 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbccf41c-e6c3-4fc1-852c-57c9cf0bc57f tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031663231353930', 'path': '/dev/sdb'} {{(pid=95467) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 08:54:21 user nova-compute[95467]: DEBUG nova.objects.instance [None req-bbccf41c-e6c3-4fc1-852c-57c9cf0bc57f tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lazy-loading 'flavor' on Instance uuid f72e8b13-7532-4900-a356-1c4b4a3b7cc8 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:54:21 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-bbccf41c-e6c3-4fc1-852c-57c9cf0bc57f tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 08:54:21 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:54:21 user nova-compute[95467]:   <source dev="/dev/sdb"/>
Nov 15 08:54:21 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:54:21 user nova-compute[95467]:   <serial>3bc5e53d-8f9e-4d09-8179-af4ae9098f1f</serial>
Nov 15 08:54:21 user nova-compute[95467]: </disk>
Nov 15 08:54:21 user nova-compute[95467]:  {{(pid=95467) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 08:54:21 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-bbccf41c-e6c3-4fc1-852c-57c9cf0bc57f tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] No BDM found with device name vda, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:54:21 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-bbccf41c-e6c3-4fc1-852c-57c9cf0bc57f tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] No BDM found with device name vdb, not building metadata. {{(pid=95467) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 08:54:21 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-bbccf41c-e6c3-4fc1-852c-57c9cf0bc57f tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] No VIF found with MAC fa:16:3e:fe:52:18, not building metadata {{(pid=95467) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 08:54:21 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:54:21 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-bbccf41c-e6c3-4fc1-852c-57c9cf0bc57f tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lock "f72e8b13-7532-4900-a356-1c4b4a3b7cc8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.499s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:54:22 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:54:23 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:54:23 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:54:24 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:54:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-59e51426-4af9-44a1-b7fb-53f9ef5e97d8 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Acquiring lock "f72e8b13-7532-4900-a356-1c4b4a3b7cc8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:54:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-59e51426-4af9-44a1-b7fb-53f9ef5e97d8 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lock "f72e8b13-7532-4900-a356-1c4b4a3b7cc8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:54:24 user nova-compute[95467]: INFO nova.compute.manager [None req-59e51426-4af9-44a1-b7fb-53f9ef5e97d8 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Detaching volume 3bc5e53d-8f9e-4d09-8179-af4ae9098f1f
Nov 15 08:54:24 user nova-compute[95467]: INFO nova.virt.block_device [None req-59e51426-4af9-44a1-b7fb-53f9ef5e97d8 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Attempting to driver detach volume 3bc5e53d-8f9e-4d09-8179-af4ae9098f1f from mountpoint /dev/vdb
Nov 15 08:54:24 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-59e51426-4af9-44a1-b7fb-53f9ef5e97d8 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Attempting to detach device vdb from instance f72e8b13-7532-4900-a356-1c4b4a3b7cc8 from the persistent domain config. {{(pid=95467) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 08:54:24 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-59e51426-4af9-44a1-b7fb-53f9ef5e97d8 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 08:54:24 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:54:24 user nova-compute[95467]:   <source dev="/dev/sdb"/>
Nov 15 08:54:24 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:54:24 user nova-compute[95467]:   <serial>3bc5e53d-8f9e-4d09-8179-af4ae9098f1f</serial>
Nov 15 08:54:24 user nova-compute[95467]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 08:54:24 user nova-compute[95467]: </disk>
Nov 15 08:54:24 user nova-compute[95467]:  {{(pid=95467) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 08:54:24 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-59e51426-4af9-44a1-b7fb-53f9ef5e97d8 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Successfully detached device vdb from instance f72e8b13-7532-4900-a356-1c4b4a3b7cc8 from the persistent domain config.
Nov 15 08:54:24 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-59e51426-4af9-44a1-b7fb-53f9ef5e97d8 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f72e8b13-7532-4900-a356-1c4b4a3b7cc8 from the live domain config. {{(pid=95467) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 08:54:24 user nova-compute[95467]: DEBUG nova.virt.libvirt.guest [None req-59e51426-4af9-44a1-b7fb-53f9ef5e97d8 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 08:54:24 user nova-compute[95467]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 08:54:24 user nova-compute[95467]:   <source dev="/dev/sdb"/>
Nov 15 08:54:24 user nova-compute[95467]:   <target dev="vdb" bus="virtio"/>
Nov 15 08:54:24 user nova-compute[95467]:   <serial>3bc5e53d-8f9e-4d09-8179-af4ae9098f1f</serial>
Nov 15 08:54:24 user nova-compute[95467]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 08:54:24 user nova-compute[95467]: </disk>
Nov 15 08:54:24 user nova-compute[95467]:  {{(pid=95467) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 08:54:24 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:54:24 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Starting heal instance info cache {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 08:54:24 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Rebuilding the list of instances to heal {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 08:54:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "refresh_cache-f72e8b13-7532-4900-a356-1c4b4a3b7cc8" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:54:24 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquired lock "refresh_cache-f72e8b13-7532-4900-a356-1c4b4a3b7cc8" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:54:24 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Forcefully refreshing network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 08:54:24 user nova-compute[95467]: DEBUG nova.objects.instance [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lazy-loading 'info_cache' on Instance uuid f72e8b13-7532-4900-a356-1c4b4a3b7cc8 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:54:24 user nova-compute[95467]: DEBUG nova.virt.libvirt.driver [None req-59e51426-4af9-44a1-b7fb-53f9ef5e97d8 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f72e8b13-7532-4900-a356-1c4b4a3b7cc8 {{(pid=95467) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 08:54:25 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Updating instance_info_cache with network_info: [{"id": "1bf0b597-4b85-4ce5-b8ab-2a1f399c8a1f", "address": "fa:16:3e:fe:52:18", "network": {"id": "fbab5af1-c1c6-4bdf-bfe3-b47ff49c5771", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-349235580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41c0dc5f8ffe415cb84df29cff554d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf0b597-4b", "ovs_interfaceid": "1bf0b597-4b85-4ce5-b8ab-2a1f399c8a1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:54:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Releasing lock "refresh_cache-f72e8b13-7532-4900-a356-1c4b4a3b7cc8" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:54:25 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Updated the network info_cache for instance {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 08:54:28 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:54:29 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:54:31 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:54:34 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:54:34 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:54:34 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=95467) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 08:54:34 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:54:34 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:54:34 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:54:39 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:54:39 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:54:39 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=95467) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 08:54:39 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:54:39 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:54:39 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:54:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:54:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:54:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=95467) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 08:54:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:54:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:54:44 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:54:44 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-59e51426-4af9-44a1-b7fb-53f9ef5e97d8 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f72e8b13-7532-4900-a356-1c4b4a3b7cc8 is timed out.
Nov 15 08:54:44 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-59e51426-4af9-44a1-b7fb-53f9ef5e97d8 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Successfully detached device vdb from instance f72e8b13-7532-4900-a356-1c4b4a3b7cc8 from the live domain config.
Nov 15 08:54:44 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59e51426-4af9-44a1-b7fb-53f9ef5e97d8 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] calling os-brick to detach iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 08:54:44 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e51426-4af9-44a1-b7fb-53f9ef5e97d8 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efed8094af0>, {'target_iqn': 'iqn.2010-10.org.openstack:3bc5e53d-8f9e-4d09-8179-af4ae9098f1f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eYTNEMGi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 08:54:44 user nova-compute[95467]: WARNING os_brick.initiator.connectors.base [None req-59e51426-4af9-44a1-b7fb-53f9ef5e97d8 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 08:54:44 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-59e51426-4af9-44a1-b7fb-53f9ef5e97d8 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 08:54:44 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-59e51426-4af9-44a1-b7fb-53f9ef5e97d8 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 08:54:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:54:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:54:44 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c3ef03-b500-4ad4-94f9-5f35dd755103]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3bc5e53d-8f9e-4d09-8179-af4ae9098f1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:54:44 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e51426-4af9-44a1-b7fb-53f9ef5e97d8 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 08:54:44 user nova-compute[95467]: No targets found.
Nov 15 08:54:44 user nova-compute[95467]: iSNS:
Nov 15 08:54:44 user nova-compute[95467]: No targets found.
Nov 15 08:54:44 user nova-compute[95467]: STATIC:
Nov 15 08:54:44 user nova-compute[95467]: Target: iqn.2010-10.org.openstack:3bc5e53d-8f9e-4d09-8179-af4ae9098f1f
Nov 15 08:54:44 user nova-compute[95467]:         Portal: 172.16.0.220:3260,-1
Nov 15 08:54:44 user nova-compute[95467]:                 Iface Name: default
Nov 15 08:54:44 user nova-compute[95467]: FIRMWARE:
Nov 15 08:54:44 user nova-compute[95467]: No targets found.
Nov 15 08:54:44 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:54:44 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e51426-4af9-44a1-b7fb-53f9ef5e97d8 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 08:54:44 user nova-compute[95467]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 08:54:44 user nova-compute[95467]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=95467) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 08:54:44 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e51426-4af9-44a1-b7fb-53f9ef5e97d8 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3bc5e53d-8f9e-4d09-8179-af4ae9098f1f', 0)] {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 08:54:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:54:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:54:44 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d462a9e-026f-496c-ab5f-1e73132b12e8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bc5e53d-8f9e-4d09-8179-af4ae9098f1f\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:54:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:54:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:54:44 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[1212d194-217f-43c9-aef7-7cdd01a2f4f7]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5e53d-8f9e-4d09-8179-af4ae9098f1f (non-flash)\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:54:44 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e51426-4af9-44a1-b7fb-53f9ef5e97d8 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5e53d-8f9e-4d09-8179-af4ae9098f1f (non-flash)
Nov 15 08:54:44 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 08:54:44 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e51426-4af9-44a1-b7fb-53f9ef5e97d8 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5e53d-8f9e-4d09-8179-af4ae9098f1f (non-flash)
Nov 15 08:54:44 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 08:54:44 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e51426-4af9-44a1-b7fb-53f9ef5e97d8 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efec834b250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3bc5e53d-8f9e-4d09-8179-af4ae9098f1f'): ({'sdb'}, set())}) {{(pid=95467) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 08:54:44 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-59e51426-4af9-44a1-b7fb-53f9ef5e97d8 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Removing single pathed devices sdb {{(pid=95467) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 08:54:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:54:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:54:44 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[fadf16e8-7f71-429d-a0a0-a9ee86704361]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:54:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:54:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:54:44 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8dc701-6844-4d3e-83a5-5d4904f476d7]: (4, ('ok\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:54:44 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-59e51426-4af9-44a1-b7fb-53f9ef5e97d8 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Flushing IO for device /dev/sdb {{(pid=95467) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 08:54:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:54:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:54:44 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d196aee-bd1a-4f40-9c5f-a7a97a8aa401]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:54:44 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-59e51426-4af9-44a1-b7fb-53f9ef5e97d8 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=95467) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 08:54:44 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:54:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:54:45 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[501e3bd1-2915-4451-8bc5-71e40a19e241]: (4, ('1', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:54:45 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-59e51426-4af9-44a1-b7fb-53f9ef5e97d8 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 08:54:45 user nova-compute[95467]: DEBUG os_brick.initiator.linuxscsi [None req-59e51426-4af9-44a1-b7fb-53f9ef5e97d8 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] SCSI volumes sdb have been removed. {{(pid=95467) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 08:54:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e51426-4af9-44a1-b7fb-53f9ef5e97d8 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3bc5e53d-8f9e-4d09-8179-af4ae9098f1f')] {{(pid=95467) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 08:54:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bc5e53d-8f9e-4d09-8179-af4ae9098f1f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:54:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bc5e53d-8f9e-4d09-8179-af4ae9098f1f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:54:45 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[33736c39-b802-4d50-9bff-e318912cc52f]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:54:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e51426-4af9-44a1-b7fb-53f9ef5e97d8 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:54:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bc5e53d-8f9e-4d09-8179-af4ae9098f1f -p 172.16.0.220:3260 --logout {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:54:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bc5e53d-8f9e-4d09-8179-af4ae9098f1f -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:54:45 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e5cdcc-d203-4a02-99b3-e23b8d1ccaa7]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:3bc5e53d-8f9e-4d09-8179-af4ae9098f1f, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:3bc5e53d-8f9e-4d09-8179-af4ae9098f1f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:54:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e51426-4af9-44a1-b7fb-53f9ef5e97d8 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:3bc5e53d-8f9e-4d09-8179-af4ae9098f1f, portal: 172.16.0.220,3260]
Nov 15 08:54:45 user nova-compute[95467]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:3bc5e53d-8f9e-4d09-8179-af4ae9098f1f, portal: 172.16.0.220,3260] successful.
Nov 15 08:54:45 user nova-compute[95467]:  stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:54:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bc5e53d-8f9e-4d09-8179-af4ae9098f1f -p 172.16.0.220:3260 --op delete {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:54:45 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bc5e53d-8f9e-4d09-8179-af4ae9098f1f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=105611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:54:45 user nova-compute[95467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8a46c8-c372-4580-99cf-1be2d7fc9d75]: (4, ('', '')) {{(pid=105611) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 08:54:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e51426-4af9-44a1-b7fb-53f9ef5e97d8 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=95467) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 08:54:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.base [None req-59e51426-4af9-44a1-b7fb-53f9ef5e97d8 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 08:54:45 user nova-compute[95467]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e51426-4af9-44a1-b7fb-53f9ef5e97d8 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] <== disconnect_volume: return (282ms) None {{(pid=95467) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 08:54:45 user nova-compute[95467]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59e51426-4af9-44a1-b7fb-53f9ef5e97d8 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Disconnected iSCSI Volume {{(pid=95467) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 08:54:45 user nova-compute[95467]: DEBUG nova.objects.instance [None req-59e51426-4af9-44a1-b7fb-53f9ef5e97d8 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lazy-loading 'flavor' on Instance uuid f72e8b13-7532-4900-a356-1c4b4a3b7cc8 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:54:45 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-59e51426-4af9-44a1-b7fb-53f9ef5e97d8 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lock "f72e8b13-7532-4900-a356-1c4b4a3b7cc8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.585s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:54:49 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:54:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:54:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:54:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=95467) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 08:54:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:54:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:54:54 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:54:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:54:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:54:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=95467) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 08:54:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:54:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:54:59 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:55:04 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:55:04 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:55:04 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=95467) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 08:55:04 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:55:04 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:55:04 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:55:09 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:55:09 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:55:09 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=95467) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 08:55:09 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:55:09 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:55:09 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:55:14 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:55:14 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:55:14 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=95467) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 08:55:15 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager.update_available_resource {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:55:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:55:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:55:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:55:15 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Auditing locally available compute resources for user (node: user) {{(pid=95467) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 08:55:15 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f72e8b13-7532-4900-a356-1c4b4a3b7cc8/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:55:15 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f72e8b13-7532-4900-a356-1c4b4a3b7cc8/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:55:15 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f72e8b13-7532-4900-a356-1c4b4a3b7cc8/disk --force-share --output=json {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 08:55:16 user nova-compute[95467]: DEBUG oslo_concurrency.processutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f72e8b13-7532-4900-a356-1c4b4a3b7cc8/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=95467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 08:55:16 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:55:16 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:55:16 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Hypervisor/Node resource view: name=user free_ram=9031MB free_disk=25.04410171508789GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=95467) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 08:55:16 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:55:16 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:55:16 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Instance f72e8b13-7532-4900-a356-1c4b4a3b7cc8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=95467) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 08:55:16 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 08:55:16 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 08:55:16 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:55:16 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:55:16 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Compute_service record updated for user:user {{(pid=95467) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 08:55:16 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.169s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:55:18 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:55:18 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:55:19 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:55:19 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:55:19 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=95467) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 08:55:19 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:55:19 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:55:19 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:55:21 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:55:22 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:55:23 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:55:23 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:55:24 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:55:25 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:55:25 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Starting heal instance info cache {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 08:55:25 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Rebuilding the list of instances to heal {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 08:55:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "refresh_cache-f72e8b13-7532-4900-a356-1c4b4a3b7cc8" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 08:55:25 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquired lock "refresh_cache-f72e8b13-7532-4900-a356-1c4b4a3b7cc8" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 08:55:25 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Forcefully refreshing network info cache for instance {{(pid=95467) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 08:55:25 user nova-compute[95467]: DEBUG nova.objects.instance [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lazy-loading 'info_cache' on Instance uuid f72e8b13-7532-4900-a356-1c4b4a3b7cc8 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:55:26 user nova-compute[95467]: DEBUG nova.network.neutron [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Updating instance_info_cache with network_info: [{"id": "1bf0b597-4b85-4ce5-b8ab-2a1f399c8a1f", "address": "fa:16:3e:fe:52:18", "network": {"id": "fbab5af1-c1c6-4bdf-bfe3-b47ff49c5771", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-349235580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41c0dc5f8ffe415cb84df29cff554d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf0b597-4b", "ovs_interfaceid": "1bf0b597-4b85-4ce5-b8ab-2a1f399c8a1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:55:26 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Releasing lock "refresh_cache-f72e8b13-7532-4900-a356-1c4b4a3b7cc8" {{(pid=95467) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 08:55:26 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Updated the network info_cache for instance {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 08:55:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-28b9f8c6-453c-40c3-9824-5f775a5937b5 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Acquiring lock "f72e8b13-7532-4900-a356-1c4b4a3b7cc8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:55:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-28b9f8c6-453c-40c3-9824-5f775a5937b5 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lock "f72e8b13-7532-4900-a356-1c4b4a3b7cc8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:55:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-28b9f8c6-453c-40c3-9824-5f775a5937b5 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Acquiring lock "f72e8b13-7532-4900-a356-1c4b4a3b7cc8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:55:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-28b9f8c6-453c-40c3-9824-5f775a5937b5 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lock "f72e8b13-7532-4900-a356-1c4b4a3b7cc8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:55:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-28b9f8c6-453c-40c3-9824-5f775a5937b5 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lock "f72e8b13-7532-4900-a356-1c4b4a3b7cc8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:55:27 user nova-compute[95467]: INFO nova.compute.manager [None req-28b9f8c6-453c-40c3-9824-5f775a5937b5 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Terminating instance
Nov 15 08:55:27 user nova-compute[95467]: DEBUG nova.compute.manager [None req-28b9f8c6-453c-40c3-9824-5f775a5937b5 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Start destroying the instance on the hypervisor. {{(pid=95467) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 08:55:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:55:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:55:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:55:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:55:27 user nova-compute[95467]: DEBUG nova.compute.manager [req-ecd7a57c-e641-425b-b6a5-01bd58b2f8f6 req-67bf14b2-26b1-48f9-8f00-05ad96aab726 service nova] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Received event network-vif-unplugged-1bf0b597-4b85-4ce5-b8ab-2a1f399c8a1f {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:55:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ecd7a57c-e641-425b-b6a5-01bd58b2f8f6 req-67bf14b2-26b1-48f9-8f00-05ad96aab726 service nova] Acquiring lock "f72e8b13-7532-4900-a356-1c4b4a3b7cc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:55:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ecd7a57c-e641-425b-b6a5-01bd58b2f8f6 req-67bf14b2-26b1-48f9-8f00-05ad96aab726 service nova] Lock "f72e8b13-7532-4900-a356-1c4b4a3b7cc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:55:27 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-ecd7a57c-e641-425b-b6a5-01bd58b2f8f6 req-67bf14b2-26b1-48f9-8f00-05ad96aab726 service nova] Lock "f72e8b13-7532-4900-a356-1c4b4a3b7cc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:55:27 user nova-compute[95467]: DEBUG nova.compute.manager [req-ecd7a57c-e641-425b-b6a5-01bd58b2f8f6 req-67bf14b2-26b1-48f9-8f00-05ad96aab726 service nova] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] No waiting events found dispatching network-vif-unplugged-1bf0b597-4b85-4ce5-b8ab-2a1f399c8a1f {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:55:27 user nova-compute[95467]: DEBUG nova.compute.manager [req-ecd7a57c-e641-425b-b6a5-01bd58b2f8f6 req-67bf14b2-26b1-48f9-8f00-05ad96aab726 service nova] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Received event network-vif-unplugged-1bf0b597-4b85-4ce5-b8ab-2a1f399c8a1f for instance with task_state deleting. {{(pid=95467) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 08:55:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:55:27 user nova-compute[95467]: INFO nova.virt.libvirt.driver [-] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Instance destroyed successfully.
Nov 15 08:55:27 user nova-compute[95467]: DEBUG nova.objects.instance [None req-28b9f8c6-453c-40c3-9824-5f775a5937b5 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lazy-loading 'resources' on Instance uuid f72e8b13-7532-4900-a356-1c4b4a3b7cc8 {{(pid=95467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 08:55:27 user nova-compute[95467]: DEBUG nova.virt.libvirt.vif [None req-28b9f8c6-453c-40c3-9824-5f775a5937b5 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T08:49:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-145521287',display_name='tempest-SnapshotDataIntegrityTests-server-145521287',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-145521287',id=53,image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKW0RGUenyiBq2Zn3FkpehZSymFhFzZniCVOww7sylcEOWjwxUu9VkliuKMJ1DcyuTLR8HOeW/AxlBZ8KTIfQVT6GKX/u5xZw18Eg1MbPdfS3yflwjJX40oYT6XlK7grNg==',key_name='tempest-keypair-1544801961',keypairs=<?>,launch_index=0,launched_at=2023-11-15T08:49:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='41c0dc5f8ffe415cb84df29cff554d09',ramdisk_id='',reservation_id='r-8hviksb8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed9c48aa-ce73-4b3b-9db1-235898be671b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-988051725',owner_user_name='tempest-SnapshotDataIntegrityTests-988051725-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T08:49:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32c2bb738baf4a93b61a24413d5467d6',uuid=f72e8b13-7532-4900-a356-1c4b4a3b7cc8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1bf0b597-4b85-4ce5-b8ab-2a1f399c8a1f", "address": "fa:16:3e:fe:52:18", "network": {"id": "fbab5af1-c1c6-4bdf-bfe3-b47ff49c5771", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-349235580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41c0dc5f8ffe415cb84df29cff554d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf0b597-4b", "ovs_interfaceid": "1bf0b597-4b85-4ce5-b8ab-2a1f399c8a1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 08:55:27 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-28b9f8c6-453c-40c3-9824-5f775a5937b5 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Converting VIF {"id": "1bf0b597-4b85-4ce5-b8ab-2a1f399c8a1f", "address": "fa:16:3e:fe:52:18", "network": {"id": "fbab5af1-c1c6-4bdf-bfe3-b47ff49c5771", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-349235580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41c0dc5f8ffe415cb84df29cff554d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf0b597-4b", "ovs_interfaceid": "1bf0b597-4b85-4ce5-b8ab-2a1f399c8a1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 08:55:27 user nova-compute[95467]: DEBUG nova.network.os_vif_util [None req-28b9f8c6-453c-40c3-9824-5f775a5937b5 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:52:18,bridge_name='br-int',has_traffic_filtering=True,id=1bf0b597-4b85-4ce5-b8ab-2a1f399c8a1f,network=Network(fbab5af1-c1c6-4bdf-bfe3-b47ff49c5771),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bf0b597-4b') {{(pid=95467) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 08:55:27 user nova-compute[95467]: DEBUG os_vif [None req-28b9f8c6-453c-40c3-9824-5f775a5937b5 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:52:18,bridge_name='br-int',has_traffic_filtering=True,id=1bf0b597-4b85-4ce5-b8ab-2a1f399c8a1f,network=Network(fbab5af1-c1c6-4bdf-bfe3-b47ff49c5771),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bf0b597-4b') {{(pid=95467) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 08:55:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:55:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1bf0b597-4b, bridge=br-int, if_exists=True) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:55:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:55:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:55:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:55:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c23a0952-aa67-48f1-ae36-28b701aac6a5) {{(pid=95467) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 08:55:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:55:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:55:27 user nova-compute[95467]: INFO os_vif [None req-28b9f8c6-453c-40c3-9824-5f775a5937b5 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:52:18,bridge_name='br-int',has_traffic_filtering=True,id=1bf0b597-4b85-4ce5-b8ab-2a1f399c8a1f,network=Network(fbab5af1-c1c6-4bdf-bfe3-b47ff49c5771),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bf0b597-4b')
Nov 15 08:55:27 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-28b9f8c6-453c-40c3-9824-5f775a5937b5 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Deleting instance files /opt/stack/data/nova/instances/f72e8b13-7532-4900-a356-1c4b4a3b7cc8_del
Nov 15 08:55:27 user nova-compute[95467]: INFO nova.virt.libvirt.driver [None req-28b9f8c6-453c-40c3-9824-5f775a5937b5 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Deletion of /opt/stack/data/nova/instances/f72e8b13-7532-4900-a356-1c4b4a3b7cc8_del complete
Nov 15 08:55:27 user nova-compute[95467]: INFO nova.compute.manager [None req-28b9f8c6-453c-40c3-9824-5f775a5937b5 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 15 08:55:27 user nova-compute[95467]: DEBUG oslo.service.loopingcall [None req-28b9f8c6-453c-40c3-9824-5f775a5937b5 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=95467) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 08:55:27 user nova-compute[95467]: DEBUG nova.compute.manager [-] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Deallocating network for instance {{(pid=95467) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 08:55:27 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] deallocate_for_instance() {{(pid=95467) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 08:55:28 user nova-compute[95467]: DEBUG nova.network.neutron [-] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Updating instance_info_cache with network_info: [] {{(pid=95467) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 08:55:28 user nova-compute[95467]: INFO nova.compute.manager [-] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Took 0.96 seconds to deallocate network for instance.
Nov 15 08:55:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-28b9f8c6-453c-40c3-9824-5f775a5937b5 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:55:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-28b9f8c6-453c-40c3-9824-5f775a5937b5 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:55:29 user nova-compute[95467]: DEBUG nova.compute.manager [req-5bda3d83-2bad-4001-94fa-dc9a1c68c201 req-51e9b1e5-de5a-44b6-a7f7-602049002f9d service nova] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Received event network-vif-deleted-1bf0b597-4b85-4ce5-b8ab-2a1f399c8a1f {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:55:29 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-28b9f8c6-453c-40c3-9824-5f775a5937b5 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:55:29 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-28b9f8c6-453c-40c3-9824-5f775a5937b5 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:55:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-28b9f8c6-453c-40c3-9824-5f775a5937b5 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.119s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:55:29 user nova-compute[95467]: INFO nova.scheduler.client.report [None req-28b9f8c6-453c-40c3-9824-5f775a5937b5 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Deleted allocations for instance f72e8b13-7532-4900-a356-1c4b4a3b7cc8
Nov 15 08:55:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-28b9f8c6-453c-40c3-9824-5f775a5937b5 tempest-SnapshotDataIntegrityTests-988051725 tempest-SnapshotDataIntegrityTests-988051725-project-member] Lock "f72e8b13-7532-4900-a356-1c4b4a3b7cc8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.221s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:55:29 user nova-compute[95467]: DEBUG nova.compute.manager [req-b464abd6-717f-48bb-b449-4d0d74f5561c req-a38c82da-22f7-4291-9376-8b6526e83b15 service nova] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Received event network-vif-plugged-1bf0b597-4b85-4ce5-b8ab-2a1f399c8a1f {{(pid=95467) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 08:55:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b464abd6-717f-48bb-b449-4d0d74f5561c req-a38c82da-22f7-4291-9376-8b6526e83b15 service nova] Acquiring lock "f72e8b13-7532-4900-a356-1c4b4a3b7cc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:55:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b464abd6-717f-48bb-b449-4d0d74f5561c req-a38c82da-22f7-4291-9376-8b6526e83b15 service nova] Lock "f72e8b13-7532-4900-a356-1c4b4a3b7cc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:55:29 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [req-b464abd6-717f-48bb-b449-4d0d74f5561c req-a38c82da-22f7-4291-9376-8b6526e83b15 service nova] Lock "f72e8b13-7532-4900-a356-1c4b4a3b7cc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:55:29 user nova-compute[95467]: DEBUG nova.compute.manager [req-b464abd6-717f-48bb-b449-4d0d74f5561c req-a38c82da-22f7-4291-9376-8b6526e83b15 service nova] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] No waiting events found dispatching network-vif-plugged-1bf0b597-4b85-4ce5-b8ab-2a1f399c8a1f {{(pid=95467) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 08:55:29 user nova-compute[95467]: WARNING nova.compute.manager [req-b464abd6-717f-48bb-b449-4d0d74f5561c req-a38c82da-22f7-4291-9376-8b6526e83b15 service nova] [instance: f72e8b13-7532-4900-a356-1c4b4a3b7cc8] Received unexpected event network-vif-plugged-1bf0b597-4b85-4ce5-b8ab-2a1f399c8a1f for instance with vm_state deleted and task_state None.
Nov 15 08:55:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:55:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:55:42 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:55:42 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:55:42 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=95467) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 08:55:42 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:55:42 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:55:42 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:55:47 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:55:52 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:55:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:55:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:55:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=95467) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 08:55:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:55:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:55:57 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:56:02 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:56:07 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:56:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:56:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:56:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=95467) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 08:56:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:56:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:56:12 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:56:15 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:56:15 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=95467) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 08:56:15 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager.update_available_resource {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:56:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:56:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:56:15 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:56:15 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Auditing locally available compute resources for user (node: user) {{(pid=95467) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 08:56:16 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:56:16 user nova-compute[95467]: WARNING nova.virt.libvirt.driver [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 08:56:16 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Hypervisor/Node resource view: name=user free_ram=9173MB free_disk=25.0712890625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=95467) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 08:56:16 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 08:56:16 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 08:56:16 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 08:56:16 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=95467) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 08:56:16 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Refreshing inventories for resource provider f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 08:56:16 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Updating ProviderTree inventory for provider f56c3524-ed11-494e-82e4-b1a23920d1ae from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 08:56:16 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Updating inventory in ProviderTree for provider f56c3524-ed11-494e-82e4-b1a23920d1ae with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 08:56:16 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Refreshing aggregate associations for resource provider f56c3524-ed11-494e-82e4-b1a23920d1ae, aggregates: None {{(pid=95467) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 08:56:16 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Refreshing trait associations for resource provider f56c3524-ed11-494e-82e4-b1a23920d1ae, traits: COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSSE3,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI {{(pid=95467) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 08:56:16 user nova-compute[95467]: DEBUG nova.compute.provider_tree [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed in ProviderTree for provider: f56c3524-ed11-494e-82e4-b1a23920d1ae {{(pid=95467) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 08:56:16 user nova-compute[95467]: DEBUG nova.scheduler.client.report [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Inventory has not changed for provider f56c3524-ed11-494e-82e4-b1a23920d1ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=95467) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 08:56:16 user nova-compute[95467]: DEBUG nova.compute.resource_tracker [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Compute_service record updated for user:user {{(pid=95467) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 08:56:16 user nova-compute[95467]: DEBUG oslo_concurrency.lockutils [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.389s {{(pid=95467) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 08:56:17 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:56:19 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:56:19 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:56:19 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:56:21 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:56:21 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:56:22 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:56:22 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:56:22 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:56:23 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:56:24 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:56:25 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:56:26 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:56:26 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Starting heal instance info cache {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 08:56:26 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Rebuilding the list of instances to heal {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 08:56:26 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Didn't find any instances for network info cache update. {{(pid=95467) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 08:56:27 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:56:28 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:56:28 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Cleaning up deleted instances with incomplete migration  {{(pid=95467) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 08:56:30 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:56:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 08:56:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:56:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=95467) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 08:56:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:56:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=95467) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 08:56:32 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:56:37 user nova-compute[95467]: DEBUG oslo_service.periodic_task [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=95467) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 08:56:37 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] Cleaning up deleted instances {{(pid=95467) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 08:56:37 user nova-compute[95467]: DEBUG nova.compute.manager [None req-3cbe6d27-ac3f-4d3d-8575-3550d8d5b68e None None] There are 0 instances to clean {{(pid=95467) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 08:56:37 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 08:56:42 user nova-compute[95467]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=95467) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}